2026-02-22T23:19:56.299 INFO:root:teuthology version: 1.2.4.dev9+gfa17720d0 2026-02-22T23:19:56.314 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-22T23:19:56.393 INFO:teuthology.run:Config: archive_path: /home/teuthworker/mnt/teuthology/yuriw-2026-02-22_19:35:40-rados-wip-yuri6-testing-2026-02-22-1629-squid-distro-default-trial/64386 branch: wip-yuri6-testing-2026-02-22-1629-squid description: rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_latest} thrashers/sync workloads/rados_5925} email: yweinste@redhat.com first_in_suite: false flavor: default job_id: '64386' kernel: branch: distro kdb: true sha1: distro last_in_suite: false machine_type: trial name: yuriw-2026-02-22_19:35:40-rados-wip-yuri6-testing-2026-02-22-1629-squid-distro-default-trial no_nested_subset: false openstack: - volumes: count: 3 size: 10 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-yuri6-testing-2026-02-22-1629-squid ceph: conf: client: debug monc: 20 debug ms: 1 global: mon client directed command retry: 5 mon election default strategy: 3 ms bind msgr2: false ms inject socket failures: 5000 ms type: async mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon min osdmap epochs: 25 mon osdmap full prune interval: 2 mon osdmap full prune min: 15 mon osdmap full prune txsize: 2 mon scrub inject crc mismatch: 0.01 mon scrub inject missing keys: 0.05 mon scrub interval: 300 paxos min: 10 paxos service trim min: 5 paxos trim min: 10 osd: bluestore block size: 96636764160 bluestore compression algorithm: lz4 bluestore compression mode: aggressive bluestore fsck on mount: true bluestore zero block detection: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd debug verify cached snaps: true osd debug verify missing on start: true osd failsafe full ratio: 0.95 osd mclock override recovery settings: true osd mclock profile: high_recovery_ops osd mclock skip benchmark: true osd objectstore: bluestore osd op queue: debug_random osd op queue cut off: debug_random flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - ScrubResult - scrub mismatch - overall HEALTH_ - \(MGR_DOWN\) - \(PG_AVAILABILITY\) - \(SLOW_OPS\) - slow request - \(OSD_SLOW_PING_TIME - overall HEALTH_ - \(MON_DOWN\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ mon_bind_msgr2: false sha1: f90f4eaebb28b619cf76e80cbbe997656da69579 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} install: ceph: flavor: default sha1: f90f4eaebb28b619cf76e80cbbe997656da69579 selinux: allowlist: - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-yuri6-testing-2026-02-22-1629-squid sha1: f90f4eaebb28b619cf76e80cbbe997656da69579 owner: scheduled_yuriw@soko04.front.sepia.ceph.com priority: 69 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mon.b - mon.c - mon.d - mon.e - osd.0 - osd.1 - osd.2 - - mon.f - mon.g - mon.h - mon.i - mgr.x - osd.3 - osd.4 - osd.5 - client.0 seed: 5907 sha1: f90f4eaebb28b619cf76e80cbbe997656da69579 sleep_before_teardown: 0 subset: 111/120000 suite: rados suite_branch: wip-yuri6-testing-2026-02-22-1629-squid suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_f90f4eaebb28b619cf76e80cbbe997656da69579/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: f90f4eaebb28b619cf76e80cbbe997656da69579 targets: trial045.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBD+9ZAmktAugS/lDDsn+dZOPEzSVHuedaAibXeTNUx0SvWb2CeBtU0bprNi3k39rX0CqxExfTbzfLyVlfzpGyz8= trial073.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBB75Fw0XUvqO5yAT89BzP+qb4rFgOf1CVTWZZRNiQlNLoGRTw3hITF0nNGS4XDddo+KC/7iHBAmuHUDIFIcmJqE= tasks: - install: null - ceph: null - mon_thrash: revive_delay: 90 thrash_delay: 1 - exec: client.0: - ceph_test_rados_delete_pools_parallel --debug_objecter 20 --debug_ms 1 --debug_rados 20 --debug_monc 20 teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: fa17720d0088c3ac28e473468bfc79eeaff5cd38 timestamp: 2026-02-22_19:35:40 tube: trial user: yuriw verbose: true worker_log: /home/teuthworker/mnt/teuthology/worker_logs/dispatcher.trial.3318653 2026-02-22T23:19:56.394 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_f90f4eaebb28b619cf76e80cbbe997656da69579/qa; will attempt to use it 2026-02-22T23:19:56.394 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_f90f4eaebb28b619cf76e80cbbe997656da69579/qa/tasks 2026-02-22T23:19:56.394 INFO:teuthology.run_tasks:Running task internal.check_packages... 2026-02-22T23:19:56.396 INFO:teuthology.task.internal:Checking packages... 2026-02-22T23:19:56.396 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'f90f4eaebb28b619cf76e80cbbe997656da69579' 2026-02-22T23:19:56.396 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2026-02-22T23:19:56.396 INFO:teuthology.packaging:ref: None 2026-02-22T23:19:56.396 INFO:teuthology.packaging:tag: None 2026-02-22T23:19:56.396 INFO:teuthology.packaging:branch: wip-yuri6-testing-2026-02-22-1629-squid 2026-02-22T23:19:56.396 INFO:teuthology.packaging:sha1: f90f4eaebb28b619cf76e80cbbe997656da69579 2026-02-22T23:19:56.396 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-yuri6-testing-2026-02-22-1629-squid 2026-02-22T23:19:56.515 INFO:teuthology.task.internal:Found packages for ceph version 19.2.3-689.gf90f4eae 2026-02-22T23:19:56.517 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2026-02-22T23:19:56.529 INFO:teuthology.task.internal:no buildpackages task found 2026-02-22T23:19:56.529 INFO:teuthology.run_tasks:Running task internal.save_config... 2026-02-22T23:19:56.543 INFO:teuthology.task.internal:Saving configuration 2026-02-22T23:19:56.555 INFO:teuthology.run_tasks:Running task internal.check_lock... 2026-02-22T23:19:56.567 INFO:teuthology.task.internal.check_lock:Checking locks... 2026-02-22T23:19:56.645 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial045.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/yuriw-2026-02-22_19:35:40-rados-wip-yuri6-testing-2026-02-22-1629-squid-distro-default-trial/64386', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-22 23:16:24.516909', 'locked_by': 'scheduled_yuriw@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBD+9ZAmktAugS/lDDsn+dZOPEzSVHuedaAibXeTNUx0SvWb2CeBtU0bprNi3k39rX0CqxExfTbzfLyVlfzpGyz8='} 2026-02-22T23:19:56.702 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial073.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/yuriw-2026-02-22_19:35:40-rados-wip-yuri6-testing-2026-02-22-1629-squid-distro-default-trial/64386', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-22 23:16:24.517493', 'locked_by': 'scheduled_yuriw@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBB75Fw0XUvqO5yAT89BzP+qb4rFgOf1CVTWZZRNiQlNLoGRTw3hITF0nNGS4XDddo+KC/7iHBAmuHUDIFIcmJqE='} 2026-02-22T23:19:56.702 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2026-02-22T23:19:56.715 INFO:teuthology.task.internal:roles: ubuntu@trial045.front.sepia.ceph.com - ['mon.a', 'mon.b', 'mon.c', 'mon.d', 'mon.e', 'osd.0', 'osd.1', 'osd.2'] 2026-02-22T23:19:56.715 INFO:teuthology.task.internal:roles: ubuntu@trial073.front.sepia.ceph.com - ['mon.f', 'mon.g', 'mon.h', 'mon.i', 'mgr.x', 'osd.3', 'osd.4', 'osd.5', 'client.0'] 2026-02-22T23:19:56.715 INFO:teuthology.run_tasks:Running task console_log... 2026-02-22T23:19:56.849 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7330280dd9e0>, signals=[15]) 2026-02-22T23:19:56.849 INFO:teuthology.run_tasks:Running task internal.connect... 2026-02-22T23:19:56.860 INFO:teuthology.task.internal:Opening connections... 2026-02-22T23:19:56.860 DEBUG:teuthology.task.internal:connecting to ubuntu@trial045.front.sepia.ceph.com 2026-02-22T23:19:56.861 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial045.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-22T23:19:56.925 DEBUG:teuthology.task.internal:connecting to ubuntu@trial073.front.sepia.ceph.com 2026-02-22T23:19:56.925 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-22T23:19:56.984 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2026-02-22T23:19:56.996 DEBUG:teuthology.orchestra.run.trial045:> uname -m 2026-02-22T23:19:57.012 INFO:teuthology.orchestra.run.trial045.stdout:x86_64 2026-02-22T23:19:57.012 DEBUG:teuthology.orchestra.run.trial045:> cat /etc/os-release 2026-02-22T23:19:57.068 INFO:teuthology.orchestra.run.trial045.stdout:NAME="CentOS Stream" 2026-02-22T23:19:57.068 INFO:teuthology.orchestra.run.trial045.stdout:VERSION="9" 2026-02-22T23:19:57.068 INFO:teuthology.orchestra.run.trial045.stdout:ID="centos" 2026-02-22T23:19:57.068 INFO:teuthology.orchestra.run.trial045.stdout:ID_LIKE="rhel fedora" 2026-02-22T23:19:57.068 INFO:teuthology.orchestra.run.trial045.stdout:VERSION_ID="9" 2026-02-22T23:19:57.069 INFO:teuthology.orchestra.run.trial045.stdout:PLATFORM_ID="platform:el9" 2026-02-22T23:19:57.069 INFO:teuthology.orchestra.run.trial045.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-22T23:19:57.069 INFO:teuthology.orchestra.run.trial045.stdout:ANSI_COLOR="0;31" 2026-02-22T23:19:57.069 INFO:teuthology.orchestra.run.trial045.stdout:LOGO="fedora-logo-icon" 2026-02-22T23:19:57.069 INFO:teuthology.orchestra.run.trial045.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-22T23:19:57.069 INFO:teuthology.orchestra.run.trial045.stdout:HOME_URL="https://centos.org/" 2026-02-22T23:19:57.069 INFO:teuthology.orchestra.run.trial045.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-22T23:19:57.069 INFO:teuthology.orchestra.run.trial045.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-22T23:19:57.069 INFO:teuthology.orchestra.run.trial045.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-22T23:19:57.069 INFO:teuthology.lock.ops:Updating trial045.front.sepia.ceph.com on lock server 2026-02-22T23:19:57.142 DEBUG:teuthology.orchestra.run.trial073:> uname -m 2026-02-22T23:19:57.157 INFO:teuthology.orchestra.run.trial073.stdout:x86_64 2026-02-22T23:19:57.157 DEBUG:teuthology.orchestra.run.trial073:> cat /etc/os-release 2026-02-22T23:19:57.212 INFO:teuthology.orchestra.run.trial073.stdout:NAME="CentOS Stream" 2026-02-22T23:19:57.212 INFO:teuthology.orchestra.run.trial073.stdout:VERSION="9" 2026-02-22T23:19:57.212 INFO:teuthology.orchestra.run.trial073.stdout:ID="centos" 2026-02-22T23:19:57.212 INFO:teuthology.orchestra.run.trial073.stdout:ID_LIKE="rhel fedora" 2026-02-22T23:19:57.212 INFO:teuthology.orchestra.run.trial073.stdout:VERSION_ID="9" 2026-02-22T23:19:57.212 INFO:teuthology.orchestra.run.trial073.stdout:PLATFORM_ID="platform:el9" 2026-02-22T23:19:57.212 INFO:teuthology.orchestra.run.trial073.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-22T23:19:57.212 INFO:teuthology.orchestra.run.trial073.stdout:ANSI_COLOR="0;31" 2026-02-22T23:19:57.212 INFO:teuthology.orchestra.run.trial073.stdout:LOGO="fedora-logo-icon" 2026-02-22T23:19:57.212 INFO:teuthology.orchestra.run.trial073.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-22T23:19:57.212 INFO:teuthology.orchestra.run.trial073.stdout:HOME_URL="https://centos.org/" 2026-02-22T23:19:57.212 INFO:teuthology.orchestra.run.trial073.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-22T23:19:57.212 INFO:teuthology.orchestra.run.trial073.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-22T23:19:57.212 INFO:teuthology.orchestra.run.trial073.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-22T23:19:57.212 INFO:teuthology.lock.ops:Updating trial073.front.sepia.ceph.com on lock server 2026-02-22T23:19:57.271 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2026-02-22T23:19:57.284 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2026-02-22T23:19:57.294 INFO:teuthology.task.internal:Checking for old test directory... 2026-02-22T23:19:57.294 DEBUG:teuthology.orchestra.run.trial045:> test '!' -e /home/ubuntu/cephtest 2026-02-22T23:19:57.296 DEBUG:teuthology.orchestra.run.trial073:> test '!' -e /home/ubuntu/cephtest 2026-02-22T23:19:57.310 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2026-02-22T23:19:57.322 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2026-02-22T23:19:57.322 DEBUG:teuthology.orchestra.run.trial045:> test -z $(ls -A /var/lib/ceph) 2026-02-22T23:19:57.351 DEBUG:teuthology.orchestra.run.trial073:> test -z $(ls -A /var/lib/ceph) 2026-02-22T23:19:57.368 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2026-02-22T23:19:57.518 INFO:teuthology.run_tasks:Running task kernel... 2026-02-22T23:19:57.537 INFO:teuthology.task.kernel:normalize config orig: {'branch': 'distro', 'kdb': True, 'sha1': 'distro'} 2026-02-22T23:19:57.537 INFO:teuthology.task.kernel:config {'mon.a': {'branch': 'distro', 'kdb': True, 'sha1': 'distro'}, 'mon.f': {'branch': 'distro', 'kdb': True, 'sha1': 'distro'}}, timeout 300 2026-02-22T23:19:57.537 DEBUG:teuthology.orchestra.run.trial045:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-22T23:19:57.537 DEBUG:teuthology.orchestra.run.trial073:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-22T23:19:57.551 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-22T23:19:57.552 DEBUG:teuthology.orchestra.run.trial073:> uname -r 2026-02-22T23:19:57.552 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-22T23:19:57.552 DEBUG:teuthology.orchestra.run.trial045:> uname -r 2026-02-22T23:19:57.606 INFO:teuthology.orchestra.run.trial073.stdout:5.14.0-681.el9.x86_64 2026-02-22T23:19:57.606 INFO:teuthology.task.kernel:Running kernel on trial073: 5.14.0-681.el9.x86_64 2026-02-22T23:19:57.606 DEBUG:teuthology.orchestra.run.trial073:> sudo yum install -y kernel 2026-02-22T23:19:57.607 INFO:teuthology.orchestra.run.trial045.stdout:5.14.0-681.el9.x86_64 2026-02-22T23:19:57.607 INFO:teuthology.task.kernel:Running kernel on trial045: 5.14.0-681.el9.x86_64 2026-02-22T23:19:57.607 DEBUG:teuthology.orchestra.run.trial045:> sudo yum install -y kernel 2026-02-22T23:20:06.823 INFO:teuthology.orchestra.run.trial045.stdout:CentOS Stream 9 - BaseOS 1.0 MB/s | 8.9 MB 00:08 2026-02-22T23:20:16.246 INFO:teuthology.orchestra.run.trial073.stdout:CentOS Stream 9 - BaseOS 498 kB/s | 8.9 MB 00:18 2026-02-22T23:20:22.814 INFO:teuthology.orchestra.run.trial045.stdout:CentOS Stream 9 - AppStream 1.7 MB/s | 27 MB 00:15 2026-02-22T23:20:23.921 INFO:teuthology.orchestra.run.trial073.stdout:CentOS Stream 9 - AppStream 3.8 MB/s | 27 MB 00:07 2026-02-22T23:20:26.069 INFO:teuthology.orchestra.run.trial045.stdout:CentOS Stream 9 - CRB 9.0 MB/s | 7.8 MB 00:00 2026-02-22T23:20:27.670 INFO:teuthology.orchestra.run.trial045.stdout:CentOS Stream 9 - Extras packages 23 kB/s | 20 kB 00:00 2026-02-22T23:20:28.226 INFO:teuthology.orchestra.run.trial045.stdout:Extra Packages for Enterprise Linux 41 MB/s | 20 MB 00:00 2026-02-22T23:20:34.900 INFO:teuthology.orchestra.run.trial073.stdout:CentOS Stream 9 - CRB 922 kB/s | 7.8 MB 00:08 2026-02-22T23:20:35.865 INFO:teuthology.orchestra.run.trial073.stdout:CentOS Stream 9 - Extras packages 83 kB/s | 20 kB 00:00 2026-02-22T23:20:36.406 INFO:teuthology.orchestra.run.trial045.stdout:lab-extras 9.9 kB/s | 50 kB 00:05 2026-02-22T23:20:37.088 INFO:teuthology.orchestra.run.trial073.stdout:Extra Packages for Enterprise Linux 18 MB/s | 20 MB 00:01 2026-02-22T23:20:37.415 INFO:teuthology.orchestra.run.trial045.stdout:Package kernel-5.14.0-645.el9.x86_64 is already installed. 2026-02-22T23:20:37.415 INFO:teuthology.orchestra.run.trial045.stdout:Package kernel-5.14.0-681.el9.x86_64 is already installed. 2026-02-22T23:20:37.434 INFO:teuthology.orchestra.run.trial045.stdout:Dependencies resolved. 2026-02-22T23:20:37.434 INFO:teuthology.orchestra.run.trial045.stdout:Nothing to do. 2026-02-22T23:20:37.434 INFO:teuthology.orchestra.run.trial045.stdout:Complete! 2026-02-22T23:20:37.457 DEBUG:teuthology.orchestra.run.trial045:> echo no | sudo yum reinstall kernel || true 2026-02-22T23:20:37.760 INFO:teuthology.orchestra.run.trial045.stdout:Last metadata expiration check: 0:00:01 ago on Sun 22 Feb 2026 11:20:36 PM UTC. 2026-02-22T23:20:37.841 INFO:teuthology.orchestra.run.trial045.stdout:Dependencies resolved. 2026-02-22T23:20:37.841 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-22T23:20:37.841 INFO:teuthology.orchestra.run.trial045.stdout: Package Architecture Version Repository Size 2026-02-22T23:20:37.841 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-22T23:20:37.841 INFO:teuthology.orchestra.run.trial045.stdout:Reinstalling: 2026-02-22T23:20:37.841 INFO:teuthology.orchestra.run.trial045.stdout: kernel x86_64 5.14.0-681.el9 baseos 803 k 2026-02-22T23:20:37.841 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-22T23:20:37.841 INFO:teuthology.orchestra.run.trial045.stdout:Transaction Summary 2026-02-22T23:20:37.841 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-22T23:20:37.841 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-22T23:20:37.841 INFO:teuthology.orchestra.run.trial045.stdout:Total download size: 803 k 2026-02-22T23:20:37.841 INFO:teuthology.orchestra.run.trial045.stdout:Installed size: 0 2026-02-22T23:20:37.842 INFO:teuthology.orchestra.run.trial045.stderr:Operation aborted. 2026-02-22T23:20:37.861 INFO:teuthology.orchestra.run.trial045.stdout:Is this ok [y/N]: 2026-02-22T23:20:37.862 DEBUG:teuthology.orchestra.run.trial045:> sudo yum reinstall -y kernel || true 2026-02-22T23:20:38.163 INFO:teuthology.orchestra.run.trial045.stdout:Last metadata expiration check: 0:00:02 ago on Sun 22 Feb 2026 11:20:36 PM UTC. 2026-02-22T23:20:38.242 INFO:teuthology.orchestra.run.trial045.stdout:Dependencies resolved. 2026-02-22T23:20:38.242 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-22T23:20:38.242 INFO:teuthology.orchestra.run.trial045.stdout: Package Architecture Version Repository Size 2026-02-22T23:20:38.242 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-22T23:20:38.243 INFO:teuthology.orchestra.run.trial045.stdout:Reinstalling: 2026-02-22T23:20:38.243 INFO:teuthology.orchestra.run.trial045.stdout: kernel x86_64 5.14.0-681.el9 baseos 803 k 2026-02-22T23:20:38.243 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-22T23:20:38.243 INFO:teuthology.orchestra.run.trial045.stdout:Transaction Summary 2026-02-22T23:20:38.243 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-22T23:20:38.243 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-22T23:20:38.243 INFO:teuthology.orchestra.run.trial045.stdout:Total download size: 803 k 2026-02-22T23:20:38.243 INFO:teuthology.orchestra.run.trial045.stdout:Installed size: 0 2026-02-22T23:20:38.243 INFO:teuthology.orchestra.run.trial045.stdout:Downloading Packages: 2026-02-22T23:20:38.443 INFO:teuthology.orchestra.run.trial045.stdout:kernel-5.14.0-681.el9.x86_64.rpm 7.0 MB/s | 803 kB 00:00 2026-02-22T23:20:38.443 INFO:teuthology.orchestra.run.trial045.stdout:-------------------------------------------------------------------------------- 2026-02-22T23:20:38.443 INFO:teuthology.orchestra.run.trial045.stdout:Total 3.9 MB/s | 803 kB 00:00 2026-02-22T23:20:38.453 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction check 2026-02-22T23:20:38.490 INFO:teuthology.orchestra.run.trial045.stdout:Transaction check succeeded. 2026-02-22T23:20:38.490 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction test 2026-02-22T23:20:38.495 INFO:teuthology.orchestra.run.trial045.stdout:Transaction test succeeded. 2026-02-22T23:20:38.495 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction 2026-02-22T23:20:38.519 INFO:teuthology.orchestra.run.trial045.stdout: Preparing : 1/1 2026-02-22T23:20:38.523 INFO:teuthology.orchestra.run.trial045.stdout: Reinstalling : kernel-5.14.0-681.el9.x86_64 1/2 2026-02-22T23:20:38.523 INFO:teuthology.orchestra.run.trial045.stdout: Cleanup : kernel-5.14.0-681.el9.x86_64 2/2 2026-02-22T23:20:38.631 INFO:teuthology.orchestra.run.trial045.stdout: Running scriptlet: kernel-5.14.0-681.el9.x86_64 2/2 2026-02-22T23:20:38.631 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : kernel-5.14.0-681.el9.x86_64 1/2 2026-02-22T23:20:38.682 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : kernel-5.14.0-681.el9.x86_64 2/2 2026-02-22T23:20:38.683 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-22T23:20:38.683 INFO:teuthology.orchestra.run.trial045.stdout:Reinstalled: 2026-02-22T23:20:38.683 INFO:teuthology.orchestra.run.trial045.stdout: kernel-5.14.0-681.el9.x86_64 2026-02-22T23:20:38.683 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-22T23:20:38.683 INFO:teuthology.orchestra.run.trial045.stdout:Complete! 2026-02-22T23:20:38.709 DEBUG:teuthology.orchestra.run.trial045:> rpm -q kernel | sort -rV | head -n 1 2026-02-22T23:20:38.734 INFO:teuthology.orchestra.run.trial045.stdout:kernel-5.14.0-681.el9.x86_64 2026-02-22T23:20:38.734 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-681.el9.x86_64 2026-02-22T23:20:38.734 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2026-02-22T23:20:38.735 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2026-02-22T23:20:38.735 DEBUG:teuthology.orchestra.run.trial045:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2026-02-22T23:20:38.803 INFO:teuthology.orchestra.run.trial045.stdout:ttyS1 2026-02-22T23:20:38.830 DEBUG:teuthology.parallel:result is None 2026-02-22T23:20:40.220 INFO:teuthology.orchestra.run.trial073.stdout:lab-extras 2.5 MB/s | 50 kB 00:00 2026-02-22T23:20:41.231 INFO:teuthology.orchestra.run.trial073.stdout:Package kernel-5.14.0-645.el9.x86_64 is already installed. 2026-02-22T23:20:41.231 INFO:teuthology.orchestra.run.trial073.stdout:Package kernel-5.14.0-681.el9.x86_64 is already installed. 2026-02-22T23:20:41.250 INFO:teuthology.orchestra.run.trial073.stdout:Dependencies resolved. 2026-02-22T23:20:41.250 INFO:teuthology.orchestra.run.trial073.stdout:Nothing to do. 2026-02-22T23:20:41.250 INFO:teuthology.orchestra.run.trial073.stdout:Complete! 2026-02-22T23:20:41.273 DEBUG:teuthology.orchestra.run.trial073:> echo no | sudo yum reinstall kernel || true 2026-02-22T23:20:41.574 INFO:teuthology.orchestra.run.trial073.stdout:Last metadata expiration check: 0:00:01 ago on Sun 22 Feb 2026 11:20:40 PM UTC. 2026-02-22T23:20:41.654 INFO:teuthology.orchestra.run.trial073.stdout:Dependencies resolved. 2026-02-22T23:20:41.655 INFO:teuthology.orchestra.run.trial073.stdout:================================================================================ 2026-02-22T23:20:41.655 INFO:teuthology.orchestra.run.trial073.stdout: Package Architecture Version Repository Size 2026-02-22T23:20:41.655 INFO:teuthology.orchestra.run.trial073.stdout:================================================================================ 2026-02-22T23:20:41.655 INFO:teuthology.orchestra.run.trial073.stdout:Reinstalling: 2026-02-22T23:20:41.655 INFO:teuthology.orchestra.run.trial073.stdout: kernel x86_64 5.14.0-681.el9 baseos 803 k 2026-02-22T23:20:41.655 INFO:teuthology.orchestra.run.trial073.stdout: 2026-02-22T23:20:41.655 INFO:teuthology.orchestra.run.trial073.stdout:Transaction Summary 2026-02-22T23:20:41.656 INFO:teuthology.orchestra.run.trial073.stdout:================================================================================ 2026-02-22T23:20:41.656 INFO:teuthology.orchestra.run.trial073.stdout: 2026-02-22T23:20:41.656 INFO:teuthology.orchestra.run.trial073.stdout:Total download size: 803 k 2026-02-22T23:20:41.656 INFO:teuthology.orchestra.run.trial073.stdout:Installed size: 0 2026-02-22T23:20:41.656 INFO:teuthology.orchestra.run.trial073.stderr:Operation aborted. 2026-02-22T23:20:41.674 INFO:teuthology.orchestra.run.trial073.stdout:Is this ok [y/N]: 2026-02-22T23:20:41.674 DEBUG:teuthology.orchestra.run.trial073:> sudo yum reinstall -y kernel || true 2026-02-22T23:20:41.970 INFO:teuthology.orchestra.run.trial073.stdout:Last metadata expiration check: 0:00:01 ago on Sun 22 Feb 2026 11:20:40 PM UTC. 2026-02-22T23:20:42.049 INFO:teuthology.orchestra.run.trial073.stdout:Dependencies resolved. 2026-02-22T23:20:42.050 INFO:teuthology.orchestra.run.trial073.stdout:================================================================================ 2026-02-22T23:20:42.050 INFO:teuthology.orchestra.run.trial073.stdout: Package Architecture Version Repository Size 2026-02-22T23:20:42.050 INFO:teuthology.orchestra.run.trial073.stdout:================================================================================ 2026-02-22T23:20:42.050 INFO:teuthology.orchestra.run.trial073.stdout:Reinstalling: 2026-02-22T23:20:42.050 INFO:teuthology.orchestra.run.trial073.stdout: kernel x86_64 5.14.0-681.el9 baseos 803 k 2026-02-22T23:20:42.050 INFO:teuthology.orchestra.run.trial073.stdout: 2026-02-22T23:20:42.050 INFO:teuthology.orchestra.run.trial073.stdout:Transaction Summary 2026-02-22T23:20:42.050 INFO:teuthology.orchestra.run.trial073.stdout:================================================================================ 2026-02-22T23:20:42.050 INFO:teuthology.orchestra.run.trial073.stdout: 2026-02-22T23:20:42.050 INFO:teuthology.orchestra.run.trial073.stdout:Total download size: 803 k 2026-02-22T23:20:42.050 INFO:teuthology.orchestra.run.trial073.stdout:Installed size: 0 2026-02-22T23:20:42.050 INFO:teuthology.orchestra.run.trial073.stdout:Downloading Packages: 2026-02-22T23:20:42.138 INFO:teuthology.orchestra.run.trial073.stdout:kernel-5.14.0-681.el9.x86_64.rpm 30 MB/s | 803 kB 00:00 2026-02-22T23:20:42.138 INFO:teuthology.orchestra.run.trial073.stdout:-------------------------------------------------------------------------------- 2026-02-22T23:20:42.139 INFO:teuthology.orchestra.run.trial073.stdout:Total 8.9 MB/s | 803 kB 00:00 2026-02-22T23:20:42.147 INFO:teuthology.orchestra.run.trial073.stdout:Running transaction check 2026-02-22T23:20:42.181 INFO:teuthology.orchestra.run.trial073.stdout:Transaction check succeeded. 2026-02-22T23:20:42.181 INFO:teuthology.orchestra.run.trial073.stdout:Running transaction test 2026-02-22T23:20:42.185 INFO:teuthology.orchestra.run.trial073.stdout:Transaction test succeeded. 2026-02-22T23:20:42.185 INFO:teuthology.orchestra.run.trial073.stdout:Running transaction 2026-02-22T23:20:42.208 INFO:teuthology.orchestra.run.trial073.stdout: Preparing : 1/1 2026-02-22T23:20:42.212 INFO:teuthology.orchestra.run.trial073.stdout: Reinstalling : kernel-5.14.0-681.el9.x86_64 1/2 2026-02-22T23:20:42.213 INFO:teuthology.orchestra.run.trial073.stdout: Cleanup : kernel-5.14.0-681.el9.x86_64 2/2 2026-02-22T23:20:42.319 INFO:teuthology.orchestra.run.trial073.stdout: Running scriptlet: kernel-5.14.0-681.el9.x86_64 2/2 2026-02-22T23:20:42.319 INFO:teuthology.orchestra.run.trial073.stdout: Verifying : kernel-5.14.0-681.el9.x86_64 1/2 2026-02-22T23:20:42.376 INFO:teuthology.orchestra.run.trial073.stdout: Verifying : kernel-5.14.0-681.el9.x86_64 2/2 2026-02-22T23:20:42.376 INFO:teuthology.orchestra.run.trial073.stdout: 2026-02-22T23:20:42.377 INFO:teuthology.orchestra.run.trial073.stdout:Reinstalled: 2026-02-22T23:20:42.377 INFO:teuthology.orchestra.run.trial073.stdout: kernel-5.14.0-681.el9.x86_64 2026-02-22T23:20:42.377 INFO:teuthology.orchestra.run.trial073.stdout: 2026-02-22T23:20:42.377 INFO:teuthology.orchestra.run.trial073.stdout:Complete! 2026-02-22T23:20:42.402 DEBUG:teuthology.orchestra.run.trial073:> rpm -q kernel | sort -rV | head -n 1 2026-02-22T23:20:42.427 INFO:teuthology.orchestra.run.trial073.stdout:kernel-5.14.0-681.el9.x86_64 2026-02-22T23:20:42.427 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-681.el9.x86_64 2026-02-22T23:20:42.427 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2026-02-22T23:20:42.427 INFO:teuthology.task.kernel:Enabling kdb on mon.f... 2026-02-22T23:20:42.428 DEBUG:teuthology.orchestra.run.trial073:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2026-02-22T23:20:42.490 INFO:teuthology.orchestra.run.trial073.stdout:ttyS1 2026-02-22T23:20:42.515 DEBUG:teuthology.parallel:result is None 2026-02-22T23:20:42.516 INFO:teuthology.run_tasks:Running task internal.base... 2026-02-22T23:20:42.522 INFO:teuthology.task.internal:Creating test directory... 2026-02-22T23:20:42.523 DEBUG:teuthology.orchestra.run.trial045:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-22T23:20:42.526 DEBUG:teuthology.orchestra.run.trial073:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-22T23:20:42.572 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2026-02-22T23:20:42.584 INFO:teuthology.run_tasks:Running task internal.archive... 2026-02-22T23:20:42.596 INFO:teuthology.task.internal:Creating archive directory... 2026-02-22T23:20:42.597 DEBUG:teuthology.orchestra.run.trial045:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-22T23:20:42.599 DEBUG:teuthology.orchestra.run.trial073:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-22T23:20:42.646 INFO:teuthology.run_tasks:Running task internal.coredump... 2026-02-22T23:20:42.661 INFO:teuthology.task.internal:Enabling coredump saving... 2026-02-22T23:20:42.661 DEBUG:teuthology.orchestra.run.trial045:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-22T23:20:42.664 DEBUG:teuthology.orchestra.run.trial073:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-22T23:20:42.686 INFO:teuthology.orchestra.run.trial045.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-22T23:20:42.693 INFO:teuthology.orchestra.run.trial073.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-22T23:20:42.694 INFO:teuthology.orchestra.run.trial045.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-22T23:20:42.702 INFO:teuthology.orchestra.run.trial073.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-22T23:20:42.704 INFO:teuthology.run_tasks:Running task internal.sudo... 2026-02-22T23:20:42.715 INFO:teuthology.task.internal:Configuring sudo... 2026-02-22T23:20:42.715 DEBUG:teuthology.orchestra.run.trial045:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-22T23:20:42.738 DEBUG:teuthology.orchestra.run.trial073:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-22T23:20:42.768 INFO:teuthology.run_tasks:Running task internal.syslog... 2026-02-22T23:20:42.784 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2026-02-22T23:20:42.784 DEBUG:teuthology.orchestra.run.trial045:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-22T23:20:42.802 DEBUG:teuthology.orchestra.run.trial073:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-22T23:20:42.824 DEBUG:teuthology.orchestra.run.trial045:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-22T23:20:42.975 DEBUG:teuthology.orchestra.run.trial045:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-22T23:20:43.000 DEBUG:teuthology.orchestra.run.trial045:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-22T23:20:43.145 DEBUG:teuthology.orchestra.run.trial045:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-22T23:20:43.170 DEBUG:teuthology.orchestra.run.trial045:> set -ex 2026-02-22T23:20:43.170 DEBUG:teuthology.orchestra.run.trial045:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-22T23:20:43.237 DEBUG:teuthology.orchestra.run.trial073:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-22T23:20:43.323 DEBUG:teuthology.orchestra.run.trial073:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-22T23:20:43.347 DEBUG:teuthology.orchestra.run.trial073:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-22T23:20:43.480 DEBUG:teuthology.orchestra.run.trial073:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-22T23:20:43.504 DEBUG:teuthology.orchestra.run.trial073:> set -ex 2026-02-22T23:20:43.504 DEBUG:teuthology.orchestra.run.trial073:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-22T23:20:43.569 DEBUG:teuthology.orchestra.run.trial045:> sudo service rsyslog restart 2026-02-22T23:20:43.571 DEBUG:teuthology.orchestra.run.trial073:> sudo service rsyslog restart 2026-02-22T23:20:43.598 INFO:teuthology.orchestra.run.trial045.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-22T23:20:43.638 INFO:teuthology.orchestra.run.trial073.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-22T23:20:44.141 INFO:teuthology.run_tasks:Running task internal.timer... 2026-02-22T23:20:44.153 INFO:teuthology.task.internal:Starting timer... 2026-02-22T23:20:44.153 INFO:teuthology.run_tasks:Running task pcp... 2026-02-22T23:20:44.174 INFO:teuthology.run_tasks:Running task selinux... 2026-02-22T23:20:44.188 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:getty_t:s0']} 2026-02-22T23:20:44.188 DEBUG:teuthology.orchestra.run.trial045:> sudo service auditd rotate 2026-02-22T23:20:44.220 INFO:teuthology.orchestra.run.trial045.stdout:Rotating logs: 2026-02-22T23:20:44.222 DEBUG:teuthology.orchestra.run.trial073:> sudo service auditd rotate 2026-02-22T23:20:44.252 INFO:teuthology.orchestra.run.trial073.stdout:Rotating logs: 2026-02-22T23:20:44.254 DEBUG:teuthology.task.selinux:Getting current SELinux state 2026-02-22T23:20:44.254 DEBUG:teuthology.orchestra.run.trial045:> /usr/sbin/getenforce 2026-02-22T23:20:44.279 INFO:teuthology.orchestra.run.trial045.stdout:Permissive 2026-02-22T23:20:44.280 DEBUG:teuthology.orchestra.run.trial073:> /usr/sbin/getenforce 2026-02-22T23:20:44.310 INFO:teuthology.orchestra.run.trial073.stdout:Permissive 2026-02-22T23:20:44.310 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@trial045.front.sepia.ceph.com': 'permissive', 'ubuntu@trial073.front.sepia.ceph.com': 'permissive'} 2026-02-22T23:20:44.310 DEBUG:teuthology.orchestra.run.trial045:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2026-02-22T23:20:44.345 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-22T23:20:44.346 DEBUG:teuthology.orchestra.run.trial073:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2026-02-22T23:20:44.373 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-22T23:20:44.373 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2026-02-22T23:20:44.373 DEBUG:teuthology.orchestra.run.trial045:> sudo /usr/sbin/setenforce permissive 2026-02-22T23:20:44.408 DEBUG:teuthology.orchestra.run.trial073:> sudo /usr/sbin/setenforce permissive 2026-02-22T23:20:44.437 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2026-02-22T23:20:44.451 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2026-02-22T23:20:44.462 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2026-02-22T23:20:44.464 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit trial045.front.sepia.ceph.com,trial073.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2026-02-22T23:23:30.680 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@trial045.front.sepia.ceph.com'), Remote(name='ubuntu@trial073.front.sepia.ceph.com')] 2026-02-22T23:23:30.681 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial045.front.sepia.ceph.com' 2026-02-22T23:23:30.683 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial045.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-22T23:23:30.794 DEBUG:teuthology.orchestra.run.trial045:> true 2026-02-22T23:23:30.869 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial045.front.sepia.ceph.com' 2026-02-22T23:23:30.869 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial073.front.sepia.ceph.com' 2026-02-22T23:23:30.869 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-22T23:23:30.951 DEBUG:teuthology.orchestra.run.trial073:> true 2026-02-22T23:23:31.023 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial073.front.sepia.ceph.com' 2026-02-22T23:23:31.023 INFO:teuthology.run_tasks:Running task clock... 2026-02-22T23:23:31.037 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2026-02-22T23:23:31.037 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-22T23:23:31.037 DEBUG:teuthology.orchestra.run.trial045:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-22T23:23:31.039 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-22T23:23:31.040 DEBUG:teuthology.orchestra.run.trial073:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-22T23:23:31.065 INFO:teuthology.orchestra.run.trial045.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2026-02-22T23:23:31.077 INFO:teuthology.orchestra.run.trial045.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2026-02-22T23:23:31.089 INFO:teuthology.orchestra.run.trial073.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2026-02-22T23:23:31.099 INFO:teuthology.orchestra.run.trial045.stderr:sudo: ntpd: command not found 2026-02-22T23:23:31.101 INFO:teuthology.orchestra.run.trial073.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2026-02-22T23:23:31.108 INFO:teuthology.orchestra.run.trial045.stdout:506 Cannot talk to daemon 2026-02-22T23:23:31.120 INFO:teuthology.orchestra.run.trial045.stderr:Failed to start ntp.service: Unit ntp.service not found. 2026-02-22T23:23:31.122 INFO:teuthology.orchestra.run.trial073.stderr:sudo: ntpd: command not found 2026-02-22T23:23:31.132 INFO:teuthology.orchestra.run.trial073.stdout:506 Cannot talk to daemon 2026-02-22T23:23:31.132 INFO:teuthology.orchestra.run.trial045.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2026-02-22T23:23:31.144 INFO:teuthology.orchestra.run.trial073.stderr:Failed to start ntp.service: Unit ntp.service not found. 2026-02-22T23:23:31.155 INFO:teuthology.orchestra.run.trial073.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2026-02-22T23:23:31.178 INFO:teuthology.orchestra.run.trial045.stderr:bash: line 1: ntpq: command not found 2026-02-22T23:23:31.180 INFO:teuthology.orchestra.run.trial045.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-22T23:23:31.180 INFO:teuthology.orchestra.run.trial045.stdout:=============================================================================== 2026-02-22T23:23:31.198 INFO:teuthology.orchestra.run.trial073.stderr:bash: line 1: ntpq: command not found 2026-02-22T23:23:31.200 INFO:teuthology.orchestra.run.trial073.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-22T23:23:31.200 INFO:teuthology.orchestra.run.trial073.stdout:=============================================================================== 2026-02-22T23:23:31.202 INFO:teuthology.run_tasks:Running task install... 2026-02-22T23:23:31.216 DEBUG:teuthology.task.install:project ceph 2026-02-22T23:23:31.216 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'f90f4eaebb28b619cf76e80cbbe997656da69579'}} 2026-02-22T23:23:31.216 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': 'f90f4eaebb28b619cf76e80cbbe997656da69579'} 2026-02-22T23:23:31.216 INFO:teuthology.task.install:Using flavor: default 2026-02-22T23:23:31.221 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2026-02-22T23:23:31.221 INFO:teuthology.task.install:extra packages: [] 2026-02-22T23:23:31.222 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'f90f4eaebb28b619cf76e80cbbe997656da69579', 'tag': None, 'wait_for_package': False} 2026-02-22T23:23:31.222 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=f90f4eaebb28b619cf76e80cbbe997656da69579 2026-02-22T23:23:31.224 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'f90f4eaebb28b619cf76e80cbbe997656da69579', 'tag': None, 'wait_for_package': False} 2026-02-22T23:23:31.224 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=f90f4eaebb28b619cf76e80cbbe997656da69579 2026-02-22T23:23:31.397 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-yuri6-testing-2026-02-22-1629-squid/f90f4eaebb28b619cf76e80cbbe997656da69579/centos/9/flavors/default/ 2026-02-22T23:23:31.397 INFO:teuthology.task.install.rpm:Package version is 19.2.3-689.gf90f4eae 2026-02-22T23:23:31.409 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-yuri6-testing-2026-02-22-1629-squid/f90f4eaebb28b619cf76e80cbbe997656da69579/centos/9/flavors/default/ 2026-02-22T23:23:31.409 INFO:teuthology.task.install.rpm:Package version is 19.2.3-689.gf90f4eae 2026-02-22T23:23:31.583 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri6-testing-2026-02-22-1629-squid/f90f4eaebb28b619cf76e80cbbe997656da69579/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri6-testing-2026-02-22-1629-squid/f90f4eaebb28b619cf76e80cbbe997656da69579/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri6-testing-2026-02-22-1629-squid/f90f4eaebb28b619cf76e80cbbe997656da69579/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-22T23:23:31.583 DEBUG:teuthology.orchestra.run.trial045:> set -ex 2026-02-22T23:23:31.583 DEBUG:teuthology.orchestra.run.trial045:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-22T23:23:31.587 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri6-testing-2026-02-22-1629-squid/f90f4eaebb28b619cf76e80cbbe997656da69579/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri6-testing-2026-02-22-1629-squid/f90f4eaebb28b619cf76e80cbbe997656da69579/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri6-testing-2026-02-22-1629-squid/f90f4eaebb28b619cf76e80cbbe997656da69579/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-22T23:23:31.588 DEBUG:teuthology.orchestra.run.trial073:> set -ex 2026-02-22T23:23:31.588 DEBUG:teuthology.orchestra.run.trial073:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-22T23:23:31.609 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2026-02-22T23:23:31.609 DEBUG:teuthology.orchestra.run.trial045:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/f90f4eaebb28b619cf76e80cbbe997656da69579/;g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-22T23:23:31.613 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2026-02-22T23:23:31.613 DEBUG:teuthology.orchestra.run.trial073:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/f90f4eaebb28b619cf76e80cbbe997656da69579/;g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-22T23:23:31.673 DEBUG:teuthology.orchestra.run.trial045:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-22T23:23:31.682 DEBUG:teuthology.orchestra.run.trial073:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-22T23:23:31.747 DEBUG:teuthology.orchestra.run.trial045:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-22T23:23:31.754 DEBUG:teuthology.orchestra.run.trial073:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-22T23:23:31.810 INFO:teuthology.orchestra.run.trial045.stdout:check_obsoletes = 1 2026-02-22T23:23:31.812 DEBUG:teuthology.orchestra.run.trial045:> sudo yum clean all 2026-02-22T23:23:31.818 INFO:teuthology.orchestra.run.trial073.stdout:check_obsoletes = 1 2026-02-22T23:23:31.820 DEBUG:teuthology.orchestra.run.trial073:> sudo yum clean all 2026-02-22T23:23:31.972 INFO:teuthology.orchestra.run.trial045.stdout:41 files removed 2026-02-22T23:23:31.980 INFO:teuthology.orchestra.run.trial073.stdout:41 files removed 2026-02-22T23:23:31.986 DEBUG:teuthology.orchestra.run.trial045:> sudo yum -y install ceph-radosgw 2026-02-22T23:23:31.995 DEBUG:teuthology.orchestra.run.trial073:> sudo yum -y install ceph-radosgw 2026-02-22T23:23:32.328 INFO:teuthology.orchestra.run.trial045.stdout:ceph packages for x86_64 434 kB/s | 86 kB 00:00 2026-02-22T23:23:32.336 INFO:teuthology.orchestra.run.trial073.stdout:ceph packages for x86_64 430 kB/s | 86 kB 00:00 2026-02-22T23:23:32.495 INFO:teuthology.orchestra.run.trial045.stdout:ceph noarch packages 84 kB/s | 12 kB 00:00 2026-02-22T23:23:32.496 INFO:teuthology.orchestra.run.trial073.stdout:ceph noarch packages 89 kB/s | 12 kB 00:00 2026-02-22T23:23:32.666 INFO:teuthology.orchestra.run.trial073.stdout:ceph source packages 13 kB/s | 1.9 kB 00:00 2026-02-22T23:23:32.667 INFO:teuthology.orchestra.run.trial045.stdout:ceph source packages 12 kB/s | 1.9 kB 00:00 2026-02-22T23:23:34.659 INFO:teuthology.orchestra.run.trial073.stdout:CentOS Stream 9 - BaseOS 4.5 MB/s | 8.9 MB 00:01 2026-02-22T23:23:36.240 INFO:teuthology.orchestra.run.trial045.stdout:CentOS Stream 9 - BaseOS 2.5 MB/s | 8.9 MB 00:03 2026-02-22T23:23:37.730 INFO:teuthology.orchestra.run.trial073.stdout:CentOS Stream 9 - AppStream 11 MB/s | 27 MB 00:02 2026-02-22T23:23:41.010 INFO:teuthology.orchestra.run.trial073.stdout:CentOS Stream 9 - CRB 8.9 MB/s | 7.8 MB 00:00 2026-02-22T23:23:42.726 INFO:teuthology.orchestra.run.trial073.stdout:CentOS Stream 9 - Extras packages 20 kB/s | 20 kB 00:00 2026-02-22T23:23:43.592 INFO:teuthology.orchestra.run.trial073.stdout:Extra Packages for Enterprise Linux 25 MB/s | 20 MB 00:00 2026-02-22T23:23:46.832 INFO:teuthology.orchestra.run.trial073.stdout:lab-extras 2.6 MB/s | 50 kB 00:00 2026-02-22T23:23:48.030 INFO:teuthology.orchestra.run.trial073.stdout:Dependencies resolved. 2026-02-22T23:23:48.031 INFO:teuthology.orchestra.run.trial073.stdout:================================================================================ 2026-02-22T23:23:48.032 INFO:teuthology.orchestra.run.trial073.stdout: Package Arch Version Repository Size 2026-02-22T23:23:48.032 INFO:teuthology.orchestra.run.trial073.stdout:================================================================================ 2026-02-22T23:23:48.032 INFO:teuthology.orchestra.run.trial073.stdout:Installing: 2026-02-22T23:23:48.032 INFO:teuthology.orchestra.run.trial073.stdout: ceph-radosgw x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 11 M 2026-02-22T23:23:48.032 INFO:teuthology.orchestra.run.trial073.stdout:Upgrading: 2026-02-22T23:23:48.032 INFO:teuthology.orchestra.run.trial073.stdout: librados2 x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 3.4 M 2026-02-22T23:23:48.032 INFO:teuthology.orchestra.run.trial073.stdout: librbd1 x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 3.2 M 2026-02-22T23:23:48.033 INFO:teuthology.orchestra.run.trial073.stdout:Installing dependencies: 2026-02-22T23:23:48.033 INFO:teuthology.orchestra.run.trial073.stdout: boost-program-options x86_64 1.75.0-13.el9 appstream 104 k 2026-02-22T23:23:48.033 INFO:teuthology.orchestra.run.trial073.stdout: ceph-base x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 5.5 M 2026-02-22T23:23:48.033 INFO:teuthology.orchestra.run.trial073.stdout: ceph-common x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 22 M 2026-02-22T23:23:48.033 INFO:teuthology.orchestra.run.trial073.stdout: ceph-selinux x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 25 k 2026-02-22T23:23:48.033 INFO:teuthology.orchestra.run.trial073.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2026-02-22T23:23:48.033 INFO:teuthology.orchestra.run.trial073.stdout: libarrow x86_64 9.0.0-15.el9 epel 4.4 M 2026-02-22T23:23:48.033 INFO:teuthology.orchestra.run.trial073.stdout: libarrow-doc noarch 9.0.0-15.el9 epel 25 k 2026-02-22T23:23:48.033 INFO:teuthology.orchestra.run.trial073.stdout: libcephfs2 x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 999 k 2026-02-22T23:23:48.033 INFO:teuthology.orchestra.run.trial073.stdout: libnbd x86_64 1.20.3-4.el9 appstream 164 k 2026-02-22T23:23:48.033 INFO:teuthology.orchestra.run.trial073.stdout: liboath x86_64 2.6.12-1.el9 epel 49 k 2026-02-22T23:23:48.034 INFO:teuthology.orchestra.run.trial073.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2026-02-22T23:23:48.034 INFO:teuthology.orchestra.run.trial073.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2026-02-22T23:23:48.034 INFO:teuthology.orchestra.run.trial073.stdout: libradosstriper1 x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 503 k 2026-02-22T23:23:48.034 INFO:teuthology.orchestra.run.trial073.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2026-02-22T23:23:48.034 INFO:teuthology.orchestra.run.trial073.stdout: librgw2 x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 5.4 M 2026-02-22T23:23:48.034 INFO:teuthology.orchestra.run.trial073.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2026-02-22T23:23:48.034 INFO:teuthology.orchestra.run.trial073.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2026-02-22T23:23:48.034 INFO:teuthology.orchestra.run.trial073.stdout: mailcap noarch 2.1.49-5.el9 baseos 33 k 2026-02-22T23:23:48.034 INFO:teuthology.orchestra.run.trial073.stdout: parquet-libs x86_64 9.0.0-15.el9 epel 838 k 2026-02-22T23:23:48.034 INFO:teuthology.orchestra.run.trial073.stdout: pciutils x86_64 3.7.0-7.el9 baseos 93 k 2026-02-22T23:23:48.034 INFO:teuthology.orchestra.run.trial073.stdout: python3-ceph-argparse x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 45 k 2026-02-22T23:23:48.034 INFO:teuthology.orchestra.run.trial073.stdout: python3-ceph-common x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 142 k 2026-02-22T23:23:48.034 INFO:teuthology.orchestra.run.trial073.stdout: python3-cephfs x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 165 k 2026-02-22T23:23:48.035 INFO:teuthology.orchestra.run.trial073.stdout: python3-rados x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 322 k 2026-02-22T23:23:48.035 INFO:teuthology.orchestra.run.trial073.stdout: python3-rbd x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 303 k 2026-02-22T23:23:48.035 INFO:teuthology.orchestra.run.trial073.stdout: python3-rgw x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 100 k 2026-02-22T23:23:48.035 INFO:teuthology.orchestra.run.trial073.stdout: qatlib x86_64 25.08.0-2.el9 appstream 240 k 2026-02-22T23:23:48.035 INFO:teuthology.orchestra.run.trial073.stdout: qatzip-libs x86_64 1.3.1-1.el9 appstream 66 k 2026-02-22T23:23:48.035 INFO:teuthology.orchestra.run.trial073.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2026-02-22T23:23:48.035 INFO:teuthology.orchestra.run.trial073.stdout: thrift x86_64 0.15.0-4.el9 epel 1.6 M 2026-02-22T23:23:48.035 INFO:teuthology.orchestra.run.trial073.stdout:Installing weak dependencies: 2026-02-22T23:23:48.035 INFO:teuthology.orchestra.run.trial073.stdout: nvme-cli x86_64 2.16-1.el9 baseos 1.2 M 2026-02-22T23:23:48.035 INFO:teuthology.orchestra.run.trial073.stdout: qatlib-service x86_64 25.08.0-2.el9 appstream 37 k 2026-02-22T23:23:48.035 INFO:teuthology.orchestra.run.trial073.stdout: 2026-02-22T23:23:48.035 INFO:teuthology.orchestra.run.trial073.stdout:Transaction Summary 2026-02-22T23:23:48.036 INFO:teuthology.orchestra.run.trial073.stdout:================================================================================ 2026-02-22T23:23:48.036 INFO:teuthology.orchestra.run.trial073.stdout:Install 33 Packages 2026-02-22T23:23:48.036 INFO:teuthology.orchestra.run.trial073.stdout:Upgrade 2 Packages 2026-02-22T23:23:48.036 INFO:teuthology.orchestra.run.trial073.stdout: 2026-02-22T23:23:48.036 INFO:teuthology.orchestra.run.trial073.stdout:Total download size: 63 M 2026-02-22T23:23:48.037 INFO:teuthology.orchestra.run.trial073.stdout:Downloading Packages: 2026-02-22T23:23:49.246 INFO:teuthology.orchestra.run.trial073.stdout:(1/35): ceph-base-19.2.3-689.gf90f4eae.el9.x86_ 11 MB/s | 5.5 MB 00:00 2026-02-22T23:23:49.281 INFO:teuthology.orchestra.run.trial073.stdout:(2/35): ceph-selinux-19.2.3-689.gf90f4eae.el9.x 733 kB/s | 25 kB 00:00 2026-02-22T23:23:49.365 INFO:teuthology.orchestra.run.trial073.stdout:(3/35): libcephfs2-19.2.3-689.gf90f4eae.el9.x86 12 MB/s | 999 kB 00:00 2026-02-22T23:23:49.407 INFO:teuthology.orchestra.run.trial073.stdout:(4/35): libradosstriper1-19.2.3-689.gf90f4eae.e 12 MB/s | 503 kB 00:00 2026-02-22T23:23:49.427 INFO:teuthology.orchestra.run.trial073.stdout:(5/35): ceph-radosgw-19.2.3-689.gf90f4eae.el9.x 16 MB/s | 11 MB 00:00 2026-02-22T23:23:49.451 INFO:teuthology.orchestra.run.trial073.stdout:(6/35): python3-ceph-argparse-19.2.3-689.gf90f4 1.8 MB/s | 45 kB 00:00 2026-02-22T23:23:49.483 INFO:teuthology.orchestra.run.trial073.stdout:(7/35): python3-ceph-common-19.2.3-689.gf90f4ea 4.4 MB/s | 142 kB 00:00 2026-02-22T23:23:49.514 INFO:teuthology.orchestra.run.trial073.stdout:(8/35): python3-cephfs-19.2.3-689.gf90f4eae.el9 5.1 MB/s | 165 kB 00:00 2026-02-22T23:23:49.550 INFO:teuthology.orchestra.run.trial073.stdout:(9/35): python3-rados-19.2.3-689.gf90f4eae.el9. 8.8 MB/s | 322 kB 00:00 2026-02-22T23:23:49.609 INFO:teuthology.orchestra.run.trial073.stdout:(10/35): python3-rbd-19.2.3-689.gf90f4eae.el9.x 5.0 MB/s | 303 kB 00:00 2026-02-22T23:23:49.666 INFO:teuthology.orchestra.run.trial073.stdout:(11/35): ceph-common-19.2.3-689.gf90f4eae.el9.x 24 MB/s | 22 MB 00:00 2026-02-22T23:23:49.667 INFO:teuthology.orchestra.run.trial073.stdout:(12/35): python3-rgw-19.2.3-689.gf90f4eae.el9.x 1.7 MB/s | 100 kB 00:00 2026-02-22T23:23:49.709 INFO:teuthology.orchestra.run.trial073.stdout:(13/35): librgw2-19.2.3-689.gf90f4eae.el9.x86_6 18 MB/s | 5.4 MB 00:00 2026-02-22T23:23:49.929 INFO:teuthology.orchestra.run.trial073.stdout:(14/35): mailcap-2.1.49-5.el9.noarch.rpm 126 kB/s | 33 kB 00:00 2026-02-22T23:23:50.098 INFO:teuthology.orchestra.run.trial073.stdout:(15/35): pciutils-3.7.0-7.el9.x86_64.rpm 240 kB/s | 93 kB 00:00 2026-02-22T23:23:50.166 INFO:teuthology.orchestra.run.trial073.stdout:(16/35): boost-program-options-1.75.0-13.el9.x8 439 kB/s | 104 kB 00:00 2026-02-22T23:23:50.283 INFO:teuthology.orchestra.run.trial073.stdout:(17/35): libnbd-1.20.3-4.el9.x86_64.rpm 882 kB/s | 164 kB 00:00 2026-02-22T23:23:50.333 INFO:teuthology.orchestra.run.trial073.stdout:(18/35): libpmemobj-1.12.1-1.el9.x86_64.rpm 963 kB/s | 160 kB 00:00 2026-02-22T23:23:50.342 INFO:teuthology.orchestra.run.trial073.stdout:(19/35): nvme-cli-2.16-1.el9.x86_64.rpm 1.7 MB/s | 1.2 MB 00:00 2026-02-22T23:23:50.371 INFO:teuthology.orchestra.run.trial073.stdout:(20/35): librabbitmq-0.11.0-7.el9.x86_64.rpm 513 kB/s | 45 kB 00:00 2026-02-22T23:23:50.433 INFO:teuthology.orchestra.run.trial073.stdout:(21/35): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.2 MB/s | 292 kB 00:00 2026-02-22T23:23:50.508 INFO:teuthology.orchestra.run.trial073.stdout:(22/35): qatlib-25.08.0-2.el9.x86_64.rpm 1.7 MB/s | 240 kB 00:00 2026-02-22T23:23:50.512 INFO:teuthology.orchestra.run.trial073.stdout:(23/35): qatlib-service-25.08.0-2.el9.x86_64.rp 469 kB/s | 37 kB 00:00 2026-02-22T23:23:50.568 INFO:teuthology.orchestra.run.trial073.stdout:(24/35): librdkafka-1.6.1-102.el9.x86_64.rpm 2.8 MB/s | 662 kB 00:00 2026-02-22T23:23:50.597 INFO:teuthology.orchestra.run.trial073.stdout:(25/35): qatzip-libs-1.3.1-1.el9.x86_64.rpm 742 kB/s | 66 kB 00:00 2026-02-22T23:23:50.726 INFO:teuthology.orchestra.run.trial073.stdout:(26/35): libarrow-doc-9.0.0-15.el9.noarch.rpm 193 kB/s | 25 kB 00:00 2026-02-22T23:23:50.777 INFO:teuthology.orchestra.run.trial073.stdout:(27/35): gperftools-libs-2.9.1-3.el9.x86_64.rpm 1.1 MB/s | 308 kB 00:00 2026-02-22T23:23:50.786 INFO:teuthology.orchestra.run.trial073.stdout:(28/35): liboath-2.6.12-1.el9.x86_64.rpm 816 kB/s | 49 kB 00:00 2026-02-22T23:23:50.810 INFO:teuthology.orchestra.run.trial073.stdout:(29/35): libunwind-1.6.2-1.el9.x86_64.rpm 2.0 MB/s | 67 kB 00:00 2026-02-22T23:23:50.853 INFO:teuthology.orchestra.run.trial073.stdout:(30/35): re2-20211101-20.el9.x86_64.rpm 4.4 MB/s | 191 kB 00:00 2026-02-22T23:23:50.925 INFO:teuthology.orchestra.run.trial073.stdout:(31/35): libarrow-9.0.0-15.el9.x86_64.rpm 12 MB/s | 4.4 MB 00:00 2026-02-22T23:23:50.926 INFO:teuthology.orchestra.run.trial073.stdout:(32/35): parquet-libs-9.0.0-15.el9.x86_64.rpm 5.8 MB/s | 838 kB 00:00 2026-02-22T23:23:50.962 INFO:teuthology.orchestra.run.trial073.stdout:(33/35): thrift-0.15.0-4.el9.x86_64.rpm 15 MB/s | 1.6 MB 00:00 2026-02-22T23:23:51.096 INFO:teuthology.orchestra.run.trial073.stdout:(34/35): librbd1-19.2.3-689.gf90f4eae.el9.x86_6 19 MB/s | 3.2 MB 00:00 2026-02-22T23:23:51.177 INFO:teuthology.orchestra.run.trial073.stdout:(35/35): librados2-19.2.3-689.gf90f4eae.el9.x86 14 MB/s | 3.4 MB 00:00 2026-02-22T23:23:51.180 INFO:teuthology.orchestra.run.trial073.stdout:-------------------------------------------------------------------------------- 2026-02-22T23:23:51.180 INFO:teuthology.orchestra.run.trial073.stdout:Total 20 MB/s | 63 MB 00:03 2026-02-22T23:23:51.275 INFO:teuthology.orchestra.run.trial073.stdout:Running transaction check 2026-02-22T23:23:51.295 INFO:teuthology.orchestra.run.trial073.stdout:Transaction check succeeded. 2026-02-22T23:23:51.295 INFO:teuthology.orchestra.run.trial073.stdout:Running transaction test 2026-02-22T23:23:51.550 INFO:teuthology.orchestra.run.trial073.stdout:Transaction test succeeded. 2026-02-22T23:23:51.550 INFO:teuthology.orchestra.run.trial073.stdout:Running transaction 2026-02-22T23:23:51.844 INFO:teuthology.orchestra.run.trial073.stdout: Preparing : 1/1 2026-02-22T23:23:51.853 INFO:teuthology.orchestra.run.trial073.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/37 2026-02-22T23:23:51.856 INFO:teuthology.orchestra.run.trial073.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/37 2026-02-22T23:23:51.869 INFO:teuthology.orchestra.run.trial073.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/37 2026-02-22T23:23:52.022 INFO:teuthology.orchestra.run.trial073.stdout: Installing : thrift-0.15.0-4.el9.x86_64 4/37 2026-02-22T23:23:52.026 INFO:teuthology.orchestra.run.trial073.stdout: Upgrading : librados2-2:19.2.3-689.gf90f4eae.el9.x86_64 5/37 2026-02-22T23:23:52.054 INFO:teuthology.orchestra.run.trial073.stdout: Running scriptlet: librados2-2:19.2.3-689.gf90f4eae.el9.x86_64 5/37 2026-02-22T23:23:52.096 INFO:teuthology.orchestra.run.trial073.stdout: Installing : python3-rados-2:19.2.3-689.gf90f4eae.el9.x86_64 6/37 2026-02-22T23:23:52.097 INFO:teuthology.orchestra.run.trial073.stdout: Installing : libcephfs2-2:19.2.3-689.gf90f4eae.el9.x86_64 7/37 2026-02-22T23:23:52.111 INFO:teuthology.orchestra.run.trial073.stdout: Running scriptlet: libcephfs2-2:19.2.3-689.gf90f4eae.el9.x86_64 7/37 2026-02-22T23:23:52.113 INFO:teuthology.orchestra.run.trial073.stdout: Installing : liboath-2.6.12-1.el9.x86_64 8/37 2026-02-22T23:23:52.122 INFO:teuthology.orchestra.run.trial073.stdout: Installing : python3-ceph-argparse-2:19.2.3-689.gf90f4eae.el9.x 9/37 2026-02-22T23:23:52.144 INFO:teuthology.orchestra.run.trial073.stdout: Installing : python3-cephfs-2:19.2.3-689.gf90f4eae.el9.x86_64 10/37 2026-02-22T23:23:52.145 INFO:teuthology.orchestra.run.trial073.stdout: Installing : libradosstriper1-2:19.2.3-689.gf90f4eae.el9.x86_64 11/37 2026-02-22T23:23:52.157 INFO:teuthology.orchestra.run.trial073.stdout: Running scriptlet: libradosstriper1-2:19.2.3-689.gf90f4eae.el9.x86_64 11/37 2026-02-22T23:23:52.192 INFO:teuthology.orchestra.run.trial073.stdout: Installing : re2-1:20211101-20.el9.x86_64 12/37 2026-02-22T23:23:52.197 INFO:teuthology.orchestra.run.trial073.stdout: Installing : libarrow-9.0.0-15.el9.x86_64 13/37 2026-02-22T23:23:52.203 INFO:teuthology.orchestra.run.trial073.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 14/37 2026-02-22T23:23:52.206 INFO:teuthology.orchestra.run.trial073.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 15/37 2026-02-22T23:23:52.209 INFO:teuthology.orchestra.run.trial073.stdout: Installing : libarrow-doc-9.0.0-15.el9.noarch 16/37 2026-02-22T23:23:52.214 INFO:teuthology.orchestra.run.trial073.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 17/37 2026-02-22T23:23:52.355 INFO:teuthology.orchestra.run.trial073.stdout: Installing : libnbd-1.20.3-4.el9.x86_64 18/37 2026-02-22T23:23:52.356 INFO:teuthology.orchestra.run.trial073.stdout: Upgrading : librbd1-2:19.2.3-689.gf90f4eae.el9.x86_64 19/37 2026-02-22T23:23:52.381 INFO:teuthology.orchestra.run.trial073.stdout: Running scriptlet: librbd1-2:19.2.3-689.gf90f4eae.el9.x86_64 19/37 2026-02-22T23:23:52.384 INFO:teuthology.orchestra.run.trial073.stdout: Installing : python3-rbd-2:19.2.3-689.gf90f4eae.el9.x86_64 20/37 2026-02-22T23:23:52.390 INFO:teuthology.orchestra.run.trial073.stdout: Installing : boost-program-options-1.75.0-13.el9.x86_64 21/37 2026-02-22T23:23:52.616 INFO:teuthology.orchestra.run.trial073.stdout: Installing : parquet-libs-9.0.0-15.el9.x86_64 22/37 2026-02-22T23:23:52.617 INFO:teuthology.orchestra.run.trial073.stdout: Installing : librgw2-2:19.2.3-689.gf90f4eae.el9.x86_64 23/37 2026-02-22T23:23:52.633 INFO:teuthology.orchestra.run.trial073.stdout: Running scriptlet: librgw2-2:19.2.3-689.gf90f4eae.el9.x86_64 23/37 2026-02-22T23:23:52.637 INFO:teuthology.orchestra.run.trial073.stdout: Installing : python3-rgw-2:19.2.3-689.gf90f4eae.el9.x86_64 24/37 2026-02-22T23:23:52.642 INFO:teuthology.orchestra.run.trial073.stdout: Installing : pciutils-3.7.0-7.el9.x86_64 25/37 2026-02-22T23:23:52.645 INFO:teuthology.orchestra.run.trial073.stdout: Installing : qatlib-25.08.0-2.el9.x86_64 26/37 2026-02-22T23:23:52.646 INFO:teuthology.orchestra.run.trial073.stdout: Installing : qatlib-service-25.08.0-2.el9.x86_64 27/37 2026-02-22T23:23:52.664 INFO:teuthology.orchestra.run.trial073.stdout: Running scriptlet: qatlib-service-25.08.0-2.el9.x86_64 27/37 2026-02-22T23:23:52.784 INFO:teuthology.orchestra.run.trial073.stdout: Installing : qatzip-libs-1.3.1-1.el9.x86_64 28/37 2026-02-22T23:23:52.786 INFO:teuthology.orchestra.run.trial073.stdout: Installing : nvme-cli-2.16-1.el9.x86_64 29/37 2026-02-22T23:23:53.081 INFO:teuthology.orchestra.run.trial073.stdout: Running scriptlet: nvme-cli-2.16-1.el9.x86_64 29/37 2026-02-22T23:23:53.082 INFO:teuthology.orchestra.run.trial073.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service → /usr/lib/systemd/system/nvmefc-boot-connections.service. 2026-02-22T23:23:53.082 INFO:teuthology.orchestra.run.trial073.stdout: 2026-02-22T23:23:53.117 INFO:teuthology.orchestra.run.trial073.stdout: Installing : mailcap-2.1.49-5.el9.noarch 30/37 2026-02-22T23:23:53.119 INFO:teuthology.orchestra.run.trial073.stdout: Installing : python3-ceph-common-2:19.2.3-689.gf90f4eae.el9.x86 31/37 2026-02-22T23:23:54.099 INFO:teuthology.orchestra.run.trial073.stdout: Running scriptlet: ceph-common-2:19.2.3-689.gf90f4eae.el9.x86_64 32/37 2026-02-22T23:23:54.102 INFO:teuthology.orchestra.run.trial073.stdout: Installing : ceph-common-2:19.2.3-689.gf90f4eae.el9.x86_64 32/37 2026-02-22T23:23:54.387 INFO:teuthology.orchestra.run.trial073.stdout: Running scriptlet: ceph-common-2:19.2.3-689.gf90f4eae.el9.x86_64 32/37 2026-02-22T23:23:54.390 INFO:teuthology.orchestra.run.trial073.stdout: Installing : ceph-base-2:19.2.3-689.gf90f4eae.el9.x86_64 33/37 2026-02-22T23:23:54.432 INFO:teuthology.orchestra.run.trial073.stdout: Running scriptlet: ceph-base-2:19.2.3-689.gf90f4eae.el9.x86_64 33/37 2026-02-22T23:23:54.432 INFO:teuthology.orchestra.run.trial073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2026-02-22T23:23:54.432 INFO:teuthology.orchestra.run.trial073.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2026-02-22T23:23:54.432 INFO:teuthology.orchestra.run.trial073.stdout: 2026-02-22T23:23:54.435 INFO:teuthology.orchestra.run.trial073.stdout: Installing : ceph-selinux-2:19.2.3-689.gf90f4eae.el9.x86_64 34/37 2026-02-22T23:23:59.012 INFO:teuthology.orchestra.run.trial073.stdout: Running scriptlet: ceph-selinux-2:19.2.3-689.gf90f4eae.el9.x86_64 34/37 2026-02-22T23:23:59.012 INFO:teuthology.orchestra.run.trial073.stdout:skipping the directory /sys 2026-02-22T23:23:59.012 INFO:teuthology.orchestra.run.trial073.stdout:skipping the directory /proc 2026-02-22T23:23:59.012 INFO:teuthology.orchestra.run.trial073.stdout:skipping the directory /mnt 2026-02-22T23:23:59.012 INFO:teuthology.orchestra.run.trial073.stdout:skipping the directory /var/tmp 2026-02-22T23:23:59.012 INFO:teuthology.orchestra.run.trial073.stdout:skipping the directory /home 2026-02-22T23:23:59.013 INFO:teuthology.orchestra.run.trial073.stdout:skipping the directory /root 2026-02-22T23:23:59.013 INFO:teuthology.orchestra.run.trial073.stdout:skipping the directory /tmp 2026-02-22T23:23:59.013 INFO:teuthology.orchestra.run.trial073.stdout: 2026-02-22T23:23:59.461 INFO:teuthology.orchestra.run.trial073.stdout: Installing : ceph-radosgw-2:19.2.3-689.gf90f4eae.el9.x86_64 35/37 2026-02-22T23:23:59.485 INFO:teuthology.orchestra.run.trial073.stdout: Running scriptlet: ceph-radosgw-2:19.2.3-689.gf90f4eae.el9.x86_64 35/37 2026-02-22T23:23:59.485 INFO:teuthology.orchestra.run.trial073.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-22T23:23:59.485 INFO:teuthology.orchestra.run.trial073.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2026-02-22T23:23:59.485 INFO:teuthology.orchestra.run.trial073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-22T23:23:59.485 INFO:teuthology.orchestra.run.trial073.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-22T23:23:59.485 INFO:teuthology.orchestra.run.trial073.stdout: 2026-02-22T23:23:59.487 INFO:teuthology.orchestra.run.trial073.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 36/37 2026-02-22T23:23:59.500 INFO:teuthology.orchestra.run.trial073.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 36/37 2026-02-22T23:23:59.500 INFO:teuthology.orchestra.run.trial073.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 37/37 2026-02-22T23:23:59.555 INFO:teuthology.orchestra.run.trial073.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 37/37 2026-02-22T23:23:59.556 INFO:teuthology.orchestra.run.trial073.stdout:Creating group 'qat' with GID 992. 2026-02-22T23:23:59.556 INFO:teuthology.orchestra.run.trial073.stdout: 2026-02-22T23:23:59.836 INFO:teuthology.orchestra.run.trial073.stdout: Verifying : ceph-base-2:19.2.3-689.gf90f4eae.el9.x86_64 1/37 2026-02-22T23:23:59.836 INFO:teuthology.orchestra.run.trial073.stdout: Verifying : ceph-common-2:19.2.3-689.gf90f4eae.el9.x86_64 2/37 2026-02-22T23:23:59.836 INFO:teuthology.orchestra.run.trial073.stdout: Verifying : ceph-radosgw-2:19.2.3-689.gf90f4eae.el9.x86_64 3/37 2026-02-22T23:23:59.836 INFO:teuthology.orchestra.run.trial073.stdout: Verifying : ceph-selinux-2:19.2.3-689.gf90f4eae.el9.x86_64 4/37 2026-02-22T23:23:59.836 INFO:teuthology.orchestra.run.trial073.stdout: Verifying : libcephfs2-2:19.2.3-689.gf90f4eae.el9.x86_64 5/37 2026-02-22T23:23:59.836 INFO:teuthology.orchestra.run.trial073.stdout: Verifying : libradosstriper1-2:19.2.3-689.gf90f4eae.el9.x86_64 6/37 2026-02-22T23:23:59.837 INFO:teuthology.orchestra.run.trial073.stdout: Verifying : librgw2-2:19.2.3-689.gf90f4eae.el9.x86_64 7/37 2026-02-22T23:23:59.837 INFO:teuthology.orchestra.run.trial073.stdout: Verifying : python3-ceph-argparse-2:19.2.3-689.gf90f4eae.el9.x 8/37 2026-02-22T23:23:59.837 INFO:teuthology.orchestra.run.trial073.stdout: Verifying : python3-ceph-common-2:19.2.3-689.gf90f4eae.el9.x86 9/37 2026-02-22T23:23:59.837 INFO:teuthology.orchestra.run.trial073.stdout: Verifying : python3-cephfs-2:19.2.3-689.gf90f4eae.el9.x86_64 10/37 2026-02-22T23:23:59.837 INFO:teuthology.orchestra.run.trial073.stdout: Verifying : python3-rados-2:19.2.3-689.gf90f4eae.el9.x86_64 11/37 2026-02-22T23:23:59.837 INFO:teuthology.orchestra.run.trial073.stdout: Verifying : python3-rbd-2:19.2.3-689.gf90f4eae.el9.x86_64 12/37 2026-02-22T23:23:59.837 INFO:teuthology.orchestra.run.trial073.stdout: Verifying : python3-rgw-2:19.2.3-689.gf90f4eae.el9.x86_64 13/37 2026-02-22T23:23:59.837 INFO:teuthology.orchestra.run.trial073.stdout: Verifying : mailcap-2.1.49-5.el9.noarch 14/37 2026-02-22T23:23:59.837 INFO:teuthology.orchestra.run.trial073.stdout: Verifying : nvme-cli-2.16-1.el9.x86_64 15/37 2026-02-22T23:23:59.837 INFO:teuthology.orchestra.run.trial073.stdout: Verifying : pciutils-3.7.0-7.el9.x86_64 16/37 2026-02-22T23:23:59.837 INFO:teuthology.orchestra.run.trial073.stdout: Verifying : boost-program-options-1.75.0-13.el9.x86_64 17/37 2026-02-22T23:23:59.838 INFO:teuthology.orchestra.run.trial073.stdout: Verifying : libnbd-1.20.3-4.el9.x86_64 18/37 2026-02-22T23:23:59.838 INFO:teuthology.orchestra.run.trial073.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 19/37 2026-02-22T23:23:59.838 INFO:teuthology.orchestra.run.trial073.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 20/37 2026-02-22T23:23:59.838 INFO:teuthology.orchestra.run.trial073.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 21/37 2026-02-22T23:23:59.838 INFO:teuthology.orchestra.run.trial073.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 22/37 2026-02-22T23:23:59.838 INFO:teuthology.orchestra.run.trial073.stdout: Verifying : qatlib-25.08.0-2.el9.x86_64 23/37 2026-02-22T23:23:59.838 INFO:teuthology.orchestra.run.trial073.stdout: Verifying : qatlib-service-25.08.0-2.el9.x86_64 24/37 2026-02-22T23:23:59.839 INFO:teuthology.orchestra.run.trial073.stdout: Verifying : qatzip-libs-1.3.1-1.el9.x86_64 25/37 2026-02-22T23:23:59.839 INFO:teuthology.orchestra.run.trial073.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 26/37 2026-02-22T23:23:59.839 INFO:teuthology.orchestra.run.trial073.stdout: Verifying : libarrow-9.0.0-15.el9.x86_64 27/37 2026-02-22T23:23:59.839 INFO:teuthology.orchestra.run.trial073.stdout: Verifying : libarrow-doc-9.0.0-15.el9.noarch 28/37 2026-02-22T23:23:59.839 INFO:teuthology.orchestra.run.trial073.stdout: Verifying : liboath-2.6.12-1.el9.x86_64 29/37 2026-02-22T23:23:59.839 INFO:teuthology.orchestra.run.trial073.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 30/37 2026-02-22T23:23:59.839 INFO:teuthology.orchestra.run.trial073.stdout: Verifying : parquet-libs-9.0.0-15.el9.x86_64 31/37 2026-02-22T23:23:59.839 INFO:teuthology.orchestra.run.trial073.stdout: Verifying : re2-1:20211101-20.el9.x86_64 32/37 2026-02-22T23:23:59.839 INFO:teuthology.orchestra.run.trial073.stdout: Verifying : thrift-0.15.0-4.el9.x86_64 33/37 2026-02-22T23:23:59.840 INFO:teuthology.orchestra.run.trial073.stdout: Verifying : librados2-2:19.2.3-689.gf90f4eae.el9.x86_64 34/37 2026-02-22T23:23:59.840 INFO:teuthology.orchestra.run.trial073.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 35/37 2026-02-22T23:23:59.840 INFO:teuthology.orchestra.run.trial073.stdout: Verifying : librbd1-2:19.2.3-689.gf90f4eae.el9.x86_64 36/37 2026-02-22T23:23:59.895 INFO:teuthology.orchestra.run.trial073.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 37/37 2026-02-22T23:23:59.895 INFO:teuthology.orchestra.run.trial073.stdout: 2026-02-22T23:23:59.895 INFO:teuthology.orchestra.run.trial073.stdout:Upgraded: 2026-02-22T23:23:59.895 INFO:teuthology.orchestra.run.trial073.stdout: librados2-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T23:23:59.895 INFO:teuthology.orchestra.run.trial073.stdout: librbd1-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T23:23:59.895 INFO:teuthology.orchestra.run.trial073.stdout:Installed: 2026-02-22T23:23:59.895 INFO:teuthology.orchestra.run.trial073.stdout: boost-program-options-1.75.0-13.el9.x86_64 2026-02-22T23:23:59.896 INFO:teuthology.orchestra.run.trial073.stdout: ceph-base-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T23:23:59.896 INFO:teuthology.orchestra.run.trial073.stdout: ceph-common-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T23:23:59.896 INFO:teuthology.orchestra.run.trial073.stdout: ceph-radosgw-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T23:23:59.896 INFO:teuthology.orchestra.run.trial073.stdout: ceph-selinux-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T23:23:59.896 INFO:teuthology.orchestra.run.trial073.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2026-02-22T23:23:59.896 INFO:teuthology.orchestra.run.trial073.stdout: libarrow-9.0.0-15.el9.x86_64 2026-02-22T23:23:59.896 INFO:teuthology.orchestra.run.trial073.stdout: libarrow-doc-9.0.0-15.el9.noarch 2026-02-22T23:23:59.896 INFO:teuthology.orchestra.run.trial073.stdout: libcephfs2-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T23:23:59.896 INFO:teuthology.orchestra.run.trial073.stdout: libnbd-1.20.3-4.el9.x86_64 2026-02-22T23:23:59.896 INFO:teuthology.orchestra.run.trial073.stdout: liboath-2.6.12-1.el9.x86_64 2026-02-22T23:23:59.896 INFO:teuthology.orchestra.run.trial073.stdout: libpmemobj-1.12.1-1.el9.x86_64 2026-02-22T23:23:59.896 INFO:teuthology.orchestra.run.trial073.stdout: librabbitmq-0.11.0-7.el9.x86_64 2026-02-22T23:23:59.897 INFO:teuthology.orchestra.run.trial073.stdout: libradosstriper1-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T23:23:59.897 INFO:teuthology.orchestra.run.trial073.stdout: librdkafka-1.6.1-102.el9.x86_64 2026-02-22T23:23:59.897 INFO:teuthology.orchestra.run.trial073.stdout: librgw2-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T23:23:59.897 INFO:teuthology.orchestra.run.trial073.stdout: libunwind-1.6.2-1.el9.x86_64 2026-02-22T23:23:59.897 INFO:teuthology.orchestra.run.trial073.stdout: lttng-ust-2.12.0-6.el9.x86_64 2026-02-22T23:23:59.897 INFO:teuthology.orchestra.run.trial073.stdout: mailcap-2.1.49-5.el9.noarch 2026-02-22T23:23:59.897 INFO:teuthology.orchestra.run.trial073.stdout: nvme-cli-2.16-1.el9.x86_64 2026-02-22T23:23:59.897 INFO:teuthology.orchestra.run.trial073.stdout: parquet-libs-9.0.0-15.el9.x86_64 2026-02-22T23:23:59.897 INFO:teuthology.orchestra.run.trial073.stdout: pciutils-3.7.0-7.el9.x86_64 2026-02-22T23:23:59.897 INFO:teuthology.orchestra.run.trial073.stdout: python3-ceph-argparse-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T23:23:59.897 INFO:teuthology.orchestra.run.trial073.stdout: python3-ceph-common-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T23:23:59.897 INFO:teuthology.orchestra.run.trial073.stdout: python3-cephfs-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T23:23:59.898 INFO:teuthology.orchestra.run.trial073.stdout: python3-rados-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T23:23:59.898 INFO:teuthology.orchestra.run.trial073.stdout: python3-rbd-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T23:23:59.898 INFO:teuthology.orchestra.run.trial073.stdout: python3-rgw-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T23:23:59.898 INFO:teuthology.orchestra.run.trial073.stdout: qatlib-25.08.0-2.el9.x86_64 2026-02-22T23:23:59.898 INFO:teuthology.orchestra.run.trial073.stdout: qatlib-service-25.08.0-2.el9.x86_64 2026-02-22T23:23:59.898 INFO:teuthology.orchestra.run.trial073.stdout: qatzip-libs-1.3.1-1.el9.x86_64 2026-02-22T23:23:59.898 INFO:teuthology.orchestra.run.trial073.stdout: re2-1:20211101-20.el9.x86_64 2026-02-22T23:23:59.898 INFO:teuthology.orchestra.run.trial073.stdout: thrift-0.15.0-4.el9.x86_64 2026-02-22T23:23:59.898 INFO:teuthology.orchestra.run.trial073.stdout: 2026-02-22T23:23:59.898 INFO:teuthology.orchestra.run.trial073.stdout:Complete! 2026-02-22T23:23:59.935 DEBUG:teuthology.orchestra.run.trial073:> sudo yum -y install ceph-test 2026-02-22T23:24:00.250 INFO:teuthology.orchestra.run.trial073.stdout:Last metadata expiration check: 0:00:14 ago on Sun 22 Feb 2026 11:23:46 PM UTC. 2026-02-22T23:24:00.334 INFO:teuthology.orchestra.run.trial073.stdout:Dependencies resolved. 2026-02-22T23:24:00.335 INFO:teuthology.orchestra.run.trial073.stdout:================================================================================ 2026-02-22T23:24:00.335 INFO:teuthology.orchestra.run.trial073.stdout: Package Arch Version Repository Size 2026-02-22T23:24:00.335 INFO:teuthology.orchestra.run.trial073.stdout:================================================================================ 2026-02-22T23:24:00.335 INFO:teuthology.orchestra.run.trial073.stdout:Installing: 2026-02-22T23:24:00.336 INFO:teuthology.orchestra.run.trial073.stdout: ceph-test x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 50 M 2026-02-22T23:24:00.336 INFO:teuthology.orchestra.run.trial073.stdout:Installing dependencies: 2026-02-22T23:24:00.336 INFO:teuthology.orchestra.run.trial073.stdout: libcephsqlite x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 163 k 2026-02-22T23:24:00.336 INFO:teuthology.orchestra.run.trial073.stdout: libxslt x86_64 1.1.34-12.el9 appstream 233 k 2026-02-22T23:24:00.336 INFO:teuthology.orchestra.run.trial073.stdout: socat x86_64 1.7.4.1-8.el9 appstream 303 k 2026-02-22T23:24:00.336 INFO:teuthology.orchestra.run.trial073.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2026-02-22T23:24:00.336 INFO:teuthology.orchestra.run.trial073.stdout: 2026-02-22T23:24:00.336 INFO:teuthology.orchestra.run.trial073.stdout:Transaction Summary 2026-02-22T23:24:00.336 INFO:teuthology.orchestra.run.trial073.stdout:================================================================================ 2026-02-22T23:24:00.336 INFO:teuthology.orchestra.run.trial073.stdout:Install 5 Packages 2026-02-22T23:24:00.336 INFO:teuthology.orchestra.run.trial073.stdout: 2026-02-22T23:24:00.337 INFO:teuthology.orchestra.run.trial073.stdout:Total download size: 50 M 2026-02-22T23:24:00.337 INFO:teuthology.orchestra.run.trial073.stdout:Installed size: 212 M 2026-02-22T23:24:00.337 INFO:teuthology.orchestra.run.trial073.stdout:Downloading Packages: 2026-02-22T23:24:00.777 INFO:teuthology.orchestra.run.trial073.stdout:(1/5): libcephsqlite-19.2.3-689.gf90f4eae.el9.x 428 kB/s | 163 kB 00:00 2026-02-22T23:24:01.175 INFO:teuthology.orchestra.run.trial073.stdout:(2/5): libxslt-1.1.34-12.el9.x86_64.rpm 299 kB/s | 233 kB 00:00 2026-02-22T23:24:01.258 INFO:teuthology.orchestra.run.trial073.stdout:(3/5): xmlstarlet-1.6.1-20.el9.x86_64.rpm 769 kB/s | 64 kB 00:00 2026-02-22T23:24:01.366 INFO:teuthology.orchestra.run.trial045.stdout:CentOS Stream 9 - AppStream 1.1 MB/s | 27 MB 00:24 2026-02-22T23:24:01.567 INFO:teuthology.orchestra.run.trial073.stdout:(4/5): socat-1.7.4.1-8.el9.x86_64.rpm 384 kB/s | 303 kB 00:00 2026-02-22T23:24:02.453 INFO:teuthology.orchestra.run.trial073.stdout:(5/5): ceph-test-19.2.3-689.gf90f4eae.el9.x86_6 24 MB/s | 50 MB 00:02 2026-02-22T23:24:02.455 INFO:teuthology.orchestra.run.trial073.stdout:-------------------------------------------------------------------------------- 2026-02-22T23:24:02.455 INFO:teuthology.orchestra.run.trial073.stdout:Total 24 MB/s | 50 MB 00:02 2026-02-22T23:24:02.483 INFO:teuthology.orchestra.run.trial073.stdout:Running transaction check 2026-02-22T23:24:02.493 INFO:teuthology.orchestra.run.trial073.stdout:Transaction check succeeded. 2026-02-22T23:24:02.493 INFO:teuthology.orchestra.run.trial073.stdout:Running transaction test 2026-02-22T23:24:02.680 INFO:teuthology.orchestra.run.trial073.stdout:Transaction test succeeded. 2026-02-22T23:24:02.680 INFO:teuthology.orchestra.run.trial073.stdout:Running transaction 2026-02-22T23:24:02.894 INFO:teuthology.orchestra.run.trial073.stdout: Preparing : 1/1 2026-02-22T23:24:02.900 INFO:teuthology.orchestra.run.trial073.stdout: Installing : socat-1.7.4.1-8.el9.x86_64 1/5 2026-02-22T23:24:02.904 INFO:teuthology.orchestra.run.trial073.stdout: Installing : libxslt-1.1.34-12.el9.x86_64 2/5 2026-02-22T23:24:02.912 INFO:teuthology.orchestra.run.trial073.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 3/5 2026-02-22T23:24:02.913 INFO:teuthology.orchestra.run.trial073.stdout: Installing : libcephsqlite-2:19.2.3-689.gf90f4eae.el9.x86_64 4/5 2026-02-22T23:24:04.659 INFO:teuthology.orchestra.run.trial045.stdout:CentOS Stream 9 - CRB 8.3 MB/s | 7.8 MB 00:00 2026-02-22T23:24:05.158 INFO:teuthology.orchestra.run.trial073.stdout: Running scriptlet: libcephsqlite-2:19.2.3-689.gf90f4eae.el9.x86_64 4/5 2026-02-22T23:24:05.176 INFO:teuthology.orchestra.run.trial073.stdout: Installing : ceph-test-2:19.2.3-689.gf90f4eae.el9.x86_64 5/5 2026-02-22T23:24:05.407 INFO:teuthology.orchestra.run.trial073.stdout: Running scriptlet: ceph-test-2:19.2.3-689.gf90f4eae.el9.x86_64 5/5 2026-02-22T23:24:05.408 INFO:teuthology.orchestra.run.trial073.stdout: Verifying : ceph-test-2:19.2.3-689.gf90f4eae.el9.x86_64 1/5 2026-02-22T23:24:05.408 INFO:teuthology.orchestra.run.trial073.stdout: Verifying : libcephsqlite-2:19.2.3-689.gf90f4eae.el9.x86_64 2/5 2026-02-22T23:24:05.408 INFO:teuthology.orchestra.run.trial073.stdout: Verifying : libxslt-1.1.34-12.el9.x86_64 3/5 2026-02-22T23:24:05.408 INFO:teuthology.orchestra.run.trial073.stdout: Verifying : socat-1.7.4.1-8.el9.x86_64 4/5 2026-02-22T23:24:05.462 INFO:teuthology.orchestra.run.trial073.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 5/5 2026-02-22T23:24:05.462 INFO:teuthology.orchestra.run.trial073.stdout: 2026-02-22T23:24:05.462 INFO:teuthology.orchestra.run.trial073.stdout:Installed: 2026-02-22T23:24:05.462 INFO:teuthology.orchestra.run.trial073.stdout: ceph-test-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T23:24:05.462 INFO:teuthology.orchestra.run.trial073.stdout: libcephsqlite-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T23:24:05.462 INFO:teuthology.orchestra.run.trial073.stdout: libxslt-1.1.34-12.el9.x86_64 2026-02-22T23:24:05.462 INFO:teuthology.orchestra.run.trial073.stdout: socat-1.7.4.1-8.el9.x86_64 2026-02-22T23:24:05.463 INFO:teuthology.orchestra.run.trial073.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2026-02-22T23:24:05.463 INFO:teuthology.orchestra.run.trial073.stdout: 2026-02-22T23:24:05.463 INFO:teuthology.orchestra.run.trial073.stdout:Complete! 2026-02-22T23:24:05.498 DEBUG:teuthology.orchestra.run.trial073:> sudo yum -y install ceph 2026-02-22T23:24:05.657 INFO:teuthology.orchestra.run.trial045.stdout:CentOS Stream 9 - Extras packages 72 kB/s | 20 kB 00:00 2026-02-22T23:24:05.801 INFO:teuthology.orchestra.run.trial073.stdout:Last metadata expiration check: 0:00:19 ago on Sun 22 Feb 2026 11:23:46 PM UTC. 2026-02-22T23:24:05.888 INFO:teuthology.orchestra.run.trial073.stdout:Dependencies resolved. 2026-02-22T23:24:05.891 INFO:teuthology.orchestra.run.trial073.stdout:====================================================================================== 2026-02-22T23:24:05.891 INFO:teuthology.orchestra.run.trial073.stdout: Package Arch Version Repository Size 2026-02-22T23:24:05.891 INFO:teuthology.orchestra.run.trial073.stdout:====================================================================================== 2026-02-22T23:24:05.891 INFO:teuthology.orchestra.run.trial073.stdout:Installing: 2026-02-22T23:24:05.891 INFO:teuthology.orchestra.run.trial073.stdout: ceph x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 6.5 k 2026-02-22T23:24:05.891 INFO:teuthology.orchestra.run.trial073.stdout:Installing dependencies: 2026-02-22T23:24:05.891 INFO:teuthology.orchestra.run.trial073.stdout: abseil-cpp x86_64 20211102.0-4.el9 epel 551 k 2026-02-22T23:24:05.892 INFO:teuthology.orchestra.run.trial073.stdout: ceph-grafana-dashboards noarch 2:19.2.3-689.gf90f4eae.el9 ceph-noarch 31 k 2026-02-22T23:24:05.892 INFO:teuthology.orchestra.run.trial073.stdout: ceph-mds x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 2.4 M 2026-02-22T23:24:05.892 INFO:teuthology.orchestra.run.trial073.stdout: ceph-mgr x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 1.1 M 2026-02-22T23:24:05.892 INFO:teuthology.orchestra.run.trial073.stdout: ceph-mgr-modules-core noarch 2:19.2.3-689.gf90f4eae.el9 ceph-noarch 253 k 2026-02-22T23:24:05.892 INFO:teuthology.orchestra.run.trial073.stdout: ceph-mon x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 4.7 M 2026-02-22T23:24:05.892 INFO:teuthology.orchestra.run.trial073.stdout: ceph-osd x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 17 M 2026-02-22T23:24:05.892 INFO:teuthology.orchestra.run.trial073.stdout: ceph-prometheus-alerts noarch 2:19.2.3-689.gf90f4eae.el9 ceph-noarch 17 k 2026-02-22T23:24:05.892 INFO:teuthology.orchestra.run.trial073.stdout: cephadm noarch 2:19.2.3-689.gf90f4eae.el9 ceph-noarch 769 k 2026-02-22T23:24:05.892 INFO:teuthology.orchestra.run.trial073.stdout: cryptsetup x86_64 2.8.1-3.el9 baseos 351 k 2026-02-22T23:24:05.892 INFO:teuthology.orchestra.run.trial073.stdout: flexiblas x86_64 3.0.4-9.el9 appstream 30 k 2026-02-22T23:24:05.892 INFO:teuthology.orchestra.run.trial073.stdout: flexiblas-netlib x86_64 3.0.4-9.el9 appstream 3.0 M 2026-02-22T23:24:05.892 INFO:teuthology.orchestra.run.trial073.stdout: flexiblas-openblas-openmp x86_64 3.0.4-9.el9 appstream 15 k 2026-02-22T23:24:05.892 INFO:teuthology.orchestra.run.trial073.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2026-02-22T23:24:05.892 INFO:teuthology.orchestra.run.trial073.stdout: ledmon-libs x86_64 1.1.0-3.el9 baseos 40 k 2026-02-22T23:24:05.893 INFO:teuthology.orchestra.run.trial073.stdout: libconfig x86_64 1.7.2-9.el9 baseos 72 k 2026-02-22T23:24:05.893 INFO:teuthology.orchestra.run.trial073.stdout: libgfortran x86_64 11.5.0-14.el9 baseos 794 k 2026-02-22T23:24:05.893 INFO:teuthology.orchestra.run.trial073.stdout: libquadmath x86_64 11.5.0-14.el9 baseos 184 k 2026-02-22T23:24:05.893 INFO:teuthology.orchestra.run.trial073.stdout: libstoragemgmt x86_64 1.10.1-1.el9 appstream 246 k 2026-02-22T23:24:05.893 INFO:teuthology.orchestra.run.trial073.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2026-02-22T23:24:05.893 INFO:teuthology.orchestra.run.trial073.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2026-02-22T23:24:05.893 INFO:teuthology.orchestra.run.trial073.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2026-02-22T23:24:05.893 INFO:teuthology.orchestra.run.trial073.stdout: openblas x86_64 0.3.29-1.el9 appstream 42 k 2026-02-22T23:24:05.893 INFO:teuthology.orchestra.run.trial073.stdout: openblas-openmp x86_64 0.3.29-1.el9 appstream 5.3 M 2026-02-22T23:24:05.893 INFO:teuthology.orchestra.run.trial073.stdout: protobuf x86_64 3.14.0-17.el9 appstream 1.0 M 2026-02-22T23:24:05.893 INFO:teuthology.orchestra.run.trial073.stdout: protobuf-compiler x86_64 3.14.0-17.el9 crb 862 k 2026-02-22T23:24:05.893 INFO:teuthology.orchestra.run.trial073.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2026-02-22T23:24:05.893 INFO:teuthology.orchestra.run.trial073.stdout: python3-autocommand noarch 2.2.2-8.el9 epel 29 k 2026-02-22T23:24:05.893 INFO:teuthology.orchestra.run.trial073.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2026-02-22T23:24:05.894 INFO:teuthology.orchestra.run.trial073.stdout: python3-backports-tarfile noarch 1.2.0-1.el9 epel 60 k 2026-02-22T23:24:05.894 INFO:teuthology.orchestra.run.trial073.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2026-02-22T23:24:05.894 INFO:teuthology.orchestra.run.trial073.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2026-02-22T23:24:05.894 INFO:teuthology.orchestra.run.trial073.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2026-02-22T23:24:05.894 INFO:teuthology.orchestra.run.trial073.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2026-02-22T23:24:05.894 INFO:teuthology.orchestra.run.trial073.stdout: python3-cheroot noarch 10.0.1-4.el9 epel 173 k 2026-02-22T23:24:05.894 INFO:teuthology.orchestra.run.trial073.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2026-02-22T23:24:05.894 INFO:teuthology.orchestra.run.trial073.stdout: python3-cryptography x86_64 36.0.1-5.el9 baseos 1.2 M 2026-02-22T23:24:05.894 INFO:teuthology.orchestra.run.trial073.stdout: python3-devel x86_64 3.9.25-3.el9 appstream 244 k 2026-02-22T23:24:05.894 INFO:teuthology.orchestra.run.trial073.stdout: python3-google-auth noarch 1:2.45.0-1.el9 epel 254 k 2026-02-22T23:24:05.894 INFO:teuthology.orchestra.run.trial073.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2026-02-22T23:24:05.894 INFO:teuthology.orchestra.run.trial073.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2026-02-22T23:24:05.894 INFO:teuthology.orchestra.run.trial073.stdout: python3-isodate noarch 0.6.1-3.el9 epel 56 k 2026-02-22T23:24:05.894 INFO:teuthology.orchestra.run.trial073.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2026-02-22T23:24:05.895 INFO:teuthology.orchestra.run.trial073.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2026-02-22T23:24:05.895 INFO:teuthology.orchestra.run.trial073.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2026-02-22T23:24:05.895 INFO:teuthology.orchestra.run.trial073.stdout: python3-jaraco-context noarch 6.0.1-3.el9 epel 20 k 2026-02-22T23:24:05.895 INFO:teuthology.orchestra.run.trial073.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2026-02-22T23:24:05.895 INFO:teuthology.orchestra.run.trial073.stdout: python3-jaraco-text noarch 4.0.0-2.el9 epel 26 k 2026-02-22T23:24:05.895 INFO:teuthology.orchestra.run.trial073.stdout: python3-jinja2 noarch 2.11.3-8.el9 appstream 249 k 2026-02-22T23:24:05.895 INFO:teuthology.orchestra.run.trial073.stdout: python3-kubernetes noarch 1:26.1.0-3.el9 epel 1.0 M 2026-02-22T23:24:05.895 INFO:teuthology.orchestra.run.trial073.stdout: python3-libstoragemgmt x86_64 1.10.1-1.el9 appstream 177 k 2026-02-22T23:24:05.895 INFO:teuthology.orchestra.run.trial073.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2026-02-22T23:24:05.895 INFO:teuthology.orchestra.run.trial073.stdout: python3-lxml x86_64 4.6.5-3.el9 appstream 1.2 M 2026-02-22T23:24:05.895 INFO:teuthology.orchestra.run.trial073.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2026-02-22T23:24:05.895 INFO:teuthology.orchestra.run.trial073.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2026-02-22T23:24:05.895 INFO:teuthology.orchestra.run.trial073.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2026-02-22T23:24:05.895 INFO:teuthology.orchestra.run.trial073.stdout: python3-msgpack x86_64 1.0.3-2.el9 epel 86 k 2026-02-22T23:24:05.896 INFO:teuthology.orchestra.run.trial073.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2026-02-22T23:24:05.896 INFO:teuthology.orchestra.run.trial073.stdout: python3-numpy x86_64 1:1.23.5-2.el9 appstream 6.1 M 2026-02-22T23:24:05.896 INFO:teuthology.orchestra.run.trial073.stdout: python3-numpy-f2py x86_64 1:1.23.5-2.el9 appstream 442 k 2026-02-22T23:24:05.896 INFO:teuthology.orchestra.run.trial073.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2026-02-22T23:24:05.896 INFO:teuthology.orchestra.run.trial073.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2026-02-22T23:24:05.896 INFO:teuthology.orchestra.run.trial073.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2026-02-22T23:24:05.896 INFO:teuthology.orchestra.run.trial073.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2026-02-22T23:24:05.896 INFO:teuthology.orchestra.run.trial073.stdout: python3-protobuf noarch 3.14.0-17.el9 appstream 267 k 2026-02-22T23:24:05.896 INFO:teuthology.orchestra.run.trial073.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2026-02-22T23:24:05.896 INFO:teuthology.orchestra.run.trial073.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2026-02-22T23:24:05.896 INFO:teuthology.orchestra.run.trial073.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2026-02-22T23:24:05.896 INFO:teuthology.orchestra.run.trial073.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2026-02-22T23:24:05.896 INFO:teuthology.orchestra.run.trial073.stdout: python3-pyparsing noarch 2.4.7-9.el9 baseos 150 k 2026-02-22T23:24:05.896 INFO:teuthology.orchestra.run.trial073.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2026-02-22T23:24:05.896 INFO:teuthology.orchestra.run.trial073.stdout: python3-requests noarch 2.25.1-10.el9 baseos 126 k 2026-02-22T23:24:05.897 INFO:teuthology.orchestra.run.trial073.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2026-02-22T23:24:05.897 INFO:teuthology.orchestra.run.trial073.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2026-02-22T23:24:05.897 INFO:teuthology.orchestra.run.trial073.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2026-02-22T23:24:05.897 INFO:teuthology.orchestra.run.trial073.stdout: python3-scipy x86_64 1.9.3-2.el9 appstream 19 M 2026-02-22T23:24:05.897 INFO:teuthology.orchestra.run.trial073.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2026-02-22T23:24:05.897 INFO:teuthology.orchestra.run.trial073.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2026-02-22T23:24:05.897 INFO:teuthology.orchestra.run.trial073.stdout: python3-typing-extensions noarch 4.15.0-1.el9 epel 86 k 2026-02-22T23:24:05.897 INFO:teuthology.orchestra.run.trial073.stdout: python3-urllib3 noarch 1.26.5-7.el9 baseos 218 k 2026-02-22T23:24:05.897 INFO:teuthology.orchestra.run.trial073.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2026-02-22T23:24:05.897 INFO:teuthology.orchestra.run.trial073.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2026-02-22T23:24:05.897 INFO:teuthology.orchestra.run.trial073.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2026-02-22T23:24:05.897 INFO:teuthology.orchestra.run.trial073.stdout: python3-xmlsec x86_64 1.3.13-1.el9 epel 48 k 2026-02-22T23:24:05.897 INFO:teuthology.orchestra.run.trial073.stdout: python3-xmltodict noarch 0.12.0-15.el9 epel 22 k 2026-02-22T23:24:05.897 INFO:teuthology.orchestra.run.trial073.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2026-02-22T23:24:05.898 INFO:teuthology.orchestra.run.trial073.stdout: unzip x86_64 6.0-59.el9 baseos 182 k 2026-02-22T23:24:05.898 INFO:teuthology.orchestra.run.trial073.stdout: xmlsec1 x86_64 1.2.29-13.el9 appstream 189 k 2026-02-22T23:24:05.898 INFO:teuthology.orchestra.run.trial073.stdout: xmlsec1-openssl x86_64 1.2.29-13.el9 appstream 90 k 2026-02-22T23:24:05.898 INFO:teuthology.orchestra.run.trial073.stdout: zip x86_64 3.0-35.el9 baseos 266 k 2026-02-22T23:24:05.898 INFO:teuthology.orchestra.run.trial073.stdout:Installing weak dependencies: 2026-02-22T23:24:05.898 INFO:teuthology.orchestra.run.trial073.stdout: ceph-mgr-cephadm noarch 2:19.2.3-689.gf90f4eae.el9 ceph-noarch 150 k 2026-02-22T23:24:05.898 INFO:teuthology.orchestra.run.trial073.stdout: ceph-mgr-dashboard noarch 2:19.2.3-689.gf90f4eae.el9 ceph-noarch 3.8 M 2026-02-22T23:24:05.898 INFO:teuthology.orchestra.run.trial073.stdout: ceph-mgr-diskprediction-local noarch 2:19.2.3-689.gf90f4eae.el9 ceph-noarch 7.4 M 2026-02-22T23:24:05.898 INFO:teuthology.orchestra.run.trial073.stdout: ceph-mgr-k8sevents noarch 2:19.2.3-689.gf90f4eae.el9 ceph-noarch 22 k 2026-02-22T23:24:05.898 INFO:teuthology.orchestra.run.trial073.stdout: ceph-mgr-rook noarch 2:19.2.3-689.gf90f4eae.el9 ceph-noarch 49 k 2026-02-22T23:24:05.898 INFO:teuthology.orchestra.run.trial073.stdout: ceph-volume noarch 2:19.2.3-689.gf90f4eae.el9 ceph-noarch 299 k 2026-02-22T23:24:05.898 INFO:teuthology.orchestra.run.trial073.stdout: python3-influxdb noarch 5.3.1-1.el9 epel 139 k 2026-02-22T23:24:05.898 INFO:teuthology.orchestra.run.trial073.stdout: python3-saml noarch 1.16.0-1.el9 epel 125 k 2026-02-22T23:24:05.899 INFO:teuthology.orchestra.run.trial073.stdout: 2026-02-22T23:24:05.899 INFO:teuthology.orchestra.run.trial073.stdout:Transaction Summary 2026-02-22T23:24:05.899 INFO:teuthology.orchestra.run.trial073.stdout:====================================================================================== 2026-02-22T23:24:05.899 INFO:teuthology.orchestra.run.trial073.stdout:Install 99 Packages 2026-02-22T23:24:05.899 INFO:teuthology.orchestra.run.trial073.stdout: 2026-02-22T23:24:05.900 INFO:teuthology.orchestra.run.trial073.stdout:Total download size: 95 M 2026-02-22T23:24:05.900 INFO:teuthology.orchestra.run.trial073.stdout:Installed size: 520 M 2026-02-22T23:24:05.900 INFO:teuthology.orchestra.run.trial073.stdout:Downloading Packages: 2026-02-22T23:24:06.196 INFO:teuthology.orchestra.run.trial045.stdout:Extra Packages for Enterprise Linux 42 MB/s | 20 MB 00:00 2026-02-22T23:24:07.019 INFO:teuthology.orchestra.run.trial073.stdout:(1/99): ceph-19.2.3-689.gf90f4eae.el9.x86_64.rp 117 kB/s | 6.5 kB 00:00 2026-02-22T23:24:07.147 INFO:teuthology.orchestra.run.trial073.stdout:(2/99): ceph-mgr-19.2.3-689.gf90f4eae.el9.x86_6 5.9 MB/s | 1.1 MB 00:00 2026-02-22T23:24:07.249 INFO:teuthology.orchestra.run.trial073.stdout:(3/99): ceph-mds-19.2.3-689.gf90f4eae.el9.x86_6 8.5 MB/s | 2.4 MB 00:00 2026-02-22T23:24:07.278 INFO:teuthology.orchestra.run.trial073.stdout:(4/99): ceph-grafana-dashboards-19.2.3-689.gf90 1.1 MB/s | 31 kB 00:00 2026-02-22T23:24:07.307 INFO:teuthology.orchestra.run.trial073.stdout:(5/99): ceph-mgr-cephadm-19.2.3-689.gf90f4eae.e 5.0 MB/s | 150 kB 00:00 2026-02-22T23:24:07.681 INFO:teuthology.orchestra.run.trial073.stdout:(6/99): ceph-mgr-dashboard-19.2.3-689.gf90f4eae 10 MB/s | 3.8 MB 00:00 2026-02-22T23:24:07.736 INFO:teuthology.orchestra.run.trial073.stdout:(7/99): ceph-mon-19.2.3-689.gf90f4eae.el9.x86_6 6.6 MB/s | 4.7 MB 00:00 2026-02-22T23:24:07.782 INFO:teuthology.orchestra.run.trial073.stdout:(8/99): ceph-mgr-k8sevents-19.2.3-689.gf90f4eae 475 kB/s | 22 kB 00:00 2026-02-22T23:24:07.831 INFO:teuthology.orchestra.run.trial073.stdout:(9/99): ceph-mgr-modules-core-19.2.3-689.gf90f4 5.1 MB/s | 253 kB 00:00 2026-02-22T23:24:07.878 INFO:teuthology.orchestra.run.trial073.stdout:(10/99): ceph-mgr-rook-19.2.3-689.gf90f4eae.el9 1.0 MB/s | 49 kB 00:00 2026-02-22T23:24:07.926 INFO:teuthology.orchestra.run.trial073.stdout:(11/99): ceph-prometheus-alerts-19.2.3-689.gf90 352 kB/s | 17 kB 00:00 2026-02-22T23:24:07.986 INFO:teuthology.orchestra.run.trial073.stdout:(12/99): ceph-volume-19.2.3-689.gf90f4eae.el9.n 4.9 MB/s | 299 kB 00:00 2026-02-22T23:24:08.110 INFO:teuthology.orchestra.run.trial073.stdout:(13/99): cephadm-19.2.3-689.gf90f4eae.el9.noarc 6.0 MB/s | 769 kB 00:00 2026-02-22T23:24:08.176 INFO:teuthology.orchestra.run.trial073.stdout:(14/99): cryptsetup-2.8.1-3.el9.x86_64.rpm 5.2 MB/s | 351 kB 00:00 2026-02-22T23:24:08.207 INFO:teuthology.orchestra.run.trial073.stdout:(15/99): ledmon-libs-1.1.0-3.el9.x86_64.rpm 1.3 MB/s | 40 kB 00:00 2026-02-22T23:24:08.235 INFO:teuthology.orchestra.run.trial073.stdout:(16/99): libconfig-1.7.2-9.el9.x86_64.rpm 2.6 MB/s | 72 kB 00:00 2026-02-22T23:24:08.270 INFO:teuthology.orchestra.run.trial073.stdout:(17/99): ceph-mgr-diskprediction-local-19.2.3-6 13 MB/s | 7.4 MB 00:00 2026-02-22T23:24:08.274 INFO:teuthology.orchestra.run.trial073.stdout:(18/99): libgfortran-11.5.0-14.el9.x86_64.rpm 20 MB/s | 794 kB 00:00 2026-02-22T23:24:08.311 INFO:teuthology.orchestra.run.trial073.stdout:(19/99): libquadmath-11.5.0-14.el9.x86_64.rpm 4.4 MB/s | 184 kB 00:00 2026-02-22T23:24:08.317 INFO:teuthology.orchestra.run.trial073.stdout:(20/99): python3-cffi-1.14.5-5.el9.x86_64.rpm 5.8 MB/s | 253 kB 00:00 2026-02-22T23:24:08.350 INFO:teuthology.orchestra.run.trial073.stdout:(21/99): python3-ply-3.11-14.el9.noarch.rpm 3.1 MB/s | 106 kB 00:00 2026-02-22T23:24:08.355 INFO:teuthology.orchestra.run.trial073.stdout:(22/99): python3-cryptography-36.0.1-5.el9.x86_ 28 MB/s | 1.2 MB 00:00 2026-02-22T23:24:08.383 INFO:teuthology.orchestra.run.trial073.stdout:(23/99): python3-pycparser-2.20-6.el9.noarch.rp 4.1 MB/s | 135 kB 00:00 2026-02-22T23:24:08.388 INFO:teuthology.orchestra.run.trial073.stdout:(24/99): python3-pyparsing-2.4.7-9.el9.noarch.r 4.5 MB/s | 150 kB 00:00 2026-02-22T23:24:08.432 INFO:teuthology.orchestra.run.trial073.stdout:(25/99): ceph-osd-19.2.3-689.gf90f4eae.el9.x86_ 13 MB/s | 17 MB 00:01 2026-02-22T23:24:08.433 INFO:teuthology.orchestra.run.trial073.stdout:(26/99): python3-requests-2.25.1-10.el9.noarch. 2.5 MB/s | 126 kB 00:00 2026-02-22T23:24:08.433 INFO:teuthology.orchestra.run.trial073.stdout:(27/99): python3-urllib3-1.26.5-7.el9.noarch.rp 4.8 MB/s | 218 kB 00:00 2026-02-22T23:24:08.476 INFO:teuthology.orchestra.run.trial073.stdout:(28/99): unzip-6.0-59.el9.x86_64.rpm 4.0 MB/s | 182 kB 00:00 2026-02-22T23:24:08.478 INFO:teuthology.orchestra.run.trial073.stdout:(29/99): zip-3.0-35.el9.x86_64.rpm 5.8 MB/s | 266 kB 00:00 2026-02-22T23:24:08.558 INFO:teuthology.orchestra.run.trial073.stdout:(30/99): flexiblas-openblas-openmp-3.0.4-9.el9. 186 kB/s | 15 kB 00:00 2026-02-22T23:24:08.559 INFO:teuthology.orchestra.run.trial073.stdout:(31/99): flexiblas-3.0.4-9.el9.x86_64.rpm 237 kB/s | 30 kB 00:00 2026-02-22T23:24:08.622 INFO:teuthology.orchestra.run.trial073.stdout:(32/99): libstoragemgmt-1.10.1-1.el9.x86_64.rpm 3.8 MB/s | 246 kB 00:00 2026-02-22T23:24:08.623 INFO:teuthology.orchestra.run.trial073.stdout:(33/99): lua-5.4.4-4.el9.x86_64.rpm 2.9 MB/s | 188 kB 00:00 2026-02-22T23:24:08.644 INFO:teuthology.orchestra.run.trial073.stdout:(34/99): openblas-0.3.29-1.el9.x86_64.rpm 1.9 MB/s | 42 kB 00:00 2026-02-22T23:24:08.686 INFO:teuthology.orchestra.run.trial073.stdout:(35/99): flexiblas-netlib-3.0.4-9.el9.x86_64.rp 14 MB/s | 3.0 MB 00:00 2026-02-22T23:24:08.705 INFO:teuthology.orchestra.run.trial073.stdout:(36/99): protobuf-3.14.0-17.el9.x86_64.rpm 17 MB/s | 1.0 MB 00:00 2026-02-22T23:24:08.731 INFO:teuthology.orchestra.run.trial073.stdout:(37/99): python3-devel-3.9.25-3.el9.x86_64.rpm 9.1 MB/s | 244 kB 00:00 2026-02-22T23:24:08.744 INFO:teuthology.orchestra.run.trial073.stdout:(38/99): python3-babel-2.9.1-2.el9.noarch.rpm 103 MB/s | 6.0 MB 00:00 2026-02-22T23:24:08.760 INFO:teuthology.orchestra.run.trial073.stdout:(39/99): python3-jinja2-2.11.3-8.el9.noarch.rpm 8.5 MB/s | 249 kB 00:00 2026-02-22T23:24:08.768 INFO:teuthology.orchestra.run.trial073.stdout:(40/99): python3-libstoragemgmt-1.10.1-1.el9.x8 7.2 MB/s | 177 kB 00:00 2026-02-22T23:24:08.789 INFO:teuthology.orchestra.run.trial073.stdout:(41/99): python3-lxml-4.6.5-3.el9.x86_64.rpm 43 MB/s | 1.2 MB 00:00 2026-02-22T23:24:08.794 INFO:teuthology.orchestra.run.trial073.stdout:(42/99): python3-mako-1.1.4-6.el9.noarch.rpm 6.5 MB/s | 172 kB 00:00 2026-02-22T23:24:08.812 INFO:teuthology.orchestra.run.trial073.stdout:(43/99): python3-markupsafe-1.1.1-12.el9.x86_64 1.5 MB/s | 35 kB 00:00 2026-02-22T23:24:08.818 INFO:teuthology.orchestra.run.trial073.stdout:(44/99): openblas-openmp-0.3.29-1.el9.x86_64.rp 27 MB/s | 5.3 MB 00:00 2026-02-22T23:24:08.836 INFO:teuthology.orchestra.run.trial073.stdout:(45/99): python3-numpy-f2py-1.23.5-2.el9.x86_64 17 MB/s | 442 kB 00:00 2026-02-22T23:24:08.841 INFO:teuthology.orchestra.run.trial073.stdout:(46/99): python3-packaging-20.9-5.el9.noarch.rp 3.2 MB/s | 77 kB 00:00 2026-02-22T23:24:08.851 INFO:teuthology.orchestra.run.trial073.stdout:(47/99): python3-numpy-1.23.5-2.el9.x86_64.rpm 108 MB/s | 6.1 MB 00:00 2026-02-22T23:24:08.861 INFO:teuthology.orchestra.run.trial073.stdout:(48/99): python3-protobuf-3.14.0-17.el9.noarch. 11 MB/s | 267 kB 00:00 2026-02-22T23:24:08.866 INFO:teuthology.orchestra.run.trial073.stdout:(49/99): python3-pyasn1-0.4.8-6.el9.noarch.rpm 6.3 MB/s | 159 kB 00:00 2026-02-22T23:24:08.876 INFO:teuthology.orchestra.run.trial073.stdout:(50/99): python3-pyasn1-modules-0.4.8-6.el9.noa 11 MB/s | 279 kB 00:00 2026-02-22T23:24:08.884 INFO:teuthology.orchestra.run.trial073.stdout:(51/99): python3-requests-oauthlib-1.3.0-12.el9 2.3 MB/s | 54 kB 00:00 2026-02-22T23:24:08.898 INFO:teuthology.orchestra.run.trial073.stdout:(52/99): python3-toml-0.10.2-6.el9.noarch.rpm 1.8 MB/s | 42 kB 00:00 2026-02-22T23:24:08.907 INFO:teuthology.orchestra.run.trial073.stdout:(53/99): xmlsec1-1.2.29-13.el9.x86_64.rpm 8.2 MB/s | 189 kB 00:00 2026-02-22T23:24:08.921 INFO:teuthology.orchestra.run.trial073.stdout:(54/99): xmlsec1-openssl-1.2.29-13.el9.x86_64.r 3.9 MB/s | 90 kB 00:00 2026-02-22T23:24:08.940 INFO:teuthology.orchestra.run.trial073.stdout:(55/99): lua-devel-5.4.4-4.el9.x86_64.rpm 670 kB/s | 22 kB 00:00 2026-02-22T23:24:08.995 INFO:teuthology.orchestra.run.trial073.stdout:(56/99): protobuf-compiler-3.14.0-17.el9.x86_64 11 MB/s | 862 kB 00:00 2026-02-22T23:24:09.180 INFO:teuthology.orchestra.run.trial073.stdout:(57/99): grpc-data-1.46.7-10.el9.noarch.rpm 105 kB/s | 19 kB 00:00 2026-02-22T23:24:09.308 INFO:teuthology.orchestra.run.trial073.stdout:(58/99): python3-scipy-1.9.3-2.el9.x86_64.rpm 44 MB/s | 19 MB 00:00 2026-02-22T23:24:09.359 INFO:teuthology.orchestra.run.trial045.stdout:lab-extras 1.4 MB/s | 50 kB 00:00 2026-02-22T23:24:09.406 INFO:teuthology.orchestra.run.trial073.stdout:(59/99): luarocks-3.9.2-5.el9.noarch.rpm 670 kB/s | 151 kB 00:00 2026-02-22T23:24:09.420 INFO:teuthology.orchestra.run.trial073.stdout:(60/99): abseil-cpp-20211102.0-4.el9.x86_64.rpm 1.1 MB/s | 551 kB 00:00 2026-02-22T23:24:09.475 INFO:teuthology.orchestra.run.trial073.stdout:(61/99): python3-autocommand-2.2.2-8.el9.noarch 429 kB/s | 29 kB 00:00 2026-02-22T23:24:09.487 INFO:teuthology.orchestra.run.trial073.stdout:(62/99): python3-backports-tarfile-1.2.0-1.el9. 902 kB/s | 60 kB 00:00 2026-02-22T23:24:09.547 INFO:teuthology.orchestra.run.trial073.stdout:(63/99): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 600 kB/s | 43 kB 00:00 2026-02-22T23:24:09.550 INFO:teuthology.orchestra.run.trial073.stdout:(64/99): python3-cachetools-4.2.4-1.el9.noarch. 505 kB/s | 32 kB 00:00 2026-02-22T23:24:09.612 INFO:teuthology.orchestra.run.trial073.stdout:(65/99): python3-certifi-2023.05.07-4.el9.noarc 218 kB/s | 14 kB 00:00 2026-02-22T23:24:09.627 INFO:teuthology.orchestra.run.trial073.stdout:(66/99): python3-cheroot-10.0.1-4.el9.noarch.rp 2.2 MB/s | 173 kB 00:00 2026-02-22T23:24:09.710 INFO:teuthology.orchestra.run.trial073.stdout:(67/99): python3-google-auth-2.45.0-1.el9.noarc 3.0 MB/s | 254 kB 00:00 2026-02-22T23:24:09.768 INFO:teuthology.orchestra.run.trial073.stdout:(68/99): python3-cherrypy-18.6.1-2.el9.noarch.r 2.2 MB/s | 358 kB 00:00 2026-02-22T23:24:09.782 INFO:teuthology.orchestra.run.trial073.stdout:(69/99): python3-asyncssh-2.13.2-5.el9.noarch.r 1.1 MB/s | 548 kB 00:00 2026-02-22T23:24:09.842 INFO:teuthology.orchestra.run.trial073.stdout:(70/99): python3-grpcio-tools-1.46.7-10.el9.x86 1.9 MB/s | 144 kB 00:00 2026-02-22T23:24:09.855 INFO:teuthology.orchestra.run.trial073.stdout:(71/99): python3-influxdb-5.3.1-1.el9.noarch.rp 1.9 MB/s | 139 kB 00:00 2026-02-22T23:24:09.908 INFO:teuthology.orchestra.run.trial073.stdout:(72/99): python3-isodate-0.6.1-3.el9.noarch.rpm 852 kB/s | 56 kB 00:00 2026-02-22T23:24:09.913 INFO:teuthology.orchestra.run.trial073.stdout:(73/99): python3-grpcio-1.46.7-10.el9.x86_64.rp 10 MB/s | 2.0 MB 00:00 2026-02-22T23:24:09.917 INFO:teuthology.orchestra.run.trial073.stdout:(74/99): python3-jaraco-8.2.1-3.el9.noarch.rpm 173 kB/s | 11 kB 00:00 2026-02-22T23:24:09.970 INFO:teuthology.orchestra.run.trial073.stdout:(75/99): python3-jaraco-classes-3.2.1-5.el9.noa 284 kB/s | 18 kB 00:00 2026-02-22T23:24:09.976 INFO:teuthology.orchestra.run.trial073.stdout:(76/99): python3-jaraco-collections-3.0.0-8.el9 368 kB/s | 23 kB 00:00 2026-02-22T23:24:09.979 INFO:teuthology.orchestra.run.trial073.stdout:(77/99): python3-jaraco-context-6.0.1-3.el9.noa 317 kB/s | 20 kB 00:00 2026-02-22T23:24:10.032 INFO:teuthology.orchestra.run.trial073.stdout:(78/99): python3-jaraco-functools-3.5.0-2.el9.n 313 kB/s | 19 kB 00:00 2026-02-22T23:24:10.039 INFO:teuthology.orchestra.run.trial073.stdout:(79/99): python3-jaraco-text-4.0.0-2.el9.noarch 420 kB/s | 26 kB 00:00 2026-02-22T23:24:10.097 INFO:teuthology.orchestra.run.trial073.stdout:(80/99): python3-logutils-0.3.5-21.el9.noarch.r 715 kB/s | 46 kB 00:00 2026-02-22T23:24:10.103 INFO:teuthology.orchestra.run.trial073.stdout:(81/99): python3-more-itertools-8.12.0-2.el9.no 1.2 MB/s | 79 kB 00:00 2026-02-22T23:24:10.126 INFO:teuthology.orchestra.run.trial073.stdout:(82/99): python3-kubernetes-26.1.0-3.el9.noarch 6.9 MB/s | 1.0 MB 00:00 2026-02-22T23:24:10.166 INFO:teuthology.orchestra.run.trial073.stdout:(83/99): python3-msgpack-1.0.3-2.el9.x86_64.rpm 1.2 MB/s | 86 kB 00:00 2026-02-22T23:24:10.167 INFO:teuthology.orchestra.run.trial073.stdout:(84/99): python3-natsort-7.1.1-5.el9.noarch.rpm 902 kB/s | 58 kB 00:00 2026-02-22T23:24:10.195 INFO:teuthology.orchestra.run.trial073.stdout:(85/99): python3-pecan-1.4.2-3.el9.noarch.rpm 3.9 MB/s | 272 kB 00:00 2026-02-22T23:24:10.228 INFO:teuthology.orchestra.run.trial073.stdout:(86/99): python3-portend-3.1.0-2.el9.noarch.rpm 264 kB/s | 16 kB 00:00 2026-02-22T23:24:10.231 INFO:teuthology.orchestra.run.trial073.stdout:(87/99): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.4 MB/s | 90 kB 00:00 2026-02-22T23:24:10.257 INFO:teuthology.orchestra.run.trial073.stdout:(88/99): python3-repoze-lru-0.7-16.el9.noarch.r 495 kB/s | 31 kB 00:00 2026-02-22T23:24:10.294 INFO:teuthology.orchestra.run.trial073.stdout:(89/99): python3-rsa-4.9-2.el9.noarch.rpm 935 kB/s | 59 kB 00:00 2026-02-22T23:24:10.306 INFO:teuthology.orchestra.run.trial073.stdout:(90/99): python3-routes-2.5.1-5.el9.noarch.rpm 2.4 MB/s | 188 kB 00:00 2026-02-22T23:24:10.322 INFO:teuthology.orchestra.run.trial073.stdout:(91/99): python3-saml-1.16.0-1.el9.noarch.rpm 1.9 MB/s | 125 kB 00:00 2026-02-22T23:24:10.357 INFO:teuthology.orchestra.run.trial073.stdout:(92/99): python3-tempora-5.0.0-2.el9.noarch.rpm 568 kB/s | 36 kB 00:00 2026-02-22T23:24:10.375 INFO:teuthology.orchestra.run.trial073.stdout:(93/99): python3-typing-extensions-4.15.0-1.el9 1.2 MB/s | 86 kB 00:00 2026-02-22T23:24:10.389 INFO:teuthology.orchestra.run.trial073.stdout:(94/99): python3-webob-1.8.8-2.el9.noarch.rpm 3.3 MB/s | 230 kB 00:00 2026-02-22T23:24:10.421 INFO:teuthology.orchestra.run.trial073.stdout:(95/99): python3-websocket-client-1.2.3-2.el9.n 1.4 MB/s | 90 kB 00:00 2026-02-22T23:24:10.452 INFO:teuthology.orchestra.run.trial073.stdout:(96/99): python3-xmlsec-1.3.13-1.el9.x86_64.rpm 776 kB/s | 48 kB 00:00 2026-02-22T23:24:10.475 INFO:teuthology.orchestra.run.trial073.stdout:(97/99): python3-werkzeug-2.0.3-3.el9.1.noarch. 4.2 MB/s | 427 kB 00:00 2026-02-22T23:24:10.485 INFO:teuthology.orchestra.run.trial073.stdout:(98/99): python3-xmltodict-0.12.0-15.el9.noarch 348 kB/s | 22 kB 00:00 2026-02-22T23:24:10.515 INFO:teuthology.orchestra.run.trial073.stdout:(99/99): python3-zc-lockfile-2.0-10.el9.noarch. 318 kB/s | 20 kB 00:00 2026-02-22T23:24:10.516 INFO:teuthology.orchestra.run.trial073.stdout:-------------------------------------------------------------------------------- 2026-02-22T23:24:10.516 INFO:teuthology.orchestra.run.trial073.stdout:Total 21 MB/s | 95 MB 00:04 2026-02-22T23:24:10.548 INFO:teuthology.orchestra.run.trial045.stdout:Dependencies resolved. 2026-02-22T23:24:10.550 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-22T23:24:10.550 INFO:teuthology.orchestra.run.trial045.stdout: Package Arch Version Repository Size 2026-02-22T23:24:10.550 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-22T23:24:10.550 INFO:teuthology.orchestra.run.trial045.stdout:Installing: 2026-02-22T23:24:10.550 INFO:teuthology.orchestra.run.trial045.stdout: ceph-radosgw x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 11 M 2026-02-22T23:24:10.550 INFO:teuthology.orchestra.run.trial045.stdout:Upgrading: 2026-02-22T23:24:10.550 INFO:teuthology.orchestra.run.trial045.stdout: librados2 x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 3.4 M 2026-02-22T23:24:10.550 INFO:teuthology.orchestra.run.trial045.stdout: librbd1 x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 3.2 M 2026-02-22T23:24:10.550 INFO:teuthology.orchestra.run.trial045.stdout:Installing dependencies: 2026-02-22T23:24:10.550 INFO:teuthology.orchestra.run.trial045.stdout: boost-program-options x86_64 1.75.0-13.el9 appstream 104 k 2026-02-22T23:24:10.550 INFO:teuthology.orchestra.run.trial045.stdout: ceph-base x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 5.5 M 2026-02-22T23:24:10.551 INFO:teuthology.orchestra.run.trial045.stdout: ceph-common x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 22 M 2026-02-22T23:24:10.551 INFO:teuthology.orchestra.run.trial045.stdout: ceph-selinux x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 25 k 2026-02-22T23:24:10.551 INFO:teuthology.orchestra.run.trial045.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2026-02-22T23:24:10.551 INFO:teuthology.orchestra.run.trial045.stdout: libarrow x86_64 9.0.0-15.el9 epel 4.4 M 2026-02-22T23:24:10.551 INFO:teuthology.orchestra.run.trial045.stdout: libarrow-doc noarch 9.0.0-15.el9 epel 25 k 2026-02-22T23:24:10.551 INFO:teuthology.orchestra.run.trial045.stdout: libcephfs2 x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 999 k 2026-02-22T23:24:10.551 INFO:teuthology.orchestra.run.trial045.stdout: libnbd x86_64 1.20.3-4.el9 appstream 164 k 2026-02-22T23:24:10.551 INFO:teuthology.orchestra.run.trial045.stdout: liboath x86_64 2.6.12-1.el9 epel 49 k 2026-02-22T23:24:10.551 INFO:teuthology.orchestra.run.trial045.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2026-02-22T23:24:10.551 INFO:teuthology.orchestra.run.trial045.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2026-02-22T23:24:10.551 INFO:teuthology.orchestra.run.trial045.stdout: libradosstriper1 x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 503 k 2026-02-22T23:24:10.551 INFO:teuthology.orchestra.run.trial045.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2026-02-22T23:24:10.552 INFO:teuthology.orchestra.run.trial045.stdout: librgw2 x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 5.4 M 2026-02-22T23:24:10.552 INFO:teuthology.orchestra.run.trial045.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2026-02-22T23:24:10.552 INFO:teuthology.orchestra.run.trial045.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2026-02-22T23:24:10.552 INFO:teuthology.orchestra.run.trial045.stdout: mailcap noarch 2.1.49-5.el9 baseos 33 k 2026-02-22T23:24:10.552 INFO:teuthology.orchestra.run.trial045.stdout: parquet-libs x86_64 9.0.0-15.el9 epel 838 k 2026-02-22T23:24:10.552 INFO:teuthology.orchestra.run.trial045.stdout: pciutils x86_64 3.7.0-7.el9 baseos 93 k 2026-02-22T23:24:10.552 INFO:teuthology.orchestra.run.trial045.stdout: python3-ceph-argparse x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 45 k 2026-02-22T23:24:10.552 INFO:teuthology.orchestra.run.trial045.stdout: python3-ceph-common x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 142 k 2026-02-22T23:24:10.552 INFO:teuthology.orchestra.run.trial045.stdout: python3-cephfs x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 165 k 2026-02-22T23:24:10.552 INFO:teuthology.orchestra.run.trial045.stdout: python3-rados x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 322 k 2026-02-22T23:24:10.552 INFO:teuthology.orchestra.run.trial045.stdout: python3-rbd x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 303 k 2026-02-22T23:24:10.552 INFO:teuthology.orchestra.run.trial045.stdout: python3-rgw x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 100 k 2026-02-22T23:24:10.553 INFO:teuthology.orchestra.run.trial045.stdout: qatlib x86_64 25.08.0-2.el9 appstream 240 k 2026-02-22T23:24:10.553 INFO:teuthology.orchestra.run.trial045.stdout: qatzip-libs x86_64 1.3.1-1.el9 appstream 66 k 2026-02-22T23:24:10.553 INFO:teuthology.orchestra.run.trial045.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2026-02-22T23:24:10.553 INFO:teuthology.orchestra.run.trial045.stdout: thrift x86_64 0.15.0-4.el9 epel 1.6 M 2026-02-22T23:24:10.553 INFO:teuthology.orchestra.run.trial045.stdout:Installing weak dependencies: 2026-02-22T23:24:10.553 INFO:teuthology.orchestra.run.trial045.stdout: nvme-cli x86_64 2.16-1.el9 baseos 1.2 M 2026-02-22T23:24:10.553 INFO:teuthology.orchestra.run.trial045.stdout: qatlib-service x86_64 25.08.0-2.el9 appstream 37 k 2026-02-22T23:24:10.553 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-22T23:24:10.553 INFO:teuthology.orchestra.run.trial045.stdout:Transaction Summary 2026-02-22T23:24:10.553 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-22T23:24:10.553 INFO:teuthology.orchestra.run.trial045.stdout:Install 33 Packages 2026-02-22T23:24:10.553 INFO:teuthology.orchestra.run.trial045.stdout:Upgrade 2 Packages 2026-02-22T23:24:10.554 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-22T23:24:10.554 INFO:teuthology.orchestra.run.trial045.stdout:Total download size: 63 M 2026-02-22T23:24:10.554 INFO:teuthology.orchestra.run.trial045.stdout:Downloading Packages: 2026-02-22T23:24:10.959 INFO:teuthology.orchestra.run.trial073.stdout:Running transaction check 2026-02-22T23:24:10.996 INFO:teuthology.orchestra.run.trial073.stdout:Transaction check succeeded. 2026-02-22T23:24:10.996 INFO:teuthology.orchestra.run.trial073.stdout:Running transaction test 2026-02-22T23:24:11.414 INFO:teuthology.orchestra.run.trial073.stdout:Transaction test succeeded. 2026-02-22T23:24:11.414 INFO:teuthology.orchestra.run.trial073.stdout:Running transaction 2026-02-22T23:24:11.821 INFO:teuthology.orchestra.run.trial045.stdout:(1/35): ceph-base-19.2.3-689.gf90f4eae.el9.x86_ 11 MB/s | 5.5 MB 00:00 2026-02-22T23:24:11.862 INFO:teuthology.orchestra.run.trial045.stdout:(2/35): ceph-selinux-19.2.3-689.gf90f4eae.el9.x 626 kB/s | 25 kB 00:00 2026-02-22T23:24:11.891 INFO:teuthology.orchestra.run.trial073.stdout: Preparing : 1/1 2026-02-22T23:24:11.893 INFO:teuthology.orchestra.run.trial073.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/99 2026-02-22T23:24:11.924 INFO:teuthology.orchestra.run.trial073.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/99 2026-02-22T23:24:11.930 INFO:teuthology.orchestra.run.trial073.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 3/99 2026-02-22T23:24:11.951 INFO:teuthology.orchestra.run.trial073.stdout: Installing : xmlsec1-1.2.29-13.el9.x86_64 4/99 2026-02-22T23:24:11.957 INFO:teuthology.orchestra.run.trial073.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 5/99 2026-02-22T23:24:11.991 INFO:teuthology.orchestra.run.trial073.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 6/99 2026-02-22T23:24:11.994 INFO:teuthology.orchestra.run.trial045.stdout:(3/35): ceph-radosgw-19.2.3-689.gf90f4eae.el9.x 16 MB/s | 11 MB 00:00 2026-02-22T23:24:11.996 INFO:teuthology.orchestra.run.trial045.stdout:(4/35): libcephfs2-19.2.3-689.gf90f4eae.el9.x86 7.3 MB/s | 999 kB 00:00 2026-02-22T23:24:12.000 INFO:teuthology.orchestra.run.trial073.stdout: Installing : python3-lxml-4.6.5-3.el9.x86_64 7/99 2026-02-22T23:24:12.005 INFO:teuthology.orchestra.run.trial073.stdout: Installing : protobuf-3.14.0-17.el9.x86_64 8/99 2026-02-22T23:24:12.008 INFO:teuthology.orchestra.run.trial073.stdout: Installing : lua-5.4.4-4.el9.x86_64 9/99 2026-02-22T23:24:12.012 INFO:teuthology.orchestra.run.trial073.stdout: Installing : flexiblas-3.0.4-9.el9.x86_64 10/99 2026-02-22T23:24:12.031 INFO:teuthology.orchestra.run.trial045.stdout:(5/35): libradosstriper1-19.2.3-689.gf90f4eae.e 13 MB/s | 503 kB 00:00 2026-02-22T23:24:12.035 INFO:teuthology.orchestra.run.trial073.stdout: Installing : unzip-6.0-59.el9.x86_64 11/99 2026-02-22T23:24:12.048 INFO:teuthology.orchestra.run.trial073.stdout: Installing : python3-urllib3-1.26.5-7.el9.noarch 12/99 2026-02-22T23:24:12.051 INFO:teuthology.orchestra.run.trial073.stdout: Installing : python3-requests-2.25.1-10.el9.noarch 13/99 2026-02-22T23:24:12.057 INFO:teuthology.orchestra.run.trial073.stdout: Installing : libquadmath-11.5.0-14.el9.x86_64 14/99 2026-02-22T23:24:12.059 INFO:teuthology.orchestra.run.trial073.stdout: Installing : libgfortran-11.5.0-14.el9.x86_64 15/99 2026-02-22T23:24:12.070 INFO:teuthology.orchestra.run.trial073.stdout: Installing : ledmon-libs-1.1.0-3.el9.x86_64 16/99 2026-02-22T23:24:12.074 INFO:teuthology.orchestra.run.trial045.stdout:(6/35): python3-ceph-argparse-19.2.3-689.gf90f4 1.0 MB/s | 45 kB 00:00 2026-02-22T23:24:12.076 INFO:teuthology.orchestra.run.trial073.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 17/99 2026-02-22T23:24:12.101 INFO:teuthology.orchestra.run.trial073.stdout: Installing : zip-3.0-35.el9.x86_64 18/99 2026-02-22T23:24:12.104 INFO:teuthology.orchestra.run.trial073.stdout: Installing : luarocks-3.9.2-5.el9.noarch 19/99 2026-02-22T23:24:12.111 INFO:teuthology.orchestra.run.trial073.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 20/99 2026-02-22T23:24:12.117 INFO:teuthology.orchestra.run.trial045.stdout:(7/35): python3-ceph-common-19.2.3-689.gf90f4ea 3.2 MB/s | 142 kB 00:00 2026-02-22T23:24:12.135 INFO:teuthology.orchestra.run.trial073.stdout: Installing : protobuf-compiler-3.14.0-17.el9.x86_64 21/99 2026-02-22T23:24:12.163 INFO:teuthology.orchestra.run.trial045.stdout:(8/35): python3-cephfs-19.2.3-689.gf90f4eae.el9 3.5 MB/s | 165 kB 00:00 2026-02-22T23:24:12.187 INFO:teuthology.orchestra.run.trial073.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 22/99 2026-02-22T23:24:12.200 INFO:teuthology.orchestra.run.trial073.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 23/99 2026-02-22T23:24:12.202 INFO:teuthology.orchestra.run.trial073.stdout: Installing : python3-rsa-4.9-2.el9.noarch 24/99 2026-02-22T23:24:12.207 INFO:teuthology.orchestra.run.trial073.stdout: Installing : xmlsec1-openssl-1.2.29-13.el9.x86_64 25/99 2026-02-22T23:24:12.211 INFO:teuthology.orchestra.run.trial045.stdout:(9/35): python3-rados-19.2.3-689.gf90f4eae.el9. 6.7 MB/s | 322 kB 00:00 2026-02-22T23:24:12.212 INFO:teuthology.orchestra.run.trial073.stdout: Installing : python3-xmlsec-1.3.13-1.el9.x86_64 26/99 2026-02-22T23:24:12.217 INFO:teuthology.orchestra.run.trial073.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 27/99 2026-02-22T23:24:12.220 INFO:teuthology.orchestra.run.trial073.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 28/99 2026-02-22T23:24:12.234 INFO:teuthology.orchestra.run.trial073.stdout: Installing : python3-xmltodict-0.12.0-15.el9.noarch 29/99 2026-02-22T23:24:12.255 INFO:teuthology.orchestra.run.trial073.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 30/99 2026-02-22T23:24:12.260 INFO:teuthology.orchestra.run.trial073.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 31/99 2026-02-22T23:24:12.261 INFO:teuthology.orchestra.run.trial045.stdout:(10/35): python3-rbd-19.2.3-689.gf90f4eae.el9.x 5.8 MB/s | 303 kB 00:00 2026-02-22T23:24:12.265 INFO:teuthology.orchestra.run.trial073.stdout: Installing : python3-typing-extensions-4.15.0-1.el9.noarch 32/99 2026-02-22T23:24:12.276 INFO:teuthology.orchestra.run.trial073.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 33/99 2026-02-22T23:24:12.285 INFO:teuthology.orchestra.run.trial073.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 34/99 2026-02-22T23:24:12.291 INFO:teuthology.orchestra.run.trial073.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 35/99 2026-02-22T23:24:12.308 INFO:teuthology.orchestra.run.trial045.stdout:(11/35): python3-rgw-19.2.3-689.gf90f4eae.el9.x 2.1 MB/s | 100 kB 00:00 2026-02-22T23:24:12.311 INFO:teuthology.orchestra.run.trial073.stdout: Installing : python3-msgpack-1.0.3-2.el9.x86_64 36/99 2026-02-22T23:24:12.320 INFO:teuthology.orchestra.run.trial073.stdout: Installing : python3-influxdb-5.3.1-1.el9.noarch 37/99 2026-02-22T23:24:12.376 INFO:teuthology.orchestra.run.trial073.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 38/99 2026-02-22T23:24:12.388 INFO:teuthology.orchestra.run.trial073.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 39/99 2026-02-22T23:24:12.398 INFO:teuthology.orchestra.run.trial045.stdout:(12/35): librgw2-19.2.3-689.gf90f4eae.el9.x86_6 13 MB/s | 5.4 MB 00:00 2026-02-22T23:24:12.403 INFO:teuthology.orchestra.run.trial073.stdout: Installing : python3-isodate-0.6.1-3.el9.noarch 40/99 2026-02-22T23:24:12.408 INFO:teuthology.orchestra.run.trial073.stdout: Installing : python3-saml-1.16.0-1.el9.noarch 41/99 2026-02-22T23:24:12.415 INFO:teuthology.orchestra.run.trial073.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 42/99 2026-02-22T23:24:12.428 INFO:teuthology.orchestra.run.trial045.stdout:(13/35): ceph-common-19.2.3-689.gf90f4eae.el9.x 19 MB/s | 22 MB 00:01 2026-02-22T23:24:12.456 INFO:teuthology.orchestra.run.trial073.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 43/99 2026-02-22T23:24:12.786 INFO:teuthology.orchestra.run.trial073.stdout: Installing : python3-google-auth-1:2.45.0-1.el9.noarch 44/99 2026-02-22T23:24:12.796 INFO:teuthology.orchestra.run.trial073.stdout: Installing : python3-kubernetes-1:26.1.0-3.el9.noarch 45/99 2026-02-22T23:24:12.800 INFO:teuthology.orchestra.run.trial073.stdout: Installing : python3-backports-tarfile-1.2.0-1.el9.noarch 46/99 2026-02-22T23:24:12.806 INFO:teuthology.orchestra.run.trial073.stdout: Installing : python3-jaraco-context-6.0.1-3.el9.noarch 47/99 2026-02-22T23:24:12.808 INFO:teuthology.orchestra.run.trial073.stdout: Installing : python3-autocommand-2.2.2-8.el9.noarch 48/99 2026-02-22T23:24:12.836 INFO:teuthology.orchestra.run.trial073.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 49/99 2026-02-22T23:24:12.864 INFO:teuthology.orchestra.run.trial045.stdout:(14/35): mailcap-2.1.49-5.el9.noarch.rpm 60 kB/s | 33 kB 00:00 2026-02-22T23:24:12.880 INFO:teuthology.orchestra.run.trial073.stdout: Installing : abseil-cpp-20211102.0-4.el9.x86_64 50/99 2026-02-22T23:24:12.886 INFO:teuthology.orchestra.run.trial073.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 51/99 2026-02-22T23:24:12.890 INFO:teuthology.orchestra.run.trial073.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 52/99 2026-02-22T23:24:12.895 INFO:teuthology.orchestra.run.trial073.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 53/99 2026-02-22T23:24:12.899 INFO:teuthology.orchestra.run.trial073.stdout: Installing : python3-jaraco-text-4.0.0-2.el9.noarch 54/99 2026-02-22T23:24:12.906 INFO:teuthology.orchestra.run.trial073.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 55/99 2026-02-22T23:24:12.909 INFO:teuthology.orchestra.run.trial073.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 56/99 2026-02-22T23:24:12.927 INFO:teuthology.orchestra.run.trial045.stdout:(15/35): boost-program-options-1.75.0-13.el9.x8 1.6 MB/s | 104 kB 00:00 2026-02-22T23:24:12.937 INFO:teuthology.orchestra.run.trial073.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 57/99 2026-02-22T23:24:12.949 INFO:teuthology.orchestra.run.trial073.stdout: Installing : python3-protobuf-3.14.0-17.el9.noarch 58/99 2026-02-22T23:24:12.971 INFO:teuthology.orchestra.run.trial045.stdout:(16/35): libnbd-1.20.3-4.el9.x86_64.rpm 3.7 MB/s | 164 kB 00:00 2026-02-22T23:24:12.983 INFO:teuthology.orchestra.run.trial073.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 59/99 2026-02-22T23:24:12.996 INFO:teuthology.orchestra.run.trial045.stdout:(17/35): libpmemobj-1.12.1-1.el9.x86_64.rpm 6.4 MB/s | 160 kB 00:00 2026-02-22T23:24:13.018 INFO:teuthology.orchestra.run.trial045.stdout:(18/35): librabbitmq-0.11.0-7.el9.x86_64.rpm 2.0 MB/s | 45 kB 00:00 2026-02-22T23:24:13.060 INFO:teuthology.orchestra.run.trial045.stdout:(19/35): pciutils-3.7.0-7.el9.x86_64.rpm 148 kB/s | 93 kB 00:00 2026-02-22T23:24:13.062 INFO:teuthology.orchestra.run.trial045.stdout:(20/35): librdkafka-1.6.1-102.el9.x86_64.rpm 14 MB/s | 662 kB 00:00 2026-02-22T23:24:13.086 INFO:teuthology.orchestra.run.trial045.stdout:(21/35): qatlib-25.08.0-2.el9.x86_64.rpm 9.9 MB/s | 240 kB 00:00 2026-02-22T23:24:13.108 INFO:teuthology.orchestra.run.trial045.stdout:(22/35): qatlib-service-25.08.0-2.el9.x86_64.rp 1.7 MB/s | 37 kB 00:00 2026-02-22T23:24:13.130 INFO:teuthology.orchestra.run.trial045.stdout:(23/35): qatzip-libs-1.3.1-1.el9.x86_64.rpm 2.9 MB/s | 66 kB 00:00 2026-02-22T23:24:13.165 INFO:teuthology.orchestra.run.trial045.stdout:(24/35): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.7 MB/s | 292 kB 00:00 2026-02-22T23:24:13.209 INFO:teuthology.orchestra.run.trial073.stdout: Installing : python3-devel-3.9.25-3.el9.x86_64 60/99 2026-02-22T23:24:13.233 INFO:teuthology.orchestra.run.trial073.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 61/99 2026-02-22T23:24:13.237 INFO:teuthology.orchestra.run.trial073.stdout: Installing : python3-jinja2-2.11.3-8.el9.noarch 62/99 2026-02-22T23:24:13.295 INFO:teuthology.orchestra.run.trial073.stdout: Installing : openblas-0.3.29-1.el9.x86_64 63/99 2026-02-22T23:24:13.297 INFO:teuthology.orchestra.run.trial073.stdout: Installing : openblas-openmp-0.3.29-1.el9.x86_64 64/99 2026-02-22T23:24:13.307 INFO:teuthology.orchestra.run.trial045.stdout:(25/35): gperftools-libs-2.9.1-3.el9.x86_64.rpm 1.7 MB/s | 308 kB 00:00 2026-02-22T23:24:13.318 INFO:teuthology.orchestra.run.trial073.stdout: Installing : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 65/99 2026-02-22T23:24:13.330 INFO:teuthology.orchestra.run.trial045.stdout:(26/35): libarrow-doc-9.0.0-15.el9.noarch.rpm 1.1 MB/s | 25 kB 00:00 2026-02-22T23:24:13.348 INFO:teuthology.orchestra.run.trial045.stdout:(27/35): nvme-cli-2.16-1.el9.x86_64.rpm 1.2 MB/s | 1.2 MB 00:00 2026-02-22T23:24:13.355 INFO:teuthology.orchestra.run.trial045.stdout:(28/35): liboath-2.6.12-1.el9.x86_64.rpm 2.0 MB/s | 49 kB 00:00 2026-02-22T23:24:13.420 INFO:teuthology.orchestra.run.trial045.stdout:(29/35): parquet-libs-9.0.0-15.el9.x86_64.rpm 13 MB/s | 838 kB 00:00 2026-02-22T23:24:13.445 INFO:teuthology.orchestra.run.trial045.stdout:(30/35): re2-20211101-20.el9.x86_64.rpm 7.5 MB/s | 191 kB 00:00 2026-02-22T23:24:13.452 INFO:teuthology.orchestra.run.trial045.stdout:(31/35): libunwind-1.6.2-1.el9.x86_64.rpm 648 kB/s | 67 kB 00:00 2026-02-22T23:24:13.477 INFO:teuthology.orchestra.run.trial045.stdout:(32/35): libarrow-9.0.0-15.el9.x86_64.rpm 14 MB/s | 4.4 MB 00:00 2026-02-22T23:24:13.498 INFO:teuthology.orchestra.run.trial045.stdout:(33/35): thrift-0.15.0-4.el9.x86_64.rpm 30 MB/s | 1.6 MB 00:00 2026-02-22T23:24:13.634 INFO:teuthology.orchestra.run.trial045.stdout:(34/35): librados2-19.2.3-689.gf90f4eae.el9.x86 19 MB/s | 3.4 MB 00:00 2026-02-22T23:24:13.645 INFO:teuthology.orchestra.run.trial073.stdout: Installing : flexiblas-netlib-3.0.4-9.el9.x86_64 66/99 2026-02-22T23:24:13.719 INFO:teuthology.orchestra.run.trial073.stdout: Installing : python3-numpy-1:1.23.5-2.el9.x86_64 67/99 2026-02-22T23:24:13.879 INFO:teuthology.orchestra.run.trial045.stdout:(35/35): librbd1-19.2.3-689.gf90f4eae.el9.x86_6 7.9 MB/s | 3.2 MB 00:00 2026-02-22T23:24:13.883 INFO:teuthology.orchestra.run.trial045.stdout:-------------------------------------------------------------------------------- 2026-02-22T23:24:13.883 INFO:teuthology.orchestra.run.trial045.stdout:Total 19 MB/s | 63 MB 00:03 2026-02-22T23:24:13.980 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction check 2026-02-22T23:24:13.999 INFO:teuthology.orchestra.run.trial045.stdout:Transaction check succeeded. 2026-02-22T23:24:13.999 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction test 2026-02-22T23:24:14.254 INFO:teuthology.orchestra.run.trial045.stdout:Transaction test succeeded. 2026-02-22T23:24:14.254 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction 2026-02-22T23:24:14.394 INFO:teuthology.orchestra.run.trial073.stdout: Installing : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 68/99 2026-02-22T23:24:14.411 INFO:teuthology.orchestra.run.trial073.stdout: Installing : python3-scipy-1.9.3-2.el9.x86_64 69/99 2026-02-22T23:24:14.421 INFO:teuthology.orchestra.run.trial073.stdout: Installing : python3-pyparsing-2.4.7-9.el9.noarch 70/99 2026-02-22T23:24:14.428 INFO:teuthology.orchestra.run.trial073.stdout: Installing : python3-packaging-20.9-5.el9.noarch 71/99 2026-02-22T23:24:14.441 INFO:teuthology.orchestra.run.trial073.stdout: Installing : python3-ply-3.11-14.el9.noarch 72/99 2026-02-22T23:24:14.457 INFO:teuthology.orchestra.run.trial073.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 73/99 2026-02-22T23:24:14.533 INFO:teuthology.orchestra.run.trial073.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 74/99 2026-02-22T23:24:14.542 INFO:teuthology.orchestra.run.trial073.stdout: Installing : python3-cryptography-36.0.1-5.el9.x86_64 75/99 2026-02-22T23:24:14.548 INFO:teuthology.orchestra.run.trial045.stdout: Preparing : 1/1 2026-02-22T23:24:14.558 INFO:teuthology.orchestra.run.trial045.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/37 2026-02-22T23:24:14.560 INFO:teuthology.orchestra.run.trial045.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/37 2026-02-22T23:24:14.565 INFO:teuthology.orchestra.run.trial073.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 76/99 2026-02-22T23:24:14.571 INFO:teuthology.orchestra.run.trial045.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/37 2026-02-22T23:24:14.595 INFO:teuthology.orchestra.run.trial073.stdout: Installing : python3-cheroot-10.0.1-4.el9.noarch 77/99 2026-02-22T23:24:14.645 INFO:teuthology.orchestra.run.trial073.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 78/99 2026-02-22T23:24:14.651 INFO:teuthology.orchestra.run.trial073.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 79/99 2026-02-22T23:24:14.655 INFO:teuthology.orchestra.run.trial073.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 80/99 2026-02-22T23:24:14.656 INFO:teuthology.orchestra.run.trial073.stdout: Installing : libconfig-1.7.2-9.el9.x86_64 81/99 2026-02-22T23:24:14.676 INFO:teuthology.orchestra.run.trial073.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 82/99 2026-02-22T23:24:14.676 INFO:teuthology.orchestra.run.trial073.stdout:Creating group 'libstoragemgmt' with GID 991. 2026-02-22T23:24:14.676 INFO:teuthology.orchestra.run.trial073.stdout:Creating user 'libstoragemgmt' (daemon account for libstoragemgmt) with UID 991 and GID 991. 2026-02-22T23:24:14.676 INFO:teuthology.orchestra.run.trial073.stdout: 2026-02-22T23:24:14.683 INFO:teuthology.orchestra.run.trial073.stdout: Installing : libstoragemgmt-1.10.1-1.el9.x86_64 82/99 2026-02-22T23:24:14.709 INFO:teuthology.orchestra.run.trial073.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 82/99 2026-02-22T23:24:14.709 INFO:teuthology.orchestra.run.trial073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/libstoragemgmt.service → /usr/lib/systemd/system/libstoragemgmt.service. 2026-02-22T23:24:14.709 INFO:teuthology.orchestra.run.trial073.stdout: 2026-02-22T23:24:14.722 INFO:teuthology.orchestra.run.trial045.stdout: Installing : thrift-0.15.0-4.el9.x86_64 4/37 2026-02-22T23:24:14.726 INFO:teuthology.orchestra.run.trial045.stdout: Upgrading : librados2-2:19.2.3-689.gf90f4eae.el9.x86_64 5/37 2026-02-22T23:24:14.743 INFO:teuthology.orchestra.run.trial073.stdout: Installing : python3-libstoragemgmt-1.10.1-1.el9.x86_64 83/99 2026-02-22T23:24:14.755 INFO:teuthology.orchestra.run.trial045.stdout: Running scriptlet: librados2-2:19.2.3-689.gf90f4eae.el9.x86_64 5/37 2026-02-22T23:24:14.797 INFO:teuthology.orchestra.run.trial045.stdout: Installing : python3-rados-2:19.2.3-689.gf90f4eae.el9.x86_64 6/37 2026-02-22T23:24:14.798 INFO:teuthology.orchestra.run.trial045.stdout: Installing : libcephfs2-2:19.2.3-689.gf90f4eae.el9.x86_64 7/37 2026-02-22T23:24:14.807 INFO:teuthology.orchestra.run.trial073.stdout: Installing : cryptsetup-2.8.1-3.el9.x86_64 84/99 2026-02-22T23:24:14.809 INFO:teuthology.orchestra.run.trial073.stdout: Installing : ceph-volume-2:19.2.3-689.gf90f4eae.el9.noarch 85/99 2026-02-22T23:24:14.810 INFO:teuthology.orchestra.run.trial045.stdout: Running scriptlet: libcephfs2-2:19.2.3-689.gf90f4eae.el9.x86_64 7/37 2026-02-22T23:24:14.814 INFO:teuthology.orchestra.run.trial045.stdout: Installing : liboath-2.6.12-1.el9.x86_64 8/37 2026-02-22T23:24:14.825 INFO:teuthology.orchestra.run.trial073.stdout: Running scriptlet: ceph-volume-2:19.2.3-689.gf90f4eae.el9.noarch 85/99 2026-02-22T23:24:14.825 INFO:teuthology.orchestra.run.trial073.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-22T23:24:14.825 INFO:teuthology.orchestra.run.trial073.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2026-02-22T23:24:14.825 INFO:teuthology.orchestra.run.trial073.stdout: 2026-02-22T23:24:14.825 INFO:teuthology.orchestra.run.trial045.stdout: Installing : python3-ceph-argparse-2:19.2.3-689.gf90f4eae.el9.x 9/37 2026-02-22T23:24:14.849 INFO:teuthology.orchestra.run.trial045.stdout: Installing : python3-cephfs-2:19.2.3-689.gf90f4eae.el9.x86_64 10/37 2026-02-22T23:24:14.850 INFO:teuthology.orchestra.run.trial045.stdout: Installing : libradosstriper1-2:19.2.3-689.gf90f4eae.el9.x86_64 11/37 2026-02-22T23:24:14.864 INFO:teuthology.orchestra.run.trial045.stdout: Running scriptlet: libradosstriper1-2:19.2.3-689.gf90f4eae.el9.x86_64 11/37 2026-02-22T23:24:14.894 INFO:teuthology.orchestra.run.trial045.stdout: Installing : re2-1:20211101-20.el9.x86_64 12/37 2026-02-22T23:24:14.898 INFO:teuthology.orchestra.run.trial045.stdout: Installing : libarrow-9.0.0-15.el9.x86_64 13/37 2026-02-22T23:24:14.904 INFO:teuthology.orchestra.run.trial045.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 14/37 2026-02-22T23:24:14.907 INFO:teuthology.orchestra.run.trial045.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 15/37 2026-02-22T23:24:14.909 INFO:teuthology.orchestra.run.trial045.stdout: Installing : libarrow-doc-9.0.0-15.el9.noarch 16/37 2026-02-22T23:24:14.915 INFO:teuthology.orchestra.run.trial045.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 17/37 2026-02-22T23:24:15.054 INFO:teuthology.orchestra.run.trial045.stdout: Installing : libnbd-1.20.3-4.el9.x86_64 18/37 2026-02-22T23:24:15.056 INFO:teuthology.orchestra.run.trial045.stdout: Upgrading : librbd1-2:19.2.3-689.gf90f4eae.el9.x86_64 19/37 2026-02-22T23:24:15.081 INFO:teuthology.orchestra.run.trial045.stdout: Running scriptlet: librbd1-2:19.2.3-689.gf90f4eae.el9.x86_64 19/37 2026-02-22T23:24:15.085 INFO:teuthology.orchestra.run.trial045.stdout: Installing : python3-rbd-2:19.2.3-689.gf90f4eae.el9.x86_64 20/37 2026-02-22T23:24:15.091 INFO:teuthology.orchestra.run.trial045.stdout: Installing : boost-program-options-1.75.0-13.el9.x86_64 21/37 2026-02-22T23:24:15.316 INFO:teuthology.orchestra.run.trial045.stdout: Installing : parquet-libs-9.0.0-15.el9.x86_64 22/37 2026-02-22T23:24:15.317 INFO:teuthology.orchestra.run.trial045.stdout: Installing : librgw2-2:19.2.3-689.gf90f4eae.el9.x86_64 23/37 2026-02-22T23:24:15.335 INFO:teuthology.orchestra.run.trial045.stdout: Running scriptlet: librgw2-2:19.2.3-689.gf90f4eae.el9.x86_64 23/37 2026-02-22T23:24:15.340 INFO:teuthology.orchestra.run.trial045.stdout: Installing : python3-rgw-2:19.2.3-689.gf90f4eae.el9.x86_64 24/37 2026-02-22T23:24:15.345 INFO:teuthology.orchestra.run.trial045.stdout: Installing : pciutils-3.7.0-7.el9.x86_64 25/37 2026-02-22T23:24:15.348 INFO:teuthology.orchestra.run.trial045.stdout: Installing : qatlib-25.08.0-2.el9.x86_64 26/37 2026-02-22T23:24:15.349 INFO:teuthology.orchestra.run.trial045.stdout: Installing : qatlib-service-25.08.0-2.el9.x86_64 27/37 2026-02-22T23:24:15.366 INFO:teuthology.orchestra.run.trial045.stdout: Running scriptlet: qatlib-service-25.08.0-2.el9.x86_64 27/37 2026-02-22T23:24:15.480 INFO:teuthology.orchestra.run.trial045.stdout: Installing : qatzip-libs-1.3.1-1.el9.x86_64 28/37 2026-02-22T23:24:15.483 INFO:teuthology.orchestra.run.trial045.stdout: Installing : nvme-cli-2.16-1.el9.x86_64 29/37 2026-02-22T23:24:15.524 INFO:teuthology.orchestra.run.trial073.stdout: Installing : ceph-osd-2:19.2.3-689.gf90f4eae.el9.x86_64 86/99 2026-02-22T23:24:15.550 INFO:teuthology.orchestra.run.trial073.stdout: Running scriptlet: ceph-osd-2:19.2.3-689.gf90f4eae.el9.x86_64 86/99 2026-02-22T23:24:15.551 INFO:teuthology.orchestra.run.trial073.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-22T23:24:15.551 INFO:teuthology.orchestra.run.trial073.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2026-02-22T23:24:15.551 INFO:teuthology.orchestra.run.trial073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-22T23:24:15.551 INFO:teuthology.orchestra.run.trial073.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-22T23:24:15.551 INFO:teuthology.orchestra.run.trial073.stdout: 2026-02-22T23:24:15.611 INFO:teuthology.orchestra.run.trial073.stdout: Running scriptlet: cephadm-2:19.2.3-689.gf90f4eae.el9.noarch 87/99 2026-02-22T23:24:15.613 INFO:teuthology.orchestra.run.trial073.stdout: Installing : cephadm-2:19.2.3-689.gf90f4eae.el9.noarch 87/99 2026-02-22T23:24:15.618 INFO:teuthology.orchestra.run.trial073.stdout: Installing : ceph-prometheus-alerts-2:19.2.3-689.gf90f4eae.el9. 88/99 2026-02-22T23:24:15.638 INFO:teuthology.orchestra.run.trial073.stdout: Installing : ceph-grafana-dashboards-2:19.2.3-689.gf90f4eae.el9 89/99 2026-02-22T23:24:15.639 INFO:teuthology.orchestra.run.trial073.stdout: Installing : ceph-mgr-cephadm-2:19.2.3-689.gf90f4eae.el9.noarch 90/99 2026-02-22T23:24:15.753 INFO:teuthology.orchestra.run.trial045.stdout: Running scriptlet: nvme-cli-2.16-1.el9.x86_64 29/37 2026-02-22T23:24:15.754 INFO:teuthology.orchestra.run.trial045.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service → /usr/lib/systemd/system/nvmefc-boot-connections.service. 2026-02-22T23:24:15.754 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-22T23:24:15.787 INFO:teuthology.orchestra.run.trial045.stdout: Installing : mailcap-2.1.49-5.el9.noarch 30/37 2026-02-22T23:24:15.789 INFO:teuthology.orchestra.run.trial045.stdout: Installing : python3-ceph-common-2:19.2.3-689.gf90f4eae.el9.x86 31/37 2026-02-22T23:24:16.129 INFO:teuthology.orchestra.run.trial073.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.2.3-689.gf90f4eae.el9.noarch 90/99 2026-02-22T23:24:16.132 INFO:teuthology.orchestra.run.trial073.stdout: Installing : ceph-mgr-dashboard-2:19.2.3-689.gf90f4eae.el9.noar 91/99 2026-02-22T23:24:16.584 INFO:teuthology.orchestra.run.trial073.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.2.3-689.gf90f4eae.el9.noar 91/99 2026-02-22T23:24:16.585 INFO:teuthology.orchestra.run.trial073.stdout: Installing : ceph-mgr-diskprediction-local-2:19.2.3-689.gf90f4e 92/99 2026-02-22T23:24:16.598 INFO:teuthology.orchestra.run.trial073.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.2.3-689.gf90f4e 92/99 2026-02-22T23:24:16.598 INFO:teuthology.orchestra.run.trial073.stdout: Installing : ceph-mgr-k8sevents-2:19.2.3-689.gf90f4eae.el9.noar 93/99 2026-02-22T23:24:16.655 INFO:teuthology.orchestra.run.trial073.stdout: Running scriptlet: ceph-mgr-k8sevents-2:19.2.3-689.gf90f4eae.el9.noar 93/99 2026-02-22T23:24:16.704 INFO:teuthology.orchestra.run.trial073.stdout: Installing : ceph-mgr-modules-core-2:19.2.3-689.gf90f4eae.el9.n 94/99 2026-02-22T23:24:16.705 INFO:teuthology.orchestra.run.trial073.stdout: Installing : ceph-mgr-2:19.2.3-689.gf90f4eae.el9.x86_64 95/99 2026-02-22T23:24:16.727 INFO:teuthology.orchestra.run.trial073.stdout: Running scriptlet: ceph-mgr-2:19.2.3-689.gf90f4eae.el9.x86_64 95/99 2026-02-22T23:24:16.727 INFO:teuthology.orchestra.run.trial073.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-22T23:24:16.727 INFO:teuthology.orchestra.run.trial073.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2026-02-22T23:24:16.727 INFO:teuthology.orchestra.run.trial073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-22T23:24:16.727 INFO:teuthology.orchestra.run.trial073.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-22T23:24:16.727 INFO:teuthology.orchestra.run.trial073.stdout: 2026-02-22T23:24:16.740 INFO:teuthology.orchestra.run.trial073.stdout: Installing : ceph-mgr-rook-2:19.2.3-689.gf90f4eae.el9.noarch 96/99 2026-02-22T23:24:16.765 INFO:teuthology.orchestra.run.trial045.stdout: Running scriptlet: ceph-common-2:19.2.3-689.gf90f4eae.el9.x86_64 32/37 2026-02-22T23:24:16.767 INFO:teuthology.orchestra.run.trial045.stdout: Installing : ceph-common-2:19.2.3-689.gf90f4eae.el9.x86_64 32/37 2026-02-22T23:24:16.957 INFO:teuthology.orchestra.run.trial073.stdout: Running scriptlet: ceph-mgr-rook-2:19.2.3-689.gf90f4eae.el9.noarch 96/99 2026-02-22T23:24:16.958 INFO:teuthology.orchestra.run.trial073.stdout: Installing : ceph-mon-2:19.2.3-689.gf90f4eae.el9.x86_64 97/99 2026-02-22T23:24:16.979 INFO:teuthology.orchestra.run.trial073.stdout: Running scriptlet: ceph-mon-2:19.2.3-689.gf90f4eae.el9.x86_64 97/99 2026-02-22T23:24:16.980 INFO:teuthology.orchestra.run.trial073.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-22T23:24:16.980 INFO:teuthology.orchestra.run.trial073.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2026-02-22T23:24:16.980 INFO:teuthology.orchestra.run.trial073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-22T23:24:16.980 INFO:teuthology.orchestra.run.trial073.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-22T23:24:16.980 INFO:teuthology.orchestra.run.trial073.stdout: 2026-02-22T23:24:17.052 INFO:teuthology.orchestra.run.trial045.stdout: Running scriptlet: ceph-common-2:19.2.3-689.gf90f4eae.el9.x86_64 32/37 2026-02-22T23:24:17.056 INFO:teuthology.orchestra.run.trial045.stdout: Installing : ceph-base-2:19.2.3-689.gf90f4eae.el9.x86_64 33/37 2026-02-22T23:24:17.081 INFO:teuthology.orchestra.run.trial073.stdout: Installing : ceph-mds-2:19.2.3-689.gf90f4eae.el9.x86_64 98/99 2026-02-22T23:24:17.097 INFO:teuthology.orchestra.run.trial045.stdout: Running scriptlet: ceph-base-2:19.2.3-689.gf90f4eae.el9.x86_64 33/37 2026-02-22T23:24:17.097 INFO:teuthology.orchestra.run.trial045.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2026-02-22T23:24:17.097 INFO:teuthology.orchestra.run.trial045.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2026-02-22T23:24:17.097 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-22T23:24:17.100 INFO:teuthology.orchestra.run.trial045.stdout: Installing : ceph-selinux-2:19.2.3-689.gf90f4eae.el9.x86_64 34/37 2026-02-22T23:24:17.102 INFO:teuthology.orchestra.run.trial073.stdout: Running scriptlet: ceph-mds-2:19.2.3-689.gf90f4eae.el9.x86_64 98/99 2026-02-22T23:24:17.102 INFO:teuthology.orchestra.run.trial073.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-22T23:24:17.102 INFO:teuthology.orchestra.run.trial073.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2026-02-22T23:24:17.102 INFO:teuthology.orchestra.run.trial073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-22T23:24:17.102 INFO:teuthology.orchestra.run.trial073.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-22T23:24:17.102 INFO:teuthology.orchestra.run.trial073.stdout: 2026-02-22T23:24:17.120 INFO:teuthology.orchestra.run.trial073.stdout: Installing : ceph-2:19.2.3-689.gf90f4eae.el9.x86_64 99/99 2026-02-22T23:24:17.769 INFO:teuthology.orchestra.run.trial073.stdout: Running scriptlet: ceph-2:19.2.3-689.gf90f4eae.el9.x86_64 99/99 2026-02-22T23:24:17.770 INFO:teuthology.orchestra.run.trial073.stdout: Verifying : ceph-2:19.2.3-689.gf90f4eae.el9.x86_64 1/99 2026-02-22T23:24:17.770 INFO:teuthology.orchestra.run.trial073.stdout: Verifying : ceph-mds-2:19.2.3-689.gf90f4eae.el9.x86_64 2/99 2026-02-22T23:24:17.770 INFO:teuthology.orchestra.run.trial073.stdout: Verifying : ceph-mgr-2:19.2.3-689.gf90f4eae.el9.x86_64 3/99 2026-02-22T23:24:17.770 INFO:teuthology.orchestra.run.trial073.stdout: Verifying : ceph-mon-2:19.2.3-689.gf90f4eae.el9.x86_64 4/99 2026-02-22T23:24:17.770 INFO:teuthology.orchestra.run.trial073.stdout: Verifying : ceph-osd-2:19.2.3-689.gf90f4eae.el9.x86_64 5/99 2026-02-22T23:24:17.770 INFO:teuthology.orchestra.run.trial073.stdout: Verifying : ceph-grafana-dashboards-2:19.2.3-689.gf90f4eae.el9 6/99 2026-02-22T23:24:17.770 INFO:teuthology.orchestra.run.trial073.stdout: Verifying : ceph-mgr-cephadm-2:19.2.3-689.gf90f4eae.el9.noarch 7/99 2026-02-22T23:24:17.770 INFO:teuthology.orchestra.run.trial073.stdout: Verifying : ceph-mgr-dashboard-2:19.2.3-689.gf90f4eae.el9.noar 8/99 2026-02-22T23:24:17.770 INFO:teuthology.orchestra.run.trial073.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.2.3-689.gf90f4e 9/99 2026-02-22T23:24:17.770 INFO:teuthology.orchestra.run.trial073.stdout: Verifying : ceph-mgr-k8sevents-2:19.2.3-689.gf90f4eae.el9.noar 10/99 2026-02-22T23:24:17.771 INFO:teuthology.orchestra.run.trial073.stdout: Verifying : ceph-mgr-modules-core-2:19.2.3-689.gf90f4eae.el9.n 11/99 2026-02-22T23:24:17.771 INFO:teuthology.orchestra.run.trial073.stdout: Verifying : ceph-mgr-rook-2:19.2.3-689.gf90f4eae.el9.noarch 12/99 2026-02-22T23:24:17.771 INFO:teuthology.orchestra.run.trial073.stdout: Verifying : ceph-prometheus-alerts-2:19.2.3-689.gf90f4eae.el9. 13/99 2026-02-22T23:24:17.771 INFO:teuthology.orchestra.run.trial073.stdout: Verifying : ceph-volume-2:19.2.3-689.gf90f4eae.el9.noarch 14/99 2026-02-22T23:24:17.771 INFO:teuthology.orchestra.run.trial073.stdout: Verifying : cephadm-2:19.2.3-689.gf90f4eae.el9.noarch 15/99 2026-02-22T23:24:17.771 INFO:teuthology.orchestra.run.trial073.stdout: Verifying : cryptsetup-2.8.1-3.el9.x86_64 16/99 2026-02-22T23:24:17.771 INFO:teuthology.orchestra.run.trial073.stdout: Verifying : ledmon-libs-1.1.0-3.el9.x86_64 17/99 2026-02-22T23:24:17.771 INFO:teuthology.orchestra.run.trial073.stdout: Verifying : libconfig-1.7.2-9.el9.x86_64 18/99 2026-02-22T23:24:17.771 INFO:teuthology.orchestra.run.trial073.stdout: Verifying : libgfortran-11.5.0-14.el9.x86_64 19/99 2026-02-22T23:24:17.771 INFO:teuthology.orchestra.run.trial073.stdout: Verifying : libquadmath-11.5.0-14.el9.x86_64 20/99 2026-02-22T23:24:17.771 INFO:teuthology.orchestra.run.trial073.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 21/99 2026-02-22T23:24:17.771 INFO:teuthology.orchestra.run.trial073.stdout: Verifying : python3-cryptography-36.0.1-5.el9.x86_64 22/99 2026-02-22T23:24:17.771 INFO:teuthology.orchestra.run.trial073.stdout: Verifying : python3-ply-3.11-14.el9.noarch 23/99 2026-02-22T23:24:17.772 INFO:teuthology.orchestra.run.trial073.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 24/99 2026-02-22T23:24:17.772 INFO:teuthology.orchestra.run.trial073.stdout: Verifying : python3-pyparsing-2.4.7-9.el9.noarch 25/99 2026-02-22T23:24:17.772 INFO:teuthology.orchestra.run.trial073.stdout: Verifying : python3-requests-2.25.1-10.el9.noarch 26/99 2026-02-22T23:24:17.772 INFO:teuthology.orchestra.run.trial073.stdout: Verifying : python3-urllib3-1.26.5-7.el9.noarch 27/99 2026-02-22T23:24:17.772 INFO:teuthology.orchestra.run.trial073.stdout: Verifying : unzip-6.0-59.el9.x86_64 28/99 2026-02-22T23:24:17.772 INFO:teuthology.orchestra.run.trial073.stdout: Verifying : zip-3.0-35.el9.x86_64 29/99 2026-02-22T23:24:17.772 INFO:teuthology.orchestra.run.trial073.stdout: Verifying : flexiblas-3.0.4-9.el9.x86_64 30/99 2026-02-22T23:24:17.772 INFO:teuthology.orchestra.run.trial073.stdout: Verifying : flexiblas-netlib-3.0.4-9.el9.x86_64 31/99 2026-02-22T23:24:17.772 INFO:teuthology.orchestra.run.trial073.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 32/99 2026-02-22T23:24:17.772 INFO:teuthology.orchestra.run.trial073.stdout: Verifying : libstoragemgmt-1.10.1-1.el9.x86_64 33/99 2026-02-22T23:24:17.772 INFO:teuthology.orchestra.run.trial073.stdout: Verifying : lua-5.4.4-4.el9.x86_64 34/99 2026-02-22T23:24:17.772 INFO:teuthology.orchestra.run.trial073.stdout: Verifying : openblas-0.3.29-1.el9.x86_64 35/99 2026-02-22T23:24:17.772 INFO:teuthology.orchestra.run.trial073.stdout: Verifying : openblas-openmp-0.3.29-1.el9.x86_64 36/99 2026-02-22T23:24:17.773 INFO:teuthology.orchestra.run.trial073.stdout: Verifying : protobuf-3.14.0-17.el9.x86_64 37/99 2026-02-22T23:24:17.773 INFO:teuthology.orchestra.run.trial073.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 38/99 2026-02-22T23:24:17.773 INFO:teuthology.orchestra.run.trial073.stdout: Verifying : python3-devel-3.9.25-3.el9.x86_64 39/99 2026-02-22T23:24:17.773 INFO:teuthology.orchestra.run.trial073.stdout: Verifying : python3-jinja2-2.11.3-8.el9.noarch 40/99 2026-02-22T23:24:17.773 INFO:teuthology.orchestra.run.trial073.stdout: Verifying : python3-libstoragemgmt-1.10.1-1.el9.x86_64 41/99 2026-02-22T23:24:17.773 INFO:teuthology.orchestra.run.trial073.stdout: Verifying : python3-lxml-4.6.5-3.el9.x86_64 42/99 2026-02-22T23:24:17.773 INFO:teuthology.orchestra.run.trial073.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 43/99 2026-02-22T23:24:17.773 INFO:teuthology.orchestra.run.trial073.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 44/99 2026-02-22T23:24:17.773 INFO:teuthology.orchestra.run.trial073.stdout: Verifying : python3-numpy-1:1.23.5-2.el9.x86_64 45/99 2026-02-22T23:24:17.773 INFO:teuthology.orchestra.run.trial073.stdout: Verifying : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 46/99 2026-02-22T23:24:17.773 INFO:teuthology.orchestra.run.trial073.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 47/99 2026-02-22T23:24:17.773 INFO:teuthology.orchestra.run.trial073.stdout: Verifying : python3-protobuf-3.14.0-17.el9.noarch 48/99 2026-02-22T23:24:17.773 INFO:teuthology.orchestra.run.trial073.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 49/99 2026-02-22T23:24:17.774 INFO:teuthology.orchestra.run.trial073.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 50/99 2026-02-22T23:24:17.774 INFO:teuthology.orchestra.run.trial073.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 51/99 2026-02-22T23:24:17.774 INFO:teuthology.orchestra.run.trial073.stdout: Verifying : python3-scipy-1.9.3-2.el9.x86_64 52/99 2026-02-22T23:24:17.774 INFO:teuthology.orchestra.run.trial073.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 53/99 2026-02-22T23:24:17.774 INFO:teuthology.orchestra.run.trial073.stdout: Verifying : xmlsec1-1.2.29-13.el9.x86_64 54/99 2026-02-22T23:24:17.774 INFO:teuthology.orchestra.run.trial073.stdout: Verifying : xmlsec1-openssl-1.2.29-13.el9.x86_64 55/99 2026-02-22T23:24:17.774 INFO:teuthology.orchestra.run.trial073.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 56/99 2026-02-22T23:24:17.774 INFO:teuthology.orchestra.run.trial073.stdout: Verifying : protobuf-compiler-3.14.0-17.el9.x86_64 57/99 2026-02-22T23:24:17.774 INFO:teuthology.orchestra.run.trial073.stdout: Verifying : abseil-cpp-20211102.0-4.el9.x86_64 58/99 2026-02-22T23:24:17.774 INFO:teuthology.orchestra.run.trial073.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 59/99 2026-02-22T23:24:17.774 INFO:teuthology.orchestra.run.trial073.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 60/99 2026-02-22T23:24:17.774 INFO:teuthology.orchestra.run.trial073.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 61/99 2026-02-22T23:24:17.774 INFO:teuthology.orchestra.run.trial073.stdout: Verifying : python3-autocommand-2.2.2-8.el9.noarch 62/99 2026-02-22T23:24:17.775 INFO:teuthology.orchestra.run.trial073.stdout: Verifying : python3-backports-tarfile-1.2.0-1.el9.noarch 63/99 2026-02-22T23:24:17.775 INFO:teuthology.orchestra.run.trial073.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 64/99 2026-02-22T23:24:17.775 INFO:teuthology.orchestra.run.trial073.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 65/99 2026-02-22T23:24:17.775 INFO:teuthology.orchestra.run.trial073.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 66/99 2026-02-22T23:24:17.775 INFO:teuthology.orchestra.run.trial073.stdout: Verifying : python3-cheroot-10.0.1-4.el9.noarch 67/99 2026-02-22T23:24:17.775 INFO:teuthology.orchestra.run.trial073.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 68/99 2026-02-22T23:24:17.775 INFO:teuthology.orchestra.run.trial073.stdout: Verifying : python3-google-auth-1:2.45.0-1.el9.noarch 69/99 2026-02-22T23:24:17.775 INFO:teuthology.orchestra.run.trial073.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 70/99 2026-02-22T23:24:17.775 INFO:teuthology.orchestra.run.trial073.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 71/99 2026-02-22T23:24:17.775 INFO:teuthology.orchestra.run.trial073.stdout: Verifying : python3-influxdb-5.3.1-1.el9.noarch 72/99 2026-02-22T23:24:17.775 INFO:teuthology.orchestra.run.trial073.stdout: Verifying : python3-isodate-0.6.1-3.el9.noarch 73/99 2026-02-22T23:24:17.775 INFO:teuthology.orchestra.run.trial073.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 74/99 2026-02-22T23:24:17.775 INFO:teuthology.orchestra.run.trial073.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 75/99 2026-02-22T23:24:17.776 INFO:teuthology.orchestra.run.trial073.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 76/99 2026-02-22T23:24:17.776 INFO:teuthology.orchestra.run.trial073.stdout: Verifying : python3-jaraco-context-6.0.1-3.el9.noarch 77/99 2026-02-22T23:24:17.776 INFO:teuthology.orchestra.run.trial073.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 78/99 2026-02-22T23:24:17.776 INFO:teuthology.orchestra.run.trial073.stdout: Verifying : python3-jaraco-text-4.0.0-2.el9.noarch 79/99 2026-02-22T23:24:17.776 INFO:teuthology.orchestra.run.trial073.stdout: Verifying : python3-kubernetes-1:26.1.0-3.el9.noarch 80/99 2026-02-22T23:24:17.776 INFO:teuthology.orchestra.run.trial073.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 81/99 2026-02-22T23:24:17.776 INFO:teuthology.orchestra.run.trial073.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 82/99 2026-02-22T23:24:17.776 INFO:teuthology.orchestra.run.trial073.stdout: Verifying : python3-msgpack-1.0.3-2.el9.x86_64 83/99 2026-02-22T23:24:17.776 INFO:teuthology.orchestra.run.trial073.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 84/99 2026-02-22T23:24:17.776 INFO:teuthology.orchestra.run.trial073.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 85/99 2026-02-22T23:24:17.776 INFO:teuthology.orchestra.run.trial073.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 86/99 2026-02-22T23:24:17.776 INFO:teuthology.orchestra.run.trial073.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 87/99 2026-02-22T23:24:17.776 INFO:teuthology.orchestra.run.trial073.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 88/99 2026-02-22T23:24:17.777 INFO:teuthology.orchestra.run.trial073.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 89/99 2026-02-22T23:24:17.777 INFO:teuthology.orchestra.run.trial073.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 90/99 2026-02-22T23:24:17.777 INFO:teuthology.orchestra.run.trial073.stdout: Verifying : python3-saml-1.16.0-1.el9.noarch 91/99 2026-02-22T23:24:17.777 INFO:teuthology.orchestra.run.trial073.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 92/99 2026-02-22T23:24:17.777 INFO:teuthology.orchestra.run.trial073.stdout: Verifying : python3-typing-extensions-4.15.0-1.el9.noarch 93/99 2026-02-22T23:24:17.777 INFO:teuthology.orchestra.run.trial073.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 94/99 2026-02-22T23:24:17.777 INFO:teuthology.orchestra.run.trial073.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 95/99 2026-02-22T23:24:17.777 INFO:teuthology.orchestra.run.trial073.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 96/99 2026-02-22T23:24:17.777 INFO:teuthology.orchestra.run.trial073.stdout: Verifying : python3-xmlsec-1.3.13-1.el9.x86_64 97/99 2026-02-22T23:24:17.777 INFO:teuthology.orchestra.run.trial073.stdout: Verifying : python3-xmltodict-0.12.0-15.el9.noarch 98/99 2026-02-22T23:24:17.836 INFO:teuthology.orchestra.run.trial073.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 99/99 2026-02-22T23:24:17.836 INFO:teuthology.orchestra.run.trial073.stdout: 2026-02-22T23:24:17.836 INFO:teuthology.orchestra.run.trial073.stdout:Installed: 2026-02-22T23:24:17.836 INFO:teuthology.orchestra.run.trial073.stdout: abseil-cpp-20211102.0-4.el9.x86_64 2026-02-22T23:24:17.836 INFO:teuthology.orchestra.run.trial073.stdout: ceph-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T23:24:17.836 INFO:teuthology.orchestra.run.trial073.stdout: ceph-grafana-dashboards-2:19.2.3-689.gf90f4eae.el9.noarch 2026-02-22T23:24:17.837 INFO:teuthology.orchestra.run.trial073.stdout: ceph-mds-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T23:24:17.837 INFO:teuthology.orchestra.run.trial073.stdout: ceph-mgr-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T23:24:17.837 INFO:teuthology.orchestra.run.trial073.stdout: ceph-mgr-cephadm-2:19.2.3-689.gf90f4eae.el9.noarch 2026-02-22T23:24:17.837 INFO:teuthology.orchestra.run.trial073.stdout: ceph-mgr-dashboard-2:19.2.3-689.gf90f4eae.el9.noarch 2026-02-22T23:24:17.837 INFO:teuthology.orchestra.run.trial073.stdout: ceph-mgr-diskprediction-local-2:19.2.3-689.gf90f4eae.el9.noarch 2026-02-22T23:24:17.837 INFO:teuthology.orchestra.run.trial073.stdout: ceph-mgr-k8sevents-2:19.2.3-689.gf90f4eae.el9.noarch 2026-02-22T23:24:17.837 INFO:teuthology.orchestra.run.trial073.stdout: ceph-mgr-modules-core-2:19.2.3-689.gf90f4eae.el9.noarch 2026-02-22T23:24:17.837 INFO:teuthology.orchestra.run.trial073.stdout: ceph-mgr-rook-2:19.2.3-689.gf90f4eae.el9.noarch 2026-02-22T23:24:17.837 INFO:teuthology.orchestra.run.trial073.stdout: ceph-mon-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T23:24:17.837 INFO:teuthology.orchestra.run.trial073.stdout: ceph-osd-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T23:24:17.837 INFO:teuthology.orchestra.run.trial073.stdout: ceph-prometheus-alerts-2:19.2.3-689.gf90f4eae.el9.noarch 2026-02-22T23:24:17.838 INFO:teuthology.orchestra.run.trial073.stdout: ceph-volume-2:19.2.3-689.gf90f4eae.el9.noarch 2026-02-22T23:24:17.838 INFO:teuthology.orchestra.run.trial073.stdout: cephadm-2:19.2.3-689.gf90f4eae.el9.noarch 2026-02-22T23:24:17.838 INFO:teuthology.orchestra.run.trial073.stdout: cryptsetup-2.8.1-3.el9.x86_64 2026-02-22T23:24:17.838 INFO:teuthology.orchestra.run.trial073.stdout: flexiblas-3.0.4-9.el9.x86_64 2026-02-22T23:24:17.838 INFO:teuthology.orchestra.run.trial073.stdout: flexiblas-netlib-3.0.4-9.el9.x86_64 2026-02-22T23:24:17.838 INFO:teuthology.orchestra.run.trial073.stdout: flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 2026-02-22T23:24:17.838 INFO:teuthology.orchestra.run.trial073.stdout: grpc-data-1.46.7-10.el9.noarch 2026-02-22T23:24:17.838 INFO:teuthology.orchestra.run.trial073.stdout: ledmon-libs-1.1.0-3.el9.x86_64 2026-02-22T23:24:17.838 INFO:teuthology.orchestra.run.trial073.stdout: libconfig-1.7.2-9.el9.x86_64 2026-02-22T23:24:17.838 INFO:teuthology.orchestra.run.trial073.stdout: libgfortran-11.5.0-14.el9.x86_64 2026-02-22T23:24:17.838 INFO:teuthology.orchestra.run.trial073.stdout: libquadmath-11.5.0-14.el9.x86_64 2026-02-22T23:24:17.838 INFO:teuthology.orchestra.run.trial073.stdout: libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-22T23:24:17.838 INFO:teuthology.orchestra.run.trial073.stdout: lua-5.4.4-4.el9.x86_64 2026-02-22T23:24:17.839 INFO:teuthology.orchestra.run.trial073.stdout: lua-devel-5.4.4-4.el9.x86_64 2026-02-22T23:24:17.839 INFO:teuthology.orchestra.run.trial073.stdout: luarocks-3.9.2-5.el9.noarch 2026-02-22T23:24:17.839 INFO:teuthology.orchestra.run.trial073.stdout: openblas-0.3.29-1.el9.x86_64 2026-02-22T23:24:17.839 INFO:teuthology.orchestra.run.trial073.stdout: openblas-openmp-0.3.29-1.el9.x86_64 2026-02-22T23:24:17.839 INFO:teuthology.orchestra.run.trial073.stdout: protobuf-3.14.0-17.el9.x86_64 2026-02-22T23:24:17.839 INFO:teuthology.orchestra.run.trial073.stdout: protobuf-compiler-3.14.0-17.el9.x86_64 2026-02-22T23:24:17.839 INFO:teuthology.orchestra.run.trial073.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2026-02-22T23:24:17.839 INFO:teuthology.orchestra.run.trial073.stdout: python3-autocommand-2.2.2-8.el9.noarch 2026-02-22T23:24:17.839 INFO:teuthology.orchestra.run.trial073.stdout: python3-babel-2.9.1-2.el9.noarch 2026-02-22T23:24:17.839 INFO:teuthology.orchestra.run.trial073.stdout: python3-backports-tarfile-1.2.0-1.el9.noarch 2026-02-22T23:24:17.839 INFO:teuthology.orchestra.run.trial073.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2026-02-22T23:24:17.839 INFO:teuthology.orchestra.run.trial073.stdout: python3-cachetools-4.2.4-1.el9.noarch 2026-02-22T23:24:17.840 INFO:teuthology.orchestra.run.trial073.stdout: python3-certifi-2023.05.07-4.el9.noarch 2026-02-22T23:24:17.840 INFO:teuthology.orchestra.run.trial073.stdout: python3-cffi-1.14.5-5.el9.x86_64 2026-02-22T23:24:17.840 INFO:teuthology.orchestra.run.trial073.stdout: python3-cheroot-10.0.1-4.el9.noarch 2026-02-22T23:24:17.840 INFO:teuthology.orchestra.run.trial073.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2026-02-22T23:24:17.840 INFO:teuthology.orchestra.run.trial073.stdout: python3-cryptography-36.0.1-5.el9.x86_64 2026-02-22T23:24:17.840 INFO:teuthology.orchestra.run.trial073.stdout: python3-devel-3.9.25-3.el9.x86_64 2026-02-22T23:24:17.840 INFO:teuthology.orchestra.run.trial073.stdout: python3-google-auth-1:2.45.0-1.el9.noarch 2026-02-22T23:24:17.840 INFO:teuthology.orchestra.run.trial073.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2026-02-22T23:24:17.840 INFO:teuthology.orchestra.run.trial073.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2026-02-22T23:24:17.840 INFO:teuthology.orchestra.run.trial073.stdout: python3-influxdb-5.3.1-1.el9.noarch 2026-02-22T23:24:17.840 INFO:teuthology.orchestra.run.trial073.stdout: python3-isodate-0.6.1-3.el9.noarch 2026-02-22T23:24:17.840 INFO:teuthology.orchestra.run.trial073.stdout: python3-jaraco-8.2.1-3.el9.noarch 2026-02-22T23:24:17.840 INFO:teuthology.orchestra.run.trial073.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2026-02-22T23:24:17.840 INFO:teuthology.orchestra.run.trial073.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2026-02-22T23:24:17.841 INFO:teuthology.orchestra.run.trial073.stdout: python3-jaraco-context-6.0.1-3.el9.noarch 2026-02-22T23:24:17.841 INFO:teuthology.orchestra.run.trial073.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2026-02-22T23:24:17.841 INFO:teuthology.orchestra.run.trial073.stdout: python3-jaraco-text-4.0.0-2.el9.noarch 2026-02-22T23:24:17.841 INFO:teuthology.orchestra.run.trial073.stdout: python3-jinja2-2.11.3-8.el9.noarch 2026-02-22T23:24:17.841 INFO:teuthology.orchestra.run.trial073.stdout: python3-kubernetes-1:26.1.0-3.el9.noarch 2026-02-22T23:24:17.841 INFO:teuthology.orchestra.run.trial073.stdout: python3-libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-22T23:24:17.841 INFO:teuthology.orchestra.run.trial073.stdout: python3-logutils-0.3.5-21.el9.noarch 2026-02-22T23:24:17.841 INFO:teuthology.orchestra.run.trial073.stdout: python3-lxml-4.6.5-3.el9.x86_64 2026-02-22T23:24:17.841 INFO:teuthology.orchestra.run.trial073.stdout: python3-mako-1.1.4-6.el9.noarch 2026-02-22T23:24:17.841 INFO:teuthology.orchestra.run.trial073.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2026-02-22T23:24:17.841 INFO:teuthology.orchestra.run.trial073.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2026-02-22T23:24:17.841 INFO:teuthology.orchestra.run.trial073.stdout: python3-msgpack-1.0.3-2.el9.x86_64 2026-02-22T23:24:17.842 INFO:teuthology.orchestra.run.trial073.stdout: python3-natsort-7.1.1-5.el9.noarch 2026-02-22T23:24:17.842 INFO:teuthology.orchestra.run.trial073.stdout: python3-numpy-1:1.23.5-2.el9.x86_64 2026-02-22T23:24:17.842 INFO:teuthology.orchestra.run.trial073.stdout: python3-numpy-f2py-1:1.23.5-2.el9.x86_64 2026-02-22T23:24:17.842 INFO:teuthology.orchestra.run.trial073.stdout: python3-packaging-20.9-5.el9.noarch 2026-02-22T23:24:17.842 INFO:teuthology.orchestra.run.trial073.stdout: python3-pecan-1.4.2-3.el9.noarch 2026-02-22T23:24:17.842 INFO:teuthology.orchestra.run.trial073.stdout: python3-ply-3.11-14.el9.noarch 2026-02-22T23:24:17.842 INFO:teuthology.orchestra.run.trial073.stdout: python3-portend-3.1.0-2.el9.noarch 2026-02-22T23:24:17.842 INFO:teuthology.orchestra.run.trial073.stdout: python3-protobuf-3.14.0-17.el9.noarch 2026-02-22T23:24:17.842 INFO:teuthology.orchestra.run.trial073.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2026-02-22T23:24:17.842 INFO:teuthology.orchestra.run.trial073.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2026-02-22T23:24:17.842 INFO:teuthology.orchestra.run.trial073.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2026-02-22T23:24:17.843 INFO:teuthology.orchestra.run.trial073.stdout: python3-pycparser-2.20-6.el9.noarch 2026-02-22T23:24:17.843 INFO:teuthology.orchestra.run.trial073.stdout: python3-pyparsing-2.4.7-9.el9.noarch 2026-02-22T23:24:17.843 INFO:teuthology.orchestra.run.trial073.stdout: python3-repoze-lru-0.7-16.el9.noarch 2026-02-22T23:24:17.843 INFO:teuthology.orchestra.run.trial073.stdout: python3-requests-2.25.1-10.el9.noarch 2026-02-22T23:24:17.843 INFO:teuthology.orchestra.run.trial073.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2026-02-22T23:24:17.843 INFO:teuthology.orchestra.run.trial073.stdout: python3-routes-2.5.1-5.el9.noarch 2026-02-22T23:24:17.843 INFO:teuthology.orchestra.run.trial073.stdout: python3-rsa-4.9-2.el9.noarch 2026-02-22T23:24:17.843 INFO:teuthology.orchestra.run.trial073.stdout: python3-saml-1.16.0-1.el9.noarch 2026-02-22T23:24:17.843 INFO:teuthology.orchestra.run.trial073.stdout: python3-scipy-1.9.3-2.el9.x86_64 2026-02-22T23:24:17.843 INFO:teuthology.orchestra.run.trial073.stdout: python3-tempora-5.0.0-2.el9.noarch 2026-02-22T23:24:17.843 INFO:teuthology.orchestra.run.trial073.stdout: python3-toml-0.10.2-6.el9.noarch 2026-02-22T23:24:17.843 INFO:teuthology.orchestra.run.trial073.stdout: python3-typing-extensions-4.15.0-1.el9.noarch 2026-02-22T23:24:17.843 INFO:teuthology.orchestra.run.trial073.stdout: python3-urllib3-1.26.5-7.el9.noarch 2026-02-22T23:24:17.844 INFO:teuthology.orchestra.run.trial073.stdout: python3-webob-1.8.8-2.el9.noarch 2026-02-22T23:24:17.844 INFO:teuthology.orchestra.run.trial073.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2026-02-22T23:24:17.844 INFO:teuthology.orchestra.run.trial073.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2026-02-22T23:24:17.844 INFO:teuthology.orchestra.run.trial073.stdout: python3-xmlsec-1.3.13-1.el9.x86_64 2026-02-22T23:24:17.844 INFO:teuthology.orchestra.run.trial073.stdout: python3-xmltodict-0.12.0-15.el9.noarch 2026-02-22T23:24:17.844 INFO:teuthology.orchestra.run.trial073.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2026-02-22T23:24:17.844 INFO:teuthology.orchestra.run.trial073.stdout: unzip-6.0-59.el9.x86_64 2026-02-22T23:24:17.844 INFO:teuthology.orchestra.run.trial073.stdout: xmlsec1-1.2.29-13.el9.x86_64 2026-02-22T23:24:17.844 INFO:teuthology.orchestra.run.trial073.stdout: xmlsec1-openssl-1.2.29-13.el9.x86_64 2026-02-22T23:24:17.844 INFO:teuthology.orchestra.run.trial073.stdout: zip-3.0-35.el9.x86_64 2026-02-22T23:24:17.844 INFO:teuthology.orchestra.run.trial073.stdout: 2026-02-22T23:24:17.844 INFO:teuthology.orchestra.run.trial073.stdout:Complete! 2026-02-22T23:24:17.893 DEBUG:teuthology.orchestra.run.trial073:> sudo yum -y install ceph-base 2026-02-22T23:24:18.204 INFO:teuthology.orchestra.run.trial073.stdout:Last metadata expiration check: 0:00:32 ago on Sun 22 Feb 2026 11:23:46 PM UTC. 2026-02-22T23:24:18.269 INFO:teuthology.orchestra.run.trial073.stdout:Package ceph-base-2:19.2.3-689.gf90f4eae.el9.x86_64 is already installed. 2026-02-22T23:24:18.287 INFO:teuthology.orchestra.run.trial073.stdout:Dependencies resolved. 2026-02-22T23:24:18.287 INFO:teuthology.orchestra.run.trial073.stdout:Nothing to do. 2026-02-22T23:24:18.288 INFO:teuthology.orchestra.run.trial073.stdout:Complete! 2026-02-22T23:24:18.309 DEBUG:teuthology.orchestra.run.trial073:> sudo yum -y install cephadm 2026-02-22T23:24:18.620 INFO:teuthology.orchestra.run.trial073.stdout:Last metadata expiration check: 0:00:32 ago on Sun 22 Feb 2026 11:23:46 PM UTC. 2026-02-22T23:24:18.686 INFO:teuthology.orchestra.run.trial073.stdout:Package cephadm-2:19.2.3-689.gf90f4eae.el9.noarch is already installed. 2026-02-22T23:24:18.705 INFO:teuthology.orchestra.run.trial073.stdout:Dependencies resolved. 2026-02-22T23:24:18.705 INFO:teuthology.orchestra.run.trial073.stdout:Nothing to do. 2026-02-22T23:24:18.705 INFO:teuthology.orchestra.run.trial073.stdout:Complete! 2026-02-22T23:24:18.727 DEBUG:teuthology.orchestra.run.trial073:> sudo yum -y install ceph-immutable-object-cache 2026-02-22T23:24:19.034 INFO:teuthology.orchestra.run.trial073.stdout:Last metadata expiration check: 0:00:33 ago on Sun 22 Feb 2026 11:23:46 PM UTC. 2026-02-22T23:24:19.117 INFO:teuthology.orchestra.run.trial073.stdout:Dependencies resolved. 2026-02-22T23:24:19.118 INFO:teuthology.orchestra.run.trial073.stdout:================================================================================ 2026-02-22T23:24:19.118 INFO:teuthology.orchestra.run.trial073.stdout: Package Arch Version Repo Size 2026-02-22T23:24:19.118 INFO:teuthology.orchestra.run.trial073.stdout:================================================================================ 2026-02-22T23:24:19.118 INFO:teuthology.orchestra.run.trial073.stdout:Installing: 2026-02-22T23:24:19.118 INFO:teuthology.orchestra.run.trial073.stdout: ceph-immutable-object-cache x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 145 k 2026-02-22T23:24:19.118 INFO:teuthology.orchestra.run.trial073.stdout: 2026-02-22T23:24:19.118 INFO:teuthology.orchestra.run.trial073.stdout:Transaction Summary 2026-02-22T23:24:19.118 INFO:teuthology.orchestra.run.trial073.stdout:================================================================================ 2026-02-22T23:24:19.118 INFO:teuthology.orchestra.run.trial073.stdout:Install 1 Package 2026-02-22T23:24:19.118 INFO:teuthology.orchestra.run.trial073.stdout: 2026-02-22T23:24:19.118 INFO:teuthology.orchestra.run.trial073.stdout:Total download size: 145 k 2026-02-22T23:24:19.118 INFO:teuthology.orchestra.run.trial073.stdout:Installed size: 431 k 2026-02-22T23:24:19.118 INFO:teuthology.orchestra.run.trial073.stdout:Downloading Packages: 2026-02-22T23:24:19.206 INFO:teuthology.orchestra.run.trial073.stdout:ceph-immutable-object-cache-19.2.3-689.gf90f4ea 1.6 MB/s | 145 kB 00:00 2026-02-22T23:24:19.206 INFO:teuthology.orchestra.run.trial073.stdout:-------------------------------------------------------------------------------- 2026-02-22T23:24:19.207 INFO:teuthology.orchestra.run.trial073.stdout:Total 1.6 MB/s | 145 kB 00:00 2026-02-22T23:24:19.207 INFO:teuthology.orchestra.run.trial073.stdout:Running transaction check 2026-02-22T23:24:19.211 INFO:teuthology.orchestra.run.trial073.stdout:Transaction check succeeded. 2026-02-22T23:24:19.211 INFO:teuthology.orchestra.run.trial073.stdout:Running transaction test 2026-02-22T23:24:19.243 INFO:teuthology.orchestra.run.trial073.stdout:Transaction test succeeded. 2026-02-22T23:24:19.244 INFO:teuthology.orchestra.run.trial073.stdout:Running transaction 2026-02-22T23:24:19.299 INFO:teuthology.orchestra.run.trial073.stdout: Preparing : 1/1 2026-02-22T23:24:19.300 INFO:teuthology.orchestra.run.trial073.stdout: Installing : ceph-immutable-object-cache-2:19.2.3-689.gf90f4eae.e 1/1 2026-02-22T23:24:19.323 INFO:teuthology.orchestra.run.trial073.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.2.3-689.gf90f4eae.e 1/1 2026-02-22T23:24:19.323 INFO:teuthology.orchestra.run.trial073.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-22T23:24:19.323 INFO:teuthology.orchestra.run.trial073.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2026-02-22T23:24:19.323 INFO:teuthology.orchestra.run.trial073.stdout: 2026-02-22T23:24:19.638 INFO:teuthology.orchestra.run.trial073.stdout: Verifying : ceph-immutable-object-cache-2:19.2.3-689.gf90f4eae.e 1/1 2026-02-22T23:24:19.639 INFO:teuthology.orchestra.run.trial073.stdout: 2026-02-22T23:24:19.639 INFO:teuthology.orchestra.run.trial073.stdout:Installed: 2026-02-22T23:24:19.639 INFO:teuthology.orchestra.run.trial073.stdout: ceph-immutable-object-cache-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T23:24:19.639 INFO:teuthology.orchestra.run.trial073.stdout: 2026-02-22T23:24:19.639 INFO:teuthology.orchestra.run.trial073.stdout:Complete! 2026-02-22T23:24:19.666 DEBUG:teuthology.orchestra.run.trial073:> sudo yum -y install ceph-mgr 2026-02-22T23:24:19.978 INFO:teuthology.orchestra.run.trial073.stdout:Last metadata expiration check: 0:00:33 ago on Sun 22 Feb 2026 11:23:46 PM UTC. 2026-02-22T23:24:20.044 INFO:teuthology.orchestra.run.trial073.stdout:Package ceph-mgr-2:19.2.3-689.gf90f4eae.el9.x86_64 is already installed. 2026-02-22T23:24:20.062 INFO:teuthology.orchestra.run.trial073.stdout:Dependencies resolved. 2026-02-22T23:24:20.063 INFO:teuthology.orchestra.run.trial073.stdout:Nothing to do. 2026-02-22T23:24:20.063 INFO:teuthology.orchestra.run.trial073.stdout:Complete! 2026-02-22T23:24:20.086 DEBUG:teuthology.orchestra.run.trial073:> sudo yum -y install ceph-mgr-dashboard 2026-02-22T23:24:20.396 INFO:teuthology.orchestra.run.trial073.stdout:Last metadata expiration check: 0:00:34 ago on Sun 22 Feb 2026 11:23:46 PM UTC. 2026-02-22T23:24:20.463 INFO:teuthology.orchestra.run.trial073.stdout:Package ceph-mgr-dashboard-2:19.2.3-689.gf90f4eae.el9.noarch is already installed. 2026-02-22T23:24:20.481 INFO:teuthology.orchestra.run.trial073.stdout:Dependencies resolved. 2026-02-22T23:24:20.481 INFO:teuthology.orchestra.run.trial073.stdout:Nothing to do. 2026-02-22T23:24:20.481 INFO:teuthology.orchestra.run.trial073.stdout:Complete! 2026-02-22T23:24:20.503 DEBUG:teuthology.orchestra.run.trial073:> sudo yum -y install ceph-mgr-diskprediction-local 2026-02-22T23:24:20.813 INFO:teuthology.orchestra.run.trial073.stdout:Last metadata expiration check: 0:00:34 ago on Sun 22 Feb 2026 11:23:46 PM UTC. 2026-02-22T23:24:20.878 INFO:teuthology.orchestra.run.trial073.stdout:Package ceph-mgr-diskprediction-local-2:19.2.3-689.gf90f4eae.el9.noarch is already installed. 2026-02-22T23:24:20.897 INFO:teuthology.orchestra.run.trial073.stdout:Dependencies resolved. 2026-02-22T23:24:20.897 INFO:teuthology.orchestra.run.trial073.stdout:Nothing to do. 2026-02-22T23:24:20.897 INFO:teuthology.orchestra.run.trial073.stdout:Complete! 2026-02-22T23:24:20.919 DEBUG:teuthology.orchestra.run.trial073:> sudo yum -y install ceph-mgr-rook 2026-02-22T23:24:21.230 INFO:teuthology.orchestra.run.trial073.stdout:Last metadata expiration check: 0:00:35 ago on Sun 22 Feb 2026 11:23:46 PM UTC. 2026-02-22T23:24:21.296 INFO:teuthology.orchestra.run.trial073.stdout:Package ceph-mgr-rook-2:19.2.3-689.gf90f4eae.el9.noarch is already installed. 2026-02-22T23:24:21.314 INFO:teuthology.orchestra.run.trial073.stdout:Dependencies resolved. 2026-02-22T23:24:21.315 INFO:teuthology.orchestra.run.trial073.stdout:Nothing to do. 2026-02-22T23:24:21.315 INFO:teuthology.orchestra.run.trial073.stdout:Complete! 2026-02-22T23:24:21.338 DEBUG:teuthology.orchestra.run.trial073:> sudo yum -y install ceph-mgr-cephadm 2026-02-22T23:24:21.586 INFO:teuthology.orchestra.run.trial045.stdout: Running scriptlet: ceph-selinux-2:19.2.3-689.gf90f4eae.el9.x86_64 34/37 2026-02-22T23:24:21.586 INFO:teuthology.orchestra.run.trial045.stdout:skipping the directory /sys 2026-02-22T23:24:21.586 INFO:teuthology.orchestra.run.trial045.stdout:skipping the directory /proc 2026-02-22T23:24:21.586 INFO:teuthology.orchestra.run.trial045.stdout:skipping the directory /mnt 2026-02-22T23:24:21.586 INFO:teuthology.orchestra.run.trial045.stdout:skipping the directory /var/tmp 2026-02-22T23:24:21.586 INFO:teuthology.orchestra.run.trial045.stdout:skipping the directory /home 2026-02-22T23:24:21.586 INFO:teuthology.orchestra.run.trial045.stdout:skipping the directory /root 2026-02-22T23:24:21.586 INFO:teuthology.orchestra.run.trial045.stdout:skipping the directory /tmp 2026-02-22T23:24:21.586 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-22T23:24:21.655 INFO:teuthology.orchestra.run.trial073.stdout:Last metadata expiration check: 0:00:35 ago on Sun 22 Feb 2026 11:23:46 PM UTC. 2026-02-22T23:24:21.719 INFO:teuthology.orchestra.run.trial073.stdout:Package ceph-mgr-cephadm-2:19.2.3-689.gf90f4eae.el9.noarch is already installed. 2026-02-22T23:24:21.738 INFO:teuthology.orchestra.run.trial073.stdout:Dependencies resolved. 2026-02-22T23:24:21.738 INFO:teuthology.orchestra.run.trial073.stdout:Nothing to do. 2026-02-22T23:24:21.739 INFO:teuthology.orchestra.run.trial073.stdout:Complete! 2026-02-22T23:24:21.759 DEBUG:teuthology.orchestra.run.trial073:> sudo yum -y install ceph-fuse 2026-02-22T23:24:22.036 INFO:teuthology.orchestra.run.trial045.stdout: Installing : ceph-radosgw-2:19.2.3-689.gf90f4eae.el9.x86_64 35/37 2026-02-22T23:24:22.059 INFO:teuthology.orchestra.run.trial045.stdout: Running scriptlet: ceph-radosgw-2:19.2.3-689.gf90f4eae.el9.x86_64 35/37 2026-02-22T23:24:22.059 INFO:teuthology.orchestra.run.trial045.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-22T23:24:22.059 INFO:teuthology.orchestra.run.trial045.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2026-02-22T23:24:22.059 INFO:teuthology.orchestra.run.trial045.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-22T23:24:22.059 INFO:teuthology.orchestra.run.trial045.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-22T23:24:22.059 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-22T23:24:22.061 INFO:teuthology.orchestra.run.trial045.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 36/37 2026-02-22T23:24:22.069 INFO:teuthology.orchestra.run.trial073.stdout:Last metadata expiration check: 0:00:36 ago on Sun 22 Feb 2026 11:23:46 PM UTC. 2026-02-22T23:24:22.074 INFO:teuthology.orchestra.run.trial045.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 36/37 2026-02-22T23:24:22.074 INFO:teuthology.orchestra.run.trial045.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 37/37 2026-02-22T23:24:22.128 INFO:teuthology.orchestra.run.trial045.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 37/37 2026-02-22T23:24:22.128 INFO:teuthology.orchestra.run.trial045.stdout:Creating group 'qat' with GID 992. 2026-02-22T23:24:22.129 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-22T23:24:22.154 INFO:teuthology.orchestra.run.trial073.stdout:Dependencies resolved. 2026-02-22T23:24:22.154 INFO:teuthology.orchestra.run.trial073.stdout:================================================================================ 2026-02-22T23:24:22.154 INFO:teuthology.orchestra.run.trial073.stdout: Package Architecture Version Repository Size 2026-02-22T23:24:22.154 INFO:teuthology.orchestra.run.trial073.stdout:================================================================================ 2026-02-22T23:24:22.154 INFO:teuthology.orchestra.run.trial073.stdout:Installing: 2026-02-22T23:24:22.154 INFO:teuthology.orchestra.run.trial073.stdout: ceph-fuse x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 1.2 M 2026-02-22T23:24:22.154 INFO:teuthology.orchestra.run.trial073.stdout: 2026-02-22T23:24:22.154 INFO:teuthology.orchestra.run.trial073.stdout:Transaction Summary 2026-02-22T23:24:22.154 INFO:teuthology.orchestra.run.trial073.stdout:================================================================================ 2026-02-22T23:24:22.155 INFO:teuthology.orchestra.run.trial073.stdout:Install 1 Package 2026-02-22T23:24:22.155 INFO:teuthology.orchestra.run.trial073.stdout: 2026-02-22T23:24:22.155 INFO:teuthology.orchestra.run.trial073.stdout:Total download size: 1.2 M 2026-02-22T23:24:22.155 INFO:teuthology.orchestra.run.trial073.stdout:Installed size: 3.6 M 2026-02-22T23:24:22.155 INFO:teuthology.orchestra.run.trial073.stdout:Downloading Packages: 2026-02-22T23:24:22.277 INFO:teuthology.orchestra.run.trial073.stdout:ceph-fuse-19.2.3-689.gf90f4eae.el9.x86_64.rpm 9.4 MB/s | 1.2 MB 00:00 2026-02-22T23:24:22.277 INFO:teuthology.orchestra.run.trial073.stdout:-------------------------------------------------------------------------------- 2026-02-22T23:24:22.277 INFO:teuthology.orchestra.run.trial073.stdout:Total 9.3 MB/s | 1.2 MB 00:00 2026-02-22T23:24:22.277 INFO:teuthology.orchestra.run.trial073.stdout:Running transaction check 2026-02-22T23:24:22.281 INFO:teuthology.orchestra.run.trial073.stdout:Transaction check succeeded. 2026-02-22T23:24:22.281 INFO:teuthology.orchestra.run.trial073.stdout:Running transaction test 2026-02-22T23:24:22.318 INFO:teuthology.orchestra.run.trial073.stdout:Transaction test succeeded. 2026-02-22T23:24:22.318 INFO:teuthology.orchestra.run.trial073.stdout:Running transaction 2026-02-22T23:24:22.419 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : ceph-base-2:19.2.3-689.gf90f4eae.el9.x86_64 1/37 2026-02-22T23:24:22.420 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : ceph-common-2:19.2.3-689.gf90f4eae.el9.x86_64 2/37 2026-02-22T23:24:22.420 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : ceph-radosgw-2:19.2.3-689.gf90f4eae.el9.x86_64 3/37 2026-02-22T23:24:22.420 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : ceph-selinux-2:19.2.3-689.gf90f4eae.el9.x86_64 4/37 2026-02-22T23:24:22.420 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : libcephfs2-2:19.2.3-689.gf90f4eae.el9.x86_64 5/37 2026-02-22T23:24:22.420 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : libradosstriper1-2:19.2.3-689.gf90f4eae.el9.x86_64 6/37 2026-02-22T23:24:22.420 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : librgw2-2:19.2.3-689.gf90f4eae.el9.x86_64 7/37 2026-02-22T23:24:22.420 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : python3-ceph-argparse-2:19.2.3-689.gf90f4eae.el9.x 8/37 2026-02-22T23:24:22.420 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : python3-ceph-common-2:19.2.3-689.gf90f4eae.el9.x86 9/37 2026-02-22T23:24:22.420 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : python3-cephfs-2:19.2.3-689.gf90f4eae.el9.x86_64 10/37 2026-02-22T23:24:22.420 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : python3-rados-2:19.2.3-689.gf90f4eae.el9.x86_64 11/37 2026-02-22T23:24:22.421 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : python3-rbd-2:19.2.3-689.gf90f4eae.el9.x86_64 12/37 2026-02-22T23:24:22.421 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : python3-rgw-2:19.2.3-689.gf90f4eae.el9.x86_64 13/37 2026-02-22T23:24:22.421 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : mailcap-2.1.49-5.el9.noarch 14/37 2026-02-22T23:24:22.421 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : nvme-cli-2.16-1.el9.x86_64 15/37 2026-02-22T23:24:22.421 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : pciutils-3.7.0-7.el9.x86_64 16/37 2026-02-22T23:24:22.421 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : boost-program-options-1.75.0-13.el9.x86_64 17/37 2026-02-22T23:24:22.421 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : libnbd-1.20.3-4.el9.x86_64 18/37 2026-02-22T23:24:22.421 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 19/37 2026-02-22T23:24:22.421 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 20/37 2026-02-22T23:24:22.421 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 21/37 2026-02-22T23:24:22.421 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 22/37 2026-02-22T23:24:22.421 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : qatlib-25.08.0-2.el9.x86_64 23/37 2026-02-22T23:24:22.422 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : qatlib-service-25.08.0-2.el9.x86_64 24/37 2026-02-22T23:24:22.422 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : qatzip-libs-1.3.1-1.el9.x86_64 25/37 2026-02-22T23:24:22.422 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 26/37 2026-02-22T23:24:22.422 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : libarrow-9.0.0-15.el9.x86_64 27/37 2026-02-22T23:24:22.422 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : libarrow-doc-9.0.0-15.el9.noarch 28/37 2026-02-22T23:24:22.422 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : liboath-2.6.12-1.el9.x86_64 29/37 2026-02-22T23:24:22.422 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 30/37 2026-02-22T23:24:22.422 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : parquet-libs-9.0.0-15.el9.x86_64 31/37 2026-02-22T23:24:22.422 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : re2-1:20211101-20.el9.x86_64 32/37 2026-02-22T23:24:22.422 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : thrift-0.15.0-4.el9.x86_64 33/37 2026-02-22T23:24:22.422 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : librados2-2:19.2.3-689.gf90f4eae.el9.x86_64 34/37 2026-02-22T23:24:22.422 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 35/37 2026-02-22T23:24:22.422 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : librbd1-2:19.2.3-689.gf90f4eae.el9.x86_64 36/37 2026-02-22T23:24:22.423 INFO:teuthology.orchestra.run.trial073.stdout: Preparing : 1/1 2026-02-22T23:24:22.438 INFO:teuthology.orchestra.run.trial073.stdout: Installing : ceph-fuse-2:19.2.3-689.gf90f4eae.el9.x86_64 1/1 2026-02-22T23:24:22.481 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 37/37 2026-02-22T23:24:22.481 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-22T23:24:22.481 INFO:teuthology.orchestra.run.trial045.stdout:Upgraded: 2026-02-22T23:24:22.481 INFO:teuthology.orchestra.run.trial045.stdout: librados2-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T23:24:22.481 INFO:teuthology.orchestra.run.trial045.stdout: librbd1-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T23:24:22.481 INFO:teuthology.orchestra.run.trial045.stdout:Installed: 2026-02-22T23:24:22.481 INFO:teuthology.orchestra.run.trial045.stdout: boost-program-options-1.75.0-13.el9.x86_64 2026-02-22T23:24:22.482 INFO:teuthology.orchestra.run.trial045.stdout: ceph-base-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T23:24:22.482 INFO:teuthology.orchestra.run.trial045.stdout: ceph-common-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T23:24:22.482 INFO:teuthology.orchestra.run.trial045.stdout: ceph-radosgw-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T23:24:22.482 INFO:teuthology.orchestra.run.trial045.stdout: ceph-selinux-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T23:24:22.482 INFO:teuthology.orchestra.run.trial045.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2026-02-22T23:24:22.482 INFO:teuthology.orchestra.run.trial045.stdout: libarrow-9.0.0-15.el9.x86_64 2026-02-22T23:24:22.482 INFO:teuthology.orchestra.run.trial045.stdout: libarrow-doc-9.0.0-15.el9.noarch 2026-02-22T23:24:22.482 INFO:teuthology.orchestra.run.trial045.stdout: libcephfs2-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T23:24:22.482 INFO:teuthology.orchestra.run.trial045.stdout: libnbd-1.20.3-4.el9.x86_64 2026-02-22T23:24:22.482 INFO:teuthology.orchestra.run.trial045.stdout: liboath-2.6.12-1.el9.x86_64 2026-02-22T23:24:22.482 INFO:teuthology.orchestra.run.trial045.stdout: libpmemobj-1.12.1-1.el9.x86_64 2026-02-22T23:24:22.482 INFO:teuthology.orchestra.run.trial045.stdout: librabbitmq-0.11.0-7.el9.x86_64 2026-02-22T23:24:22.483 INFO:teuthology.orchestra.run.trial045.stdout: libradosstriper1-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T23:24:22.483 INFO:teuthology.orchestra.run.trial045.stdout: librdkafka-1.6.1-102.el9.x86_64 2026-02-22T23:24:22.483 INFO:teuthology.orchestra.run.trial045.stdout: librgw2-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T23:24:22.483 INFO:teuthology.orchestra.run.trial045.stdout: libunwind-1.6.2-1.el9.x86_64 2026-02-22T23:24:22.483 INFO:teuthology.orchestra.run.trial045.stdout: lttng-ust-2.12.0-6.el9.x86_64 2026-02-22T23:24:22.483 INFO:teuthology.orchestra.run.trial045.stdout: mailcap-2.1.49-5.el9.noarch 2026-02-22T23:24:22.483 INFO:teuthology.orchestra.run.trial045.stdout: nvme-cli-2.16-1.el9.x86_64 2026-02-22T23:24:22.483 INFO:teuthology.orchestra.run.trial045.stdout: parquet-libs-9.0.0-15.el9.x86_64 2026-02-22T23:24:22.483 INFO:teuthology.orchestra.run.trial045.stdout: pciutils-3.7.0-7.el9.x86_64 2026-02-22T23:24:22.483 INFO:teuthology.orchestra.run.trial045.stdout: python3-ceph-argparse-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T23:24:22.483 INFO:teuthology.orchestra.run.trial045.stdout: python3-ceph-common-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T23:24:22.483 INFO:teuthology.orchestra.run.trial045.stdout: python3-cephfs-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T23:24:22.484 INFO:teuthology.orchestra.run.trial045.stdout: python3-rados-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T23:24:22.484 INFO:teuthology.orchestra.run.trial045.stdout: python3-rbd-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T23:24:22.484 INFO:teuthology.orchestra.run.trial045.stdout: python3-rgw-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T23:24:22.484 INFO:teuthology.orchestra.run.trial045.stdout: qatlib-25.08.0-2.el9.x86_64 2026-02-22T23:24:22.484 INFO:teuthology.orchestra.run.trial045.stdout: qatlib-service-25.08.0-2.el9.x86_64 2026-02-22T23:24:22.484 INFO:teuthology.orchestra.run.trial045.stdout: qatzip-libs-1.3.1-1.el9.x86_64 2026-02-22T23:24:22.484 INFO:teuthology.orchestra.run.trial045.stdout: re2-1:20211101-20.el9.x86_64 2026-02-22T23:24:22.484 INFO:teuthology.orchestra.run.trial045.stdout: thrift-0.15.0-4.el9.x86_64 2026-02-22T23:24:22.484 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-22T23:24:22.484 INFO:teuthology.orchestra.run.trial045.stdout:Complete! 2026-02-22T23:24:22.523 DEBUG:teuthology.orchestra.run.trial045:> sudo yum -y install ceph-test 2026-02-22T23:24:22.659 INFO:teuthology.orchestra.run.trial073.stdout: Running scriptlet: ceph-fuse-2:19.2.3-689.gf90f4eae.el9.x86_64 1/1 2026-02-22T23:24:22.716 INFO:teuthology.orchestra.run.trial073.stdout: Verifying : ceph-fuse-2:19.2.3-689.gf90f4eae.el9.x86_64 1/1 2026-02-22T23:24:22.716 INFO:teuthology.orchestra.run.trial073.stdout: 2026-02-22T23:24:22.717 INFO:teuthology.orchestra.run.trial073.stdout:Installed: 2026-02-22T23:24:22.717 INFO:teuthology.orchestra.run.trial073.stdout: ceph-fuse-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T23:24:22.717 INFO:teuthology.orchestra.run.trial073.stdout: 2026-02-22T23:24:22.717 INFO:teuthology.orchestra.run.trial073.stdout:Complete! 2026-02-22T23:24:22.744 DEBUG:teuthology.orchestra.run.trial073:> sudo yum -y install ceph-volume 2026-02-22T23:24:22.834 INFO:teuthology.orchestra.run.trial045.stdout:Last metadata expiration check: 0:00:13 ago on Sun 22 Feb 2026 11:24:09 PM UTC. 2026-02-22T23:24:22.914 INFO:teuthology.orchestra.run.trial045.stdout:Dependencies resolved. 2026-02-22T23:24:22.915 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-22T23:24:22.915 INFO:teuthology.orchestra.run.trial045.stdout: Package Arch Version Repository Size 2026-02-22T23:24:22.915 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-22T23:24:22.915 INFO:teuthology.orchestra.run.trial045.stdout:Installing: 2026-02-22T23:24:22.915 INFO:teuthology.orchestra.run.trial045.stdout: ceph-test x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 50 M 2026-02-22T23:24:22.915 INFO:teuthology.orchestra.run.trial045.stdout:Installing dependencies: 2026-02-22T23:24:22.915 INFO:teuthology.orchestra.run.trial045.stdout: libcephsqlite x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 163 k 2026-02-22T23:24:22.915 INFO:teuthology.orchestra.run.trial045.stdout: libxslt x86_64 1.1.34-12.el9 appstream 233 k 2026-02-22T23:24:22.915 INFO:teuthology.orchestra.run.trial045.stdout: socat x86_64 1.7.4.1-8.el9 appstream 303 k 2026-02-22T23:24:22.915 INFO:teuthology.orchestra.run.trial045.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2026-02-22T23:24:22.915 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-22T23:24:22.915 INFO:teuthology.orchestra.run.trial045.stdout:Transaction Summary 2026-02-22T23:24:22.915 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-22T23:24:22.915 INFO:teuthology.orchestra.run.trial045.stdout:Install 5 Packages 2026-02-22T23:24:22.915 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-22T23:24:22.916 INFO:teuthology.orchestra.run.trial045.stdout:Total download size: 50 M 2026-02-22T23:24:22.916 INFO:teuthology.orchestra.run.trial045.stdout:Installed size: 212 M 2026-02-22T23:24:22.916 INFO:teuthology.orchestra.run.trial045.stdout:Downloading Packages: 2026-02-22T23:24:23.057 INFO:teuthology.orchestra.run.trial073.stdout:Last metadata expiration check: 0:00:37 ago on Sun 22 Feb 2026 11:23:46 PM UTC. 2026-02-22T23:24:23.064 INFO:teuthology.orchestra.run.trial045.stdout:(1/5): libcephsqlite-19.2.3-689.gf90f4eae.el9.x 1.8 MB/s | 163 kB 00:00 2026-02-22T23:24:23.122 INFO:teuthology.orchestra.run.trial073.stdout:Package ceph-volume-2:19.2.3-689.gf90f4eae.el9.noarch is already installed. 2026-02-22T23:24:23.141 INFO:teuthology.orchestra.run.trial073.stdout:Dependencies resolved. 2026-02-22T23:24:23.142 INFO:teuthology.orchestra.run.trial073.stdout:Nothing to do. 2026-02-22T23:24:23.142 INFO:teuthology.orchestra.run.trial073.stdout:Complete! 2026-02-22T23:24:23.164 DEBUG:teuthology.orchestra.run.trial073:> sudo yum -y install librados-devel 2026-02-22T23:24:23.472 INFO:teuthology.orchestra.run.trial073.stdout:Last metadata expiration check: 0:00:37 ago on Sun 22 Feb 2026 11:23:46 PM UTC. 2026-02-22T23:24:23.556 INFO:teuthology.orchestra.run.trial073.stdout:Dependencies resolved. 2026-02-22T23:24:23.556 INFO:teuthology.orchestra.run.trial073.stdout:================================================================================ 2026-02-22T23:24:23.557 INFO:teuthology.orchestra.run.trial073.stdout: Package Arch Version Repo Size 2026-02-22T23:24:23.557 INFO:teuthology.orchestra.run.trial073.stdout:================================================================================ 2026-02-22T23:24:23.557 INFO:teuthology.orchestra.run.trial073.stdout:Installing: 2026-02-22T23:24:23.557 INFO:teuthology.orchestra.run.trial073.stdout: librados-devel x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 126 k 2026-02-22T23:24:23.557 INFO:teuthology.orchestra.run.trial073.stdout: 2026-02-22T23:24:23.557 INFO:teuthology.orchestra.run.trial073.stdout:Transaction Summary 2026-02-22T23:24:23.557 INFO:teuthology.orchestra.run.trial073.stdout:================================================================================ 2026-02-22T23:24:23.557 INFO:teuthology.orchestra.run.trial073.stdout:Install 1 Package 2026-02-22T23:24:23.557 INFO:teuthology.orchestra.run.trial073.stdout: 2026-02-22T23:24:23.557 INFO:teuthology.orchestra.run.trial073.stdout:Total download size: 126 k 2026-02-22T23:24:23.557 INFO:teuthology.orchestra.run.trial073.stdout:Installed size: 456 k 2026-02-22T23:24:23.557 INFO:teuthology.orchestra.run.trial073.stdout:Downloading Packages: 2026-02-22T23:24:23.636 INFO:teuthology.orchestra.run.trial045.stdout:(2/5): libxslt-1.1.34-12.el9.x86_64.rpm 353 kB/s | 233 kB 00:00 2026-02-22T23:24:23.715 INFO:teuthology.orchestra.run.trial045.stdout:(3/5): socat-1.7.4.1-8.el9.x86_64.rpm 466 kB/s | 303 kB 00:00 2026-02-22T23:24:23.726 INFO:teuthology.orchestra.run.trial045.stdout:(4/5): xmlstarlet-1.6.1-20.el9.x86_64.rpm 708 kB/s | 64 kB 00:00 2026-02-22T23:24:23.918 INFO:teuthology.orchestra.run.trial073.stdout:librados-devel-19.2.3-689.gf90f4eae.el9.x86_64. 350 kB/s | 126 kB 00:00 2026-02-22T23:24:23.918 INFO:teuthology.orchestra.run.trial073.stdout:-------------------------------------------------------------------------------- 2026-02-22T23:24:23.918 INFO:teuthology.orchestra.run.trial073.stdout:Total 349 kB/s | 126 kB 00:00 2026-02-22T23:24:23.919 INFO:teuthology.orchestra.run.trial073.stdout:Running transaction check 2026-02-22T23:24:23.922 INFO:teuthology.orchestra.run.trial073.stdout:Transaction check succeeded. 2026-02-22T23:24:23.922 INFO:teuthology.orchestra.run.trial073.stdout:Running transaction test 2026-02-22T23:24:23.954 INFO:teuthology.orchestra.run.trial073.stdout:Transaction test succeeded. 2026-02-22T23:24:23.955 INFO:teuthology.orchestra.run.trial073.stdout:Running transaction 2026-02-22T23:24:23.999 INFO:teuthology.orchestra.run.trial045.stdout:(5/5): ceph-test-19.2.3-689.gf90f4eae.el9.x86_6 48 MB/s | 50 MB 00:01 2026-02-22T23:24:24.001 INFO:teuthology.orchestra.run.trial045.stdout:-------------------------------------------------------------------------------- 2026-02-22T23:24:24.001 INFO:teuthology.orchestra.run.trial045.stdout:Total 46 MB/s | 50 MB 00:01 2026-02-22T23:24:24.009 INFO:teuthology.orchestra.run.trial073.stdout: Preparing : 1/1 2026-02-22T23:24:24.026 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction check 2026-02-22T23:24:24.027 INFO:teuthology.orchestra.run.trial073.stdout: Installing : librados-devel-2:19.2.3-689.gf90f4eae.el9.x86_64 1/1 2026-02-22T23:24:24.036 INFO:teuthology.orchestra.run.trial045.stdout:Transaction check succeeded. 2026-02-22T23:24:24.036 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction test 2026-02-22T23:24:24.111 INFO:teuthology.orchestra.run.trial073.stdout: Running scriptlet: librados-devel-2:19.2.3-689.gf90f4eae.el9.x86_64 1/1 2026-02-22T23:24:24.169 INFO:teuthology.orchestra.run.trial073.stdout: Verifying : librados-devel-2:19.2.3-689.gf90f4eae.el9.x86_64 1/1 2026-02-22T23:24:24.169 INFO:teuthology.orchestra.run.trial073.stdout: 2026-02-22T23:24:24.169 INFO:teuthology.orchestra.run.trial073.stdout:Installed: 2026-02-22T23:24:24.169 INFO:teuthology.orchestra.run.trial073.stdout: librados-devel-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T23:24:24.169 INFO:teuthology.orchestra.run.trial073.stdout: 2026-02-22T23:24:24.170 INFO:teuthology.orchestra.run.trial073.stdout:Complete! 2026-02-22T23:24:24.198 DEBUG:teuthology.orchestra.run.trial073:> sudo yum -y install libcephfs2 2026-02-22T23:24:24.222 INFO:teuthology.orchestra.run.trial045.stdout:Transaction test succeeded. 2026-02-22T23:24:24.222 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction 2026-02-22T23:24:24.433 INFO:teuthology.orchestra.run.trial045.stdout: Preparing : 1/1 2026-02-22T23:24:24.439 INFO:teuthology.orchestra.run.trial045.stdout: Installing : socat-1.7.4.1-8.el9.x86_64 1/5 2026-02-22T23:24:24.443 INFO:teuthology.orchestra.run.trial045.stdout: Installing : libxslt-1.1.34-12.el9.x86_64 2/5 2026-02-22T23:24:24.451 INFO:teuthology.orchestra.run.trial045.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 3/5 2026-02-22T23:24:24.452 INFO:teuthology.orchestra.run.trial045.stdout: Installing : libcephsqlite-2:19.2.3-689.gf90f4eae.el9.x86_64 4/5 2026-02-22T23:24:24.508 INFO:teuthology.orchestra.run.trial073.stdout:Last metadata expiration check: 0:00:38 ago on Sun 22 Feb 2026 11:23:46 PM UTC. 2026-02-22T23:24:24.573 INFO:teuthology.orchestra.run.trial073.stdout:Package libcephfs2-2:19.2.3-689.gf90f4eae.el9.x86_64 is already installed. 2026-02-22T23:24:24.593 INFO:teuthology.orchestra.run.trial073.stdout:Dependencies resolved. 2026-02-22T23:24:24.593 INFO:teuthology.orchestra.run.trial073.stdout:Nothing to do. 2026-02-22T23:24:24.593 INFO:teuthology.orchestra.run.trial073.stdout:Complete! 2026-02-22T23:24:24.615 DEBUG:teuthology.orchestra.run.trial073:> sudo yum -y install libcephfs-devel 2026-02-22T23:24:24.926 INFO:teuthology.orchestra.run.trial073.stdout:Last metadata expiration check: 0:00:38 ago on Sun 22 Feb 2026 11:23:46 PM UTC. 2026-02-22T23:24:25.011 INFO:teuthology.orchestra.run.trial073.stdout:Dependencies resolved. 2026-02-22T23:24:25.012 INFO:teuthology.orchestra.run.trial073.stdout:================================================================================ 2026-02-22T23:24:25.012 INFO:teuthology.orchestra.run.trial073.stdout: Package Arch Version Repo Size 2026-02-22T23:24:25.012 INFO:teuthology.orchestra.run.trial073.stdout:================================================================================ 2026-02-22T23:24:25.012 INFO:teuthology.orchestra.run.trial073.stdout:Installing: 2026-02-22T23:24:25.013 INFO:teuthology.orchestra.run.trial073.stdout: libcephfs-devel x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 34 k 2026-02-22T23:24:25.013 INFO:teuthology.orchestra.run.trial073.stdout: 2026-02-22T23:24:25.013 INFO:teuthology.orchestra.run.trial073.stdout:Transaction Summary 2026-02-22T23:24:25.013 INFO:teuthology.orchestra.run.trial073.stdout:================================================================================ 2026-02-22T23:24:25.013 INFO:teuthology.orchestra.run.trial073.stdout:Install 1 Package 2026-02-22T23:24:25.013 INFO:teuthology.orchestra.run.trial073.stdout: 2026-02-22T23:24:25.014 INFO:teuthology.orchestra.run.trial073.stdout:Total download size: 34 k 2026-02-22T23:24:25.014 INFO:teuthology.orchestra.run.trial073.stdout:Installed size: 153 k 2026-02-22T23:24:25.014 INFO:teuthology.orchestra.run.trial073.stdout:Downloading Packages: 2026-02-22T23:24:25.107 INFO:teuthology.orchestra.run.trial073.stdout:libcephfs-devel-19.2.3-689.gf90f4eae.el9.x86_64 348 kB/s | 34 kB 00:00 2026-02-22T23:24:25.108 INFO:teuthology.orchestra.run.trial073.stdout:-------------------------------------------------------------------------------- 2026-02-22T23:24:25.108 INFO:teuthology.orchestra.run.trial073.stdout:Total 345 kB/s | 34 kB 00:00 2026-02-22T23:24:25.108 INFO:teuthology.orchestra.run.trial073.stdout:Running transaction check 2026-02-22T23:24:25.110 INFO:teuthology.orchestra.run.trial073.stdout:Transaction check succeeded. 2026-02-22T23:24:25.110 INFO:teuthology.orchestra.run.trial073.stdout:Running transaction test 2026-02-22T23:24:25.113 INFO:teuthology.orchestra.run.trial073.stdout:Transaction test succeeded. 2026-02-22T23:24:25.114 INFO:teuthology.orchestra.run.trial073.stdout:Running transaction 2026-02-22T23:24:25.134 INFO:teuthology.orchestra.run.trial073.stdout: Preparing : 1/1 2026-02-22T23:24:25.150 INFO:teuthology.orchestra.run.trial073.stdout: Installing : libcephfs-devel-2:19.2.3-689.gf90f4eae.el9.x86_64 1/1 2026-02-22T23:24:25.205 INFO:teuthology.orchestra.run.trial073.stdout: Running scriptlet: libcephfs-devel-2:19.2.3-689.gf90f4eae.el9.x86_64 1/1 2026-02-22T23:24:25.263 INFO:teuthology.orchestra.run.trial073.stdout: Verifying : libcephfs-devel-2:19.2.3-689.gf90f4eae.el9.x86_64 1/1 2026-02-22T23:24:25.264 INFO:teuthology.orchestra.run.trial073.stdout: 2026-02-22T23:24:25.264 INFO:teuthology.orchestra.run.trial073.stdout:Installed: 2026-02-22T23:24:25.264 INFO:teuthology.orchestra.run.trial073.stdout: libcephfs-devel-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T23:24:25.264 INFO:teuthology.orchestra.run.trial073.stdout: 2026-02-22T23:24:25.264 INFO:teuthology.orchestra.run.trial073.stdout:Complete! 2026-02-22T23:24:25.294 DEBUG:teuthology.orchestra.run.trial073:> sudo yum -y install librados2 2026-02-22T23:24:25.599 INFO:teuthology.orchestra.run.trial073.stdout:Last metadata expiration check: 0:00:39 ago on Sun 22 Feb 2026 11:23:46 PM UTC. 2026-02-22T23:24:25.663 INFO:teuthology.orchestra.run.trial073.stdout:Package librados2-2:19.2.3-689.gf90f4eae.el9.x86_64 is already installed. 2026-02-22T23:24:25.682 INFO:teuthology.orchestra.run.trial073.stdout:Dependencies resolved. 2026-02-22T23:24:25.683 INFO:teuthology.orchestra.run.trial073.stdout:Nothing to do. 2026-02-22T23:24:25.683 INFO:teuthology.orchestra.run.trial073.stdout:Complete! 2026-02-22T23:24:25.704 DEBUG:teuthology.orchestra.run.trial073:> sudo yum -y install librbd1 2026-02-22T23:24:26.015 INFO:teuthology.orchestra.run.trial073.stdout:Last metadata expiration check: 0:00:40 ago on Sun 22 Feb 2026 11:23:46 PM UTC. 2026-02-22T23:24:26.080 INFO:teuthology.orchestra.run.trial073.stdout:Package librbd1-2:19.2.3-689.gf90f4eae.el9.x86_64 is already installed. 2026-02-22T23:24:26.098 INFO:teuthology.orchestra.run.trial073.stdout:Dependencies resolved. 2026-02-22T23:24:26.099 INFO:teuthology.orchestra.run.trial073.stdout:Nothing to do. 2026-02-22T23:24:26.099 INFO:teuthology.orchestra.run.trial073.stdout:Complete! 2026-02-22T23:24:26.119 DEBUG:teuthology.orchestra.run.trial073:> sudo yum -y install python3-rados 2026-02-22T23:24:26.436 INFO:teuthology.orchestra.run.trial073.stdout:Last metadata expiration check: 0:00:40 ago on Sun 22 Feb 2026 11:23:46 PM UTC. 2026-02-22T23:24:26.502 INFO:teuthology.orchestra.run.trial073.stdout:Package python3-rados-2:19.2.3-689.gf90f4eae.el9.x86_64 is already installed. 2026-02-22T23:24:26.521 INFO:teuthology.orchestra.run.trial073.stdout:Dependencies resolved. 2026-02-22T23:24:26.521 INFO:teuthology.orchestra.run.trial073.stdout:Nothing to do. 2026-02-22T23:24:26.521 INFO:teuthology.orchestra.run.trial073.stdout:Complete! 2026-02-22T23:24:26.543 DEBUG:teuthology.orchestra.run.trial073:> sudo yum -y install python3-rgw 2026-02-22T23:24:26.708 INFO:teuthology.orchestra.run.trial045.stdout: Running scriptlet: libcephsqlite-2:19.2.3-689.gf90f4eae.el9.x86_64 4/5 2026-02-22T23:24:26.726 INFO:teuthology.orchestra.run.trial045.stdout: Installing : ceph-test-2:19.2.3-689.gf90f4eae.el9.x86_64 5/5 2026-02-22T23:24:26.854 INFO:teuthology.orchestra.run.trial073.stdout:Last metadata expiration check: 0:00:40 ago on Sun 22 Feb 2026 11:23:46 PM UTC. 2026-02-22T23:24:26.919 INFO:teuthology.orchestra.run.trial073.stdout:Package python3-rgw-2:19.2.3-689.gf90f4eae.el9.x86_64 is already installed. 2026-02-22T23:24:26.937 INFO:teuthology.orchestra.run.trial073.stdout:Dependencies resolved. 2026-02-22T23:24:26.938 INFO:teuthology.orchestra.run.trial073.stdout:Nothing to do. 2026-02-22T23:24:26.938 INFO:teuthology.orchestra.run.trial073.stdout:Complete! 2026-02-22T23:24:26.954 INFO:teuthology.orchestra.run.trial045.stdout: Running scriptlet: ceph-test-2:19.2.3-689.gf90f4eae.el9.x86_64 5/5 2026-02-22T23:24:26.954 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : ceph-test-2:19.2.3-689.gf90f4eae.el9.x86_64 1/5 2026-02-22T23:24:26.954 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : libcephsqlite-2:19.2.3-689.gf90f4eae.el9.x86_64 2/5 2026-02-22T23:24:26.954 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : libxslt-1.1.34-12.el9.x86_64 3/5 2026-02-22T23:24:26.954 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : socat-1.7.4.1-8.el9.x86_64 4/5 2026-02-22T23:24:26.960 DEBUG:teuthology.orchestra.run.trial073:> sudo yum -y install python3-cephfs 2026-02-22T23:24:27.007 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 5/5 2026-02-22T23:24:27.007 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-22T23:24:27.007 INFO:teuthology.orchestra.run.trial045.stdout:Installed: 2026-02-22T23:24:27.007 INFO:teuthology.orchestra.run.trial045.stdout: ceph-test-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T23:24:27.008 INFO:teuthology.orchestra.run.trial045.stdout: libcephsqlite-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T23:24:27.008 INFO:teuthology.orchestra.run.trial045.stdout: libxslt-1.1.34-12.el9.x86_64 2026-02-22T23:24:27.008 INFO:teuthology.orchestra.run.trial045.stdout: socat-1.7.4.1-8.el9.x86_64 2026-02-22T23:24:27.008 INFO:teuthology.orchestra.run.trial045.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2026-02-22T23:24:27.008 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-22T23:24:27.008 INFO:teuthology.orchestra.run.trial045.stdout:Complete! 2026-02-22T23:24:27.039 DEBUG:teuthology.orchestra.run.trial045:> sudo yum -y install ceph 2026-02-22T23:24:27.265 INFO:teuthology.orchestra.run.trial073.stdout:Last metadata expiration check: 0:00:41 ago on Sun 22 Feb 2026 11:23:46 PM UTC. 2026-02-22T23:24:27.331 INFO:teuthology.orchestra.run.trial073.stdout:Package python3-cephfs-2:19.2.3-689.gf90f4eae.el9.x86_64 is already installed. 2026-02-22T23:24:27.333 INFO:teuthology.orchestra.run.trial045.stdout:Last metadata expiration check: 0:00:18 ago on Sun 22 Feb 2026 11:24:09 PM UTC. 2026-02-22T23:24:27.349 INFO:teuthology.orchestra.run.trial073.stdout:Dependencies resolved. 2026-02-22T23:24:27.350 INFO:teuthology.orchestra.run.trial073.stdout:Nothing to do. 2026-02-22T23:24:27.350 INFO:teuthology.orchestra.run.trial073.stdout:Complete! 2026-02-22T23:24:27.371 DEBUG:teuthology.orchestra.run.trial073:> sudo yum -y install python3-rbd 2026-02-22T23:24:27.420 INFO:teuthology.orchestra.run.trial045.stdout:Dependencies resolved. 2026-02-22T23:24:27.422 INFO:teuthology.orchestra.run.trial045.stdout:====================================================================================== 2026-02-22T23:24:27.423 INFO:teuthology.orchestra.run.trial045.stdout: Package Arch Version Repository Size 2026-02-22T23:24:27.423 INFO:teuthology.orchestra.run.trial045.stdout:====================================================================================== 2026-02-22T23:24:27.423 INFO:teuthology.orchestra.run.trial045.stdout:Installing: 2026-02-22T23:24:27.423 INFO:teuthology.orchestra.run.trial045.stdout: ceph x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 6.5 k 2026-02-22T23:24:27.423 INFO:teuthology.orchestra.run.trial045.stdout:Installing dependencies: 2026-02-22T23:24:27.423 INFO:teuthology.orchestra.run.trial045.stdout: abseil-cpp x86_64 20211102.0-4.el9 epel 551 k 2026-02-22T23:24:27.423 INFO:teuthology.orchestra.run.trial045.stdout: ceph-grafana-dashboards noarch 2:19.2.3-689.gf90f4eae.el9 ceph-noarch 31 k 2026-02-22T23:24:27.424 INFO:teuthology.orchestra.run.trial045.stdout: ceph-mds x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 2.4 M 2026-02-22T23:24:27.424 INFO:teuthology.orchestra.run.trial045.stdout: ceph-mgr x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 1.1 M 2026-02-22T23:24:27.424 INFO:teuthology.orchestra.run.trial045.stdout: ceph-mgr-modules-core noarch 2:19.2.3-689.gf90f4eae.el9 ceph-noarch 253 k 2026-02-22T23:24:27.424 INFO:teuthology.orchestra.run.trial045.stdout: ceph-mon x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 4.7 M 2026-02-22T23:24:27.424 INFO:teuthology.orchestra.run.trial045.stdout: ceph-osd x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 17 M 2026-02-22T23:24:27.424 INFO:teuthology.orchestra.run.trial045.stdout: ceph-prometheus-alerts noarch 2:19.2.3-689.gf90f4eae.el9 ceph-noarch 17 k 2026-02-22T23:24:27.424 INFO:teuthology.orchestra.run.trial045.stdout: cephadm noarch 2:19.2.3-689.gf90f4eae.el9 ceph-noarch 769 k 2026-02-22T23:24:27.424 INFO:teuthology.orchestra.run.trial045.stdout: cryptsetup x86_64 2.8.1-3.el9 baseos 351 k 2026-02-22T23:24:27.424 INFO:teuthology.orchestra.run.trial045.stdout: flexiblas x86_64 3.0.4-9.el9 appstream 30 k 2026-02-22T23:24:27.424 INFO:teuthology.orchestra.run.trial045.stdout: flexiblas-netlib x86_64 3.0.4-9.el9 appstream 3.0 M 2026-02-22T23:24:27.424 INFO:teuthology.orchestra.run.trial045.stdout: flexiblas-openblas-openmp x86_64 3.0.4-9.el9 appstream 15 k 2026-02-22T23:24:27.425 INFO:teuthology.orchestra.run.trial045.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2026-02-22T23:24:27.425 INFO:teuthology.orchestra.run.trial045.stdout: ledmon-libs x86_64 1.1.0-3.el9 baseos 40 k 2026-02-22T23:24:27.425 INFO:teuthology.orchestra.run.trial045.stdout: libconfig x86_64 1.7.2-9.el9 baseos 72 k 2026-02-22T23:24:27.425 INFO:teuthology.orchestra.run.trial045.stdout: libgfortran x86_64 11.5.0-14.el9 baseos 794 k 2026-02-22T23:24:27.425 INFO:teuthology.orchestra.run.trial045.stdout: libquadmath x86_64 11.5.0-14.el9 baseos 184 k 2026-02-22T23:24:27.425 INFO:teuthology.orchestra.run.trial045.stdout: libstoragemgmt x86_64 1.10.1-1.el9 appstream 246 k 2026-02-22T23:24:27.425 INFO:teuthology.orchestra.run.trial045.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2026-02-22T23:24:27.425 INFO:teuthology.orchestra.run.trial045.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2026-02-22T23:24:27.425 INFO:teuthology.orchestra.run.trial045.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2026-02-22T23:24:27.425 INFO:teuthology.orchestra.run.trial045.stdout: openblas x86_64 0.3.29-1.el9 appstream 42 k 2026-02-22T23:24:27.425 INFO:teuthology.orchestra.run.trial045.stdout: openblas-openmp x86_64 0.3.29-1.el9 appstream 5.3 M 2026-02-22T23:24:27.425 INFO:teuthology.orchestra.run.trial045.stdout: protobuf x86_64 3.14.0-17.el9 appstream 1.0 M 2026-02-22T23:24:27.425 INFO:teuthology.orchestra.run.trial045.stdout: protobuf-compiler x86_64 3.14.0-17.el9 crb 862 k 2026-02-22T23:24:27.426 INFO:teuthology.orchestra.run.trial045.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2026-02-22T23:24:27.426 INFO:teuthology.orchestra.run.trial045.stdout: python3-autocommand noarch 2.2.2-8.el9 epel 29 k 2026-02-22T23:24:27.426 INFO:teuthology.orchestra.run.trial045.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2026-02-22T23:24:27.426 INFO:teuthology.orchestra.run.trial045.stdout: python3-backports-tarfile noarch 1.2.0-1.el9 epel 60 k 2026-02-22T23:24:27.426 INFO:teuthology.orchestra.run.trial045.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2026-02-22T23:24:27.426 INFO:teuthology.orchestra.run.trial045.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2026-02-22T23:24:27.426 INFO:teuthology.orchestra.run.trial045.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2026-02-22T23:24:27.426 INFO:teuthology.orchestra.run.trial045.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2026-02-22T23:24:27.426 INFO:teuthology.orchestra.run.trial045.stdout: python3-cheroot noarch 10.0.1-4.el9 epel 173 k 2026-02-22T23:24:27.426 INFO:teuthology.orchestra.run.trial045.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2026-02-22T23:24:27.427 INFO:teuthology.orchestra.run.trial045.stdout: python3-cryptography x86_64 36.0.1-5.el9 baseos 1.2 M 2026-02-22T23:24:27.427 INFO:teuthology.orchestra.run.trial045.stdout: python3-devel x86_64 3.9.25-3.el9 appstream 244 k 2026-02-22T23:24:27.427 INFO:teuthology.orchestra.run.trial045.stdout: python3-google-auth noarch 1:2.45.0-1.el9 epel 254 k 2026-02-22T23:24:27.427 INFO:teuthology.orchestra.run.trial045.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2026-02-22T23:24:27.427 INFO:teuthology.orchestra.run.trial045.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2026-02-22T23:24:27.427 INFO:teuthology.orchestra.run.trial045.stdout: python3-isodate noarch 0.6.1-3.el9 epel 56 k 2026-02-22T23:24:27.427 INFO:teuthology.orchestra.run.trial045.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2026-02-22T23:24:27.427 INFO:teuthology.orchestra.run.trial045.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2026-02-22T23:24:27.427 INFO:teuthology.orchestra.run.trial045.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2026-02-22T23:24:27.427 INFO:teuthology.orchestra.run.trial045.stdout: python3-jaraco-context noarch 6.0.1-3.el9 epel 20 k 2026-02-22T23:24:27.427 INFO:teuthology.orchestra.run.trial045.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2026-02-22T23:24:27.427 INFO:teuthology.orchestra.run.trial045.stdout: python3-jaraco-text noarch 4.0.0-2.el9 epel 26 k 2026-02-22T23:24:27.427 INFO:teuthology.orchestra.run.trial045.stdout: python3-jinja2 noarch 2.11.3-8.el9 appstream 249 k 2026-02-22T23:24:27.428 INFO:teuthology.orchestra.run.trial045.stdout: python3-kubernetes noarch 1:26.1.0-3.el9 epel 1.0 M 2026-02-22T23:24:27.428 INFO:teuthology.orchestra.run.trial045.stdout: python3-libstoragemgmt x86_64 1.10.1-1.el9 appstream 177 k 2026-02-22T23:24:27.428 INFO:teuthology.orchestra.run.trial045.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2026-02-22T23:24:27.428 INFO:teuthology.orchestra.run.trial045.stdout: python3-lxml x86_64 4.6.5-3.el9 appstream 1.2 M 2026-02-22T23:24:27.428 INFO:teuthology.orchestra.run.trial045.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2026-02-22T23:24:27.428 INFO:teuthology.orchestra.run.trial045.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2026-02-22T23:24:27.428 INFO:teuthology.orchestra.run.trial045.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2026-02-22T23:24:27.428 INFO:teuthology.orchestra.run.trial045.stdout: python3-msgpack x86_64 1.0.3-2.el9 epel 86 k 2026-02-22T23:24:27.428 INFO:teuthology.orchestra.run.trial045.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2026-02-22T23:24:27.428 INFO:teuthology.orchestra.run.trial045.stdout: python3-numpy x86_64 1:1.23.5-2.el9 appstream 6.1 M 2026-02-22T23:24:27.428 INFO:teuthology.orchestra.run.trial045.stdout: python3-numpy-f2py x86_64 1:1.23.5-2.el9 appstream 442 k 2026-02-22T23:24:27.428 INFO:teuthology.orchestra.run.trial045.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2026-02-22T23:24:27.429 INFO:teuthology.orchestra.run.trial045.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2026-02-22T23:24:27.429 INFO:teuthology.orchestra.run.trial045.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2026-02-22T23:24:27.429 INFO:teuthology.orchestra.run.trial045.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2026-02-22T23:24:27.429 INFO:teuthology.orchestra.run.trial045.stdout: python3-protobuf noarch 3.14.0-17.el9 appstream 267 k 2026-02-22T23:24:27.429 INFO:teuthology.orchestra.run.trial045.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2026-02-22T23:24:27.429 INFO:teuthology.orchestra.run.trial045.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2026-02-22T23:24:27.429 INFO:teuthology.orchestra.run.trial045.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2026-02-22T23:24:27.429 INFO:teuthology.orchestra.run.trial045.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2026-02-22T23:24:27.429 INFO:teuthology.orchestra.run.trial045.stdout: python3-pyparsing noarch 2.4.7-9.el9 baseos 150 k 2026-02-22T23:24:27.429 INFO:teuthology.orchestra.run.trial045.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2026-02-22T23:24:27.429 INFO:teuthology.orchestra.run.trial045.stdout: python3-requests noarch 2.25.1-10.el9 baseos 126 k 2026-02-22T23:24:27.429 INFO:teuthology.orchestra.run.trial045.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2026-02-22T23:24:27.430 INFO:teuthology.orchestra.run.trial045.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2026-02-22T23:24:27.430 INFO:teuthology.orchestra.run.trial045.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2026-02-22T23:24:27.430 INFO:teuthology.orchestra.run.trial045.stdout: python3-scipy x86_64 1.9.3-2.el9 appstream 19 M 2026-02-22T23:24:27.430 INFO:teuthology.orchestra.run.trial045.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2026-02-22T23:24:27.430 INFO:teuthology.orchestra.run.trial045.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2026-02-22T23:24:27.430 INFO:teuthology.orchestra.run.trial045.stdout: python3-typing-extensions noarch 4.15.0-1.el9 epel 86 k 2026-02-22T23:24:27.430 INFO:teuthology.orchestra.run.trial045.stdout: python3-urllib3 noarch 1.26.5-7.el9 baseos 218 k 2026-02-22T23:24:27.430 INFO:teuthology.orchestra.run.trial045.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2026-02-22T23:24:27.430 INFO:teuthology.orchestra.run.trial045.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2026-02-22T23:24:27.430 INFO:teuthology.orchestra.run.trial045.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2026-02-22T23:24:27.430 INFO:teuthology.orchestra.run.trial045.stdout: python3-xmlsec x86_64 1.3.13-1.el9 epel 48 k 2026-02-22T23:24:27.430 INFO:teuthology.orchestra.run.trial045.stdout: python3-xmltodict noarch 0.12.0-15.el9 epel 22 k 2026-02-22T23:24:27.430 INFO:teuthology.orchestra.run.trial045.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2026-02-22T23:24:27.430 INFO:teuthology.orchestra.run.trial045.stdout: unzip x86_64 6.0-59.el9 baseos 182 k 2026-02-22T23:24:27.431 INFO:teuthology.orchestra.run.trial045.stdout: xmlsec1 x86_64 1.2.29-13.el9 appstream 189 k 2026-02-22T23:24:27.431 INFO:teuthology.orchestra.run.trial045.stdout: xmlsec1-openssl x86_64 1.2.29-13.el9 appstream 90 k 2026-02-22T23:24:27.431 INFO:teuthology.orchestra.run.trial045.stdout: zip x86_64 3.0-35.el9 baseos 266 k 2026-02-22T23:24:27.431 INFO:teuthology.orchestra.run.trial045.stdout:Installing weak dependencies: 2026-02-22T23:24:27.431 INFO:teuthology.orchestra.run.trial045.stdout: ceph-mgr-cephadm noarch 2:19.2.3-689.gf90f4eae.el9 ceph-noarch 150 k 2026-02-22T23:24:27.431 INFO:teuthology.orchestra.run.trial045.stdout: ceph-mgr-dashboard noarch 2:19.2.3-689.gf90f4eae.el9 ceph-noarch 3.8 M 2026-02-22T23:24:27.431 INFO:teuthology.orchestra.run.trial045.stdout: ceph-mgr-diskprediction-local noarch 2:19.2.3-689.gf90f4eae.el9 ceph-noarch 7.4 M 2026-02-22T23:24:27.431 INFO:teuthology.orchestra.run.trial045.stdout: ceph-mgr-k8sevents noarch 2:19.2.3-689.gf90f4eae.el9 ceph-noarch 22 k 2026-02-22T23:24:27.431 INFO:teuthology.orchestra.run.trial045.stdout: ceph-mgr-rook noarch 2:19.2.3-689.gf90f4eae.el9 ceph-noarch 49 k 2026-02-22T23:24:27.431 INFO:teuthology.orchestra.run.trial045.stdout: ceph-volume noarch 2:19.2.3-689.gf90f4eae.el9 ceph-noarch 299 k 2026-02-22T23:24:27.431 INFO:teuthology.orchestra.run.trial045.stdout: python3-influxdb noarch 5.3.1-1.el9 epel 139 k 2026-02-22T23:24:27.431 INFO:teuthology.orchestra.run.trial045.stdout: python3-saml noarch 1.16.0-1.el9 epel 125 k 2026-02-22T23:24:27.432 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-22T23:24:27.432 INFO:teuthology.orchestra.run.trial045.stdout:Transaction Summary 2026-02-22T23:24:27.432 INFO:teuthology.orchestra.run.trial045.stdout:====================================================================================== 2026-02-22T23:24:27.432 INFO:teuthology.orchestra.run.trial045.stdout:Install 99 Packages 2026-02-22T23:24:27.432 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-22T23:24:27.433 INFO:teuthology.orchestra.run.trial045.stdout:Total download size: 95 M 2026-02-22T23:24:27.433 INFO:teuthology.orchestra.run.trial045.stdout:Installed size: 520 M 2026-02-22T23:24:27.433 INFO:teuthology.orchestra.run.trial045.stdout:Downloading Packages: 2026-02-22T23:24:27.680 INFO:teuthology.orchestra.run.trial073.stdout:Last metadata expiration check: 0:00:41 ago on Sun 22 Feb 2026 11:23:46 PM UTC. 2026-02-22T23:24:27.745 INFO:teuthology.orchestra.run.trial073.stdout:Package python3-rbd-2:19.2.3-689.gf90f4eae.el9.x86_64 is already installed. 2026-02-22T23:24:27.763 INFO:teuthology.orchestra.run.trial073.stdout:Dependencies resolved. 2026-02-22T23:24:27.764 INFO:teuthology.orchestra.run.trial073.stdout:Nothing to do. 2026-02-22T23:24:27.764 INFO:teuthology.orchestra.run.trial073.stdout:Complete! 2026-02-22T23:24:27.785 DEBUG:teuthology.orchestra.run.trial073:> sudo yum -y install rbd-fuse 2026-02-22T23:24:28.011 INFO:teuthology.orchestra.run.trial045.stdout:(1/99): ceph-19.2.3-689.gf90f4eae.el9.x86_64.rp 115 kB/s | 6.5 kB 00:00 2026-02-22T23:24:28.097 INFO:teuthology.orchestra.run.trial045.stdout:(2/99): ceph-mgr-19.2.3-689.gf90f4eae.el9.x86_6 7.6 MB/s | 1.1 MB 00:00 2026-02-22T23:24:28.097 INFO:teuthology.orchestra.run.trial073.stdout:Last metadata expiration check: 0:00:42 ago on Sun 22 Feb 2026 11:23:46 PM UTC. 2026-02-22T23:24:28.136 INFO:teuthology.orchestra.run.trial045.stdout:(3/99): ceph-mds-19.2.3-689.gf90f4eae.el9.x86_6 13 MB/s | 2.4 MB 00:00 2026-02-22T23:24:28.180 INFO:teuthology.orchestra.run.trial073.stdout:Dependencies resolved. 2026-02-22T23:24:28.180 INFO:teuthology.orchestra.run.trial073.stdout:================================================================================ 2026-02-22T23:24:28.180 INFO:teuthology.orchestra.run.trial073.stdout: Package Architecture Version Repository Size 2026-02-22T23:24:28.180 INFO:teuthology.orchestra.run.trial073.stdout:================================================================================ 2026-02-22T23:24:28.180 INFO:teuthology.orchestra.run.trial073.stdout:Installing: 2026-02-22T23:24:28.181 INFO:teuthology.orchestra.run.trial073.stdout: rbd-fuse x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 85 k 2026-02-22T23:24:28.181 INFO:teuthology.orchestra.run.trial073.stdout: 2026-02-22T23:24:28.181 INFO:teuthology.orchestra.run.trial073.stdout:Transaction Summary 2026-02-22T23:24:28.181 INFO:teuthology.orchestra.run.trial073.stdout:================================================================================ 2026-02-22T23:24:28.181 INFO:teuthology.orchestra.run.trial073.stdout:Install 1 Package 2026-02-22T23:24:28.181 INFO:teuthology.orchestra.run.trial073.stdout: 2026-02-22T23:24:28.181 INFO:teuthology.orchestra.run.trial073.stdout:Total download size: 85 k 2026-02-22T23:24:28.181 INFO:teuthology.orchestra.run.trial073.stdout:Installed size: 227 k 2026-02-22T23:24:28.181 INFO:teuthology.orchestra.run.trial073.stdout:Downloading Packages: 2026-02-22T23:24:28.203 INFO:teuthology.orchestra.run.trial045.stdout:(4/99): ceph-grafana-dashboards-19.2.3-689.gf90 462 kB/s | 31 kB 00:00 2026-02-22T23:24:28.236 INFO:teuthology.orchestra.run.trial045.stdout:(5/99): ceph-mgr-cephadm-19.2.3-689.gf90f4eae.e 4.5 MB/s | 150 kB 00:00 2026-02-22T23:24:28.441 INFO:teuthology.orchestra.run.trial045.stdout:(6/99): ceph-mgr-dashboard-19.2.3-689.gf90f4eae 19 MB/s | 3.8 MB 00:00 2026-02-22T23:24:28.457 INFO:teuthology.orchestra.run.trial073.stdout:rbd-fuse-19.2.3-689.gf90f4eae.el9.x86_64.rpm 308 kB/s | 85 kB 00:00 2026-02-22T23:24:28.458 INFO:teuthology.orchestra.run.trial073.stdout:-------------------------------------------------------------------------------- 2026-02-22T23:24:28.458 INFO:teuthology.orchestra.run.trial073.stdout:Total 307 kB/s | 85 kB 00:00 2026-02-22T23:24:28.458 INFO:teuthology.orchestra.run.trial073.stdout:Running transaction check 2026-02-22T23:24:28.461 INFO:teuthology.orchestra.run.trial073.stdout:Transaction check succeeded. 2026-02-22T23:24:28.461 INFO:teuthology.orchestra.run.trial073.stdout:Running transaction test 2026-02-22T23:24:28.492 INFO:teuthology.orchestra.run.trial073.stdout:Transaction test succeeded. 2026-02-22T23:24:28.492 INFO:teuthology.orchestra.run.trial073.stdout:Running transaction 2026-02-22T23:24:28.543 INFO:teuthology.orchestra.run.trial073.stdout: Preparing : 1/1 2026-02-22T23:24:28.560 INFO:teuthology.orchestra.run.trial073.stdout: Installing : rbd-fuse-2:19.2.3-689.gf90f4eae.el9.x86_64 1/1 2026-02-22T23:24:28.638 INFO:teuthology.orchestra.run.trial073.stdout: Running scriptlet: rbd-fuse-2:19.2.3-689.gf90f4eae.el9.x86_64 1/1 2026-02-22T23:24:28.696 INFO:teuthology.orchestra.run.trial073.stdout: Verifying : rbd-fuse-2:19.2.3-689.gf90f4eae.el9.x86_64 1/1 2026-02-22T23:24:28.697 INFO:teuthology.orchestra.run.trial073.stdout: 2026-02-22T23:24:28.697 INFO:teuthology.orchestra.run.trial073.stdout:Installed: 2026-02-22T23:24:28.697 INFO:teuthology.orchestra.run.trial073.stdout: rbd-fuse-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T23:24:28.697 INFO:teuthology.orchestra.run.trial073.stdout: 2026-02-22T23:24:28.697 INFO:teuthology.orchestra.run.trial073.stdout:Complete! 2026-02-22T23:24:28.725 DEBUG:teuthology.orchestra.run.trial073:> sudo yum -y install rbd-mirror 2026-02-22T23:24:28.765 INFO:teuthology.orchestra.run.trial045.stdout:(7/99): ceph-mon-19.2.3-689.gf90f4eae.el9.x86_6 6.3 MB/s | 4.7 MB 00:00 2026-02-22T23:24:28.819 INFO:teuthology.orchestra.run.trial045.stdout:(8/99): ceph-mgr-k8sevents-19.2.3-689.gf90f4eae 414 kB/s | 22 kB 00:00 2026-02-22T23:24:28.867 INFO:teuthology.orchestra.run.trial045.stdout:(9/99): ceph-mgr-diskprediction-local-19.2.3-68 17 MB/s | 7.4 MB 00:00 2026-02-22T23:24:28.871 INFO:teuthology.orchestra.run.trial045.stdout:(10/99): ceph-mgr-modules-core-19.2.3-689.gf90f 4.7 MB/s | 253 kB 00:00 2026-02-22T23:24:28.903 INFO:teuthology.orchestra.run.trial045.stdout:(11/99): ceph-osd-19.2.3-689.gf90f4eae.el9.x86_ 21 MB/s | 17 MB 00:00 2026-02-22T23:24:28.904 INFO:teuthology.orchestra.run.trial045.stdout:(12/99): ceph-prometheus-alerts-19.2.3-689.gf90 527 kB/s | 17 kB 00:00 2026-02-22T23:24:28.904 INFO:teuthology.orchestra.run.trial045.stdout:(13/99): ceph-mgr-rook-19.2.3-689.gf90f4eae.el9 1.3 MB/s | 49 kB 00:00 2026-02-22T23:24:28.916 INFO:teuthology.orchestra.run.trial045.stdout:(14/99): ceph-volume-19.2.3-689.gf90f4eae.el9.n 23 MB/s | 299 kB 00:00 2026-02-22T23:24:28.939 INFO:teuthology.orchestra.run.trial045.stdout:(15/99): cephadm-19.2.3-689.gf90f4eae.el9.noarc 21 MB/s | 769 kB 00:00 2026-02-22T23:24:28.945 INFO:teuthology.orchestra.run.trial045.stdout:(16/99): ledmon-libs-1.1.0-3.el9.x86_64.rpm 1.4 MB/s | 40 kB 00:00 2026-02-22T23:24:28.960 INFO:teuthology.orchestra.run.trial045.stdout:(17/99): cryptsetup-2.8.1-3.el9.x86_64.rpm 6.1 MB/s | 351 kB 00:00 2026-02-22T23:24:28.971 INFO:teuthology.orchestra.run.trial045.stdout:(18/99): libquadmath-11.5.0-14.el9.x86_64.rpm 17 MB/s | 184 kB 00:00 2026-02-22T23:24:28.974 INFO:teuthology.orchestra.run.trial045.stdout:(19/99): libconfig-1.7.2-9.el9.x86_64.rpm 2.0 MB/s | 72 kB 00:00 2026-02-22T23:24:28.982 INFO:teuthology.orchestra.run.trial045.stdout:(20/99): libgfortran-11.5.0-14.el9.x86_64.rpm 21 MB/s | 794 kB 00:00 2026-02-22T23:24:28.985 INFO:teuthology.orchestra.run.trial045.stdout:(21/99): python3-cffi-1.14.5-5.el9.x86_64.rpm 18 MB/s | 253 kB 00:00 2026-02-22T23:24:28.993 INFO:teuthology.orchestra.run.trial045.stdout:(22/99): python3-ply-3.11-14.el9.noarch.rpm 9.6 MB/s | 106 kB 00:00 2026-02-22T23:24:28.996 INFO:teuthology.orchestra.run.trial045.stdout:(23/99): python3-pycparser-2.20-6.el9.noarch.rp 12 MB/s | 135 kB 00:00 2026-02-22T23:24:29.003 INFO:teuthology.orchestra.run.trial045.stdout:(24/99): python3-pyparsing-2.4.7-9.el9.noarch.r 15 MB/s | 150 kB 00:00 2026-02-22T23:24:29.007 INFO:teuthology.orchestra.run.trial045.stdout:(25/99): python3-requests-2.25.1-10.el9.noarch. 11 MB/s | 126 kB 00:00 2026-02-22T23:24:29.013 INFO:teuthology.orchestra.run.trial045.stdout:(26/99): python3-cryptography-36.0.1-5.el9.x86_ 32 MB/s | 1.2 MB 00:00 2026-02-22T23:24:29.015 INFO:teuthology.orchestra.run.trial045.stdout:(27/99): python3-urllib3-1.26.5-7.el9.noarch.rp 18 MB/s | 218 kB 00:00 2026-02-22T23:24:29.018 INFO:teuthology.orchestra.run.trial045.stdout:(28/99): unzip-6.0-59.el9.x86_64.rpm 17 MB/s | 182 kB 00:00 2026-02-22T23:24:29.024 INFO:teuthology.orchestra.run.trial045.stdout:(29/99): zip-3.0-35.el9.x86_64.rpm 24 MB/s | 266 kB 00:00 2026-02-22T23:24:29.034 INFO:teuthology.orchestra.run.trial073.stdout:Last metadata expiration check: 0:00:43 ago on Sun 22 Feb 2026 11:23:46 PM UTC. 2026-02-22T23:24:29.097 INFO:teuthology.orchestra.run.trial045.stdout:(30/99): flexiblas-openblas-openmp-3.0.4-9.el9. 204 kB/s | 15 kB 00:00 2026-02-22T23:24:29.100 INFO:teuthology.orchestra.run.trial045.stdout:(31/99): flexiblas-3.0.4-9.el9.x86_64.rpm 349 kB/s | 30 kB 00:00 2026-02-22T23:24:29.118 INFO:teuthology.orchestra.run.trial073.stdout:Dependencies resolved. 2026-02-22T23:24:29.119 INFO:teuthology.orchestra.run.trial073.stdout:================================================================================ 2026-02-22T23:24:29.119 INFO:teuthology.orchestra.run.trial073.stdout: Package Arch Version Repo Size 2026-02-22T23:24:29.120 INFO:teuthology.orchestra.run.trial073.stdout:================================================================================ 2026-02-22T23:24:29.120 INFO:teuthology.orchestra.run.trial073.stdout:Installing: 2026-02-22T23:24:29.120 INFO:teuthology.orchestra.run.trial073.stdout: rbd-mirror x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 3.1 M 2026-02-22T23:24:29.120 INFO:teuthology.orchestra.run.trial073.stdout: 2026-02-22T23:24:29.120 INFO:teuthology.orchestra.run.trial073.stdout:Transaction Summary 2026-02-22T23:24:29.120 INFO:teuthology.orchestra.run.trial073.stdout:================================================================================ 2026-02-22T23:24:29.120 INFO:teuthology.orchestra.run.trial073.stdout:Install 1 Package 2026-02-22T23:24:29.120 INFO:teuthology.orchestra.run.trial073.stdout: 2026-02-22T23:24:29.120 INFO:teuthology.orchestra.run.trial073.stdout:Total download size: 3.1 M 2026-02-22T23:24:29.120 INFO:teuthology.orchestra.run.trial073.stdout:Installed size: 13 M 2026-02-22T23:24:29.120 INFO:teuthology.orchestra.run.trial073.stdout:Downloading Packages: 2026-02-22T23:24:29.190 INFO:teuthology.orchestra.run.trial045.stdout:(32/99): lua-5.4.4-4.el9.x86_64.rpm 2.0 MB/s | 188 kB 00:00 2026-02-22T23:24:29.208 INFO:teuthology.orchestra.run.trial045.stdout:(33/99): libstoragemgmt-1.10.1-1.el9.x86_64.rpm 2.2 MB/s | 246 kB 00:00 2026-02-22T23:24:29.217 INFO:teuthology.orchestra.run.trial045.stdout:(34/99): openblas-0.3.29-1.el9.x86_64.rpm 1.5 MB/s | 42 kB 00:00 2026-02-22T23:24:29.264 INFO:teuthology.orchestra.run.trial045.stdout:(35/99): flexiblas-netlib-3.0.4-9.el9.x86_64.rp 12 MB/s | 3.0 MB 00:00 2026-02-22T23:24:29.277 INFO:teuthology.orchestra.run.trial073.stdout:rbd-mirror-19.2.3-689.gf90f4eae.el9.x86_64.rpm 20 MB/s | 3.1 MB 00:00 2026-02-22T23:24:29.277 INFO:teuthology.orchestra.run.trial073.stdout:-------------------------------------------------------------------------------- 2026-02-22T23:24:29.277 INFO:teuthology.orchestra.run.trial073.stdout:Total 20 MB/s | 3.1 MB 00:00 2026-02-22T23:24:29.277 INFO:teuthology.orchestra.run.trial073.stdout:Running transaction check 2026-02-22T23:24:29.281 INFO:teuthology.orchestra.run.trial073.stdout:Transaction check succeeded. 2026-02-22T23:24:29.281 INFO:teuthology.orchestra.run.trial073.stdout:Running transaction test 2026-02-22T23:24:29.305 INFO:teuthology.orchestra.run.trial045.stdout:(36/99): protobuf-3.14.0-17.el9.x86_64.rpm 11 MB/s | 1.0 MB 00:00 2026-02-22T23:24:29.322 INFO:teuthology.orchestra.run.trial073.stdout:Transaction test succeeded. 2026-02-22T23:24:29.322 INFO:teuthology.orchestra.run.trial073.stdout:Running transaction 2026-02-22T23:24:29.339 INFO:teuthology.orchestra.run.trial045.stdout:(37/99): python3-babel-2.9.1-2.el9.noarch.rpm 80 MB/s | 6.0 MB 00:00 2026-02-22T23:24:29.340 INFO:teuthology.orchestra.run.trial045.stdout:(38/99): python3-devel-3.9.25-3.el9.x86_64.rpm 6.9 MB/s | 244 kB 00:00 2026-02-22T23:24:29.367 INFO:teuthology.orchestra.run.trial045.stdout:(39/99): python3-jinja2-2.11.3-8.el9.noarch.rpm 8.6 MB/s | 249 kB 00:00 2026-02-22T23:24:29.368 INFO:teuthology.orchestra.run.trial045.stdout:(40/99): python3-libstoragemgmt-1.10.1-1.el9.x8 6.1 MB/s | 177 kB 00:00 2026-02-22T23:24:29.387 INFO:teuthology.orchestra.run.trial045.stdout:(41/99): openblas-openmp-0.3.29-1.el9.x86_64.rp 29 MB/s | 5.3 MB 00:00 2026-02-22T23:24:29.396 INFO:teuthology.orchestra.run.trial045.stdout:(42/99): python3-mako-1.1.4-6.el9.noarch.rpm 6.0 MB/s | 172 kB 00:00 2026-02-22T23:24:29.399 INFO:teuthology.orchestra.run.trial045.stdout:(43/99): python3-lxml-4.6.5-3.el9.x86_64.rpm 39 MB/s | 1.2 MB 00:00 2026-02-22T23:24:29.414 INFO:teuthology.orchestra.run.trial045.stdout:(44/99): python3-markupsafe-1.1.1-12.el9.x86_64 1.3 MB/s | 35 kB 00:00 2026-02-22T23:24:29.427 INFO:teuthology.orchestra.run.trial045.stdout:(45/99): python3-numpy-f2py-1.23.5-2.el9.x86_64 15 MB/s | 442 kB 00:00 2026-02-22T23:24:29.441 INFO:teuthology.orchestra.run.trial045.stdout:(46/99): python3-packaging-20.9-5.el9.noarch.rp 2.8 MB/s | 77 kB 00:00 2026-02-22T23:24:29.456 INFO:teuthology.orchestra.run.trial045.stdout:(47/99): python3-protobuf-3.14.0-17.el9.noarch. 9.3 MB/s | 267 kB 00:00 2026-02-22T23:24:29.469 INFO:teuthology.orchestra.run.trial045.stdout:(48/99): python3-pyasn1-0.4.8-6.el9.noarch.rpm 5.6 MB/s | 159 kB 00:00 2026-02-22T23:24:29.484 INFO:teuthology.orchestra.run.trial045.stdout:(49/99): python3-pyasn1-modules-0.4.8-6.el9.noa 9.7 MB/s | 279 kB 00:00 2026-02-22T23:24:29.495 INFO:teuthology.orchestra.run.trial045.stdout:(50/99): python3-requests-oauthlib-1.3.0-12.el9 2.0 MB/s | 54 kB 00:00 2026-02-22T23:24:29.513 INFO:teuthology.orchestra.run.trial073.stdout: Preparing : 1/1 2026-02-22T23:24:29.514 INFO:teuthology.orchestra.run.trial073.stdout: Installing : rbd-mirror-2:19.2.3-689.gf90f4eae.el9.x86_64 1/1 2026-02-22T23:24:29.522 INFO:teuthology.orchestra.run.trial045.stdout:(51/99): python3-toml-0.10.2-6.el9.noarch.rpm 1.5 MB/s | 42 kB 00:00 2026-02-22T23:24:29.538 INFO:teuthology.orchestra.run.trial073.stdout: Running scriptlet: rbd-mirror-2:19.2.3-689.gf90f4eae.el9.x86_64 1/1 2026-02-22T23:24:29.538 INFO:teuthology.orchestra.run.trial073.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-22T23:24:29.538 INFO:teuthology.orchestra.run.trial073.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2026-02-22T23:24:29.539 INFO:teuthology.orchestra.run.trial073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-22T23:24:29.539 INFO:teuthology.orchestra.run.trial073.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-22T23:24:29.539 INFO:teuthology.orchestra.run.trial073.stdout: 2026-02-22T23:24:29.544 INFO:teuthology.orchestra.run.trial045.stdout:(52/99): python3-numpy-1.23.5-2.el9.x86_64.rpm 41 MB/s | 6.1 MB 00:00 2026-02-22T23:24:29.549 INFO:teuthology.orchestra.run.trial045.stdout:(53/99): xmlsec1-1.2.29-13.el9.x86_64.rpm 6.8 MB/s | 189 kB 00:00 2026-02-22T23:24:29.571 INFO:teuthology.orchestra.run.trial045.stdout:(54/99): xmlsec1-openssl-1.2.29-13.el9.x86_64.r 3.3 MB/s | 90 kB 00:00 2026-02-22T23:24:29.580 INFO:teuthology.orchestra.run.trial045.stdout:(55/99): lua-devel-5.4.4-4.el9.x86_64.rpm 716 kB/s | 22 kB 00:00 2026-02-22T23:24:29.616 INFO:teuthology.orchestra.run.trial045.stdout:(56/99): abseil-cpp-20211102.0-4.el9.x86_64.rpm 15 MB/s | 551 kB 00:00 2026-02-22T23:24:29.619 INFO:teuthology.orchestra.run.trial045.stdout:(57/99): grpc-data-1.46.7-10.el9.noarch.rpm 6.1 MB/s | 19 kB 00:00 2026-02-22T23:24:29.623 INFO:teuthology.orchestra.run.trial045.stdout:(58/99): luarocks-3.9.2-5.el9.noarch.rpm 40 MB/s | 151 kB 00:00 2026-02-22T23:24:29.629 INFO:teuthology.orchestra.run.trial045.stdout:(59/99): python3-asyncssh-2.13.2-5.el9.noarch.r 100 MB/s | 548 kB 00:00 2026-02-22T23:24:29.632 INFO:teuthology.orchestra.run.trial045.stdout:(60/99): python3-autocommand-2.2.2-8.el9.noarch 9.4 MB/s | 29 kB 00:00 2026-02-22T23:24:29.635 INFO:teuthology.orchestra.run.trial045.stdout:(61/99): python3-backports-tarfile-1.2.0-1.el9. 18 MB/s | 60 kB 00:00 2026-02-22T23:24:29.639 INFO:teuthology.orchestra.run.trial045.stdout:(62/99): protobuf-compiler-3.14.0-17.el9.x86_64 12 MB/s | 862 kB 00:00 2026-02-22T23:24:29.640 INFO:teuthology.orchestra.run.trial045.stdout:(63/99): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 8.5 MB/s | 43 kB 00:00 2026-02-22T23:24:29.667 INFO:teuthology.orchestra.run.trial045.stdout:(64/99): python3-scipy-1.9.3-2.el9.x86_64.rpm 105 MB/s | 19 MB 00:00 2026-02-22T23:24:29.671 INFO:teuthology.orchestra.run.trial045.stdout:(65/99): python3-certifi-2023.05.07-4.el9.noarc 461 kB/s | 14 kB 00:00 2026-02-22T23:24:29.679 INFO:teuthology.orchestra.run.trial045.stdout:(66/99): python3-cheroot-10.0.1-4.el9.noarch.rp 22 MB/s | 173 kB 00:00 2026-02-22T23:24:29.683 INFO:teuthology.orchestra.run.trial045.stdout:(67/99): python3-google-auth-2.45.0-1.el9.noarc 63 MB/s | 254 kB 00:00 2026-02-22T23:24:29.684 INFO:teuthology.orchestra.run.trial045.stdout:(68/99): python3-cachetools-4.2.4-1.el9.noarch. 714 kB/s | 32 kB 00:00 2026-02-22T23:24:29.693 INFO:teuthology.orchestra.run.trial045.stdout:(69/99): python3-grpcio-1.46.7-10.el9.x86_64.rp 190 MB/s | 2.0 MB 00:00 2026-02-22T23:24:29.694 INFO:teuthology.orchestra.run.trial045.stdout:(70/99): python3-grpcio-tools-1.46.7-10.el9.x86 15 MB/s | 144 kB 00:00 2026-02-22T23:24:29.697 INFO:teuthology.orchestra.run.trial045.stdout:(71/99): python3-influxdb-5.3.1-1.el9.noarch.rp 38 MB/s | 139 kB 00:00 2026-02-22T23:24:29.698 INFO:teuthology.orchestra.run.trial045.stdout:(72/99): python3-isodate-0.6.1-3.el9.noarch.rpm 16 MB/s | 56 kB 00:00 2026-02-22T23:24:29.699 INFO:teuthology.orchestra.run.trial045.stdout:(73/99): python3-cherrypy-18.6.1-2.el9.noarch.r 13 MB/s | 358 kB 00:00 2026-02-22T23:24:29.700 INFO:teuthology.orchestra.run.trial045.stdout:(74/99): python3-jaraco-8.2.1-3.el9.noarch.rpm 3.5 MB/s | 11 kB 00:00 2026-02-22T23:24:29.701 INFO:teuthology.orchestra.run.trial045.stdout:(75/99): python3-jaraco-classes-3.2.1-5.el9.noa 5.4 MB/s | 18 kB 00:00 2026-02-22T23:24:29.702 INFO:teuthology.orchestra.run.trial045.stdout:(76/99): python3-jaraco-collections-3.0.0-8.el9 7.3 MB/s | 23 kB 00:00 2026-02-22T23:24:29.703 INFO:teuthology.orchestra.run.trial045.stdout:(77/99): python3-jaraco-context-6.0.1-3.el9.noa 6.2 MB/s | 20 kB 00:00 2026-02-22T23:24:29.704 INFO:teuthology.orchestra.run.trial045.stdout:(78/99): python3-jaraco-functools-3.5.0-2.el9.n 6.0 MB/s | 19 kB 00:00 2026-02-22T23:24:29.705 INFO:teuthology.orchestra.run.trial045.stdout:(79/99): python3-jaraco-text-4.0.0-2.el9.noarch 8.3 MB/s | 26 kB 00:00 2026-02-22T23:24:29.708 INFO:teuthology.orchestra.run.trial045.stdout:(80/99): python3-logutils-0.3.5-21.el9.noarch.r 12 MB/s | 46 kB 00:00 2026-02-22T23:24:29.709 INFO:teuthology.orchestra.run.trial045.stdout:(81/99): python3-more-itertools-8.12.0-2.el9.no 22 MB/s | 79 kB 00:00 2026-02-22T23:24:29.711 INFO:teuthology.orchestra.run.trial045.stdout:(82/99): python3-kubernetes-26.1.0-3.el9.noarch 148 MB/s | 1.0 MB 00:00 2026-02-22T23:24:29.712 INFO:teuthology.orchestra.run.trial045.stdout:(83/99): python3-natsort-7.1.1-5.el9.noarch.rpm 18 MB/s | 58 kB 00:00 2026-02-22T23:24:29.713 INFO:teuthology.orchestra.run.trial045.stdout:(84/99): python3-msgpack-1.0.3-2.el9.x86_64.rpm 20 MB/s | 86 kB 00:00 2026-02-22T23:24:29.715 INFO:teuthology.orchestra.run.trial045.stdout:(85/99): python3-pecan-1.4.2-3.el9.noarch.rpm 68 MB/s | 272 kB 00:00 2026-02-22T23:24:29.715 INFO:teuthology.orchestra.run.trial045.stdout:(86/99): python3-portend-3.1.0-2.el9.noarch.rpm 5.2 MB/s | 16 kB 00:00 2026-02-22T23:24:29.717 INFO:teuthology.orchestra.run.trial045.stdout:(87/99): python3-pyOpenSSL-21.0.0-1.el9.noarch. 22 MB/s | 90 kB 00:00 2026-02-22T23:24:29.718 INFO:teuthology.orchestra.run.trial045.stdout:(88/99): python3-repoze-lru-0.7-16.el9.noarch.r 9.7 MB/s | 31 kB 00:00 2026-02-22T23:24:29.720 INFO:teuthology.orchestra.run.trial045.stdout:(89/99): python3-routes-2.5.1-5.el9.noarch.rpm 43 MB/s | 188 kB 00:00 2026-02-22T23:24:29.720 INFO:teuthology.orchestra.run.trial045.stdout:(90/99): python3-rsa-4.9-2.el9.noarch.rpm 17 MB/s | 59 kB 00:00 2026-02-22T23:24:29.721 INFO:teuthology.orchestra.run.trial045.stdout:(91/99): python3-saml-1.16.0-1.el9.noarch.rpm 36 MB/s | 125 kB 00:00 2026-02-22T23:24:29.723 INFO:teuthology.orchestra.run.trial045.stdout:(92/99): python3-tempora-5.0.0-2.el9.noarch.rpm 11 MB/s | 36 kB 00:00 2026-02-22T23:24:29.724 INFO:teuthology.orchestra.run.trial045.stdout:(93/99): python3-typing-extensions-4.15.0-1.el9 21 MB/s | 86 kB 00:00 2026-02-22T23:24:29.725 INFO:teuthology.orchestra.run.trial045.stdout:(94/99): python3-webob-1.8.8-2.el9.noarch.rpm 58 MB/s | 230 kB 00:00 2026-02-22T23:24:29.726 INFO:teuthology.orchestra.run.trial045.stdout:(95/99): python3-websocket-client-1.2.3-2.el9.n 25 MB/s | 90 kB 00:00 2026-02-22T23:24:29.729 INFO:teuthology.orchestra.run.trial045.stdout:(96/99): python3-xmlsec-1.3.13-1.el9.x86_64.rpm 14 MB/s | 48 kB 00:00 2026-02-22T23:24:29.730 INFO:teuthology.orchestra.run.trial045.stdout:(97/99): python3-xmltodict-0.12.0-15.el9.noarch 7.1 MB/s | 22 kB 00:00 2026-02-22T23:24:29.732 INFO:teuthology.orchestra.run.trial045.stdout:(98/99): python3-zc-lockfile-2.0-10.el9.noarch. 5.5 MB/s | 20 kB 00:00 2026-02-22T23:24:29.733 INFO:teuthology.orchestra.run.trial045.stdout:(99/99): python3-werkzeug-2.0.3-3.el9.1.noarch. 47 MB/s | 427 kB 00:00 2026-02-22T23:24:29.735 INFO:teuthology.orchestra.run.trial045.stdout:-------------------------------------------------------------------------------- 2026-02-22T23:24:29.735 INFO:teuthology.orchestra.run.trial045.stdout:Total 41 MB/s | 95 MB 00:02 2026-02-22T23:24:29.867 INFO:teuthology.orchestra.run.trial073.stdout: Verifying : rbd-mirror-2:19.2.3-689.gf90f4eae.el9.x86_64 1/1 2026-02-22T23:24:29.867 INFO:teuthology.orchestra.run.trial073.stdout: 2026-02-22T23:24:29.867 INFO:teuthology.orchestra.run.trial073.stdout:Installed: 2026-02-22T23:24:29.868 INFO:teuthology.orchestra.run.trial073.stdout: rbd-mirror-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T23:24:29.868 INFO:teuthology.orchestra.run.trial073.stdout: 2026-02-22T23:24:29.868 INFO:teuthology.orchestra.run.trial073.stdout:Complete! 2026-02-22T23:24:29.897 DEBUG:teuthology.orchestra.run.trial073:> sudo yum -y install rbd-nbd 2026-02-22T23:24:30.142 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction check 2026-02-22T23:24:30.181 INFO:teuthology.orchestra.run.trial045.stdout:Transaction check succeeded. 2026-02-22T23:24:30.181 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction test 2026-02-22T23:24:30.206 INFO:teuthology.orchestra.run.trial073.stdout:Last metadata expiration check: 0:00:44 ago on Sun 22 Feb 2026 11:23:46 PM UTC. 2026-02-22T23:24:30.292 INFO:teuthology.orchestra.run.trial073.stdout:Dependencies resolved. 2026-02-22T23:24:30.292 INFO:teuthology.orchestra.run.trial073.stdout:================================================================================ 2026-02-22T23:24:30.292 INFO:teuthology.orchestra.run.trial073.stdout: Package Architecture Version Repository Size 2026-02-22T23:24:30.292 INFO:teuthology.orchestra.run.trial073.stdout:================================================================================ 2026-02-22T23:24:30.292 INFO:teuthology.orchestra.run.trial073.stdout:Installing: 2026-02-22T23:24:30.292 INFO:teuthology.orchestra.run.trial073.stdout: rbd-nbd x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 170 k 2026-02-22T23:24:30.292 INFO:teuthology.orchestra.run.trial073.stdout: 2026-02-22T23:24:30.292 INFO:teuthology.orchestra.run.trial073.stdout:Transaction Summary 2026-02-22T23:24:30.292 INFO:teuthology.orchestra.run.trial073.stdout:================================================================================ 2026-02-22T23:24:30.292 INFO:teuthology.orchestra.run.trial073.stdout:Install 1 Package 2026-02-22T23:24:30.292 INFO:teuthology.orchestra.run.trial073.stdout: 2026-02-22T23:24:30.292 INFO:teuthology.orchestra.run.trial073.stdout:Total download size: 170 k 2026-02-22T23:24:30.292 INFO:teuthology.orchestra.run.trial073.stdout:Installed size: 490 k 2026-02-22T23:24:30.292 INFO:teuthology.orchestra.run.trial073.stdout:Downloading Packages: 2026-02-22T23:24:30.380 INFO:teuthology.orchestra.run.trial073.stdout:rbd-nbd-19.2.3-689.gf90f4eae.el9.x86_64.rpm 1.9 MB/s | 170 kB 00:00 2026-02-22T23:24:30.380 INFO:teuthology.orchestra.run.trial073.stdout:-------------------------------------------------------------------------------- 2026-02-22T23:24:30.380 INFO:teuthology.orchestra.run.trial073.stdout:Total 1.9 MB/s | 170 kB 00:00 2026-02-22T23:24:30.381 INFO:teuthology.orchestra.run.trial073.stdout:Running transaction check 2026-02-22T23:24:30.384 INFO:teuthology.orchestra.run.trial073.stdout:Transaction check succeeded. 2026-02-22T23:24:30.384 INFO:teuthology.orchestra.run.trial073.stdout:Running transaction test 2026-02-22T23:24:30.415 INFO:teuthology.orchestra.run.trial073.stdout:Transaction test succeeded. 2026-02-22T23:24:30.415 INFO:teuthology.orchestra.run.trial073.stdout:Running transaction 2026-02-22T23:24:30.471 INFO:teuthology.orchestra.run.trial073.stdout: Preparing : 1/1 2026-02-22T23:24:30.488 INFO:teuthology.orchestra.run.trial073.stdout: Installing : rbd-nbd-2:19.2.3-689.gf90f4eae.el9.x86_64 1/1 2026-02-22T23:24:30.568 INFO:teuthology.orchestra.run.trial073.stdout: Running scriptlet: rbd-nbd-2:19.2.3-689.gf90f4eae.el9.x86_64 1/1 2026-02-22T23:24:30.598 INFO:teuthology.orchestra.run.trial045.stdout:Transaction test succeeded. 2026-02-22T23:24:30.598 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction 2026-02-22T23:24:30.625 INFO:teuthology.orchestra.run.trial073.stdout: Verifying : rbd-nbd-2:19.2.3-689.gf90f4eae.el9.x86_64 1/1 2026-02-22T23:24:30.626 INFO:teuthology.orchestra.run.trial073.stdout: 2026-02-22T23:24:30.626 INFO:teuthology.orchestra.run.trial073.stdout:Installed: 2026-02-22T23:24:30.626 INFO:teuthology.orchestra.run.trial073.stdout: rbd-nbd-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T23:24:30.626 INFO:teuthology.orchestra.run.trial073.stdout: 2026-02-22T23:24:30.626 INFO:teuthology.orchestra.run.trial073.stdout:Complete! 2026-02-22T23:24:30.659 DEBUG:teuthology.parallel:result is None 2026-02-22T23:24:31.061 INFO:teuthology.orchestra.run.trial045.stdout: Preparing : 1/1 2026-02-22T23:24:31.063 INFO:teuthology.orchestra.run.trial045.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/99 2026-02-22T23:24:31.094 INFO:teuthology.orchestra.run.trial045.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/99 2026-02-22T23:24:31.099 INFO:teuthology.orchestra.run.trial045.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 3/99 2026-02-22T23:24:31.121 INFO:teuthology.orchestra.run.trial045.stdout: Installing : xmlsec1-1.2.29-13.el9.x86_64 4/99 2026-02-22T23:24:31.127 INFO:teuthology.orchestra.run.trial045.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 5/99 2026-02-22T23:24:31.160 INFO:teuthology.orchestra.run.trial045.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 6/99 2026-02-22T23:24:31.169 INFO:teuthology.orchestra.run.trial045.stdout: Installing : python3-lxml-4.6.5-3.el9.x86_64 7/99 2026-02-22T23:24:31.176 INFO:teuthology.orchestra.run.trial045.stdout: Installing : protobuf-3.14.0-17.el9.x86_64 8/99 2026-02-22T23:24:31.178 INFO:teuthology.orchestra.run.trial045.stdout: Installing : lua-5.4.4-4.el9.x86_64 9/99 2026-02-22T23:24:31.183 INFO:teuthology.orchestra.run.trial045.stdout: Installing : flexiblas-3.0.4-9.el9.x86_64 10/99 2026-02-22T23:24:31.206 INFO:teuthology.orchestra.run.trial045.stdout: Installing : unzip-6.0-59.el9.x86_64 11/99 2026-02-22T23:24:31.218 INFO:teuthology.orchestra.run.trial045.stdout: Installing : python3-urllib3-1.26.5-7.el9.noarch 12/99 2026-02-22T23:24:31.222 INFO:teuthology.orchestra.run.trial045.stdout: Installing : python3-requests-2.25.1-10.el9.noarch 13/99 2026-02-22T23:24:31.231 INFO:teuthology.orchestra.run.trial045.stdout: Installing : libquadmath-11.5.0-14.el9.x86_64 14/99 2026-02-22T23:24:31.232 INFO:teuthology.orchestra.run.trial045.stdout: Installing : libgfortran-11.5.0-14.el9.x86_64 15/99 2026-02-22T23:24:31.243 INFO:teuthology.orchestra.run.trial045.stdout: Installing : ledmon-libs-1.1.0-3.el9.x86_64 16/99 2026-02-22T23:24:31.250 INFO:teuthology.orchestra.run.trial045.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 17/99 2026-02-22T23:24:31.274 INFO:teuthology.orchestra.run.trial045.stdout: Installing : zip-3.0-35.el9.x86_64 18/99 2026-02-22T23:24:31.277 INFO:teuthology.orchestra.run.trial045.stdout: Installing : luarocks-3.9.2-5.el9.noarch 19/99 2026-02-22T23:24:31.284 INFO:teuthology.orchestra.run.trial045.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 20/99 2026-02-22T23:24:31.309 INFO:teuthology.orchestra.run.trial045.stdout: Installing : protobuf-compiler-3.14.0-17.el9.x86_64 21/99 2026-02-22T23:24:31.360 INFO:teuthology.orchestra.run.trial045.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 22/99 2026-02-22T23:24:31.373 INFO:teuthology.orchestra.run.trial045.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 23/99 2026-02-22T23:24:31.375 INFO:teuthology.orchestra.run.trial045.stdout: Installing : python3-rsa-4.9-2.el9.noarch 24/99 2026-02-22T23:24:31.380 INFO:teuthology.orchestra.run.trial045.stdout: Installing : xmlsec1-openssl-1.2.29-13.el9.x86_64 25/99 2026-02-22T23:24:31.385 INFO:teuthology.orchestra.run.trial045.stdout: Installing : python3-xmlsec-1.3.13-1.el9.x86_64 26/99 2026-02-22T23:24:31.390 INFO:teuthology.orchestra.run.trial045.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 27/99 2026-02-22T23:24:31.393 INFO:teuthology.orchestra.run.trial045.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 28/99 2026-02-22T23:24:31.407 INFO:teuthology.orchestra.run.trial045.stdout: Installing : python3-xmltodict-0.12.0-15.el9.noarch 29/99 2026-02-22T23:24:31.428 INFO:teuthology.orchestra.run.trial045.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 30/99 2026-02-22T23:24:31.433 INFO:teuthology.orchestra.run.trial045.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 31/99 2026-02-22T23:24:31.438 INFO:teuthology.orchestra.run.trial045.stdout: Installing : python3-typing-extensions-4.15.0-1.el9.noarch 32/99 2026-02-22T23:24:31.449 INFO:teuthology.orchestra.run.trial045.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 33/99 2026-02-22T23:24:31.458 INFO:teuthology.orchestra.run.trial045.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 34/99 2026-02-22T23:24:31.464 INFO:teuthology.orchestra.run.trial045.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 35/99 2026-02-22T23:24:31.484 INFO:teuthology.orchestra.run.trial045.stdout: Installing : python3-msgpack-1.0.3-2.el9.x86_64 36/99 2026-02-22T23:24:31.493 INFO:teuthology.orchestra.run.trial045.stdout: Installing : python3-influxdb-5.3.1-1.el9.noarch 37/99 2026-02-22T23:24:31.547 INFO:teuthology.orchestra.run.trial045.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 38/99 2026-02-22T23:24:31.559 INFO:teuthology.orchestra.run.trial045.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 39/99 2026-02-22T23:24:31.575 INFO:teuthology.orchestra.run.trial045.stdout: Installing : python3-isodate-0.6.1-3.el9.noarch 40/99 2026-02-22T23:24:31.579 INFO:teuthology.orchestra.run.trial045.stdout: Installing : python3-saml-1.16.0-1.el9.noarch 41/99 2026-02-22T23:24:31.587 INFO:teuthology.orchestra.run.trial045.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 42/99 2026-02-22T23:24:31.627 INFO:teuthology.orchestra.run.trial045.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 43/99 2026-02-22T23:24:31.952 INFO:teuthology.orchestra.run.trial045.stdout: Installing : python3-google-auth-1:2.45.0-1.el9.noarch 44/99 2026-02-22T23:24:31.962 INFO:teuthology.orchestra.run.trial045.stdout: Installing : python3-kubernetes-1:26.1.0-3.el9.noarch 45/99 2026-02-22T23:24:31.966 INFO:teuthology.orchestra.run.trial045.stdout: Installing : python3-backports-tarfile-1.2.0-1.el9.noarch 46/99 2026-02-22T23:24:31.972 INFO:teuthology.orchestra.run.trial045.stdout: Installing : python3-jaraco-context-6.0.1-3.el9.noarch 47/99 2026-02-22T23:24:31.973 INFO:teuthology.orchestra.run.trial045.stdout: Installing : python3-autocommand-2.2.2-8.el9.noarch 48/99 2026-02-22T23:24:32.001 INFO:teuthology.orchestra.run.trial045.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 49/99 2026-02-22T23:24:32.046 INFO:teuthology.orchestra.run.trial045.stdout: Installing : abseil-cpp-20211102.0-4.el9.x86_64 50/99 2026-02-22T23:24:32.053 INFO:teuthology.orchestra.run.trial045.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 51/99 2026-02-22T23:24:32.057 INFO:teuthology.orchestra.run.trial045.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 52/99 2026-02-22T23:24:32.062 INFO:teuthology.orchestra.run.trial045.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 53/99 2026-02-22T23:24:32.066 INFO:teuthology.orchestra.run.trial045.stdout: Installing : python3-jaraco-text-4.0.0-2.el9.noarch 54/99 2026-02-22T23:24:32.073 INFO:teuthology.orchestra.run.trial045.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 55/99 2026-02-22T23:24:32.076 INFO:teuthology.orchestra.run.trial045.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 56/99 2026-02-22T23:24:32.104 INFO:teuthology.orchestra.run.trial045.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 57/99 2026-02-22T23:24:32.114 INFO:teuthology.orchestra.run.trial045.stdout: Installing : python3-protobuf-3.14.0-17.el9.noarch 58/99 2026-02-22T23:24:32.149 INFO:teuthology.orchestra.run.trial045.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 59/99 2026-02-22T23:24:32.373 INFO:teuthology.orchestra.run.trial045.stdout: Installing : python3-devel-3.9.25-3.el9.x86_64 60/99 2026-02-22T23:24:32.397 INFO:teuthology.orchestra.run.trial045.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 61/99 2026-02-22T23:24:32.400 INFO:teuthology.orchestra.run.trial045.stdout: Installing : python3-jinja2-2.11.3-8.el9.noarch 62/99 2026-02-22T23:24:32.460 INFO:teuthology.orchestra.run.trial045.stdout: Installing : openblas-0.3.29-1.el9.x86_64 63/99 2026-02-22T23:24:32.462 INFO:teuthology.orchestra.run.trial045.stdout: Installing : openblas-openmp-0.3.29-1.el9.x86_64 64/99 2026-02-22T23:24:32.484 INFO:teuthology.orchestra.run.trial045.stdout: Installing : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 65/99 2026-02-22T23:24:32.809 INFO:teuthology.orchestra.run.trial045.stdout: Installing : flexiblas-netlib-3.0.4-9.el9.x86_64 66/99 2026-02-22T23:24:32.882 INFO:teuthology.orchestra.run.trial045.stdout: Installing : python3-numpy-1:1.23.5-2.el9.x86_64 67/99 2026-02-22T23:24:33.552 INFO:teuthology.orchestra.run.trial045.stdout: Installing : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 68/99 2026-02-22T23:24:33.569 INFO:teuthology.orchestra.run.trial045.stdout: Installing : python3-scipy-1.9.3-2.el9.x86_64 69/99 2026-02-22T23:24:33.579 INFO:teuthology.orchestra.run.trial045.stdout: Installing : python3-pyparsing-2.4.7-9.el9.noarch 70/99 2026-02-22T23:24:33.585 INFO:teuthology.orchestra.run.trial045.stdout: Installing : python3-packaging-20.9-5.el9.noarch 71/99 2026-02-22T23:24:33.599 INFO:teuthology.orchestra.run.trial045.stdout: Installing : python3-ply-3.11-14.el9.noarch 72/99 2026-02-22T23:24:33.614 INFO:teuthology.orchestra.run.trial045.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 73/99 2026-02-22T23:24:33.690 INFO:teuthology.orchestra.run.trial045.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 74/99 2026-02-22T23:24:33.698 INFO:teuthology.orchestra.run.trial045.stdout: Installing : python3-cryptography-36.0.1-5.el9.x86_64 75/99 2026-02-22T23:24:33.722 INFO:teuthology.orchestra.run.trial045.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 76/99 2026-02-22T23:24:33.751 INFO:teuthology.orchestra.run.trial045.stdout: Installing : python3-cheroot-10.0.1-4.el9.noarch 77/99 2026-02-22T23:24:33.802 INFO:teuthology.orchestra.run.trial045.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 78/99 2026-02-22T23:24:33.808 INFO:teuthology.orchestra.run.trial045.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 79/99 2026-02-22T23:24:33.811 INFO:teuthology.orchestra.run.trial045.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 80/99 2026-02-22T23:24:33.813 INFO:teuthology.orchestra.run.trial045.stdout: Installing : libconfig-1.7.2-9.el9.x86_64 81/99 2026-02-22T23:24:33.831 INFO:teuthology.orchestra.run.trial045.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 82/99 2026-02-22T23:24:33.831 INFO:teuthology.orchestra.run.trial045.stdout:Creating group 'libstoragemgmt' with GID 991. 2026-02-22T23:24:33.832 INFO:teuthology.orchestra.run.trial045.stdout:Creating user 'libstoragemgmt' (daemon account for libstoragemgmt) with UID 991 and GID 991. 2026-02-22T23:24:33.832 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-22T23:24:33.838 INFO:teuthology.orchestra.run.trial045.stdout: Installing : libstoragemgmt-1.10.1-1.el9.x86_64 82/99 2026-02-22T23:24:33.864 INFO:teuthology.orchestra.run.trial045.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 82/99 2026-02-22T23:24:33.864 INFO:teuthology.orchestra.run.trial045.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/libstoragemgmt.service → /usr/lib/systemd/system/libstoragemgmt.service. 2026-02-22T23:24:33.864 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-22T23:24:33.901 INFO:teuthology.orchestra.run.trial045.stdout: Installing : python3-libstoragemgmt-1.10.1-1.el9.x86_64 83/99 2026-02-22T23:24:33.965 INFO:teuthology.orchestra.run.trial045.stdout: Installing : cryptsetup-2.8.1-3.el9.x86_64 84/99 2026-02-22T23:24:33.968 INFO:teuthology.orchestra.run.trial045.stdout: Installing : ceph-volume-2:19.2.3-689.gf90f4eae.el9.noarch 85/99 2026-02-22T23:24:33.981 INFO:teuthology.orchestra.run.trial045.stdout: Running scriptlet: ceph-volume-2:19.2.3-689.gf90f4eae.el9.noarch 85/99 2026-02-22T23:24:33.981 INFO:teuthology.orchestra.run.trial045.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-22T23:24:33.981 INFO:teuthology.orchestra.run.trial045.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2026-02-22T23:24:33.981 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-22T23:24:34.689 INFO:teuthology.orchestra.run.trial045.stdout: Installing : ceph-osd-2:19.2.3-689.gf90f4eae.el9.x86_64 86/99 2026-02-22T23:24:34.713 INFO:teuthology.orchestra.run.trial045.stdout: Running scriptlet: ceph-osd-2:19.2.3-689.gf90f4eae.el9.x86_64 86/99 2026-02-22T23:24:34.713 INFO:teuthology.orchestra.run.trial045.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-22T23:24:34.713 INFO:teuthology.orchestra.run.trial045.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2026-02-22T23:24:34.713 INFO:teuthology.orchestra.run.trial045.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-22T23:24:34.713 INFO:teuthology.orchestra.run.trial045.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-22T23:24:34.713 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-22T23:24:34.772 INFO:teuthology.orchestra.run.trial045.stdout: Running scriptlet: cephadm-2:19.2.3-689.gf90f4eae.el9.noarch 87/99 2026-02-22T23:24:34.774 INFO:teuthology.orchestra.run.trial045.stdout: Installing : cephadm-2:19.2.3-689.gf90f4eae.el9.noarch 87/99 2026-02-22T23:24:34.778 INFO:teuthology.orchestra.run.trial045.stdout: Installing : ceph-prometheus-alerts-2:19.2.3-689.gf90f4eae.el9. 88/99 2026-02-22T23:24:34.798 INFO:teuthology.orchestra.run.trial045.stdout: Installing : ceph-grafana-dashboards-2:19.2.3-689.gf90f4eae.el9 89/99 2026-02-22T23:24:34.799 INFO:teuthology.orchestra.run.trial045.stdout: Installing : ceph-mgr-cephadm-2:19.2.3-689.gf90f4eae.el9.noarch 90/99 2026-02-22T23:24:35.292 INFO:teuthology.orchestra.run.trial045.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.2.3-689.gf90f4eae.el9.noarch 90/99 2026-02-22T23:24:35.295 INFO:teuthology.orchestra.run.trial045.stdout: Installing : ceph-mgr-dashboard-2:19.2.3-689.gf90f4eae.el9.noar 91/99 2026-02-22T23:24:35.751 INFO:teuthology.orchestra.run.trial045.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.2.3-689.gf90f4eae.el9.noar 91/99 2026-02-22T23:24:35.752 INFO:teuthology.orchestra.run.trial045.stdout: Installing : ceph-mgr-diskprediction-local-2:19.2.3-689.gf90f4e 92/99 2026-02-22T23:24:35.763 INFO:teuthology.orchestra.run.trial045.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.2.3-689.gf90f4e 92/99 2026-02-22T23:24:35.764 INFO:teuthology.orchestra.run.trial045.stdout: Installing : ceph-mgr-k8sevents-2:19.2.3-689.gf90f4eae.el9.noar 93/99 2026-02-22T23:24:35.819 INFO:teuthology.orchestra.run.trial045.stdout: Running scriptlet: ceph-mgr-k8sevents-2:19.2.3-689.gf90f4eae.el9.noar 93/99 2026-02-22T23:24:35.869 INFO:teuthology.orchestra.run.trial045.stdout: Installing : ceph-mgr-modules-core-2:19.2.3-689.gf90f4eae.el9.n 94/99 2026-02-22T23:24:35.870 INFO:teuthology.orchestra.run.trial045.stdout: Installing : ceph-mgr-2:19.2.3-689.gf90f4eae.el9.x86_64 95/99 2026-02-22T23:24:35.891 INFO:teuthology.orchestra.run.trial045.stdout: Running scriptlet: ceph-mgr-2:19.2.3-689.gf90f4eae.el9.x86_64 95/99 2026-02-22T23:24:35.891 INFO:teuthology.orchestra.run.trial045.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-22T23:24:35.891 INFO:teuthology.orchestra.run.trial045.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2026-02-22T23:24:35.891 INFO:teuthology.orchestra.run.trial045.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-22T23:24:35.892 INFO:teuthology.orchestra.run.trial045.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-22T23:24:35.892 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-22T23:24:35.902 INFO:teuthology.orchestra.run.trial045.stdout: Installing : ceph-mgr-rook-2:19.2.3-689.gf90f4eae.el9.noarch 96/99 2026-02-22T23:24:36.121 INFO:teuthology.orchestra.run.trial045.stdout: Running scriptlet: ceph-mgr-rook-2:19.2.3-689.gf90f4eae.el9.noarch 96/99 2026-02-22T23:24:36.122 INFO:teuthology.orchestra.run.trial045.stdout: Installing : ceph-mon-2:19.2.3-689.gf90f4eae.el9.x86_64 97/99 2026-02-22T23:24:36.143 INFO:teuthology.orchestra.run.trial045.stdout: Running scriptlet: ceph-mon-2:19.2.3-689.gf90f4eae.el9.x86_64 97/99 2026-02-22T23:24:36.143 INFO:teuthology.orchestra.run.trial045.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-22T23:24:36.143 INFO:teuthology.orchestra.run.trial045.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2026-02-22T23:24:36.143 INFO:teuthology.orchestra.run.trial045.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-22T23:24:36.143 INFO:teuthology.orchestra.run.trial045.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-22T23:24:36.143 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-22T23:24:36.246 INFO:teuthology.orchestra.run.trial045.stdout: Installing : ceph-mds-2:19.2.3-689.gf90f4eae.el9.x86_64 98/99 2026-02-22T23:24:36.266 INFO:teuthology.orchestra.run.trial045.stdout: Running scriptlet: ceph-mds-2:19.2.3-689.gf90f4eae.el9.x86_64 98/99 2026-02-22T23:24:36.266 INFO:teuthology.orchestra.run.trial045.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-22T23:24:36.266 INFO:teuthology.orchestra.run.trial045.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2026-02-22T23:24:36.266 INFO:teuthology.orchestra.run.trial045.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-22T23:24:36.267 INFO:teuthology.orchestra.run.trial045.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-22T23:24:36.267 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-22T23:24:36.286 INFO:teuthology.orchestra.run.trial045.stdout: Installing : ceph-2:19.2.3-689.gf90f4eae.el9.x86_64 99/99 2026-02-22T23:24:36.944 INFO:teuthology.orchestra.run.trial045.stdout: Running scriptlet: ceph-2:19.2.3-689.gf90f4eae.el9.x86_64 99/99 2026-02-22T23:24:36.944 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : ceph-2:19.2.3-689.gf90f4eae.el9.x86_64 1/99 2026-02-22T23:24:36.944 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : ceph-mds-2:19.2.3-689.gf90f4eae.el9.x86_64 2/99 2026-02-22T23:24:36.944 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : ceph-mgr-2:19.2.3-689.gf90f4eae.el9.x86_64 3/99 2026-02-22T23:24:36.945 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : ceph-mon-2:19.2.3-689.gf90f4eae.el9.x86_64 4/99 2026-02-22T23:24:36.945 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : ceph-osd-2:19.2.3-689.gf90f4eae.el9.x86_64 5/99 2026-02-22T23:24:36.945 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : ceph-grafana-dashboards-2:19.2.3-689.gf90f4eae.el9 6/99 2026-02-22T23:24:36.945 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : ceph-mgr-cephadm-2:19.2.3-689.gf90f4eae.el9.noarch 7/99 2026-02-22T23:24:36.945 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : ceph-mgr-dashboard-2:19.2.3-689.gf90f4eae.el9.noar 8/99 2026-02-22T23:24:36.945 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.2.3-689.gf90f4e 9/99 2026-02-22T23:24:36.945 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : ceph-mgr-k8sevents-2:19.2.3-689.gf90f4eae.el9.noar 10/99 2026-02-22T23:24:36.945 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : ceph-mgr-modules-core-2:19.2.3-689.gf90f4eae.el9.n 11/99 2026-02-22T23:24:36.945 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : ceph-mgr-rook-2:19.2.3-689.gf90f4eae.el9.noarch 12/99 2026-02-22T23:24:36.945 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : ceph-prometheus-alerts-2:19.2.3-689.gf90f4eae.el9. 13/99 2026-02-22T23:24:36.945 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : ceph-volume-2:19.2.3-689.gf90f4eae.el9.noarch 14/99 2026-02-22T23:24:36.945 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : cephadm-2:19.2.3-689.gf90f4eae.el9.noarch 15/99 2026-02-22T23:24:36.946 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : cryptsetup-2.8.1-3.el9.x86_64 16/99 2026-02-22T23:24:36.946 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : ledmon-libs-1.1.0-3.el9.x86_64 17/99 2026-02-22T23:24:36.946 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : libconfig-1.7.2-9.el9.x86_64 18/99 2026-02-22T23:24:36.946 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : libgfortran-11.5.0-14.el9.x86_64 19/99 2026-02-22T23:24:36.946 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : libquadmath-11.5.0-14.el9.x86_64 20/99 2026-02-22T23:24:36.946 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 21/99 2026-02-22T23:24:36.946 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : python3-cryptography-36.0.1-5.el9.x86_64 22/99 2026-02-22T23:24:36.946 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : python3-ply-3.11-14.el9.noarch 23/99 2026-02-22T23:24:36.946 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 24/99 2026-02-22T23:24:36.946 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : python3-pyparsing-2.4.7-9.el9.noarch 25/99 2026-02-22T23:24:36.946 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : python3-requests-2.25.1-10.el9.noarch 26/99 2026-02-22T23:24:36.946 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : python3-urllib3-1.26.5-7.el9.noarch 27/99 2026-02-22T23:24:36.946 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : unzip-6.0-59.el9.x86_64 28/99 2026-02-22T23:24:36.947 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : zip-3.0-35.el9.x86_64 29/99 2026-02-22T23:24:36.947 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : flexiblas-3.0.4-9.el9.x86_64 30/99 2026-02-22T23:24:36.947 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : flexiblas-netlib-3.0.4-9.el9.x86_64 31/99 2026-02-22T23:24:36.947 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 32/99 2026-02-22T23:24:36.947 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : libstoragemgmt-1.10.1-1.el9.x86_64 33/99 2026-02-22T23:24:36.947 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : lua-5.4.4-4.el9.x86_64 34/99 2026-02-22T23:24:36.947 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : openblas-0.3.29-1.el9.x86_64 35/99 2026-02-22T23:24:36.947 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : openblas-openmp-0.3.29-1.el9.x86_64 36/99 2026-02-22T23:24:36.947 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : protobuf-3.14.0-17.el9.x86_64 37/99 2026-02-22T23:24:36.947 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 38/99 2026-02-22T23:24:36.948 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : python3-devel-3.9.25-3.el9.x86_64 39/99 2026-02-22T23:24:36.948 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : python3-jinja2-2.11.3-8.el9.noarch 40/99 2026-02-22T23:24:36.948 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : python3-libstoragemgmt-1.10.1-1.el9.x86_64 41/99 2026-02-22T23:24:36.948 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : python3-lxml-4.6.5-3.el9.x86_64 42/99 2026-02-22T23:24:36.948 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 43/99 2026-02-22T23:24:36.948 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 44/99 2026-02-22T23:24:36.948 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : python3-numpy-1:1.23.5-2.el9.x86_64 45/99 2026-02-22T23:24:36.948 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 46/99 2026-02-22T23:24:36.948 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 47/99 2026-02-22T23:24:36.948 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : python3-protobuf-3.14.0-17.el9.noarch 48/99 2026-02-22T23:24:36.948 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 49/99 2026-02-22T23:24:36.948 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 50/99 2026-02-22T23:24:36.948 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 51/99 2026-02-22T23:24:36.949 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : python3-scipy-1.9.3-2.el9.x86_64 52/99 2026-02-22T23:24:36.949 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 53/99 2026-02-22T23:24:36.949 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : xmlsec1-1.2.29-13.el9.x86_64 54/99 2026-02-22T23:24:36.949 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : xmlsec1-openssl-1.2.29-13.el9.x86_64 55/99 2026-02-22T23:24:36.949 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 56/99 2026-02-22T23:24:36.949 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : protobuf-compiler-3.14.0-17.el9.x86_64 57/99 2026-02-22T23:24:36.949 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : abseil-cpp-20211102.0-4.el9.x86_64 58/99 2026-02-22T23:24:36.949 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 59/99 2026-02-22T23:24:36.949 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 60/99 2026-02-22T23:24:36.949 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 61/99 2026-02-22T23:24:36.949 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : python3-autocommand-2.2.2-8.el9.noarch 62/99 2026-02-22T23:24:36.949 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : python3-backports-tarfile-1.2.0-1.el9.noarch 63/99 2026-02-22T23:24:36.949 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 64/99 2026-02-22T23:24:36.950 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 65/99 2026-02-22T23:24:36.950 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 66/99 2026-02-22T23:24:36.950 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : python3-cheroot-10.0.1-4.el9.noarch 67/99 2026-02-22T23:24:36.950 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 68/99 2026-02-22T23:24:36.950 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : python3-google-auth-1:2.45.0-1.el9.noarch 69/99 2026-02-22T23:24:36.950 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 70/99 2026-02-22T23:24:36.950 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 71/99 2026-02-22T23:24:36.950 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : python3-influxdb-5.3.1-1.el9.noarch 72/99 2026-02-22T23:24:36.950 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : python3-isodate-0.6.1-3.el9.noarch 73/99 2026-02-22T23:24:36.950 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 74/99 2026-02-22T23:24:36.950 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 75/99 2026-02-22T23:24:36.950 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 76/99 2026-02-22T23:24:36.950 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : python3-jaraco-context-6.0.1-3.el9.noarch 77/99 2026-02-22T23:24:36.951 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 78/99 2026-02-22T23:24:36.951 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : python3-jaraco-text-4.0.0-2.el9.noarch 79/99 2026-02-22T23:24:36.951 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : python3-kubernetes-1:26.1.0-3.el9.noarch 80/99 2026-02-22T23:24:36.951 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 81/99 2026-02-22T23:24:36.951 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 82/99 2026-02-22T23:24:36.951 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : python3-msgpack-1.0.3-2.el9.x86_64 83/99 2026-02-22T23:24:36.951 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 84/99 2026-02-22T23:24:36.951 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 85/99 2026-02-22T23:24:36.951 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 86/99 2026-02-22T23:24:36.951 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 87/99 2026-02-22T23:24:36.951 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 88/99 2026-02-22T23:24:36.951 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 89/99 2026-02-22T23:24:36.951 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 90/99 2026-02-22T23:24:36.952 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : python3-saml-1.16.0-1.el9.noarch 91/99 2026-02-22T23:24:36.952 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 92/99 2026-02-22T23:24:36.952 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : python3-typing-extensions-4.15.0-1.el9.noarch 93/99 2026-02-22T23:24:36.952 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 94/99 2026-02-22T23:24:36.952 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 95/99 2026-02-22T23:24:36.952 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 96/99 2026-02-22T23:24:36.952 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : python3-xmlsec-1.3.13-1.el9.x86_64 97/99 2026-02-22T23:24:36.952 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : python3-xmltodict-0.12.0-15.el9.noarch 98/99 2026-02-22T23:24:37.006 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 99/99 2026-02-22T23:24:37.007 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-22T23:24:37.007 INFO:teuthology.orchestra.run.trial045.stdout:Installed: 2026-02-22T23:24:37.007 INFO:teuthology.orchestra.run.trial045.stdout: abseil-cpp-20211102.0-4.el9.x86_64 2026-02-22T23:24:37.007 INFO:teuthology.orchestra.run.trial045.stdout: ceph-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T23:24:37.007 INFO:teuthology.orchestra.run.trial045.stdout: ceph-grafana-dashboards-2:19.2.3-689.gf90f4eae.el9.noarch 2026-02-22T23:24:37.007 INFO:teuthology.orchestra.run.trial045.stdout: ceph-mds-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T23:24:37.007 INFO:teuthology.orchestra.run.trial045.stdout: ceph-mgr-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T23:24:37.007 INFO:teuthology.orchestra.run.trial045.stdout: ceph-mgr-cephadm-2:19.2.3-689.gf90f4eae.el9.noarch 2026-02-22T23:24:37.008 INFO:teuthology.orchestra.run.trial045.stdout: ceph-mgr-dashboard-2:19.2.3-689.gf90f4eae.el9.noarch 2026-02-22T23:24:37.008 INFO:teuthology.orchestra.run.trial045.stdout: ceph-mgr-diskprediction-local-2:19.2.3-689.gf90f4eae.el9.noarch 2026-02-22T23:24:37.008 INFO:teuthology.orchestra.run.trial045.stdout: ceph-mgr-k8sevents-2:19.2.3-689.gf90f4eae.el9.noarch 2026-02-22T23:24:37.008 INFO:teuthology.orchestra.run.trial045.stdout: ceph-mgr-modules-core-2:19.2.3-689.gf90f4eae.el9.noarch 2026-02-22T23:24:37.008 INFO:teuthology.orchestra.run.trial045.stdout: ceph-mgr-rook-2:19.2.3-689.gf90f4eae.el9.noarch 2026-02-22T23:24:37.008 INFO:teuthology.orchestra.run.trial045.stdout: ceph-mon-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T23:24:37.008 INFO:teuthology.orchestra.run.trial045.stdout: ceph-osd-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T23:24:37.008 INFO:teuthology.orchestra.run.trial045.stdout: ceph-prometheus-alerts-2:19.2.3-689.gf90f4eae.el9.noarch 2026-02-22T23:24:37.008 INFO:teuthology.orchestra.run.trial045.stdout: ceph-volume-2:19.2.3-689.gf90f4eae.el9.noarch 2026-02-22T23:24:37.008 INFO:teuthology.orchestra.run.trial045.stdout: cephadm-2:19.2.3-689.gf90f4eae.el9.noarch 2026-02-22T23:24:37.008 INFO:teuthology.orchestra.run.trial045.stdout: cryptsetup-2.8.1-3.el9.x86_64 2026-02-22T23:24:37.008 INFO:teuthology.orchestra.run.trial045.stdout: flexiblas-3.0.4-9.el9.x86_64 2026-02-22T23:24:37.009 INFO:teuthology.orchestra.run.trial045.stdout: flexiblas-netlib-3.0.4-9.el9.x86_64 2026-02-22T23:24:37.009 INFO:teuthology.orchestra.run.trial045.stdout: flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 2026-02-22T23:24:37.009 INFO:teuthology.orchestra.run.trial045.stdout: grpc-data-1.46.7-10.el9.noarch 2026-02-22T23:24:37.009 INFO:teuthology.orchestra.run.trial045.stdout: ledmon-libs-1.1.0-3.el9.x86_64 2026-02-22T23:24:37.009 INFO:teuthology.orchestra.run.trial045.stdout: libconfig-1.7.2-9.el9.x86_64 2026-02-22T23:24:37.009 INFO:teuthology.orchestra.run.trial045.stdout: libgfortran-11.5.0-14.el9.x86_64 2026-02-22T23:24:37.009 INFO:teuthology.orchestra.run.trial045.stdout: libquadmath-11.5.0-14.el9.x86_64 2026-02-22T23:24:37.009 INFO:teuthology.orchestra.run.trial045.stdout: libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-22T23:24:37.009 INFO:teuthology.orchestra.run.trial045.stdout: lua-5.4.4-4.el9.x86_64 2026-02-22T23:24:37.009 INFO:teuthology.orchestra.run.trial045.stdout: lua-devel-5.4.4-4.el9.x86_64 2026-02-22T23:24:37.009 INFO:teuthology.orchestra.run.trial045.stdout: luarocks-3.9.2-5.el9.noarch 2026-02-22T23:24:37.009 INFO:teuthology.orchestra.run.trial045.stdout: openblas-0.3.29-1.el9.x86_64 2026-02-22T23:24:37.010 INFO:teuthology.orchestra.run.trial045.stdout: openblas-openmp-0.3.29-1.el9.x86_64 2026-02-22T23:24:37.010 INFO:teuthology.orchestra.run.trial045.stdout: protobuf-3.14.0-17.el9.x86_64 2026-02-22T23:24:37.010 INFO:teuthology.orchestra.run.trial045.stdout: protobuf-compiler-3.14.0-17.el9.x86_64 2026-02-22T23:24:37.010 INFO:teuthology.orchestra.run.trial045.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2026-02-22T23:24:37.010 INFO:teuthology.orchestra.run.trial045.stdout: python3-autocommand-2.2.2-8.el9.noarch 2026-02-22T23:24:37.010 INFO:teuthology.orchestra.run.trial045.stdout: python3-babel-2.9.1-2.el9.noarch 2026-02-22T23:24:37.010 INFO:teuthology.orchestra.run.trial045.stdout: python3-backports-tarfile-1.2.0-1.el9.noarch 2026-02-22T23:24:37.010 INFO:teuthology.orchestra.run.trial045.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2026-02-22T23:24:37.010 INFO:teuthology.orchestra.run.trial045.stdout: python3-cachetools-4.2.4-1.el9.noarch 2026-02-22T23:24:37.010 INFO:teuthology.orchestra.run.trial045.stdout: python3-certifi-2023.05.07-4.el9.noarch 2026-02-22T23:24:37.010 INFO:teuthology.orchestra.run.trial045.stdout: python3-cffi-1.14.5-5.el9.x86_64 2026-02-22T23:24:37.010 INFO:teuthology.orchestra.run.trial045.stdout: python3-cheroot-10.0.1-4.el9.noarch 2026-02-22T23:24:37.010 INFO:teuthology.orchestra.run.trial045.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2026-02-22T23:24:37.011 INFO:teuthology.orchestra.run.trial045.stdout: python3-cryptography-36.0.1-5.el9.x86_64 2026-02-22T23:24:37.011 INFO:teuthology.orchestra.run.trial045.stdout: python3-devel-3.9.25-3.el9.x86_64 2026-02-22T23:24:37.011 INFO:teuthology.orchestra.run.trial045.stdout: python3-google-auth-1:2.45.0-1.el9.noarch 2026-02-22T23:24:37.011 INFO:teuthology.orchestra.run.trial045.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2026-02-22T23:24:37.011 INFO:teuthology.orchestra.run.trial045.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2026-02-22T23:24:37.011 INFO:teuthology.orchestra.run.trial045.stdout: python3-influxdb-5.3.1-1.el9.noarch 2026-02-22T23:24:37.011 INFO:teuthology.orchestra.run.trial045.stdout: python3-isodate-0.6.1-3.el9.noarch 2026-02-22T23:24:37.011 INFO:teuthology.orchestra.run.trial045.stdout: python3-jaraco-8.2.1-3.el9.noarch 2026-02-22T23:24:37.011 INFO:teuthology.orchestra.run.trial045.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2026-02-22T23:24:37.011 INFO:teuthology.orchestra.run.trial045.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2026-02-22T23:24:37.011 INFO:teuthology.orchestra.run.trial045.stdout: python3-jaraco-context-6.0.1-3.el9.noarch 2026-02-22T23:24:37.011 INFO:teuthology.orchestra.run.trial045.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2026-02-22T23:24:37.011 INFO:teuthology.orchestra.run.trial045.stdout: python3-jaraco-text-4.0.0-2.el9.noarch 2026-02-22T23:24:37.012 INFO:teuthology.orchestra.run.trial045.stdout: python3-jinja2-2.11.3-8.el9.noarch 2026-02-22T23:24:37.012 INFO:teuthology.orchestra.run.trial045.stdout: python3-kubernetes-1:26.1.0-3.el9.noarch 2026-02-22T23:24:37.012 INFO:teuthology.orchestra.run.trial045.stdout: python3-libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-22T23:24:37.012 INFO:teuthology.orchestra.run.trial045.stdout: python3-logutils-0.3.5-21.el9.noarch 2026-02-22T23:24:37.012 INFO:teuthology.orchestra.run.trial045.stdout: python3-lxml-4.6.5-3.el9.x86_64 2026-02-22T23:24:37.012 INFO:teuthology.orchestra.run.trial045.stdout: python3-mako-1.1.4-6.el9.noarch 2026-02-22T23:24:37.012 INFO:teuthology.orchestra.run.trial045.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2026-02-22T23:24:37.012 INFO:teuthology.orchestra.run.trial045.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2026-02-22T23:24:37.012 INFO:teuthology.orchestra.run.trial045.stdout: python3-msgpack-1.0.3-2.el9.x86_64 2026-02-22T23:24:37.012 INFO:teuthology.orchestra.run.trial045.stdout: python3-natsort-7.1.1-5.el9.noarch 2026-02-22T23:24:37.012 INFO:teuthology.orchestra.run.trial045.stdout: python3-numpy-1:1.23.5-2.el9.x86_64 2026-02-22T23:24:37.012 INFO:teuthology.orchestra.run.trial045.stdout: python3-numpy-f2py-1:1.23.5-2.el9.x86_64 2026-02-22T23:24:37.013 INFO:teuthology.orchestra.run.trial045.stdout: python3-packaging-20.9-5.el9.noarch 2026-02-22T23:24:37.013 INFO:teuthology.orchestra.run.trial045.stdout: python3-pecan-1.4.2-3.el9.noarch 2026-02-22T23:24:37.013 INFO:teuthology.orchestra.run.trial045.stdout: python3-ply-3.11-14.el9.noarch 2026-02-22T23:24:37.013 INFO:teuthology.orchestra.run.trial045.stdout: python3-portend-3.1.0-2.el9.noarch 2026-02-22T23:24:37.013 INFO:teuthology.orchestra.run.trial045.stdout: python3-protobuf-3.14.0-17.el9.noarch 2026-02-22T23:24:37.013 INFO:teuthology.orchestra.run.trial045.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2026-02-22T23:24:37.013 INFO:teuthology.orchestra.run.trial045.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2026-02-22T23:24:37.013 INFO:teuthology.orchestra.run.trial045.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2026-02-22T23:24:37.013 INFO:teuthology.orchestra.run.trial045.stdout: python3-pycparser-2.20-6.el9.noarch 2026-02-22T23:24:37.013 INFO:teuthology.orchestra.run.trial045.stdout: python3-pyparsing-2.4.7-9.el9.noarch 2026-02-22T23:24:37.014 INFO:teuthology.orchestra.run.trial045.stdout: python3-repoze-lru-0.7-16.el9.noarch 2026-02-22T23:24:37.014 INFO:teuthology.orchestra.run.trial045.stdout: python3-requests-2.25.1-10.el9.noarch 2026-02-22T23:24:37.014 INFO:teuthology.orchestra.run.trial045.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2026-02-22T23:24:37.014 INFO:teuthology.orchestra.run.trial045.stdout: python3-routes-2.5.1-5.el9.noarch 2026-02-22T23:24:37.014 INFO:teuthology.orchestra.run.trial045.stdout: python3-rsa-4.9-2.el9.noarch 2026-02-22T23:24:37.014 INFO:teuthology.orchestra.run.trial045.stdout: python3-saml-1.16.0-1.el9.noarch 2026-02-22T23:24:37.014 INFO:teuthology.orchestra.run.trial045.stdout: python3-scipy-1.9.3-2.el9.x86_64 2026-02-22T23:24:37.014 INFO:teuthology.orchestra.run.trial045.stdout: python3-tempora-5.0.0-2.el9.noarch 2026-02-22T23:24:37.014 INFO:teuthology.orchestra.run.trial045.stdout: python3-toml-0.10.2-6.el9.noarch 2026-02-22T23:24:37.014 INFO:teuthology.orchestra.run.trial045.stdout: python3-typing-extensions-4.15.0-1.el9.noarch 2026-02-22T23:24:37.014 INFO:teuthology.orchestra.run.trial045.stdout: python3-urllib3-1.26.5-7.el9.noarch 2026-02-22T23:24:37.014 INFO:teuthology.orchestra.run.trial045.stdout: python3-webob-1.8.8-2.el9.noarch 2026-02-22T23:24:37.014 INFO:teuthology.orchestra.run.trial045.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2026-02-22T23:24:37.015 INFO:teuthology.orchestra.run.trial045.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2026-02-22T23:24:37.015 INFO:teuthology.orchestra.run.trial045.stdout: python3-xmlsec-1.3.13-1.el9.x86_64 2026-02-22T23:24:37.015 INFO:teuthology.orchestra.run.trial045.stdout: python3-xmltodict-0.12.0-15.el9.noarch 2026-02-22T23:24:37.015 INFO:teuthology.orchestra.run.trial045.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2026-02-22T23:24:37.015 INFO:teuthology.orchestra.run.trial045.stdout: unzip-6.0-59.el9.x86_64 2026-02-22T23:24:37.015 INFO:teuthology.orchestra.run.trial045.stdout: xmlsec1-1.2.29-13.el9.x86_64 2026-02-22T23:24:37.015 INFO:teuthology.orchestra.run.trial045.stdout: xmlsec1-openssl-1.2.29-13.el9.x86_64 2026-02-22T23:24:37.015 INFO:teuthology.orchestra.run.trial045.stdout: zip-3.0-35.el9.x86_64 2026-02-22T23:24:37.015 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-22T23:24:37.015 INFO:teuthology.orchestra.run.trial045.stdout:Complete! 2026-02-22T23:24:37.061 DEBUG:teuthology.orchestra.run.trial045:> sudo yum -y install ceph-base 2026-02-22T23:24:37.372 INFO:teuthology.orchestra.run.trial045.stdout:Last metadata expiration check: 0:00:28 ago on Sun 22 Feb 2026 11:24:09 PM UTC. 2026-02-22T23:24:37.437 INFO:teuthology.orchestra.run.trial045.stdout:Package ceph-base-2:19.2.3-689.gf90f4eae.el9.x86_64 is already installed. 2026-02-22T23:24:37.455 INFO:teuthology.orchestra.run.trial045.stdout:Dependencies resolved. 2026-02-22T23:24:37.456 INFO:teuthology.orchestra.run.trial045.stdout:Nothing to do. 2026-02-22T23:24:37.456 INFO:teuthology.orchestra.run.trial045.stdout:Complete! 2026-02-22T23:24:37.479 DEBUG:teuthology.orchestra.run.trial045:> sudo yum -y install cephadm 2026-02-22T23:24:37.788 INFO:teuthology.orchestra.run.trial045.stdout:Last metadata expiration check: 0:00:28 ago on Sun 22 Feb 2026 11:24:09 PM UTC. 2026-02-22T23:24:37.852 INFO:teuthology.orchestra.run.trial045.stdout:Package cephadm-2:19.2.3-689.gf90f4eae.el9.noarch is already installed. 2026-02-22T23:24:37.871 INFO:teuthology.orchestra.run.trial045.stdout:Dependencies resolved. 2026-02-22T23:24:37.871 INFO:teuthology.orchestra.run.trial045.stdout:Nothing to do. 2026-02-22T23:24:37.871 INFO:teuthology.orchestra.run.trial045.stdout:Complete! 2026-02-22T23:24:37.892 DEBUG:teuthology.orchestra.run.trial045:> sudo yum -y install ceph-immutable-object-cache 2026-02-22T23:24:38.197 INFO:teuthology.orchestra.run.trial045.stdout:Last metadata expiration check: 0:00:29 ago on Sun 22 Feb 2026 11:24:09 PM UTC. 2026-02-22T23:24:38.281 INFO:teuthology.orchestra.run.trial045.stdout:Dependencies resolved. 2026-02-22T23:24:38.281 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-22T23:24:38.281 INFO:teuthology.orchestra.run.trial045.stdout: Package Arch Version Repo Size 2026-02-22T23:24:38.281 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-22T23:24:38.281 INFO:teuthology.orchestra.run.trial045.stdout:Installing: 2026-02-22T23:24:38.281 INFO:teuthology.orchestra.run.trial045.stdout: ceph-immutable-object-cache x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 145 k 2026-02-22T23:24:38.281 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-22T23:24:38.281 INFO:teuthology.orchestra.run.trial045.stdout:Transaction Summary 2026-02-22T23:24:38.281 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-22T23:24:38.281 INFO:teuthology.orchestra.run.trial045.stdout:Install 1 Package 2026-02-22T23:24:38.281 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-22T23:24:38.281 INFO:teuthology.orchestra.run.trial045.stdout:Total download size: 145 k 2026-02-22T23:24:38.281 INFO:teuthology.orchestra.run.trial045.stdout:Installed size: 431 k 2026-02-22T23:24:38.281 INFO:teuthology.orchestra.run.trial045.stdout:Downloading Packages: 2026-02-22T23:24:38.369 INFO:teuthology.orchestra.run.trial045.stdout:ceph-immutable-object-cache-19.2.3-689.gf90f4ea 1.6 MB/s | 145 kB 00:00 2026-02-22T23:24:38.369 INFO:teuthology.orchestra.run.trial045.stdout:-------------------------------------------------------------------------------- 2026-02-22T23:24:38.369 INFO:teuthology.orchestra.run.trial045.stdout:Total 1.6 MB/s | 145 kB 00:00 2026-02-22T23:24:38.369 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction check 2026-02-22T23:24:38.372 INFO:teuthology.orchestra.run.trial045.stdout:Transaction check succeeded. 2026-02-22T23:24:38.372 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction test 2026-02-22T23:24:38.404 INFO:teuthology.orchestra.run.trial045.stdout:Transaction test succeeded. 2026-02-22T23:24:38.404 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction 2026-02-22T23:24:38.459 INFO:teuthology.orchestra.run.trial045.stdout: Preparing : 1/1 2026-02-22T23:24:38.460 INFO:teuthology.orchestra.run.trial045.stdout: Installing : ceph-immutable-object-cache-2:19.2.3-689.gf90f4eae.e 1/1 2026-02-22T23:24:38.482 INFO:teuthology.orchestra.run.trial045.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.2.3-689.gf90f4eae.e 1/1 2026-02-22T23:24:38.482 INFO:teuthology.orchestra.run.trial045.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-22T23:24:38.482 INFO:teuthology.orchestra.run.trial045.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2026-02-22T23:24:38.482 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-22T23:24:38.787 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : ceph-immutable-object-cache-2:19.2.3-689.gf90f4eae.e 1/1 2026-02-22T23:24:38.787 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-22T23:24:38.787 INFO:teuthology.orchestra.run.trial045.stdout:Installed: 2026-02-22T23:24:38.787 INFO:teuthology.orchestra.run.trial045.stdout: ceph-immutable-object-cache-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T23:24:38.787 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-22T23:24:38.787 INFO:teuthology.orchestra.run.trial045.stdout:Complete! 2026-02-22T23:24:38.814 DEBUG:teuthology.orchestra.run.trial045:> sudo yum -y install ceph-mgr 2026-02-22T23:24:39.122 INFO:teuthology.orchestra.run.trial045.stdout:Last metadata expiration check: 0:00:30 ago on Sun 22 Feb 2026 11:24:09 PM UTC. 2026-02-22T23:24:39.187 INFO:teuthology.orchestra.run.trial045.stdout:Package ceph-mgr-2:19.2.3-689.gf90f4eae.el9.x86_64 is already installed. 2026-02-22T23:24:39.205 INFO:teuthology.orchestra.run.trial045.stdout:Dependencies resolved. 2026-02-22T23:24:39.206 INFO:teuthology.orchestra.run.trial045.stdout:Nothing to do. 2026-02-22T23:24:39.206 INFO:teuthology.orchestra.run.trial045.stdout:Complete! 2026-02-22T23:24:39.225 DEBUG:teuthology.orchestra.run.trial045:> sudo yum -y install ceph-mgr-dashboard 2026-02-22T23:24:39.532 INFO:teuthology.orchestra.run.trial045.stdout:Last metadata expiration check: 0:00:30 ago on Sun 22 Feb 2026 11:24:09 PM UTC. 2026-02-22T23:24:39.596 INFO:teuthology.orchestra.run.trial045.stdout:Package ceph-mgr-dashboard-2:19.2.3-689.gf90f4eae.el9.noarch is already installed. 2026-02-22T23:24:39.614 INFO:teuthology.orchestra.run.trial045.stdout:Dependencies resolved. 2026-02-22T23:24:39.615 INFO:teuthology.orchestra.run.trial045.stdout:Nothing to do. 2026-02-22T23:24:39.615 INFO:teuthology.orchestra.run.trial045.stdout:Complete! 2026-02-22T23:24:39.635 DEBUG:teuthology.orchestra.run.trial045:> sudo yum -y install ceph-mgr-diskprediction-local 2026-02-22T23:24:39.938 INFO:teuthology.orchestra.run.trial045.stdout:Last metadata expiration check: 0:00:30 ago on Sun 22 Feb 2026 11:24:09 PM UTC. 2026-02-22T23:24:40.003 INFO:teuthology.orchestra.run.trial045.stdout:Package ceph-mgr-diskprediction-local-2:19.2.3-689.gf90f4eae.el9.noarch is already installed. 2026-02-22T23:24:40.022 INFO:teuthology.orchestra.run.trial045.stdout:Dependencies resolved. 2026-02-22T23:24:40.023 INFO:teuthology.orchestra.run.trial045.stdout:Nothing to do. 2026-02-22T23:24:40.023 INFO:teuthology.orchestra.run.trial045.stdout:Complete! 2026-02-22T23:24:40.042 DEBUG:teuthology.orchestra.run.trial045:> sudo yum -y install ceph-mgr-rook 2026-02-22T23:24:40.351 INFO:teuthology.orchestra.run.trial045.stdout:Last metadata expiration check: 0:00:31 ago on Sun 22 Feb 2026 11:24:09 PM UTC. 2026-02-22T23:24:40.415 INFO:teuthology.orchestra.run.trial045.stdout:Package ceph-mgr-rook-2:19.2.3-689.gf90f4eae.el9.noarch is already installed. 2026-02-22T23:24:40.434 INFO:teuthology.orchestra.run.trial045.stdout:Dependencies resolved. 2026-02-22T23:24:40.434 INFO:teuthology.orchestra.run.trial045.stdout:Nothing to do. 2026-02-22T23:24:40.434 INFO:teuthology.orchestra.run.trial045.stdout:Complete! 2026-02-22T23:24:40.455 DEBUG:teuthology.orchestra.run.trial045:> sudo yum -y install ceph-mgr-cephadm 2026-02-22T23:24:40.762 INFO:teuthology.orchestra.run.trial045.stdout:Last metadata expiration check: 0:00:31 ago on Sun 22 Feb 2026 11:24:09 PM UTC. 2026-02-22T23:24:40.826 INFO:teuthology.orchestra.run.trial045.stdout:Package ceph-mgr-cephadm-2:19.2.3-689.gf90f4eae.el9.noarch is already installed. 2026-02-22T23:24:40.844 INFO:teuthology.orchestra.run.trial045.stdout:Dependencies resolved. 2026-02-22T23:24:40.845 INFO:teuthology.orchestra.run.trial045.stdout:Nothing to do. 2026-02-22T23:24:40.845 INFO:teuthology.orchestra.run.trial045.stdout:Complete! 2026-02-22T23:24:40.865 DEBUG:teuthology.orchestra.run.trial045:> sudo yum -y install ceph-fuse 2026-02-22T23:24:41.165 INFO:teuthology.orchestra.run.trial045.stdout:Last metadata expiration check: 0:00:32 ago on Sun 22 Feb 2026 11:24:09 PM UTC. 2026-02-22T23:24:41.247 INFO:teuthology.orchestra.run.trial045.stdout:Dependencies resolved. 2026-02-22T23:24:41.248 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-22T23:24:41.248 INFO:teuthology.orchestra.run.trial045.stdout: Package Architecture Version Repository Size 2026-02-22T23:24:41.248 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-22T23:24:41.248 INFO:teuthology.orchestra.run.trial045.stdout:Installing: 2026-02-22T23:24:41.248 INFO:teuthology.orchestra.run.trial045.stdout: ceph-fuse x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 1.2 M 2026-02-22T23:24:41.248 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-22T23:24:41.248 INFO:teuthology.orchestra.run.trial045.stdout:Transaction Summary 2026-02-22T23:24:41.248 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-22T23:24:41.248 INFO:teuthology.orchestra.run.trial045.stdout:Install 1 Package 2026-02-22T23:24:41.248 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-22T23:24:41.248 INFO:teuthology.orchestra.run.trial045.stdout:Total download size: 1.2 M 2026-02-22T23:24:41.248 INFO:teuthology.orchestra.run.trial045.stdout:Installed size: 3.6 M 2026-02-22T23:24:41.248 INFO:teuthology.orchestra.run.trial045.stdout:Downloading Packages: 2026-02-22T23:24:41.372 INFO:teuthology.orchestra.run.trial045.stdout:ceph-fuse-19.2.3-689.gf90f4eae.el9.x86_64.rpm 9.3 MB/s | 1.2 MB 00:00 2026-02-22T23:24:41.373 INFO:teuthology.orchestra.run.trial045.stdout:-------------------------------------------------------------------------------- 2026-02-22T23:24:41.373 INFO:teuthology.orchestra.run.trial045.stdout:Total 9.2 MB/s | 1.2 MB 00:00 2026-02-22T23:24:41.373 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction check 2026-02-22T23:24:41.377 INFO:teuthology.orchestra.run.trial045.stdout:Transaction check succeeded. 2026-02-22T23:24:41.377 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction test 2026-02-22T23:24:41.413 INFO:teuthology.orchestra.run.trial045.stdout:Transaction test succeeded. 2026-02-22T23:24:41.413 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction 2026-02-22T23:24:41.517 INFO:teuthology.orchestra.run.trial045.stdout: Preparing : 1/1 2026-02-22T23:24:41.534 INFO:teuthology.orchestra.run.trial045.stdout: Installing : ceph-fuse-2:19.2.3-689.gf90f4eae.el9.x86_64 1/1 2026-02-22T23:24:41.743 INFO:teuthology.orchestra.run.trial045.stdout: Running scriptlet: ceph-fuse-2:19.2.3-689.gf90f4eae.el9.x86_64 1/1 2026-02-22T23:24:41.801 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : ceph-fuse-2:19.2.3-689.gf90f4eae.el9.x86_64 1/1 2026-02-22T23:24:41.801 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-22T23:24:41.802 INFO:teuthology.orchestra.run.trial045.stdout:Installed: 2026-02-22T23:24:41.802 INFO:teuthology.orchestra.run.trial045.stdout: ceph-fuse-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T23:24:41.802 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-22T23:24:41.802 INFO:teuthology.orchestra.run.trial045.stdout:Complete! 2026-02-22T23:24:41.830 DEBUG:teuthology.orchestra.run.trial045:> sudo yum -y install ceph-volume 2026-02-22T23:24:42.139 INFO:teuthology.orchestra.run.trial045.stdout:Last metadata expiration check: 0:00:33 ago on Sun 22 Feb 2026 11:24:09 PM UTC. 2026-02-22T23:24:42.205 INFO:teuthology.orchestra.run.trial045.stdout:Package ceph-volume-2:19.2.3-689.gf90f4eae.el9.noarch is already installed. 2026-02-22T23:24:42.223 INFO:teuthology.orchestra.run.trial045.stdout:Dependencies resolved. 2026-02-22T23:24:42.223 INFO:teuthology.orchestra.run.trial045.stdout:Nothing to do. 2026-02-22T23:24:42.223 INFO:teuthology.orchestra.run.trial045.stdout:Complete! 2026-02-22T23:24:42.245 DEBUG:teuthology.orchestra.run.trial045:> sudo yum -y install librados-devel 2026-02-22T23:24:42.551 INFO:teuthology.orchestra.run.trial045.stdout:Last metadata expiration check: 0:00:33 ago on Sun 22 Feb 2026 11:24:09 PM UTC. 2026-02-22T23:24:42.634 INFO:teuthology.orchestra.run.trial045.stdout:Dependencies resolved. 2026-02-22T23:24:42.635 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-22T23:24:42.635 INFO:teuthology.orchestra.run.trial045.stdout: Package Arch Version Repo Size 2026-02-22T23:24:42.635 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-22T23:24:42.635 INFO:teuthology.orchestra.run.trial045.stdout:Installing: 2026-02-22T23:24:42.635 INFO:teuthology.orchestra.run.trial045.stdout: librados-devel x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 126 k 2026-02-22T23:24:42.635 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-22T23:24:42.635 INFO:teuthology.orchestra.run.trial045.stdout:Transaction Summary 2026-02-22T23:24:42.635 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-22T23:24:42.636 INFO:teuthology.orchestra.run.trial045.stdout:Install 1 Package 2026-02-22T23:24:42.636 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-22T23:24:42.636 INFO:teuthology.orchestra.run.trial045.stdout:Total download size: 126 k 2026-02-22T23:24:42.636 INFO:teuthology.orchestra.run.trial045.stdout:Installed size: 456 k 2026-02-22T23:24:42.636 INFO:teuthology.orchestra.run.trial045.stdout:Downloading Packages: 2026-02-22T23:24:42.721 INFO:teuthology.orchestra.run.trial045.stdout:librados-devel-19.2.3-689.gf90f4eae.el9.x86_64. 1.4 MB/s | 126 kB 00:00 2026-02-22T23:24:42.721 INFO:teuthology.orchestra.run.trial045.stdout:-------------------------------------------------------------------------------- 2026-02-22T23:24:42.722 INFO:teuthology.orchestra.run.trial045.stdout:Total 1.4 MB/s | 126 kB 00:00 2026-02-22T23:24:42.722 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction check 2026-02-22T23:24:42.724 INFO:teuthology.orchestra.run.trial045.stdout:Transaction check succeeded. 2026-02-22T23:24:42.724 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction test 2026-02-22T23:24:42.756 INFO:teuthology.orchestra.run.trial045.stdout:Transaction test succeeded. 2026-02-22T23:24:42.757 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction 2026-02-22T23:24:42.811 INFO:teuthology.orchestra.run.trial045.stdout: Preparing : 1/1 2026-02-22T23:24:42.828 INFO:teuthology.orchestra.run.trial045.stdout: Installing : librados-devel-2:19.2.3-689.gf90f4eae.el9.x86_64 1/1 2026-02-22T23:24:42.907 INFO:teuthology.orchestra.run.trial045.stdout: Running scriptlet: librados-devel-2:19.2.3-689.gf90f4eae.el9.x86_64 1/1 2026-02-22T23:24:42.965 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : librados-devel-2:19.2.3-689.gf90f4eae.el9.x86_64 1/1 2026-02-22T23:24:42.966 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-22T23:24:42.966 INFO:teuthology.orchestra.run.trial045.stdout:Installed: 2026-02-22T23:24:42.966 INFO:teuthology.orchestra.run.trial045.stdout: librados-devel-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T23:24:42.966 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-22T23:24:42.966 INFO:teuthology.orchestra.run.trial045.stdout:Complete! 2026-02-22T23:24:42.994 DEBUG:teuthology.orchestra.run.trial045:> sudo yum -y install libcephfs2 2026-02-22T23:24:43.303 INFO:teuthology.orchestra.run.trial045.stdout:Last metadata expiration check: 0:00:34 ago on Sun 22 Feb 2026 11:24:09 PM UTC. 2026-02-22T23:24:43.367 INFO:teuthology.orchestra.run.trial045.stdout:Package libcephfs2-2:19.2.3-689.gf90f4eae.el9.x86_64 is already installed. 2026-02-22T23:24:43.386 INFO:teuthology.orchestra.run.trial045.stdout:Dependencies resolved. 2026-02-22T23:24:43.386 INFO:teuthology.orchestra.run.trial045.stdout:Nothing to do. 2026-02-22T23:24:43.386 INFO:teuthology.orchestra.run.trial045.stdout:Complete! 2026-02-22T23:24:43.407 DEBUG:teuthology.orchestra.run.trial045:> sudo yum -y install libcephfs-devel 2026-02-22T23:24:43.711 INFO:teuthology.orchestra.run.trial045.stdout:Last metadata expiration check: 0:00:34 ago on Sun 22 Feb 2026 11:24:09 PM UTC. 2026-02-22T23:24:43.794 INFO:teuthology.orchestra.run.trial045.stdout:Dependencies resolved. 2026-02-22T23:24:43.795 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-22T23:24:43.795 INFO:teuthology.orchestra.run.trial045.stdout: Package Arch Version Repo Size 2026-02-22T23:24:43.795 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-22T23:24:43.795 INFO:teuthology.orchestra.run.trial045.stdout:Installing: 2026-02-22T23:24:43.795 INFO:teuthology.orchestra.run.trial045.stdout: libcephfs-devel x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 34 k 2026-02-22T23:24:43.795 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-22T23:24:43.795 INFO:teuthology.orchestra.run.trial045.stdout:Transaction Summary 2026-02-22T23:24:43.795 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-22T23:24:43.795 INFO:teuthology.orchestra.run.trial045.stdout:Install 1 Package 2026-02-22T23:24:43.795 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-22T23:24:43.795 INFO:teuthology.orchestra.run.trial045.stdout:Total download size: 34 k 2026-02-22T23:24:43.795 INFO:teuthology.orchestra.run.trial045.stdout:Installed size: 153 k 2026-02-22T23:24:43.795 INFO:teuthology.orchestra.run.trial045.stdout:Downloading Packages: 2026-02-22T23:24:43.859 INFO:teuthology.orchestra.run.trial045.stdout:libcephfs-devel-19.2.3-689.gf90f4eae.el9.x86_64 524 kB/s | 34 kB 00:00 2026-02-22T23:24:43.860 INFO:teuthology.orchestra.run.trial045.stdout:-------------------------------------------------------------------------------- 2026-02-22T23:24:43.860 INFO:teuthology.orchestra.run.trial045.stdout:Total 514 kB/s | 34 kB 00:00 2026-02-22T23:24:43.860 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction check 2026-02-22T23:24:43.862 INFO:teuthology.orchestra.run.trial045.stdout:Transaction check succeeded. 2026-02-22T23:24:43.862 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction test 2026-02-22T23:24:43.865 INFO:teuthology.orchestra.run.trial045.stdout:Transaction test succeeded. 2026-02-22T23:24:43.865 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction 2026-02-22T23:24:43.886 INFO:teuthology.orchestra.run.trial045.stdout: Preparing : 1/1 2026-02-22T23:24:43.902 INFO:teuthology.orchestra.run.trial045.stdout: Installing : libcephfs-devel-2:19.2.3-689.gf90f4eae.el9.x86_64 1/1 2026-02-22T23:24:43.957 INFO:teuthology.orchestra.run.trial045.stdout: Running scriptlet: libcephfs-devel-2:19.2.3-689.gf90f4eae.el9.x86_64 1/1 2026-02-22T23:24:44.013 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : libcephfs-devel-2:19.2.3-689.gf90f4eae.el9.x86_64 1/1 2026-02-22T23:24:44.013 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-22T23:24:44.013 INFO:teuthology.orchestra.run.trial045.stdout:Installed: 2026-02-22T23:24:44.014 INFO:teuthology.orchestra.run.trial045.stdout: libcephfs-devel-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T23:24:44.014 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-22T23:24:44.014 INFO:teuthology.orchestra.run.trial045.stdout:Complete! 2026-02-22T23:24:44.041 DEBUG:teuthology.orchestra.run.trial045:> sudo yum -y install librados2 2026-02-22T23:24:44.349 INFO:teuthology.orchestra.run.trial045.stdout:Last metadata expiration check: 0:00:35 ago on Sun 22 Feb 2026 11:24:09 PM UTC. 2026-02-22T23:24:44.414 INFO:teuthology.orchestra.run.trial045.stdout:Package librados2-2:19.2.3-689.gf90f4eae.el9.x86_64 is already installed. 2026-02-22T23:24:44.432 INFO:teuthology.orchestra.run.trial045.stdout:Dependencies resolved. 2026-02-22T23:24:44.433 INFO:teuthology.orchestra.run.trial045.stdout:Nothing to do. 2026-02-22T23:24:44.433 INFO:teuthology.orchestra.run.trial045.stdout:Complete! 2026-02-22T23:24:44.454 DEBUG:teuthology.orchestra.run.trial045:> sudo yum -y install librbd1 2026-02-22T23:24:44.763 INFO:teuthology.orchestra.run.trial045.stdout:Last metadata expiration check: 0:00:35 ago on Sun 22 Feb 2026 11:24:09 PM UTC. 2026-02-22T23:24:44.827 INFO:teuthology.orchestra.run.trial045.stdout:Package librbd1-2:19.2.3-689.gf90f4eae.el9.x86_64 is already installed. 2026-02-22T23:24:44.845 INFO:teuthology.orchestra.run.trial045.stdout:Dependencies resolved. 2026-02-22T23:24:44.846 INFO:teuthology.orchestra.run.trial045.stdout:Nothing to do. 2026-02-22T23:24:44.846 INFO:teuthology.orchestra.run.trial045.stdout:Complete! 2026-02-22T23:24:44.867 DEBUG:teuthology.orchestra.run.trial045:> sudo yum -y install python3-rados 2026-02-22T23:24:45.178 INFO:teuthology.orchestra.run.trial045.stdout:Last metadata expiration check: 0:00:36 ago on Sun 22 Feb 2026 11:24:09 PM UTC. 2026-02-22T23:24:45.243 INFO:teuthology.orchestra.run.trial045.stdout:Package python3-rados-2:19.2.3-689.gf90f4eae.el9.x86_64 is already installed. 2026-02-22T23:24:45.261 INFO:teuthology.orchestra.run.trial045.stdout:Dependencies resolved. 2026-02-22T23:24:45.262 INFO:teuthology.orchestra.run.trial045.stdout:Nothing to do. 2026-02-22T23:24:45.262 INFO:teuthology.orchestra.run.trial045.stdout:Complete! 2026-02-22T23:24:45.284 DEBUG:teuthology.orchestra.run.trial045:> sudo yum -y install python3-rgw 2026-02-22T23:24:45.591 INFO:teuthology.orchestra.run.trial045.stdout:Last metadata expiration check: 0:00:36 ago on Sun 22 Feb 2026 11:24:09 PM UTC. 2026-02-22T23:24:45.656 INFO:teuthology.orchestra.run.trial045.stdout:Package python3-rgw-2:19.2.3-689.gf90f4eae.el9.x86_64 is already installed. 2026-02-22T23:24:45.674 INFO:teuthology.orchestra.run.trial045.stdout:Dependencies resolved. 2026-02-22T23:24:45.675 INFO:teuthology.orchestra.run.trial045.stdout:Nothing to do. 2026-02-22T23:24:45.675 INFO:teuthology.orchestra.run.trial045.stdout:Complete! 2026-02-22T23:24:45.696 DEBUG:teuthology.orchestra.run.trial045:> sudo yum -y install python3-cephfs 2026-02-22T23:24:46.004 INFO:teuthology.orchestra.run.trial045.stdout:Last metadata expiration check: 0:00:37 ago on Sun 22 Feb 2026 11:24:09 PM UTC. 2026-02-22T23:24:46.068 INFO:teuthology.orchestra.run.trial045.stdout:Package python3-cephfs-2:19.2.3-689.gf90f4eae.el9.x86_64 is already installed. 2026-02-22T23:24:46.086 INFO:teuthology.orchestra.run.trial045.stdout:Dependencies resolved. 2026-02-22T23:24:46.087 INFO:teuthology.orchestra.run.trial045.stdout:Nothing to do. 2026-02-22T23:24:46.087 INFO:teuthology.orchestra.run.trial045.stdout:Complete! 2026-02-22T23:24:46.108 DEBUG:teuthology.orchestra.run.trial045:> sudo yum -y install python3-rbd 2026-02-22T23:24:46.417 INFO:teuthology.orchestra.run.trial045.stdout:Last metadata expiration check: 0:00:37 ago on Sun 22 Feb 2026 11:24:09 PM UTC. 2026-02-22T23:24:46.483 INFO:teuthology.orchestra.run.trial045.stdout:Package python3-rbd-2:19.2.3-689.gf90f4eae.el9.x86_64 is already installed. 2026-02-22T23:24:46.501 INFO:teuthology.orchestra.run.trial045.stdout:Dependencies resolved. 2026-02-22T23:24:46.501 INFO:teuthology.orchestra.run.trial045.stdout:Nothing to do. 2026-02-22T23:24:46.502 INFO:teuthology.orchestra.run.trial045.stdout:Complete! 2026-02-22T23:24:46.523 DEBUG:teuthology.orchestra.run.trial045:> sudo yum -y install rbd-fuse 2026-02-22T23:24:46.831 INFO:teuthology.orchestra.run.trial045.stdout:Last metadata expiration check: 0:00:37 ago on Sun 22 Feb 2026 11:24:09 PM UTC. 2026-02-22T23:24:46.914 INFO:teuthology.orchestra.run.trial045.stdout:Dependencies resolved. 2026-02-22T23:24:46.915 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-22T23:24:46.915 INFO:teuthology.orchestra.run.trial045.stdout: Package Architecture Version Repository Size 2026-02-22T23:24:46.915 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-22T23:24:46.915 INFO:teuthology.orchestra.run.trial045.stdout:Installing: 2026-02-22T23:24:46.915 INFO:teuthology.orchestra.run.trial045.stdout: rbd-fuse x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 85 k 2026-02-22T23:24:46.915 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-22T23:24:46.915 INFO:teuthology.orchestra.run.trial045.stdout:Transaction Summary 2026-02-22T23:24:46.915 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-22T23:24:46.915 INFO:teuthology.orchestra.run.trial045.stdout:Install 1 Package 2026-02-22T23:24:46.915 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-22T23:24:46.915 INFO:teuthology.orchestra.run.trial045.stdout:Total download size: 85 k 2026-02-22T23:24:46.915 INFO:teuthology.orchestra.run.trial045.stdout:Installed size: 227 k 2026-02-22T23:24:46.915 INFO:teuthology.orchestra.run.trial045.stdout:Downloading Packages: 2026-02-22T23:24:46.992 INFO:teuthology.orchestra.run.trial045.stdout:rbd-fuse-19.2.3-689.gf90f4eae.el9.x86_64.rpm 1.1 MB/s | 85 kB 00:00 2026-02-22T23:24:46.992 INFO:teuthology.orchestra.run.trial045.stdout:-------------------------------------------------------------------------------- 2026-02-22T23:24:46.992 INFO:teuthology.orchestra.run.trial045.stdout:Total 1.1 MB/s | 85 kB 00:00 2026-02-22T23:24:46.992 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction check 2026-02-22T23:24:46.996 INFO:teuthology.orchestra.run.trial045.stdout:Transaction check succeeded. 2026-02-22T23:24:46.996 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction test 2026-02-22T23:24:47.026 INFO:teuthology.orchestra.run.trial045.stdout:Transaction test succeeded. 2026-02-22T23:24:47.026 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction 2026-02-22T23:24:47.077 INFO:teuthology.orchestra.run.trial045.stdout: Preparing : 1/1 2026-02-22T23:24:47.093 INFO:teuthology.orchestra.run.trial045.stdout: Installing : rbd-fuse-2:19.2.3-689.gf90f4eae.el9.x86_64 1/1 2026-02-22T23:24:47.176 INFO:teuthology.orchestra.run.trial045.stdout: Running scriptlet: rbd-fuse-2:19.2.3-689.gf90f4eae.el9.x86_64 1/1 2026-02-22T23:24:47.234 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : rbd-fuse-2:19.2.3-689.gf90f4eae.el9.x86_64 1/1 2026-02-22T23:24:47.234 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-22T23:24:47.234 INFO:teuthology.orchestra.run.trial045.stdout:Installed: 2026-02-22T23:24:47.234 INFO:teuthology.orchestra.run.trial045.stdout: rbd-fuse-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T23:24:47.234 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-22T23:24:47.234 INFO:teuthology.orchestra.run.trial045.stdout:Complete! 2026-02-22T23:24:47.263 DEBUG:teuthology.orchestra.run.trial045:> sudo yum -y install rbd-mirror 2026-02-22T23:24:47.575 INFO:teuthology.orchestra.run.trial045.stdout:Last metadata expiration check: 0:00:38 ago on Sun 22 Feb 2026 11:24:09 PM UTC. 2026-02-22T23:24:47.658 INFO:teuthology.orchestra.run.trial045.stdout:Dependencies resolved. 2026-02-22T23:24:47.658 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-22T23:24:47.658 INFO:teuthology.orchestra.run.trial045.stdout: Package Arch Version Repo Size 2026-02-22T23:24:47.658 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-22T23:24:47.658 INFO:teuthology.orchestra.run.trial045.stdout:Installing: 2026-02-22T23:24:47.658 INFO:teuthology.orchestra.run.trial045.stdout: rbd-mirror x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 3.1 M 2026-02-22T23:24:47.659 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-22T23:24:47.659 INFO:teuthology.orchestra.run.trial045.stdout:Transaction Summary 2026-02-22T23:24:47.659 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-22T23:24:47.659 INFO:teuthology.orchestra.run.trial045.stdout:Install 1 Package 2026-02-22T23:24:47.659 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-22T23:24:47.659 INFO:teuthology.orchestra.run.trial045.stdout:Total download size: 3.1 M 2026-02-22T23:24:47.659 INFO:teuthology.orchestra.run.trial045.stdout:Installed size: 13 M 2026-02-22T23:24:47.659 INFO:teuthology.orchestra.run.trial045.stdout:Downloading Packages: 2026-02-22T23:24:47.812 INFO:teuthology.orchestra.run.trial045.stdout:rbd-mirror-19.2.3-689.gf90f4eae.el9.x86_64.rpm 20 MB/s | 3.1 MB 00:00 2026-02-22T23:24:47.812 INFO:teuthology.orchestra.run.trial045.stdout:-------------------------------------------------------------------------------- 2026-02-22T23:24:47.812 INFO:teuthology.orchestra.run.trial045.stdout:Total 20 MB/s | 3.1 MB 00:00 2026-02-22T23:24:47.813 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction check 2026-02-22T23:24:47.816 INFO:teuthology.orchestra.run.trial045.stdout:Transaction check succeeded. 2026-02-22T23:24:47.816 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction test 2026-02-22T23:24:47.856 INFO:teuthology.orchestra.run.trial045.stdout:Transaction test succeeded. 2026-02-22T23:24:47.856 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction 2026-02-22T23:24:48.048 INFO:teuthology.orchestra.run.trial045.stdout: Preparing : 1/1 2026-02-22T23:24:48.049 INFO:teuthology.orchestra.run.trial045.stdout: Installing : rbd-mirror-2:19.2.3-689.gf90f4eae.el9.x86_64 1/1 2026-02-22T23:24:48.072 INFO:teuthology.orchestra.run.trial045.stdout: Running scriptlet: rbd-mirror-2:19.2.3-689.gf90f4eae.el9.x86_64 1/1 2026-02-22T23:24:48.072 INFO:teuthology.orchestra.run.trial045.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-22T23:24:48.072 INFO:teuthology.orchestra.run.trial045.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2026-02-22T23:24:48.072 INFO:teuthology.orchestra.run.trial045.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-22T23:24:48.072 INFO:teuthology.orchestra.run.trial045.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-22T23:24:48.072 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-22T23:24:48.404 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : rbd-mirror-2:19.2.3-689.gf90f4eae.el9.x86_64 1/1 2026-02-22T23:24:48.405 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-22T23:24:48.405 INFO:teuthology.orchestra.run.trial045.stdout:Installed: 2026-02-22T23:24:48.405 INFO:teuthology.orchestra.run.trial045.stdout: rbd-mirror-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T23:24:48.405 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-22T23:24:48.405 INFO:teuthology.orchestra.run.trial045.stdout:Complete! 2026-02-22T23:24:48.433 DEBUG:teuthology.orchestra.run.trial045:> sudo yum -y install rbd-nbd 2026-02-22T23:24:48.742 INFO:teuthology.orchestra.run.trial045.stdout:Last metadata expiration check: 0:00:39 ago on Sun 22 Feb 2026 11:24:09 PM UTC. 2026-02-22T23:24:48.826 INFO:teuthology.orchestra.run.trial045.stdout:Dependencies resolved. 2026-02-22T23:24:48.826 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-22T23:24:48.826 INFO:teuthology.orchestra.run.trial045.stdout: Package Architecture Version Repository Size 2026-02-22T23:24:48.826 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-22T23:24:48.826 INFO:teuthology.orchestra.run.trial045.stdout:Installing: 2026-02-22T23:24:48.826 INFO:teuthology.orchestra.run.trial045.stdout: rbd-nbd x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 170 k 2026-02-22T23:24:48.826 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-22T23:24:48.827 INFO:teuthology.orchestra.run.trial045.stdout:Transaction Summary 2026-02-22T23:24:48.827 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-22T23:24:48.827 INFO:teuthology.orchestra.run.trial045.stdout:Install 1 Package 2026-02-22T23:24:48.827 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-22T23:24:48.827 INFO:teuthology.orchestra.run.trial045.stdout:Total download size: 170 k 2026-02-22T23:24:48.827 INFO:teuthology.orchestra.run.trial045.stdout:Installed size: 490 k 2026-02-22T23:24:48.827 INFO:teuthology.orchestra.run.trial045.stdout:Downloading Packages: 2026-02-22T23:24:48.927 INFO:teuthology.orchestra.run.trial045.stdout:rbd-nbd-19.2.3-689.gf90f4eae.el9.x86_64.rpm 1.6 MB/s | 170 kB 00:00 2026-02-22T23:24:48.927 INFO:teuthology.orchestra.run.trial045.stdout:-------------------------------------------------------------------------------- 2026-02-22T23:24:48.928 INFO:teuthology.orchestra.run.trial045.stdout:Total 1.6 MB/s | 170 kB 00:00 2026-02-22T23:24:48.928 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction check 2026-02-22T23:24:48.931 INFO:teuthology.orchestra.run.trial045.stdout:Transaction check succeeded. 2026-02-22T23:24:48.932 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction test 2026-02-22T23:24:48.964 INFO:teuthology.orchestra.run.trial045.stdout:Transaction test succeeded. 2026-02-22T23:24:48.964 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction 2026-02-22T23:24:49.019 INFO:teuthology.orchestra.run.trial045.stdout: Preparing : 1/1 2026-02-22T23:24:49.036 INFO:teuthology.orchestra.run.trial045.stdout: Installing : rbd-nbd-2:19.2.3-689.gf90f4eae.el9.x86_64 1/1 2026-02-22T23:24:49.120 INFO:teuthology.orchestra.run.trial045.stdout: Running scriptlet: rbd-nbd-2:19.2.3-689.gf90f4eae.el9.x86_64 1/1 2026-02-22T23:24:49.177 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : rbd-nbd-2:19.2.3-689.gf90f4eae.el9.x86_64 1/1 2026-02-22T23:24:49.177 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-22T23:24:49.177 INFO:teuthology.orchestra.run.trial045.stdout:Installed: 2026-02-22T23:24:49.178 INFO:teuthology.orchestra.run.trial045.stdout: rbd-nbd-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T23:24:49.178 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-22T23:24:49.178 INFO:teuthology.orchestra.run.trial045.stdout:Complete! 2026-02-22T23:24:49.209 DEBUG:teuthology.parallel:result is None 2026-02-22T23:24:49.210 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=f90f4eaebb28b619cf76e80cbbe997656da69579 2026-02-22T23:24:49.379 DEBUG:teuthology.orchestra.run.trial045:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-22T23:24:49.400 INFO:teuthology.orchestra.run.trial045.stdout:19.2.3-689.gf90f4eae.el9 2026-02-22T23:24:49.401 INFO:teuthology.packaging:The installed version of ceph is 19.2.3-689.gf90f4eae.el9 2026-02-22T23:24:49.401 INFO:teuthology.task.install:The correct ceph version 19.2.3-689.gf90f4eae is installed. 2026-02-22T23:24:49.404 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=f90f4eaebb28b619cf76e80cbbe997656da69579 2026-02-22T23:24:49.535 DEBUG:teuthology.orchestra.run.trial073:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-22T23:24:49.557 INFO:teuthology.orchestra.run.trial073.stdout:19.2.3-689.gf90f4eae.el9 2026-02-22T23:24:49.558 INFO:teuthology.packaging:The installed version of ceph is 19.2.3-689.gf90f4eae.el9 2026-02-22T23:24:49.558 INFO:teuthology.task.install:The correct ceph version 19.2.3-689.gf90f4eae is installed. 2026-02-22T23:24:49.560 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2026-02-22T23:24:49.560 DEBUG:teuthology.orchestra.run.trial045:> set -ex 2026-02-22T23:24:49.560 DEBUG:teuthology.orchestra.run.trial045:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-22T23:24:49.587 DEBUG:teuthology.orchestra.run.trial073:> set -ex 2026-02-22T23:24:49.587 DEBUG:teuthology.orchestra.run.trial073:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-22T23:24:49.625 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2026-02-22T23:24:49.626 DEBUG:teuthology.orchestra.run.trial045:> set -ex 2026-02-22T23:24:49.626 DEBUG:teuthology.orchestra.run.trial045:> sudo dd of=/usr/bin/daemon-helper 2026-02-22T23:24:49.651 DEBUG:teuthology.orchestra.run.trial045:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-22T23:24:49.716 DEBUG:teuthology.orchestra.run.trial073:> set -ex 2026-02-22T23:24:49.716 DEBUG:teuthology.orchestra.run.trial073:> sudo dd of=/usr/bin/daemon-helper 2026-02-22T23:24:49.741 DEBUG:teuthology.orchestra.run.trial073:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-22T23:24:49.806 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2026-02-22T23:24:49.806 DEBUG:teuthology.orchestra.run.trial045:> set -ex 2026-02-22T23:24:49.806 DEBUG:teuthology.orchestra.run.trial045:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-22T23:24:49.831 DEBUG:teuthology.orchestra.run.trial045:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-22T23:24:49.897 DEBUG:teuthology.orchestra.run.trial073:> set -ex 2026-02-22T23:24:49.897 DEBUG:teuthology.orchestra.run.trial073:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-22T23:24:49.921 DEBUG:teuthology.orchestra.run.trial073:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-22T23:24:49.986 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2026-02-22T23:24:49.987 DEBUG:teuthology.orchestra.run.trial045:> set -ex 2026-02-22T23:24:49.987 DEBUG:teuthology.orchestra.run.trial045:> sudo dd of=/usr/bin/stdin-killer 2026-02-22T23:24:50.012 DEBUG:teuthology.orchestra.run.trial045:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-22T23:24:50.078 DEBUG:teuthology.orchestra.run.trial073:> set -ex 2026-02-22T23:24:50.078 DEBUG:teuthology.orchestra.run.trial073:> sudo dd of=/usr/bin/stdin-killer 2026-02-22T23:24:50.104 DEBUG:teuthology.orchestra.run.trial073:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-22T23:24:50.166 INFO:teuthology.run_tasks:Running task ceph... 2026-02-22T23:24:50.276 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2026-02-22T23:24:50.276 DEBUG:teuthology.orchestra.run.trial045:> sudo chmod 777 /var/log/ceph 2026-02-22T23:24:50.278 DEBUG:teuthology.orchestra.run.trial073:> sudo chmod 777 /var/log/ceph 2026-02-22T23:24:50.302 INFO:tasks.ceph:Disabling ceph logrotate... 2026-02-22T23:24:50.302 DEBUG:teuthology.orchestra.run.trial045:> sudo rm -f -- /etc/logrotate.d/ceph 2026-02-22T23:24:50.342 DEBUG:teuthology.orchestra.run.trial073:> sudo rm -f -- /etc/logrotate.d/ceph 2026-02-22T23:24:50.366 INFO:tasks.ceph:Creating extra log directories... 2026-02-22T23:24:50.366 DEBUG:teuthology.orchestra.run.trial045:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2026-02-22T23:24:50.406 DEBUG:teuthology.orchestra.run.trial073:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2026-02-22T23:24:50.444 INFO:tasks.ceph:Creating ceph cluster ceph... 2026-02-22T23:24:50.444 INFO:tasks.ceph:config {'conf': {'client': {'debug monc': 20, 'debug ms': 1}, 'global': {'mon client directed command retry': 5, 'mon election default strategy': 3, 'ms bind msgr2': False, 'ms inject socket failures': 5000, 'ms type': 'async'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon min osdmap epochs': 25, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'mon scrub inject crc mismatch': 0.01, 'mon scrub inject missing keys': 0.05, 'mon scrub interval': 300, 'paxos min': 10, 'paxos service trim min': 5, 'paxos trim min': 10}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression algorithm': 'lz4', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'bluestore zero block detection': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd mclock override recovery settings': True, 'osd mclock profile': 'high_recovery_ops', 'osd mclock skip benchmark': True, 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random'}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'ScrubResult', 'scrub mismatch', 'overall HEALTH_', '\\(MGR_DOWN\\)', '\\(PG_AVAILABILITY\\)', '\\(SLOW_OPS\\)', 'slow request', '\\(OSD_SLOW_PING_TIME', 'overall HEALTH_', '\\(MON_DOWN\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': False, 'mon_bind_addrvec': True} 2026-02-22T23:24:50.445 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/mnt/teuthology/yuriw-2026-02-22_19:35:40-rados-wip-yuri6-testing-2026-02-22-1629-squid-distro-default-trial/64386', 'branch': 'wip-yuri6-testing-2026-02-22-1629-squid', 'description': 'rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_latest} thrashers/sync workloads/rados_5925}', 'email': 'yweinste@redhat.com', 'first_in_suite': False, 'flavor': 'default', 'job_id': '64386', 'kernel': {'branch': 'distro', 'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'trial', 'name': 'yuriw-2026-02-22_19:35:40-rados-wip-yuri6-testing-2026-02-22-1629-squid-distro-default-trial', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 3, 'size': 10}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-yuri6-testing-2026-02-22-1629-squid'}, 'ceph': {'conf': {'client': {'debug monc': 20, 'debug ms': 1}, 'global': {'mon client directed command retry': 5, 'mon election default strategy': 3, 'ms bind msgr2': False, 'ms inject socket failures': 5000, 'ms type': 'async'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon min osdmap epochs': 25, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'mon scrub inject crc mismatch': 0.01, 'mon scrub inject missing keys': 0.05, 'mon scrub interval': 300, 'paxos min': 10, 'paxos service trim min': 5, 'paxos trim min': 10}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression algorithm': 'lz4', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'bluestore zero block detection': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd mclock override recovery settings': True, 'osd mclock profile': 'high_recovery_ops', 'osd mclock skip benchmark': True, 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'ScrubResult', 'scrub mismatch', 'overall HEALTH_', '\\(MGR_DOWN\\)', '\\(PG_AVAILABILITY\\)', '\\(SLOW_OPS\\)', 'slow request', '\\(OSD_SLOW_PING_TIME', 'overall HEALTH_', '\\(MON_DOWN\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_'], 'mon_bind_msgr2': False, 'sha1': 'f90f4eaebb28b619cf76e80cbbe997656da69579'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'f90f4eaebb28b619cf76e80cbbe997656da69579'}}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-yuri6-testing-2026-02-22-1629-squid', 'sha1': 'f90f4eaebb28b619cf76e80cbbe997656da69579'}}, 'owner': 'scheduled_yuriw@soko04.front.sepia.ceph.com', 'priority': 69, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mon.b', 'mon.c', 'mon.d', 'mon.e', 'osd.0', 'osd.1', 'osd.2'], ['mon.f', 'mon.g', 'mon.h', 'mon.i', 'mgr.x', 'osd.3', 'osd.4', 'osd.5', 'client.0']], 'seed': 5907, 'sha1': 'f90f4eaebb28b619cf76e80cbbe997656da69579', 'sleep_before_teardown': 0, 'subset': '111/120000', 'suite': 'rados', 'suite_branch': 'wip-yuri6-testing-2026-02-22-1629-squid', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_f90f4eaebb28b619cf76e80cbbe997656da69579/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': 'f90f4eaebb28b619cf76e80cbbe997656da69579', 'targets': {'trial045.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBD+9ZAmktAugS/lDDsn+dZOPEzSVHuedaAibXeTNUx0SvWb2CeBtU0bprNi3k39rX0CqxExfTbzfLyVlfzpGyz8=', 'trial073.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBB75Fw0XUvqO5yAT89BzP+qb4rFgOf1CVTWZZRNiQlNLoGRTw3hITF0nNGS4XDddo+KC/7iHBAmuHUDIFIcmJqE='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'branch': 'distro', 'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': None}, {'mon_thrash': {'revive_delay': 90, 'thrash_delay': 1}}, {'exec': {'client.0': ['ceph_test_rados_delete_pools_parallel --debug_objecter 20 --debug_ms 1 --debug_rados 20 --debug_monc 20']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': 'fa17720d0088c3ac28e473468bfc79eeaff5cd38', 'timestamp': '2026-02-22_19:35:40', 'tube': 'trial', 'user': 'yuriw', 'verbose': True, 'worker_log': '/home/teuthworker/mnt/teuthology/worker_logs/dispatcher.trial.3318653'} 2026-02-22T23:24:50.445 DEBUG:teuthology.orchestra.run.trial045:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2026-02-22T23:24:50.471 DEBUG:teuthology.orchestra.run.trial073:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2026-02-22T23:24:50.488 DEBUG:teuthology.orchestra.run.trial045:> sudo install -d -m0777 -- /var/run/ceph 2026-02-22T23:24:50.529 DEBUG:teuthology.orchestra.run.trial073:> sudo install -d -m0777 -- /var/run/ceph 2026-02-22T23:24:50.555 DEBUG:teuthology.orchestra.run.trial045:> set -ex 2026-02-22T23:24:50.555 DEBUG:teuthology.orchestra.run.trial045:> dd if=/scratch_devs of=/dev/stdout 2026-02-22T23:24:50.608 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2026-02-22T23:24:50.608 DEBUG:teuthology.orchestra.run.trial045:> stat /dev/vg_nvme/lv_1 2026-02-22T23:24:50.663 INFO:teuthology.orchestra.run.trial045.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2026-02-22T23:24:50.664 INFO:teuthology.orchestra.run.trial045.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-22T23:24:50.664 INFO:teuthology.orchestra.run.trial045.stdout:Device: 6h/6d Inode: 1300 Links: 1 2026-02-22T23:24:50.664 INFO:teuthology.orchestra.run.trial045.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-22T23:24:50.664 INFO:teuthology.orchestra.run.trial045.stdout:Context: system_u:object_r:device_t:s0 2026-02-22T23:24:50.664 INFO:teuthology.orchestra.run.trial045.stdout:Access: 2026-02-22 23:24:48.226992473 +0000 2026-02-22T23:24:50.664 INFO:teuthology.orchestra.run.trial045.stdout:Modify: 2026-02-22 23:24:15.779930871 +0000 2026-02-22T23:24:50.664 INFO:teuthology.orchestra.run.trial045.stdout:Change: 2026-02-22 23:24:15.779930871 +0000 2026-02-22T23:24:50.664 INFO:teuthology.orchestra.run.trial045.stdout: Birth: 2026-02-22 23:24:15.779930871 +0000 2026-02-22T23:24:50.664 DEBUG:teuthology.orchestra.run.trial045:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2026-02-22T23:24:50.726 INFO:teuthology.orchestra.run.trial045.stderr:1+0 records in 2026-02-22T23:24:50.726 INFO:teuthology.orchestra.run.trial045.stderr:1+0 records out 2026-02-22T23:24:50.727 INFO:teuthology.orchestra.run.trial045.stderr:512 bytes copied, 0.000148203 s, 3.5 MB/s 2026-02-22T23:24:50.728 DEBUG:teuthology.orchestra.run.trial045:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2026-02-22T23:24:50.786 DEBUG:teuthology.orchestra.run.trial045:> stat /dev/vg_nvme/lv_2 2026-02-22T23:24:50.842 INFO:teuthology.orchestra.run.trial045.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2026-02-22T23:24:50.842 INFO:teuthology.orchestra.run.trial045.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-22T23:24:50.842 INFO:teuthology.orchestra.run.trial045.stdout:Device: 6h/6d Inode: 1310 Links: 1 2026-02-22T23:24:50.842 INFO:teuthology.orchestra.run.trial045.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-22T23:24:50.842 INFO:teuthology.orchestra.run.trial045.stdout:Context: system_u:object_r:device_t:s0 2026-02-22T23:24:50.842 INFO:teuthology.orchestra.run.trial045.stdout:Access: 2026-02-22 23:24:48.226992473 +0000 2026-02-22T23:24:50.842 INFO:teuthology.orchestra.run.trial045.stdout:Modify: 2026-02-22 23:24:15.779930871 +0000 2026-02-22T23:24:50.842 INFO:teuthology.orchestra.run.trial045.stdout:Change: 2026-02-22 23:24:15.779930871 +0000 2026-02-22T23:24:50.843 INFO:teuthology.orchestra.run.trial045.stdout: Birth: 2026-02-22 23:24:15.779930871 +0000 2026-02-22T23:24:50.843 DEBUG:teuthology.orchestra.run.trial045:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2026-02-22T23:24:50.905 INFO:teuthology.orchestra.run.trial045.stderr:1+0 records in 2026-02-22T23:24:50.905 INFO:teuthology.orchestra.run.trial045.stderr:1+0 records out 2026-02-22T23:24:50.905 INFO:teuthology.orchestra.run.trial045.stderr:512 bytes copied, 0.000131132 s, 3.9 MB/s 2026-02-22T23:24:50.906 DEBUG:teuthology.orchestra.run.trial045:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2026-02-22T23:24:50.963 DEBUG:teuthology.orchestra.run.trial045:> stat /dev/vg_nvme/lv_3 2026-02-22T23:24:51.019 INFO:teuthology.orchestra.run.trial045.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2026-02-22T23:24:51.019 INFO:teuthology.orchestra.run.trial045.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-22T23:24:51.019 INFO:teuthology.orchestra.run.trial045.stdout:Device: 6h/6d Inode: 1306 Links: 1 2026-02-22T23:24:51.019 INFO:teuthology.orchestra.run.trial045.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-22T23:24:51.020 INFO:teuthology.orchestra.run.trial045.stdout:Context: system_u:object_r:device_t:s0 2026-02-22T23:24:51.020 INFO:teuthology.orchestra.run.trial045.stdout:Access: 2026-02-22 23:24:48.227992442 +0000 2026-02-22T23:24:51.020 INFO:teuthology.orchestra.run.trial045.stdout:Modify: 2026-02-22 23:24:15.779930871 +0000 2026-02-22T23:24:51.020 INFO:teuthology.orchestra.run.trial045.stdout:Change: 2026-02-22 23:24:15.779930871 +0000 2026-02-22T23:24:51.020 INFO:teuthology.orchestra.run.trial045.stdout: Birth: 2026-02-22 23:24:15.779930871 +0000 2026-02-22T23:24:51.020 DEBUG:teuthology.orchestra.run.trial045:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2026-02-22T23:24:51.083 INFO:teuthology.orchestra.run.trial045.stderr:1+0 records in 2026-02-22T23:24:51.084 INFO:teuthology.orchestra.run.trial045.stderr:1+0 records out 2026-02-22T23:24:51.084 INFO:teuthology.orchestra.run.trial045.stderr:512 bytes copied, 0.000157651 s, 3.2 MB/s 2026-02-22T23:24:51.085 DEBUG:teuthology.orchestra.run.trial045:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2026-02-22T23:24:51.143 DEBUG:teuthology.orchestra.run.trial045:> stat /dev/vg_nvme/lv_4 2026-02-22T23:24:51.199 INFO:teuthology.orchestra.run.trial045.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2026-02-22T23:24:51.200 INFO:teuthology.orchestra.run.trial045.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-22T23:24:51.200 INFO:teuthology.orchestra.run.trial045.stdout:Device: 6h/6d Inode: 1316 Links: 1 2026-02-22T23:24:51.200 INFO:teuthology.orchestra.run.trial045.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-22T23:24:51.200 INFO:teuthology.orchestra.run.trial045.stdout:Context: system_u:object_r:device_t:s0 2026-02-22T23:24:51.200 INFO:teuthology.orchestra.run.trial045.stdout:Access: 2026-02-22 23:24:48.227992442 +0000 2026-02-22T23:24:51.200 INFO:teuthology.orchestra.run.trial045.stdout:Modify: 2026-02-22 23:24:15.779930871 +0000 2026-02-22T23:24:51.200 INFO:teuthology.orchestra.run.trial045.stdout:Change: 2026-02-22 23:24:15.779930871 +0000 2026-02-22T23:24:51.200 INFO:teuthology.orchestra.run.trial045.stdout: Birth: 2026-02-22 23:24:15.779930871 +0000 2026-02-22T23:24:51.200 DEBUG:teuthology.orchestra.run.trial045:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2026-02-22T23:24:51.264 INFO:teuthology.orchestra.run.trial045.stderr:1+0 records in 2026-02-22T23:24:51.264 INFO:teuthology.orchestra.run.trial045.stderr:1+0 records out 2026-02-22T23:24:51.264 INFO:teuthology.orchestra.run.trial045.stderr:512 bytes copied, 0.000141591 s, 3.6 MB/s 2026-02-22T23:24:51.266 DEBUG:teuthology.orchestra.run.trial045:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2026-02-22T23:24:51.325 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2026-02-22T23:24:51.325 DEBUG:teuthology.orchestra.run.trial073:> set -ex 2026-02-22T23:24:51.325 DEBUG:teuthology.orchestra.run.trial073:> dd if=/scratch_devs of=/dev/stdout 2026-02-22T23:24:51.345 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2026-02-22T23:24:51.345 DEBUG:teuthology.orchestra.run.trial073:> stat /dev/vg_nvme/lv_1 2026-02-22T23:24:51.403 INFO:teuthology.orchestra.run.trial073.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2026-02-22T23:24:51.403 INFO:teuthology.orchestra.run.trial073.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-22T23:24:51.403 INFO:teuthology.orchestra.run.trial073.stdout:Device: 6h/6d Inode: 1292 Links: 1 2026-02-22T23:24:51.403 INFO:teuthology.orchestra.run.trial073.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-22T23:24:51.403 INFO:teuthology.orchestra.run.trial073.stdout:Context: system_u:object_r:device_t:s0 2026-02-22T23:24:51.403 INFO:teuthology.orchestra.run.trial073.stdout:Access: 2026-02-22 23:24:29.688241402 +0000 2026-02-22T23:24:51.404 INFO:teuthology.orchestra.run.trial073.stdout:Modify: 2026-02-22 23:23:53.107665313 +0000 2026-02-22T23:24:51.404 INFO:teuthology.orchestra.run.trial073.stdout:Change: 2026-02-22 23:23:53.107665313 +0000 2026-02-22T23:24:51.404 INFO:teuthology.orchestra.run.trial073.stdout: Birth: 2026-02-22 23:23:53.107665313 +0000 2026-02-22T23:24:51.404 DEBUG:teuthology.orchestra.run.trial073:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2026-02-22T23:24:51.467 INFO:teuthology.orchestra.run.trial073.stderr:1+0 records in 2026-02-22T23:24:51.467 INFO:teuthology.orchestra.run.trial073.stderr:1+0 records out 2026-02-22T23:24:51.467 INFO:teuthology.orchestra.run.trial073.stderr:512 bytes copied, 0.000181123 s, 2.8 MB/s 2026-02-22T23:24:51.469 DEBUG:teuthology.orchestra.run.trial073:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2026-02-22T23:24:51.526 DEBUG:teuthology.orchestra.run.trial073:> stat /dev/vg_nvme/lv_2 2026-02-22T23:24:51.582 INFO:teuthology.orchestra.run.trial073.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2026-02-22T23:24:51.582 INFO:teuthology.orchestra.run.trial073.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-22T23:24:51.582 INFO:teuthology.orchestra.run.trial073.stdout:Device: 6h/6d Inode: 1305 Links: 1 2026-02-22T23:24:51.582 INFO:teuthology.orchestra.run.trial073.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-22T23:24:51.582 INFO:teuthology.orchestra.run.trial073.stdout:Context: system_u:object_r:device_t:s0 2026-02-22T23:24:51.582 INFO:teuthology.orchestra.run.trial073.stdout:Access: 2026-02-22 23:24:29.688241402 +0000 2026-02-22T23:24:51.582 INFO:teuthology.orchestra.run.trial073.stdout:Modify: 2026-02-22 23:23:53.107665313 +0000 2026-02-22T23:24:51.582 INFO:teuthology.orchestra.run.trial073.stdout:Change: 2026-02-22 23:23:53.107665313 +0000 2026-02-22T23:24:51.582 INFO:teuthology.orchestra.run.trial073.stdout: Birth: 2026-02-22 23:23:53.107665313 +0000 2026-02-22T23:24:51.583 DEBUG:teuthology.orchestra.run.trial073:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2026-02-22T23:24:51.647 INFO:teuthology.orchestra.run.trial073.stderr:1+0 records in 2026-02-22T23:24:51.647 INFO:teuthology.orchestra.run.trial073.stderr:1+0 records out 2026-02-22T23:24:51.647 INFO:teuthology.orchestra.run.trial073.stderr:512 bytes copied, 0.000149835 s, 3.4 MB/s 2026-02-22T23:24:51.649 DEBUG:teuthology.orchestra.run.trial073:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2026-02-22T23:24:51.706 DEBUG:teuthology.orchestra.run.trial073:> stat /dev/vg_nvme/lv_3 2026-02-22T23:24:51.762 INFO:teuthology.orchestra.run.trial073.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2026-02-22T23:24:51.762 INFO:teuthology.orchestra.run.trial073.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-22T23:24:51.762 INFO:teuthology.orchestra.run.trial073.stdout:Device: 6h/6d Inode: 1290 Links: 1 2026-02-22T23:24:51.763 INFO:teuthology.orchestra.run.trial073.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-22T23:24:51.763 INFO:teuthology.orchestra.run.trial073.stdout:Context: system_u:object_r:device_t:s0 2026-02-22T23:24:51.763 INFO:teuthology.orchestra.run.trial073.stdout:Access: 2026-02-22 23:24:29.689241364 +0000 2026-02-22T23:24:51.763 INFO:teuthology.orchestra.run.trial073.stdout:Modify: 2026-02-22 23:23:53.107665313 +0000 2026-02-22T23:24:51.763 INFO:teuthology.orchestra.run.trial073.stdout:Change: 2026-02-22 23:23:53.107665313 +0000 2026-02-22T23:24:51.763 INFO:teuthology.orchestra.run.trial073.stdout: Birth: 2026-02-22 23:23:53.107665313 +0000 2026-02-22T23:24:51.763 DEBUG:teuthology.orchestra.run.trial073:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2026-02-22T23:24:51.825 INFO:teuthology.orchestra.run.trial073.stderr:1+0 records in 2026-02-22T23:24:51.825 INFO:teuthology.orchestra.run.trial073.stderr:1+0 records out 2026-02-22T23:24:51.826 INFO:teuthology.orchestra.run.trial073.stderr:512 bytes copied, 0.000143394 s, 3.6 MB/s 2026-02-22T23:24:51.827 DEBUG:teuthology.orchestra.run.trial073:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2026-02-22T23:24:51.886 DEBUG:teuthology.orchestra.run.trial073:> stat /dev/vg_nvme/lv_4 2026-02-22T23:24:51.943 INFO:teuthology.orchestra.run.trial073.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2026-02-22T23:24:51.943 INFO:teuthology.orchestra.run.trial073.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-22T23:24:51.943 INFO:teuthology.orchestra.run.trial073.stdout:Device: 6h/6d Inode: 1288 Links: 1 2026-02-22T23:24:51.943 INFO:teuthology.orchestra.run.trial073.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-22T23:24:51.943 INFO:teuthology.orchestra.run.trial073.stdout:Context: system_u:object_r:device_t:s0 2026-02-22T23:24:51.943 INFO:teuthology.orchestra.run.trial073.stdout:Access: 2026-02-22 23:24:29.689241364 +0000 2026-02-22T23:24:51.943 INFO:teuthology.orchestra.run.trial073.stdout:Modify: 2026-02-22 23:23:53.106665351 +0000 2026-02-22T23:24:51.943 INFO:teuthology.orchestra.run.trial073.stdout:Change: 2026-02-22 23:23:53.106665351 +0000 2026-02-22T23:24:51.943 INFO:teuthology.orchestra.run.trial073.stdout: Birth: 2026-02-22 23:23:53.106665351 +0000 2026-02-22T23:24:51.944 DEBUG:teuthology.orchestra.run.trial073:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2026-02-22T23:24:52.007 INFO:teuthology.orchestra.run.trial073.stderr:1+0 records in 2026-02-22T23:24:52.008 INFO:teuthology.orchestra.run.trial073.stderr:1+0 records out 2026-02-22T23:24:52.008 INFO:teuthology.orchestra.run.trial073.stderr:512 bytes copied, 0.000142853 s, 3.6 MB/s 2026-02-22T23:24:52.009 DEBUG:teuthology.orchestra.run.trial073:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2026-02-22T23:24:52.068 INFO:tasks.ceph:osd dev map: {'osd.3': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.5': '/dev/vg_nvme/lv_3'} 2026-02-22T23:24:52.068 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@trial045.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'}, Remote(name='ubuntu@trial073.front.sepia.ceph.com'): {'osd.3': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.5': '/dev/vg_nvme/lv_3'}} 2026-02-22T23:24:52.068 INFO:tasks.ceph:Generating config... 2026-02-22T23:24:52.071 INFO:tasks.ceph:[client] debug monc = 20 2026-02-22T23:24:52.071 INFO:tasks.ceph:[client] debug ms = 1 2026-02-22T23:24:52.071 INFO:tasks.ceph:[global] mon client directed command retry = 5 2026-02-22T23:24:52.071 INFO:tasks.ceph:[global] mon election default strategy = 3 2026-02-22T23:24:52.071 INFO:tasks.ceph:[global] ms bind msgr2 = False 2026-02-22T23:24:52.071 INFO:tasks.ceph:[global] ms inject socket failures = 5000 2026-02-22T23:24:52.072 INFO:tasks.ceph:[global] ms type = async 2026-02-22T23:24:52.072 INFO:tasks.ceph:[mgr] debug mgr = 20 2026-02-22T23:24:52.072 INFO:tasks.ceph:[mgr] debug ms = 1 2026-02-22T23:24:52.072 INFO:tasks.ceph:[mon] debug mon = 20 2026-02-22T23:24:52.072 INFO:tasks.ceph:[mon] debug ms = 1 2026-02-22T23:24:52.072 INFO:tasks.ceph:[mon] debug paxos = 20 2026-02-22T23:24:52.072 INFO:tasks.ceph:[mon] mon min osdmap epochs = 25 2026-02-22T23:24:52.072 INFO:tasks.ceph:[mon] mon osdmap full prune interval = 2 2026-02-22T23:24:52.072 INFO:tasks.ceph:[mon] mon osdmap full prune min = 15 2026-02-22T23:24:52.072 INFO:tasks.ceph:[mon] mon osdmap full prune txsize = 2 2026-02-22T23:24:52.072 INFO:tasks.ceph:[mon] mon scrub inject crc mismatch = 0.01 2026-02-22T23:24:52.072 INFO:tasks.ceph:[mon] mon scrub inject missing keys = 0.05 2026-02-22T23:24:52.073 INFO:tasks.ceph:[mon] mon scrub interval = 300 2026-02-22T23:24:52.073 INFO:tasks.ceph:[mon] paxos min = 10 2026-02-22T23:24:52.073 INFO:tasks.ceph:[mon] paxos service trim min = 5 2026-02-22T23:24:52.073 INFO:tasks.ceph:[mon] paxos trim min = 10 2026-02-22T23:24:52.073 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2026-02-22T23:24:52.073 INFO:tasks.ceph:[osd] bluestore compression algorithm = lz4 2026-02-22T23:24:52.073 INFO:tasks.ceph:[osd] bluestore compression mode = aggressive 2026-02-22T23:24:52.073 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2026-02-22T23:24:52.073 INFO:tasks.ceph:[osd] bluestore zero block detection = True 2026-02-22T23:24:52.073 INFO:tasks.ceph:[osd] debug bluefs = 20 2026-02-22T23:24:52.073 INFO:tasks.ceph:[osd] debug bluestore = 20 2026-02-22T23:24:52.074 INFO:tasks.ceph:[osd] debug ms = 1 2026-02-22T23:24:52.074 INFO:tasks.ceph:[osd] debug osd = 20 2026-02-22T23:24:52.074 INFO:tasks.ceph:[osd] debug rocksdb = 10 2026-02-22T23:24:52.074 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2026-02-22T23:24:52.074 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2026-02-22T23:24:52.074 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2026-02-22T23:24:52.074 INFO:tasks.ceph:[osd] osd debug verify cached snaps = True 2026-02-22T23:24:52.074 INFO:tasks.ceph:[osd] osd debug verify missing on start = True 2026-02-22T23:24:52.074 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2026-02-22T23:24:52.074 INFO:tasks.ceph:[osd] osd mclock override recovery settings = True 2026-02-22T23:24:52.074 INFO:tasks.ceph:[osd] osd mclock profile = high_recovery_ops 2026-02-22T23:24:52.075 INFO:tasks.ceph:[osd] osd mclock skip benchmark = True 2026-02-22T23:24:52.075 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2026-02-22T23:24:52.075 INFO:tasks.ceph:[osd] osd op queue = debug_random 2026-02-22T23:24:52.075 INFO:tasks.ceph:[osd] osd op queue cut off = debug_random 2026-02-22T23:24:52.075 INFO:tasks.ceph:Setting up mon.a... 2026-02-22T23:24:52.075 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2026-02-22T23:24:52.112 INFO:teuthology.orchestra.run.trial045.stdout:creating /etc/ceph/ceph.keyring 2026-02-22T23:24:52.115 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2026-02-22T23:24:52.191 DEBUG:teuthology.orchestra.run.trial045:> sudo chmod 0644 /etc/ceph/ceph.keyring 2026-02-22T23:24:52.256 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '[v1:10.20.193.45:6789]'), ('mon.b', '[v1:10.20.193.45:6790]'), ('mon.c', '[v1:10.20.193.45:6791]'), ('mon.d', '[v1:10.20.193.45:6792]'), ('mon.e', '[v1:10.20.193.45:6793]'), ('mon.f', '[v1:10.20.193.73:6789]'), ('mon.g', '[v1:10.20.193.73:6790]'), ('mon.h', '[v1:10.20.193.73:6791]'), ('mon.i', '[v1:10.20.193.73:6792]')] 2026-02-22T23:24:52.257 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '[v1:10.20.193.45:6789],[v1:10.20.193.45:6790],[v1:10.20.193.45:6791],[v1:10.20.193.45:6792],[v1:10.20.193.45:6793],[v1:10.20.193.73:6789],[v1:10.20.193.73:6790],[v1:10.20.193.73:6791],[v1:10.20.193.73:6792]', 'mon client directed command retry': 5, 'mon election default strategy': 3, 'ms bind msgr2': False, 'ms inject socket failures': 5000, 'ms type': 'async'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd mclock skip benchmark': True, 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore compression algorithm': 'lz4', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'bluestore zero block detection': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd mclock override recovery settings': True, 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random'}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon min osdmap epochs': 25, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'mon scrub inject crc mismatch': 0.01, 'mon scrub inject missing keys': 0.05, 'mon scrub interval': 300, 'paxos min': 10, 'paxos service trim min': 5, 'paxos trim min': 10}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'debug monc': 20, 'debug ms': 1}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mon.d': {}, 'mon.e': {}, 'mon.f': {}, 'mon.g': {}, 'mon.h': {}, 'mon.i': {}} 2026-02-22T23:24:52.258 DEBUG:teuthology.orchestra.run.trial045:> set -ex 2026-02-22T23:24:52.258 DEBUG:teuthology.orchestra.run.trial045:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2026-02-22T23:24:52.311 DEBUG:teuthology.orchestra.run.trial045:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --addv a '[v1:10.20.193.45:6789]' --addv b '[v1:10.20.193.45:6790]' --addv c '[v1:10.20.193.45:6791]' --addv d '[v1:10.20.193.45:6792]' --addv e '[v1:10.20.193.45:6793]' --addv f '[v1:10.20.193.73:6789]' --addv g '[v1:10.20.193.73:6790]' --addv h '[v1:10.20.193.73:6791]' --addv i '[v1:10.20.193.73:6792]' --print /home/ubuntu/cephtest/ceph.monmap 2026-02-22T23:24:52.393 INFO:teuthology.orchestra.run.trial045.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2026-02-22T23:24:52.393 INFO:teuthology.orchestra.run.trial045.stdout:monmaptool: generated fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:24:52.393 INFO:teuthology.orchestra.run.trial045.stdout:setting min_mon_release = quincy 2026-02-22T23:24:52.394 INFO:teuthology.orchestra.run.trial045.stdout:epoch 0 2026-02-22T23:24:52.394 INFO:teuthology.orchestra.run.trial045.stdout:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:24:52.394 INFO:teuthology.orchestra.run.trial045.stdout:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:24:52.394 INFO:teuthology.orchestra.run.trial045.stdout:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:24:52.394 INFO:teuthology.orchestra.run.trial045.stdout:min_mon_release 17 (quincy) 2026-02-22T23:24:52.394 INFO:teuthology.orchestra.run.trial045.stdout:election_strategy: 3 2026-02-22T23:24:52.394 INFO:teuthology.orchestra.run.trial045.stdout:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:24:52.394 INFO:teuthology.orchestra.run.trial045.stdout:1: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:24:52.394 INFO:teuthology.orchestra.run.trial045.stdout:2: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:24:52.394 INFO:teuthology.orchestra.run.trial045.stdout:3: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:24:52.394 INFO:teuthology.orchestra.run.trial045.stdout:4: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:24:52.394 INFO:teuthology.orchestra.run.trial045.stdout:5: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:24:52.394 INFO:teuthology.orchestra.run.trial045.stdout:6: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:24:52.395 INFO:teuthology.orchestra.run.trial045.stdout:7: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:24:52.395 INFO:teuthology.orchestra.run.trial045.stdout:8: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:24:52.395 INFO:teuthology.orchestra.run.trial045.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (9 monitors) 2026-02-22T23:24:52.396 DEBUG:teuthology.orchestra.run.trial045:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2026-02-22T23:24:52.454 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 4b60f18f-6660-4731-b731-dc85c4078413... 2026-02-22T23:24:52.455 DEBUG:teuthology.orchestra.run.trial045:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2026-02-22T23:24:52.496 DEBUG:teuthology.orchestra.run.trial073:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2026-02-22T23:24:52.534 INFO:teuthology.orchestra.run.trial045.stdout:[global] 2026-02-22T23:24:52.535 INFO:teuthology.orchestra.run.trial045.stdout: chdir = "" 2026-02-22T23:24:52.535 INFO:teuthology.orchestra.run.trial045.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2026-02-22T23:24:52.535 INFO:teuthology.orchestra.run.trial045.stdout: auth supported = cephx 2026-02-22T23:24:52.535 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-22T23:24:52.535 INFO:teuthology.orchestra.run.trial045.stdout: filestore xattr use omap = true 2026-02-22T23:24:52.535 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-22T23:24:52.535 INFO:teuthology.orchestra.run.trial045.stdout: mon clock drift allowed = 1.000 2026-02-22T23:24:52.535 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-22T23:24:52.535 INFO:teuthology.orchestra.run.trial045.stdout: osd crush chooseleaf type = 0 2026-02-22T23:24:52.535 INFO:teuthology.orchestra.run.trial045.stdout: auth debug = true 2026-02-22T23:24:52.535 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-22T23:24:52.535 INFO:teuthology.orchestra.run.trial045.stdout: ms die on old message = true 2026-02-22T23:24:52.535 INFO:teuthology.orchestra.run.trial045.stdout: ms die on bug = true 2026-02-22T23:24:52.535 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-22T23:24:52.535 INFO:teuthology.orchestra.run.trial045.stdout: mon max pg per osd = 10000 # >= luminous 2026-02-22T23:24:52.535 INFO:teuthology.orchestra.run.trial045.stdout: mon pg warn max object skew = 0 2026-02-22T23:24:52.535 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-22T23:24:52.535 INFO:teuthology.orchestra.run.trial045.stdout: # disable pg_autoscaler by default for new pools 2026-02-22T23:24:52.536 INFO:teuthology.orchestra.run.trial045.stdout: osd_pool_default_pg_autoscale_mode = off 2026-02-22T23:24:52.536 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-22T23:24:52.536 INFO:teuthology.orchestra.run.trial045.stdout: osd pool default size = 2 2026-02-22T23:24:52.536 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-22T23:24:52.536 INFO:teuthology.orchestra.run.trial045.stdout: mon osd allow primary affinity = true 2026-02-22T23:24:52.536 INFO:teuthology.orchestra.run.trial045.stdout: mon osd allow pg remap = true 2026-02-22T23:24:52.536 INFO:teuthology.orchestra.run.trial045.stdout: mon warn on legacy crush tunables = false 2026-02-22T23:24:52.536 INFO:teuthology.orchestra.run.trial045.stdout: mon warn on crush straw calc version zero = false 2026-02-22T23:24:52.536 INFO:teuthology.orchestra.run.trial045.stdout: mon warn on no sortbitwise = false 2026-02-22T23:24:52.536 INFO:teuthology.orchestra.run.trial045.stdout: mon warn on osd down out interval zero = false 2026-02-22T23:24:52.536 INFO:teuthology.orchestra.run.trial045.stdout: mon warn on too few osds = false 2026-02-22T23:24:52.536 INFO:teuthology.orchestra.run.trial045.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2026-02-22T23:24:52.536 INFO:teuthology.orchestra.run.trial045.stdout: mon_warn_on_pool_no_redundancy = false 2026-02-22T23:24:52.536 INFO:teuthology.orchestra.run.trial045.stdout: mon_allow_pool_size_one = true 2026-02-22T23:24:52.536 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-22T23:24:52.536 INFO:teuthology.orchestra.run.trial045.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2026-02-22T23:24:52.536 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-22T23:24:52.536 INFO:teuthology.orchestra.run.trial045.stdout: osd default data pool replay window = 5 2026-02-22T23:24:52.536 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-22T23:24:52.536 INFO:teuthology.orchestra.run.trial045.stdout: mon allow pool delete = true 2026-02-22T23:24:52.537 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-22T23:24:52.537 INFO:teuthology.orchestra.run.trial045.stdout: mon cluster log file level = debug 2026-02-22T23:24:52.537 INFO:teuthology.orchestra.run.trial045.stdout: debug asserts on shutdown = true 2026-02-22T23:24:52.537 INFO:teuthology.orchestra.run.trial045.stdout: mon health detail to clog = false 2026-02-22T23:24:52.537 INFO:teuthology.orchestra.run.trial045.stdout: mon host = "[v1:10.20.193.45:6789],[v1:10.20.193.45:6790],[v1:10.20.193.45:6791],[v1:10.20.193.45:6792],[v1:10.20.193.45:6793],[v1:10.20.193.73:6789],[v1:10.20.193.73:6790],[v1:10.20.193.73:6791],[v1:10.20.193.73:6792]" 2026-02-22T23:24:52.537 INFO:teuthology.orchestra.run.trial045.stdout: mon client directed command retry = 5 2026-02-22T23:24:52.537 INFO:teuthology.orchestra.run.trial045.stdout: mon election default strategy = 3 2026-02-22T23:24:52.537 INFO:teuthology.orchestra.run.trial045.stdout: ms bind msgr2 = False 2026-02-22T23:24:52.537 INFO:teuthology.orchestra.run.trial045.stdout: ms inject socket failures = 5000 2026-02-22T23:24:52.537 INFO:teuthology.orchestra.run.trial045.stdout: ms type = async 2026-02-22T23:24:52.537 INFO:teuthology.orchestra.run.trial045.stdout: fsid = 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:24:52.537 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-22T23:24:52.537 INFO:teuthology.orchestra.run.trial045.stdout:[osd] 2026-02-22T23:24:52.537 INFO:teuthology.orchestra.run.trial045.stdout: osd journal size = 100 2026-02-22T23:24:52.537 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-22T23:24:52.537 INFO:teuthology.orchestra.run.trial045.stdout: osd scrub load threshold = 5.0 2026-02-22T23:24:52.537 INFO:teuthology.orchestra.run.trial045.stdout: osd scrub max interval = 600 2026-02-22T23:24:52.537 INFO:teuthology.orchestra.run.trial045.stdout: osd mclock profile = high_recovery_ops 2026-02-22T23:24:52.537 INFO:teuthology.orchestra.run.trial045.stdout: osd mclock skip benchmark = True 2026-02-22T23:24:52.537 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-22T23:24:52.538 INFO:teuthology.orchestra.run.trial045.stdout: osd recover clone overlap = true 2026-02-22T23:24:52.538 INFO:teuthology.orchestra.run.trial045.stdout: osd recovery max chunk = 1048576 2026-02-22T23:24:52.538 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-22T23:24:52.538 INFO:teuthology.orchestra.run.trial045.stdout: osd debug shutdown = true 2026-02-22T23:24:52.538 INFO:teuthology.orchestra.run.trial045.stdout: osd debug op order = true 2026-02-22T23:24:52.538 INFO:teuthology.orchestra.run.trial045.stdout: osd debug verify stray on activate = true 2026-02-22T23:24:52.538 INFO:teuthology.orchestra.run.trial045.stdout: osd debug trim objects = true 2026-02-22T23:24:52.538 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-22T23:24:52.538 INFO:teuthology.orchestra.run.trial045.stdout: osd open classes on start = true 2026-02-22T23:24:52.538 INFO:teuthology.orchestra.run.trial045.stdout: osd debug pg log writeout = true 2026-02-22T23:24:52.538 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-22T23:24:52.538 INFO:teuthology.orchestra.run.trial045.stdout: osd deep scrub update digest min age = 30 2026-02-22T23:24:52.538 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-22T23:24:52.538 INFO:teuthology.orchestra.run.trial045.stdout: osd map max advance = 10 2026-02-22T23:24:52.538 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-22T23:24:52.538 INFO:teuthology.orchestra.run.trial045.stdout: journal zero on create = true 2026-02-22T23:24:52.538 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-22T23:24:52.538 INFO:teuthology.orchestra.run.trial045.stdout: filestore ondisk finisher threads = 3 2026-02-22T23:24:52.538 INFO:teuthology.orchestra.run.trial045.stdout: filestore apply finisher threads = 3 2026-02-22T23:24:52.538 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-22T23:24:52.538 INFO:teuthology.orchestra.run.trial045.stdout: bdev debug aio = true 2026-02-22T23:24:52.539 INFO:teuthology.orchestra.run.trial045.stdout: osd debug misdirected ops = true 2026-02-22T23:24:52.539 INFO:teuthology.orchestra.run.trial045.stdout: bluestore block size = 96636764160 2026-02-22T23:24:52.539 INFO:teuthology.orchestra.run.trial045.stdout: bluestore compression algorithm = lz4 2026-02-22T23:24:52.539 INFO:teuthology.orchestra.run.trial045.stdout: bluestore compression mode = aggressive 2026-02-22T23:24:52.539 INFO:teuthology.orchestra.run.trial045.stdout: bluestore fsck on mount = True 2026-02-22T23:24:52.539 INFO:teuthology.orchestra.run.trial045.stdout: bluestore zero block detection = True 2026-02-22T23:24:52.539 INFO:teuthology.orchestra.run.trial045.stdout: debug bluefs = 20 2026-02-22T23:24:52.539 INFO:teuthology.orchestra.run.trial045.stdout: debug bluestore = 20 2026-02-22T23:24:52.539 INFO:teuthology.orchestra.run.trial045.stdout: debug ms = 1 2026-02-22T23:24:52.539 INFO:teuthology.orchestra.run.trial045.stdout: debug osd = 20 2026-02-22T23:24:52.539 INFO:teuthology.orchestra.run.trial045.stdout: debug rocksdb = 10 2026-02-22T23:24:52.539 INFO:teuthology.orchestra.run.trial045.stdout: mon osd backfillfull_ratio = 0.85 2026-02-22T23:24:52.539 INFO:teuthology.orchestra.run.trial045.stdout: mon osd full ratio = 0.9 2026-02-22T23:24:52.539 INFO:teuthology.orchestra.run.trial045.stdout: mon osd nearfull ratio = 0.8 2026-02-22T23:24:52.539 INFO:teuthology.orchestra.run.trial045.stdout: osd debug verify cached snaps = True 2026-02-22T23:24:52.539 INFO:teuthology.orchestra.run.trial045.stdout: osd debug verify missing on start = True 2026-02-22T23:24:52.539 INFO:teuthology.orchestra.run.trial045.stdout: osd failsafe full ratio = 0.95 2026-02-22T23:24:52.539 INFO:teuthology.orchestra.run.trial045.stdout: osd mclock override recovery settings = True 2026-02-22T23:24:52.539 INFO:teuthology.orchestra.run.trial045.stdout: osd objectstore = bluestore 2026-02-22T23:24:52.539 INFO:teuthology.orchestra.run.trial045.stdout: osd op queue = debug_random 2026-02-22T23:24:52.539 INFO:teuthology.orchestra.run.trial045.stdout: osd op queue cut off = debug_random 2026-02-22T23:24:52.540 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-22T23:24:52.540 INFO:teuthology.orchestra.run.trial045.stdout:[mgr] 2026-02-22T23:24:52.540 INFO:teuthology.orchestra.run.trial045.stdout: debug ms = 1 2026-02-22T23:24:52.540 INFO:teuthology.orchestra.run.trial045.stdout: debug mgr = 20 2026-02-22T23:24:52.540 INFO:teuthology.orchestra.run.trial045.stdout: debug mon = 20 2026-02-22T23:24:52.540 INFO:teuthology.orchestra.run.trial045.stdout: debug auth = 20 2026-02-22T23:24:52.540 INFO:teuthology.orchestra.run.trial045.stdout: mon reweight min pgs per osd = 4 2026-02-22T23:24:52.540 INFO:teuthology.orchestra.run.trial045.stdout: mon reweight min bytes per osd = 10 2026-02-22T23:24:52.540 INFO:teuthology.orchestra.run.trial045.stdout: mgr/telemetry/nag = false 2026-02-22T23:24:52.540 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-22T23:24:52.540 INFO:teuthology.orchestra.run.trial045.stdout:[mon] 2026-02-22T23:24:52.540 INFO:teuthology.orchestra.run.trial045.stdout: debug ms = 1 2026-02-22T23:24:52.540 INFO:teuthology.orchestra.run.trial045.stdout: debug mon = 20 2026-02-22T23:24:52.540 INFO:teuthology.orchestra.run.trial045.stdout: debug paxos = 20 2026-02-22T23:24:52.540 INFO:teuthology.orchestra.run.trial045.stdout: debug auth = 20 2026-02-22T23:24:52.540 INFO:teuthology.orchestra.run.trial045.stdout: mon data avail warn = 5 2026-02-22T23:24:52.540 INFO:teuthology.orchestra.run.trial045.stdout: mon mgr mkfs grace = 240 2026-02-22T23:24:52.540 INFO:teuthology.orchestra.run.trial045.stdout: mon reweight min pgs per osd = 4 2026-02-22T23:24:52.540 INFO:teuthology.orchestra.run.trial045.stdout: mon osd reporter subtree level = osd 2026-02-22T23:24:52.540 INFO:teuthology.orchestra.run.trial045.stdout: mon osd prime pg temp = true 2026-02-22T23:24:52.540 INFO:teuthology.orchestra.run.trial045.stdout: mon reweight min bytes per osd = 10 2026-02-22T23:24:52.541 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-22T23:24:52.541 INFO:teuthology.orchestra.run.trial045.stdout: # rotate auth tickets quickly to exercise renewal paths 2026-02-22T23:24:52.541 INFO:teuthology.orchestra.run.trial045.stdout: auth mon ticket ttl = 660 # 11m 2026-02-22T23:24:52.541 INFO:teuthology.orchestra.run.trial045.stdout: auth service ticket ttl = 240 # 4m 2026-02-22T23:24:52.541 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-22T23:24:52.541 INFO:teuthology.orchestra.run.trial045.stdout: # don't complain about insecure global_id in the test suite 2026-02-22T23:24:52.541 INFO:teuthology.orchestra.run.trial045.stdout: mon_warn_on_insecure_global_id_reclaim = false 2026-02-22T23:24:52.541 INFO:teuthology.orchestra.run.trial045.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2026-02-22T23:24:52.541 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-22T23:24:52.541 INFO:teuthology.orchestra.run.trial045.stdout: # 1m isn't quite enough 2026-02-22T23:24:52.541 INFO:teuthology.orchestra.run.trial045.stdout: mon_down_mkfs_grace = 2m 2026-02-22T23:24:52.541 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-22T23:24:52.541 INFO:teuthology.orchestra.run.trial045.stdout: mon_warn_on_filestore_osds = false 2026-02-22T23:24:52.541 INFO:teuthology.orchestra.run.trial045.stdout: mon min osdmap epochs = 25 2026-02-22T23:24:52.541 INFO:teuthology.orchestra.run.trial045.stdout: mon osdmap full prune interval = 2 2026-02-22T23:24:52.541 INFO:teuthology.orchestra.run.trial045.stdout: mon osdmap full prune min = 15 2026-02-22T23:24:52.541 INFO:teuthology.orchestra.run.trial045.stdout: mon osdmap full prune txsize = 2 2026-02-22T23:24:52.541 INFO:teuthology.orchestra.run.trial045.stdout: mon scrub inject crc mismatch = 0.01 2026-02-22T23:24:52.541 INFO:teuthology.orchestra.run.trial045.stdout: mon scrub inject missing keys = 0.05 2026-02-22T23:24:52.541 INFO:teuthology.orchestra.run.trial045.stdout: mon scrub interval = 300 2026-02-22T23:24:52.541 INFO:teuthology.orchestra.run.trial045.stdout: paxos min = 10 2026-02-22T23:24:52.542 INFO:teuthology.orchestra.run.trial045.stdout: paxos service trim min = 5 2026-02-22T23:24:52.542 INFO:teuthology.orchestra.run.trial045.stdout: paxos trim min = 10 2026-02-22T23:24:52.542 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-22T23:24:52.542 INFO:teuthology.orchestra.run.trial045.stdout:[client] 2026-02-22T23:24:52.542 INFO:teuthology.orchestra.run.trial045.stdout: rgw cache enabled = true 2026-02-22T23:24:52.542 INFO:teuthology.orchestra.run.trial045.stdout: rgw enable ops log = true 2026-02-22T23:24:52.542 INFO:teuthology.orchestra.run.trial045.stdout: rgw enable usage log = true 2026-02-22T23:24:52.542 INFO:teuthology.orchestra.run.trial045.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2026-02-22T23:24:52.542 INFO:teuthology.orchestra.run.trial045.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2026-02-22T23:24:52.542 INFO:teuthology.orchestra.run.trial045.stdout: debug monc = 20 2026-02-22T23:24:52.542 INFO:teuthology.orchestra.run.trial045.stdout: debug ms = 1 2026-02-22T23:24:52.542 INFO:teuthology.orchestra.run.trial045.stdout:[mon.a] 2026-02-22T23:24:52.542 INFO:teuthology.orchestra.run.trial045.stdout:[mon.b] 2026-02-22T23:24:52.542 INFO:teuthology.orchestra.run.trial045.stdout:[mon.c] 2026-02-22T23:24:52.542 INFO:teuthology.orchestra.run.trial045.stdout:[mon.d] 2026-02-22T23:24:52.542 INFO:teuthology.orchestra.run.trial045.stdout:[mon.e] 2026-02-22T23:24:52.542 INFO:teuthology.orchestra.run.trial045.stdout:[mon.f] 2026-02-22T23:24:52.542 INFO:teuthology.orchestra.run.trial045.stdout:[mon.g] 2026-02-22T23:24:52.542 INFO:teuthology.orchestra.run.trial045.stdout:[mon.h] 2026-02-22T23:24:52.542 INFO:teuthology.orchestra.run.trial045.stdout:[mon.i] 2026-02-22T23:24:52.543 INFO:teuthology.orchestra.run.trial073.stdout:[global] 2026-02-22T23:24:52.543 INFO:teuthology.orchestra.run.trial073.stdout: chdir = "" 2026-02-22T23:24:52.543 INFO:teuthology.orchestra.run.trial073.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2026-02-22T23:24:52.543 INFO:teuthology.orchestra.run.trial073.stdout: auth supported = cephx 2026-02-22T23:24:52.543 INFO:teuthology.orchestra.run.trial073.stdout: 2026-02-22T23:24:52.543 INFO:teuthology.orchestra.run.trial073.stdout: filestore xattr use omap = true 2026-02-22T23:24:52.543 INFO:teuthology.orchestra.run.trial073.stdout: 2026-02-22T23:24:52.543 INFO:teuthology.orchestra.run.trial073.stdout: mon clock drift allowed = 1.000 2026-02-22T23:24:52.543 INFO:teuthology.orchestra.run.trial073.stdout: 2026-02-22T23:24:52.543 INFO:teuthology.orchestra.run.trial073.stdout: osd crush chooseleaf type = 0 2026-02-22T23:24:52.543 INFO:teuthology.orchestra.run.trial073.stdout: auth debug = true 2026-02-22T23:24:52.543 INFO:teuthology.orchestra.run.trial073.stdout: 2026-02-22T23:24:52.543 INFO:teuthology.orchestra.run.trial073.stdout: ms die on old message = true 2026-02-22T23:24:52.544 INFO:teuthology.orchestra.run.trial073.stdout: ms die on bug = true 2026-02-22T23:24:52.544 INFO:teuthology.orchestra.run.trial073.stdout: 2026-02-22T23:24:52.544 INFO:teuthology.orchestra.run.trial073.stdout: mon max pg per osd = 10000 # >= luminous 2026-02-22T23:24:52.544 INFO:teuthology.orchestra.run.trial073.stdout: mon pg warn max object skew = 0 2026-02-22T23:24:52.544 INFO:teuthology.orchestra.run.trial073.stdout: 2026-02-22T23:24:52.544 INFO:teuthology.orchestra.run.trial073.stdout: # disable pg_autoscaler by default for new pools 2026-02-22T23:24:52.544 INFO:teuthology.orchestra.run.trial073.stdout: osd_pool_default_pg_autoscale_mode = off 2026-02-22T23:24:52.544 INFO:teuthology.orchestra.run.trial073.stdout: 2026-02-22T23:24:52.544 INFO:teuthology.orchestra.run.trial073.stdout: osd pool default size = 2 2026-02-22T23:24:52.544 INFO:teuthology.orchestra.run.trial073.stdout: 2026-02-22T23:24:52.544 INFO:teuthology.orchestra.run.trial073.stdout: mon osd allow primary affinity = true 2026-02-22T23:24:52.544 INFO:teuthology.orchestra.run.trial073.stdout: mon osd allow pg remap = true 2026-02-22T23:24:52.544 INFO:teuthology.orchestra.run.trial073.stdout: mon warn on legacy crush tunables = false 2026-02-22T23:24:52.544 INFO:teuthology.orchestra.run.trial073.stdout: mon warn on crush straw calc version zero = false 2026-02-22T23:24:52.544 INFO:teuthology.orchestra.run.trial073.stdout: mon warn on no sortbitwise = false 2026-02-22T23:24:52.544 INFO:teuthology.orchestra.run.trial073.stdout: mon warn on osd down out interval zero = false 2026-02-22T23:24:52.544 INFO:teuthology.orchestra.run.trial073.stdout: mon warn on too few osds = false 2026-02-22T23:24:52.544 INFO:teuthology.orchestra.run.trial073.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2026-02-22T23:24:52.544 INFO:teuthology.orchestra.run.trial073.stdout: mon_warn_on_pool_no_redundancy = false 2026-02-22T23:24:52.544 INFO:teuthology.orchestra.run.trial073.stdout: mon_allow_pool_size_one = true 2026-02-22T23:24:52.544 INFO:teuthology.orchestra.run.trial073.stdout: 2026-02-22T23:24:52.545 INFO:teuthology.orchestra.run.trial073.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2026-02-22T23:24:52.545 INFO:teuthology.orchestra.run.trial073.stdout: 2026-02-22T23:24:52.545 INFO:teuthology.orchestra.run.trial073.stdout: osd default data pool replay window = 5 2026-02-22T23:24:52.545 INFO:teuthology.orchestra.run.trial073.stdout: 2026-02-22T23:24:52.545 INFO:teuthology.orchestra.run.trial073.stdout: mon allow pool delete = true 2026-02-22T23:24:52.545 INFO:teuthology.orchestra.run.trial073.stdout: 2026-02-22T23:24:52.545 INFO:teuthology.orchestra.run.trial073.stdout: mon cluster log file level = debug 2026-02-22T23:24:52.545 INFO:teuthology.orchestra.run.trial073.stdout: debug asserts on shutdown = true 2026-02-22T23:24:52.545 INFO:teuthology.orchestra.run.trial073.stdout: mon health detail to clog = false 2026-02-22T23:24:52.545 INFO:teuthology.orchestra.run.trial073.stdout: mon host = "[v1:10.20.193.45:6789],[v1:10.20.193.45:6790],[v1:10.20.193.45:6791],[v1:10.20.193.45:6792],[v1:10.20.193.45:6793],[v1:10.20.193.73:6789],[v1:10.20.193.73:6790],[v1:10.20.193.73:6791],[v1:10.20.193.73:6792]" 2026-02-22T23:24:52.545 INFO:teuthology.orchestra.run.trial073.stdout: mon client directed command retry = 5 2026-02-22T23:24:52.545 INFO:teuthology.orchestra.run.trial073.stdout: mon election default strategy = 3 2026-02-22T23:24:52.545 INFO:teuthology.orchestra.run.trial073.stdout: ms bind msgr2 = False 2026-02-22T23:24:52.545 INFO:teuthology.orchestra.run.trial073.stdout: ms inject socket failures = 5000 2026-02-22T23:24:52.545 INFO:teuthology.orchestra.run.trial073.stdout: ms type = async 2026-02-22T23:24:52.545 INFO:teuthology.orchestra.run.trial073.stdout: fsid = 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:24:52.545 INFO:teuthology.orchestra.run.trial073.stdout: 2026-02-22T23:24:52.545 INFO:teuthology.orchestra.run.trial073.stdout:[osd] 2026-02-22T23:24:52.545 INFO:teuthology.orchestra.run.trial073.stdout: osd journal size = 100 2026-02-22T23:24:52.545 INFO:teuthology.orchestra.run.trial073.stdout: 2026-02-22T23:24:52.546 INFO:teuthology.orchestra.run.trial073.stdout: osd scrub load threshold = 5.0 2026-02-22T23:24:52.546 INFO:teuthology.orchestra.run.trial073.stdout: osd scrub max interval = 600 2026-02-22T23:24:52.546 INFO:teuthology.orchestra.run.trial073.stdout: osd mclock profile = high_recovery_ops 2026-02-22T23:24:52.546 INFO:teuthology.orchestra.run.trial073.stdout: osd mclock skip benchmark = True 2026-02-22T23:24:52.546 INFO:teuthology.orchestra.run.trial073.stdout: 2026-02-22T23:24:52.546 INFO:teuthology.orchestra.run.trial073.stdout: osd recover clone overlap = true 2026-02-22T23:24:52.546 INFO:teuthology.orchestra.run.trial073.stdout: osd recovery max chunk = 1048576 2026-02-22T23:24:52.546 INFO:teuthology.orchestra.run.trial073.stdout: 2026-02-22T23:24:52.546 INFO:teuthology.orchestra.run.trial073.stdout: osd debug shutdown = true 2026-02-22T23:24:52.546 INFO:teuthology.orchestra.run.trial073.stdout: osd debug op order = true 2026-02-22T23:24:52.546 INFO:teuthology.orchestra.run.trial073.stdout: osd debug verify stray on activate = true 2026-02-22T23:24:52.546 INFO:teuthology.orchestra.run.trial073.stdout: osd debug trim objects = true 2026-02-22T23:24:52.546 INFO:teuthology.orchestra.run.trial073.stdout: 2026-02-22T23:24:52.546 INFO:teuthology.orchestra.run.trial073.stdout: osd open classes on start = true 2026-02-22T23:24:52.546 INFO:teuthology.orchestra.run.trial073.stdout: osd debug pg log writeout = true 2026-02-22T23:24:52.546 INFO:teuthology.orchestra.run.trial073.stdout: 2026-02-22T23:24:52.546 INFO:teuthology.orchestra.run.trial073.stdout: osd deep scrub update digest min age = 30 2026-02-22T23:24:52.546 INFO:teuthology.orchestra.run.trial073.stdout: 2026-02-22T23:24:52.546 INFO:teuthology.orchestra.run.trial073.stdout: osd map max advance = 10 2026-02-22T23:24:52.546 INFO:teuthology.orchestra.run.trial073.stdout: 2026-02-22T23:24:52.546 INFO:teuthology.orchestra.run.trial073.stdout: journal zero on create = true 2026-02-22T23:24:52.547 INFO:teuthology.orchestra.run.trial073.stdout: 2026-02-22T23:24:52.547 INFO:teuthology.orchestra.run.trial073.stdout: filestore ondisk finisher threads = 3 2026-02-22T23:24:52.547 INFO:teuthology.orchestra.run.trial073.stdout: filestore apply finisher threads = 3 2026-02-22T23:24:52.547 INFO:teuthology.orchestra.run.trial073.stdout: 2026-02-22T23:24:52.547 INFO:teuthology.orchestra.run.trial073.stdout: bdev debug aio = true 2026-02-22T23:24:52.547 INFO:teuthology.orchestra.run.trial073.stdout: osd debug misdirected ops = true 2026-02-22T23:24:52.547 INFO:teuthology.orchestra.run.trial073.stdout: bluestore block size = 96636764160 2026-02-22T23:24:52.547 INFO:teuthology.orchestra.run.trial073.stdout: bluestore compression algorithm = lz4 2026-02-22T23:24:52.547 INFO:teuthology.orchestra.run.trial073.stdout: bluestore compression mode = aggressive 2026-02-22T23:24:52.547 INFO:teuthology.orchestra.run.trial073.stdout: bluestore fsck on mount = True 2026-02-22T23:24:52.547 INFO:teuthology.orchestra.run.trial073.stdout: bluestore zero block detection = True 2026-02-22T23:24:52.547 INFO:teuthology.orchestra.run.trial073.stdout: debug bluefs = 20 2026-02-22T23:24:52.547 INFO:teuthology.orchestra.run.trial073.stdout: debug bluestore = 20 2026-02-22T23:24:52.547 INFO:teuthology.orchestra.run.trial073.stdout: debug ms = 1 2026-02-22T23:24:52.547 INFO:teuthology.orchestra.run.trial073.stdout: debug osd = 20 2026-02-22T23:24:52.547 INFO:teuthology.orchestra.run.trial073.stdout: debug rocksdb = 10 2026-02-22T23:24:52.547 INFO:teuthology.orchestra.run.trial073.stdout: mon osd backfillfull_ratio = 0.85 2026-02-22T23:24:52.547 INFO:teuthology.orchestra.run.trial073.stdout: mon osd full ratio = 0.9 2026-02-22T23:24:52.547 INFO:teuthology.orchestra.run.trial073.stdout: mon osd nearfull ratio = 0.8 2026-02-22T23:24:52.547 INFO:teuthology.orchestra.run.trial073.stdout: osd debug verify cached snaps = True 2026-02-22T23:24:52.547 INFO:teuthology.orchestra.run.trial073.stdout: osd debug verify missing on start = True 2026-02-22T23:24:52.547 INFO:teuthology.orchestra.run.trial073.stdout: osd failsafe full ratio = 0.95 2026-02-22T23:24:52.548 INFO:teuthology.orchestra.run.trial073.stdout: osd mclock override recovery settings = True 2026-02-22T23:24:52.548 INFO:teuthology.orchestra.run.trial073.stdout: osd objectstore = bluestore 2026-02-22T23:24:52.548 INFO:teuthology.orchestra.run.trial073.stdout: osd op queue = debug_random 2026-02-22T23:24:52.548 INFO:teuthology.orchestra.run.trial073.stdout: osd op queue cut off = debug_random 2026-02-22T23:24:52.548 INFO:teuthology.orchestra.run.trial073.stdout: 2026-02-22T23:24:52.548 INFO:teuthology.orchestra.run.trial073.stdout:[mgr] 2026-02-22T23:24:52.548 INFO:teuthology.orchestra.run.trial073.stdout: debug ms = 1 2026-02-22T23:24:52.548 INFO:teuthology.orchestra.run.trial073.stdout: debug mgr = 20 2026-02-22T23:24:52.548 INFO:teuthology.orchestra.run.trial073.stdout: debug mon = 20 2026-02-22T23:24:52.548 INFO:teuthology.orchestra.run.trial073.stdout: debug auth = 20 2026-02-22T23:24:52.548 INFO:teuthology.orchestra.run.trial073.stdout: mon reweight min pgs per osd = 4 2026-02-22T23:24:52.548 INFO:teuthology.orchestra.run.trial073.stdout: mon reweight min bytes per osd = 10 2026-02-22T23:24:52.548 INFO:teuthology.orchestra.run.trial073.stdout: mgr/telemetry/nag = false 2026-02-22T23:24:52.548 INFO:teuthology.orchestra.run.trial073.stdout: 2026-02-22T23:24:52.548 INFO:teuthology.orchestra.run.trial073.stdout:[mon] 2026-02-22T23:24:52.548 INFO:teuthology.orchestra.run.trial073.stdout: debug ms = 1 2026-02-22T23:24:52.548 INFO:teuthology.orchestra.run.trial073.stdout: debug mon = 20 2026-02-22T23:24:52.548 INFO:teuthology.orchestra.run.trial073.stdout: debug paxos = 20 2026-02-22T23:24:52.548 INFO:teuthology.orchestra.run.trial073.stdout: debug auth = 20 2026-02-22T23:24:52.548 INFO:teuthology.orchestra.run.trial073.stdout: mon data avail warn = 5 2026-02-22T23:24:52.548 INFO:teuthology.orchestra.run.trial073.stdout: mon mgr mkfs grace = 240 2026-02-22T23:24:52.549 INFO:teuthology.orchestra.run.trial073.stdout: mon reweight min pgs per osd = 4 2026-02-22T23:24:52.549 INFO:teuthology.orchestra.run.trial073.stdout: mon osd reporter subtree level = osd 2026-02-22T23:24:52.549 INFO:teuthology.orchestra.run.trial073.stdout: mon osd prime pg temp = true 2026-02-22T23:24:52.549 INFO:teuthology.orchestra.run.trial073.stdout: mon reweight min bytes per osd = 10 2026-02-22T23:24:52.549 INFO:teuthology.orchestra.run.trial073.stdout: 2026-02-22T23:24:52.549 INFO:teuthology.orchestra.run.trial073.stdout: # rotate auth tickets quickly to exercise renewal paths 2026-02-22T23:24:52.549 INFO:teuthology.orchestra.run.trial073.stdout: auth mon ticket ttl = 660 # 11m 2026-02-22T23:24:52.549 INFO:teuthology.orchestra.run.trial073.stdout: auth service ticket ttl = 240 # 4m 2026-02-22T23:24:52.549 INFO:teuthology.orchestra.run.trial073.stdout: 2026-02-22T23:24:52.549 INFO:teuthology.orchestra.run.trial073.stdout: # don't complain about insecure global_id in the test suite 2026-02-22T23:24:52.549 INFO:teuthology.orchestra.run.trial073.stdout: mon_warn_on_insecure_global_id_reclaim = false 2026-02-22T23:24:52.549 INFO:teuthology.orchestra.run.trial073.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2026-02-22T23:24:52.549 INFO:teuthology.orchestra.run.trial073.stdout: 2026-02-22T23:24:52.549 INFO:teuthology.orchestra.run.trial073.stdout: # 1m isn't quite enough 2026-02-22T23:24:52.549 INFO:teuthology.orchestra.run.trial073.stdout: mon_down_mkfs_grace = 2m 2026-02-22T23:24:52.549 INFO:teuthology.orchestra.run.trial073.stdout: 2026-02-22T23:24:52.549 INFO:teuthology.orchestra.run.trial073.stdout: mon_warn_on_filestore_osds = false 2026-02-22T23:24:52.549 INFO:teuthology.orchestra.run.trial073.stdout: mon min osdmap epochs = 25 2026-02-22T23:24:52.549 INFO:teuthology.orchestra.run.trial073.stdout: mon osdmap full prune interval = 2 2026-02-22T23:24:52.549 INFO:teuthology.orchestra.run.trial073.stdout: mon osdmap full prune min = 15 2026-02-22T23:24:52.550 INFO:teuthology.orchestra.run.trial073.stdout: mon osdmap full prune txsize = 2 2026-02-22T23:24:52.550 INFO:teuthology.orchestra.run.trial073.stdout: mon scrub inject crc mismatch = 0.01 2026-02-22T23:24:52.550 INFO:teuthology.orchestra.run.trial073.stdout: mon scrub inject missing keys = 0.05 2026-02-22T23:24:52.550 INFO:teuthology.orchestra.run.trial073.stdout: mon scrub interval = 300 2026-02-22T23:24:52.550 INFO:teuthology.orchestra.run.trial073.stdout: paxos min = 10 2026-02-22T23:24:52.550 INFO:teuthology.orchestra.run.trial073.stdout: paxos service trim min = 5 2026-02-22T23:24:52.550 INFO:teuthology.orchestra.run.trial073.stdout: paxos trim min = 10 2026-02-22T23:24:52.550 INFO:teuthology.orchestra.run.trial073.stdout: 2026-02-22T23:24:52.550 INFO:teuthology.orchestra.run.trial073.stdout:[client] 2026-02-22T23:24:52.550 INFO:teuthology.orchestra.run.trial073.stdout: rgw cache enabled = true 2026-02-22T23:24:52.550 INFO:teuthology.orchestra.run.trial073.stdout: rgw enable ops log = true 2026-02-22T23:24:52.550 INFO:teuthology.orchestra.run.trial073.stdout: rgw enable usage log = true 2026-02-22T23:24:52.550 INFO:teuthology.orchestra.run.trial073.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2026-02-22T23:24:52.550 INFO:teuthology.orchestra.run.trial073.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2026-02-22T23:24:52.550 INFO:teuthology.orchestra.run.trial073.stdout: debug monc = 20 2026-02-22T23:24:52.550 INFO:teuthology.orchestra.run.trial073.stdout: debug ms = 1 2026-02-22T23:24:52.550 INFO:teuthology.orchestra.run.trial073.stdout:[mon.a] 2026-02-22T23:24:52.550 INFO:teuthology.orchestra.run.trial073.stdout:[mon.b] 2026-02-22T23:24:52.550 INFO:teuthology.orchestra.run.trial073.stdout:[mon.c] 2026-02-22T23:24:52.550 INFO:teuthology.orchestra.run.trial073.stdout:[mon.d] 2026-02-22T23:24:52.550 INFO:teuthology.orchestra.run.trial073.stdout:[mon.e] 2026-02-22T23:24:52.551 INFO:teuthology.orchestra.run.trial073.stdout:[mon.f] 2026-02-22T23:24:52.551 INFO:teuthology.orchestra.run.trial073.stdout:[mon.g] 2026-02-22T23:24:52.551 INFO:teuthology.orchestra.run.trial073.stdout:[mon.h] 2026-02-22T23:24:52.551 INFO:teuthology.orchestra.run.trial073.stdout:[mon.i] 2026-02-22T23:24:52.552 INFO:tasks.ceph:Creating admin key on mon.a... 2026-02-22T23:24:52.552 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2026-02-22T23:24:52.634 INFO:tasks.ceph:Copying monmap to all nodes... 2026-02-22T23:24:52.634 DEBUG:teuthology.orchestra.run.trial045:> set -ex 2026-02-22T23:24:52.634 DEBUG:teuthology.orchestra.run.trial045:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2026-02-22T23:24:52.692 DEBUG:teuthology.orchestra.run.trial045:> set -ex 2026-02-22T23:24:52.692 DEBUG:teuthology.orchestra.run.trial045:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2026-02-22T23:24:52.748 INFO:tasks.ceph:Sending monmap to node ubuntu@trial045.front.sepia.ceph.com 2026-02-22T23:24:52.748 DEBUG:teuthology.orchestra.run.trial045:> set -ex 2026-02-22T23:24:52.748 DEBUG:teuthology.orchestra.run.trial045:> sudo dd of=/etc/ceph/ceph.keyring 2026-02-22T23:24:52.748 DEBUG:teuthology.orchestra.run.trial045:> sudo chmod 0644 /etc/ceph/ceph.keyring 2026-02-22T23:24:52.822 DEBUG:teuthology.orchestra.run.trial045:> set -ex 2026-02-22T23:24:52.823 DEBUG:teuthology.orchestra.run.trial045:> dd of=/home/ubuntu/cephtest/ceph.monmap 2026-02-22T23:24:52.878 INFO:tasks.ceph:Sending monmap to node ubuntu@trial073.front.sepia.ceph.com 2026-02-22T23:24:52.878 DEBUG:teuthology.orchestra.run.trial073:> set -ex 2026-02-22T23:24:52.878 DEBUG:teuthology.orchestra.run.trial073:> sudo dd of=/etc/ceph/ceph.keyring 2026-02-22T23:24:52.878 DEBUG:teuthology.orchestra.run.trial073:> sudo chmod 0644 /etc/ceph/ceph.keyring 2026-02-22T23:24:52.912 DEBUG:teuthology.orchestra.run.trial073:> set -ex 2026-02-22T23:24:52.913 DEBUG:teuthology.orchestra.run.trial073:> dd of=/home/ubuntu/cephtest/ceph.monmap 2026-02-22T23:24:52.970 INFO:tasks.ceph:Setting up mon nodes... 2026-02-22T23:24:52.970 INFO:tasks.ceph:Setting up mgr nodes... 2026-02-22T23:24:52.970 DEBUG:teuthology.orchestra.run.trial073:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2026-02-22T23:24:53.053 INFO:teuthology.orchestra.run.trial073.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2026-02-22T23:24:53.055 INFO:tasks.ceph:Setting up mds nodes... 2026-02-22T23:24:53.056 INFO:tasks.ceph_client:Setting up client nodes... 2026-02-22T23:24:53.056 DEBUG:teuthology.orchestra.run.trial073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2026-02-22T23:24:53.129 INFO:teuthology.orchestra.run.trial073.stdout:creating /etc/ceph/ceph.client.0.keyring 2026-02-22T23:24:53.141 INFO:tasks.ceph:Running mkfs on osd nodes... 2026-02-22T23:24:53.141 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@trial045.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'}, Remote(name='ubuntu@trial073.front.sepia.ceph.com'): {'osd.3': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.5': '/dev/vg_nvme/lv_3'}} 2026-02-22T23:24:53.142 DEBUG:teuthology.orchestra.run.trial045:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2026-02-22T23:24:53.168 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2026-02-22T23:24:53.168 INFO:tasks.ceph:role: osd.0 2026-02-22T23:24:53.168 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@trial045.front.sepia.ceph.com 2026-02-22T23:24:53.169 DEBUG:teuthology.orchestra.run.trial045:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2026-02-22T23:24:53.233 INFO:teuthology.orchestra.run.trial045.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=45875200 blks 2026-02-22T23:24:53.233 INFO:teuthology.orchestra.run.trial045.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-22T23:24:53.233 INFO:teuthology.orchestra.run.trial045.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-22T23:24:53.233 INFO:teuthology.orchestra.run.trial045.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-22T23:24:53.233 INFO:teuthology.orchestra.run.trial045.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-22T23:24:53.233 INFO:teuthology.orchestra.run.trial045.stdout: = sunit=0 swidth=0 blks 2026-02-22T23:24:53.234 INFO:teuthology.orchestra.run.trial045.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-22T23:24:53.234 INFO:teuthology.orchestra.run.trial045.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-22T23:24:53.234 INFO:teuthology.orchestra.run.trial045.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-22T23:24:53.234 INFO:teuthology.orchestra.run.trial045.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-22T23:24:53.807 INFO:teuthology.orchestra.run.trial045.stdout:Discarding blocks...Done. 2026-02-22T23:24:53.809 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@trial045.front.sepia.ceph.com -o noatime 2026-02-22T23:24:53.810 DEBUG:teuthology.orchestra.run.trial045:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2026-02-22T23:24:53.879 DEBUG:teuthology.orchestra.run.trial045:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2026-02-22T23:24:53.947 DEBUG:teuthology.orchestra.run.trial045:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2026-02-22T23:24:54.011 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2026-02-22T23:24:54.011 INFO:tasks.ceph:role: osd.1 2026-02-22T23:24:54.011 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@trial045.front.sepia.ceph.com 2026-02-22T23:24:54.011 DEBUG:teuthology.orchestra.run.trial045:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2026-02-22T23:24:54.077 INFO:teuthology.orchestra.run.trial045.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=45875200 blks 2026-02-22T23:24:54.077 INFO:teuthology.orchestra.run.trial045.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-22T23:24:54.077 INFO:teuthology.orchestra.run.trial045.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-22T23:24:54.077 INFO:teuthology.orchestra.run.trial045.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-22T23:24:54.077 INFO:teuthology.orchestra.run.trial045.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-22T23:24:54.077 INFO:teuthology.orchestra.run.trial045.stdout: = sunit=0 swidth=0 blks 2026-02-22T23:24:54.077 INFO:teuthology.orchestra.run.trial045.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-22T23:24:54.077 INFO:teuthology.orchestra.run.trial045.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-22T23:24:54.078 INFO:teuthology.orchestra.run.trial045.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-22T23:24:54.078 INFO:teuthology.orchestra.run.trial045.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-22T23:24:54.649 INFO:teuthology.orchestra.run.trial045.stdout:Discarding blocks...Done. 2026-02-22T23:24:54.652 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@trial045.front.sepia.ceph.com -o noatime 2026-02-22T23:24:54.652 DEBUG:teuthology.orchestra.run.trial045:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2026-02-22T23:24:54.720 DEBUG:teuthology.orchestra.run.trial045:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2026-02-22T23:24:54.787 DEBUG:teuthology.orchestra.run.trial045:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2026-02-22T23:24:54.851 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2026-02-22T23:24:54.851 INFO:tasks.ceph:role: osd.2 2026-02-22T23:24:54.851 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@trial045.front.sepia.ceph.com 2026-02-22T23:24:54.851 DEBUG:teuthology.orchestra.run.trial045:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2026-02-22T23:24:54.915 INFO:teuthology.orchestra.run.trial045.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=45875200 blks 2026-02-22T23:24:54.916 INFO:teuthology.orchestra.run.trial045.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-22T23:24:54.916 INFO:teuthology.orchestra.run.trial045.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-22T23:24:54.916 INFO:teuthology.orchestra.run.trial045.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-22T23:24:54.916 INFO:teuthology.orchestra.run.trial045.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-22T23:24:54.916 INFO:teuthology.orchestra.run.trial045.stdout: = sunit=0 swidth=0 blks 2026-02-22T23:24:54.916 INFO:teuthology.orchestra.run.trial045.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-22T23:24:54.916 INFO:teuthology.orchestra.run.trial045.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-22T23:24:54.916 INFO:teuthology.orchestra.run.trial045.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-22T23:24:54.916 INFO:teuthology.orchestra.run.trial045.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-22T23:24:55.472 INFO:teuthology.orchestra.run.trial045.stdout:Discarding blocks...Done. 2026-02-22T23:24:55.475 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@trial045.front.sepia.ceph.com -o noatime 2026-02-22T23:24:55.475 DEBUG:teuthology.orchestra.run.trial045:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2026-02-22T23:24:55.543 DEBUG:teuthology.orchestra.run.trial045:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2026-02-22T23:24:55.610 DEBUG:teuthology.orchestra.run.trial045:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-22T23:24:55.689 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:24:55.688+0000 7fb0592b2780 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2026-02-22T23:24:55.690 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:24:55.688+0000 7fb0592b2780 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2026-02-22T23:24:55.690 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:24:55.688+0000 7fb0592b2780 -1 bdev(0x55809e3cf800 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2026-02-22T23:24:55.690 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:24:55.688+0000 7fb0592b2780 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2026-02-22T23:24:58.590 DEBUG:teuthology.orchestra.run.trial045:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2026-02-22T23:24:58.657 DEBUG:teuthology.orchestra.run.trial045:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-22T23:24:58.736 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:24:58.735+0000 7fe101909780 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2026-02-22T23:24:58.736 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:24:58.736+0000 7fe101909780 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2026-02-22T23:24:58.737 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:24:58.736+0000 7fe101909780 -1 bdev(0x55857945d800 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2026-02-22T23:24:58.737 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:24:58.736+0000 7fe101909780 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2026-02-22T23:25:01.881 DEBUG:teuthology.orchestra.run.trial045:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2026-02-22T23:25:01.947 DEBUG:teuthology.orchestra.run.trial045:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-22T23:25:02.024 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:02.023+0000 7fa9c7a0c780 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2026-02-22T23:25:02.025 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:02.023+0000 7fa9c7a0c780 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2026-02-22T23:25:02.025 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:02.023+0000 7fa9c7a0c780 -1 bdev(0x55630b953800 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2026-02-22T23:25:02.025 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:02.023+0000 7fa9c7a0c780 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2026-02-22T23:25:04.923 DEBUG:teuthology.orchestra.run.trial045:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2026-02-22T23:25:04.990 DEBUG:teuthology.orchestra.run.trial073:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2026-02-22T23:25:05.016 INFO:tasks.ceph:roles_to_devs: {'osd.3': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.5': '/dev/vg_nvme/lv_3'} 2026-02-22T23:25:05.016 INFO:tasks.ceph:role: osd.3 2026-02-22T23:25:05.017 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@trial073.front.sepia.ceph.com 2026-02-22T23:25:05.017 DEBUG:teuthology.orchestra.run.trial073:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2026-02-22T23:25:05.081 INFO:teuthology.orchestra.run.trial073.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=45875200 blks 2026-02-22T23:25:05.081 INFO:teuthology.orchestra.run.trial073.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-22T23:25:05.082 INFO:teuthology.orchestra.run.trial073.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-22T23:25:05.082 INFO:teuthology.orchestra.run.trial073.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-22T23:25:05.082 INFO:teuthology.orchestra.run.trial073.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-22T23:25:05.082 INFO:teuthology.orchestra.run.trial073.stdout: = sunit=0 swidth=0 blks 2026-02-22T23:25:05.082 INFO:teuthology.orchestra.run.trial073.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-22T23:25:05.082 INFO:teuthology.orchestra.run.trial073.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-22T23:25:05.082 INFO:teuthology.orchestra.run.trial073.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-22T23:25:05.082 INFO:teuthology.orchestra.run.trial073.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-22T23:25:05.651 INFO:teuthology.orchestra.run.trial073.stdout:Discarding blocks...Done. 2026-02-22T23:25:05.653 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@trial073.front.sepia.ceph.com -o noatime 2026-02-22T23:25:05.653 DEBUG:teuthology.orchestra.run.trial073:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-3 2026-02-22T23:25:05.723 DEBUG:teuthology.orchestra.run.trial073:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2026-02-22T23:25:05.792 DEBUG:teuthology.orchestra.run.trial073:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2026-02-22T23:25:05.856 INFO:tasks.ceph:roles_to_devs: {'osd.3': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.5': '/dev/vg_nvme/lv_3'} 2026-02-22T23:25:05.856 INFO:tasks.ceph:role: osd.4 2026-02-22T23:25:05.856 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@trial073.front.sepia.ceph.com 2026-02-22T23:25:05.856 DEBUG:teuthology.orchestra.run.trial073:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2026-02-22T23:25:05.924 INFO:teuthology.orchestra.run.trial073.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=45875200 blks 2026-02-22T23:25:05.924 INFO:teuthology.orchestra.run.trial073.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-22T23:25:05.924 INFO:teuthology.orchestra.run.trial073.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-22T23:25:05.924 INFO:teuthology.orchestra.run.trial073.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-22T23:25:05.924 INFO:teuthology.orchestra.run.trial073.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-22T23:25:05.924 INFO:teuthology.orchestra.run.trial073.stdout: = sunit=0 swidth=0 blks 2026-02-22T23:25:05.924 INFO:teuthology.orchestra.run.trial073.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-22T23:25:05.925 INFO:teuthology.orchestra.run.trial073.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-22T23:25:05.925 INFO:teuthology.orchestra.run.trial073.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-22T23:25:05.925 INFO:teuthology.orchestra.run.trial073.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-22T23:25:06.485 INFO:teuthology.orchestra.run.trial073.stdout:Discarding blocks...Done. 2026-02-22T23:25:06.487 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@trial073.front.sepia.ceph.com -o noatime 2026-02-22T23:25:06.487 DEBUG:teuthology.orchestra.run.trial073:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-4 2026-02-22T23:25:06.556 DEBUG:teuthology.orchestra.run.trial073:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2026-02-22T23:25:06.624 DEBUG:teuthology.orchestra.run.trial073:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2026-02-22T23:25:06.689 INFO:tasks.ceph:roles_to_devs: {'osd.3': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.5': '/dev/vg_nvme/lv_3'} 2026-02-22T23:25:06.689 INFO:tasks.ceph:role: osd.5 2026-02-22T23:25:06.689 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@trial073.front.sepia.ceph.com 2026-02-22T23:25:06.689 DEBUG:teuthology.orchestra.run.trial073:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2026-02-22T23:25:06.755 INFO:teuthology.orchestra.run.trial073.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=45875200 blks 2026-02-22T23:25:06.755 INFO:teuthology.orchestra.run.trial073.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-22T23:25:06.756 INFO:teuthology.orchestra.run.trial073.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-22T23:25:06.756 INFO:teuthology.orchestra.run.trial073.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-22T23:25:06.756 INFO:teuthology.orchestra.run.trial073.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-22T23:25:06.756 INFO:teuthology.orchestra.run.trial073.stdout: = sunit=0 swidth=0 blks 2026-02-22T23:25:06.756 INFO:teuthology.orchestra.run.trial073.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-22T23:25:06.756 INFO:teuthology.orchestra.run.trial073.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-22T23:25:06.756 INFO:teuthology.orchestra.run.trial073.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-22T23:25:06.756 INFO:teuthology.orchestra.run.trial073.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-22T23:25:07.314 INFO:teuthology.orchestra.run.trial073.stdout:Discarding blocks...Done. 2026-02-22T23:25:07.316 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@trial073.front.sepia.ceph.com -o noatime 2026-02-22T23:25:07.316 DEBUG:teuthology.orchestra.run.trial073:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-5 2026-02-22T23:25:07.387 DEBUG:teuthology.orchestra.run.trial073:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2026-02-22T23:25:07.452 DEBUG:teuthology.orchestra.run.trial073:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-22T23:25:07.531 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:07.529+0000 7f745753f780 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2026-02-22T23:25:07.531 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:07.530+0000 7f745753f780 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2026-02-22T23:25:07.532 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:07.530+0000 7f745753f780 -1 bdev(0x5573d710b800 /var/lib/ceph/osd/ceph-3/block) open stat got: (1) Operation not permitted 2026-02-22T23:25:07.532 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:07.530+0000 7f745753f780 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2026-02-22T23:25:10.429 DEBUG:teuthology.orchestra.run.trial073:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2026-02-22T23:25:10.495 DEBUG:teuthology.orchestra.run.trial073:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-22T23:25:10.572 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:10.571+0000 7faee9137780 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2026-02-22T23:25:10.573 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:10.571+0000 7faee9137780 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2026-02-22T23:25:10.573 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:10.571+0000 7faee9137780 -1 bdev(0x5624769b1800 /var/lib/ceph/osd/ceph-4/block) open stat got: (1) Operation not permitted 2026-02-22T23:25:10.573 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:10.571+0000 7faee9137780 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2026-02-22T23:25:13.471 DEBUG:teuthology.orchestra.run.trial073:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2026-02-22T23:25:13.535 DEBUG:teuthology.orchestra.run.trial073:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-22T23:25:13.612 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:13.611+0000 7f078c99c780 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2026-02-22T23:25:13.613 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:13.611+0000 7f078c99c780 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2026-02-22T23:25:13.613 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:13.611+0000 7f078c99c780 -1 bdev(0x5589545a5800 /var/lib/ceph/osd/ceph-5/block) open stat got: (1) Operation not permitted 2026-02-22T23:25:13.613 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:13.611+0000 7f078c99c780 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2026-02-22T23:25:16.762 DEBUG:teuthology.orchestra.run.trial073:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2026-02-22T23:25:16.827 INFO:tasks.ceph:Reading keys from all nodes... 2026-02-22T23:25:16.828 DEBUG:teuthology.orchestra.run.trial045:> set -ex 2026-02-22T23:25:16.828 DEBUG:teuthology.orchestra.run.trial045:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2026-02-22T23:25:16.853 DEBUG:teuthology.orchestra.run.trial045:> set -ex 2026-02-22T23:25:16.853 DEBUG:teuthology.orchestra.run.trial045:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2026-02-22T23:25:16.917 DEBUG:teuthology.orchestra.run.trial045:> set -ex 2026-02-22T23:25:16.917 DEBUG:teuthology.orchestra.run.trial045:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2026-02-22T23:25:16.981 DEBUG:teuthology.orchestra.run.trial073:> set -ex 2026-02-22T23:25:16.981 DEBUG:teuthology.orchestra.run.trial073:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2026-02-22T23:25:17.006 DEBUG:teuthology.orchestra.run.trial073:> set -ex 2026-02-22T23:25:17.006 DEBUG:teuthology.orchestra.run.trial073:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2026-02-22T23:25:17.072 DEBUG:teuthology.orchestra.run.trial073:> set -ex 2026-02-22T23:25:17.072 DEBUG:teuthology.orchestra.run.trial073:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2026-02-22T23:25:17.136 DEBUG:teuthology.orchestra.run.trial073:> set -ex 2026-02-22T23:25:17.136 DEBUG:teuthology.orchestra.run.trial073:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2026-02-22T23:25:17.199 DEBUG:teuthology.orchestra.run.trial073:> set -ex 2026-02-22T23:25:17.199 DEBUG:teuthology.orchestra.run.trial073:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2026-02-22T23:25:17.255 INFO:tasks.ceph:Adding keys to all mons... 2026-02-22T23:25:17.255 DEBUG:teuthology.orchestra.run.trial045:> sudo tee -a /etc/ceph/ceph.keyring 2026-02-22T23:25:17.258 DEBUG:teuthology.orchestra.run.trial073:> sudo tee -a /etc/ceph/ceph.keyring 2026-02-22T23:25:17.298 INFO:teuthology.orchestra.run.trial045.stdout:[osd.0] 2026-02-22T23:25:17.298 INFO:teuthology.orchestra.run.trial045.stdout: key = AQBHkJtpmF8ZKRAAlY6t1HiCno6/AItElYNWmA== 2026-02-22T23:25:17.298 INFO:teuthology.orchestra.run.trial045.stdout:[osd.1] 2026-02-22T23:25:17.298 INFO:teuthology.orchestra.run.trial045.stdout: key = AQBKkJtphrDuKxAAVOKWfWuZCGrUsokO8RumrQ== 2026-02-22T23:25:17.298 INFO:teuthology.orchestra.run.trial045.stdout:[osd.2] 2026-02-22T23:25:17.298 INFO:teuthology.orchestra.run.trial045.stdout: key = AQBOkJtpkOR2ARAANpPSx+helKaioDnkozmfqw== 2026-02-22T23:25:17.298 INFO:teuthology.orchestra.run.trial045.stdout:[mgr.x] 2026-02-22T23:25:17.298 INFO:teuthology.orchestra.run.trial045.stdout: key = AQBFkJtpFLcxAxAAx424BZvGLOBXpCdK0aYOnA== 2026-02-22T23:25:17.299 INFO:teuthology.orchestra.run.trial045.stdout:[osd.3] 2026-02-22T23:25:17.299 INFO:teuthology.orchestra.run.trial045.stdout: key = AQBTkJtp9PekHxAAMaIdtBLbasnMbuAl6x8rHQ== 2026-02-22T23:25:17.299 INFO:teuthology.orchestra.run.trial045.stdout:[osd.4] 2026-02-22T23:25:17.299 INFO:teuthology.orchestra.run.trial045.stdout: key = AQBWkJtpEQcaIhAAPXl4frgL+vPDSf5iy+N2SQ== 2026-02-22T23:25:17.299 INFO:teuthology.orchestra.run.trial045.stdout:[osd.5] 2026-02-22T23:25:17.299 INFO:teuthology.orchestra.run.trial045.stdout: key = AQBZkJtpLLl9JBAAJE/6dQY7QMJPywHYcrOMPg== 2026-02-22T23:25:17.299 INFO:teuthology.orchestra.run.trial045.stdout:[client.0] 2026-02-22T23:25:17.299 INFO:teuthology.orchestra.run.trial045.stdout: key = AQBFkJtpfQa+BxAAGFumqt/2SzLo35j1pjQYIA== 2026-02-22T23:25:17.316 INFO:teuthology.orchestra.run.trial073.stdout:[osd.0] 2026-02-22T23:25:17.316 INFO:teuthology.orchestra.run.trial073.stdout: key = AQBHkJtpmF8ZKRAAlY6t1HiCno6/AItElYNWmA== 2026-02-22T23:25:17.316 INFO:teuthology.orchestra.run.trial073.stdout:[osd.1] 2026-02-22T23:25:17.317 INFO:teuthology.orchestra.run.trial073.stdout: key = AQBKkJtphrDuKxAAVOKWfWuZCGrUsokO8RumrQ== 2026-02-22T23:25:17.317 INFO:teuthology.orchestra.run.trial073.stdout:[osd.2] 2026-02-22T23:25:17.317 INFO:teuthology.orchestra.run.trial073.stdout: key = AQBOkJtpkOR2ARAANpPSx+helKaioDnkozmfqw== 2026-02-22T23:25:17.317 INFO:teuthology.orchestra.run.trial073.stdout:[mgr.x] 2026-02-22T23:25:17.317 INFO:teuthology.orchestra.run.trial073.stdout: key = AQBFkJtpFLcxAxAAx424BZvGLOBXpCdK0aYOnA== 2026-02-22T23:25:17.317 INFO:teuthology.orchestra.run.trial073.stdout:[osd.3] 2026-02-22T23:25:17.317 INFO:teuthology.orchestra.run.trial073.stdout: key = AQBTkJtp9PekHxAAMaIdtBLbasnMbuAl6x8rHQ== 2026-02-22T23:25:17.317 INFO:teuthology.orchestra.run.trial073.stdout:[osd.4] 2026-02-22T23:25:17.317 INFO:teuthology.orchestra.run.trial073.stdout: key = AQBWkJtpEQcaIhAAPXl4frgL+vPDSf5iy+N2SQ== 2026-02-22T23:25:17.317 INFO:teuthology.orchestra.run.trial073.stdout:[osd.5] 2026-02-22T23:25:17.318 INFO:teuthology.orchestra.run.trial073.stdout: key = AQBZkJtpLLl9JBAAJE/6dQY7QMJPywHYcrOMPg== 2026-02-22T23:25:17.318 INFO:teuthology.orchestra.run.trial073.stdout:[client.0] 2026-02-22T23:25:17.318 INFO:teuthology.orchestra.run.trial073.stdout: key = AQBFkJtpfQa+BxAAGFumqt/2SzLo35j1pjQYIA== 2026-02-22T23:25:17.319 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-22T23:25:17.344 DEBUG:teuthology.orchestra.run.trial073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-22T23:25:17.397 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-22T23:25:17.426 DEBUG:teuthology.orchestra.run.trial073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-22T23:25:17.477 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-22T23:25:17.506 DEBUG:teuthology.orchestra.run.trial073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-22T23:25:17.556 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2026-02-22T23:25:17.585 DEBUG:teuthology.orchestra.run.trial073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2026-02-22T23:25:17.634 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-22T23:25:17.666 DEBUG:teuthology.orchestra.run.trial073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-22T23:25:17.714 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-22T23:25:17.745 DEBUG:teuthology.orchestra.run.trial073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-22T23:25:17.792 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-22T23:25:17.823 DEBUG:teuthology.orchestra.run.trial073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-22T23:25:17.873 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2026-02-22T23:25:17.903 DEBUG:teuthology.orchestra.run.trial073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2026-02-22T23:25:17.953 INFO:tasks.ceph:Running mkfs on mon nodes... 2026-02-22T23:25:17.953 DEBUG:teuthology.orchestra.run.trial045:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2026-02-22T23:25:18.007 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2026-02-22T23:25:18.089 DEBUG:teuthology.orchestra.run.trial045:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2026-02-22T23:25:18.154 DEBUG:teuthology.orchestra.run.trial045:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2026-02-22T23:25:18.218 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2026-02-22T23:25:18.306 DEBUG:teuthology.orchestra.run.trial045:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2026-02-22T23:25:18.331 DEBUG:teuthology.orchestra.run.trial045:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2026-02-22T23:25:18.396 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2026-02-22T23:25:18.484 DEBUG:teuthology.orchestra.run.trial045:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2026-02-22T23:25:18.507 DEBUG:teuthology.orchestra.run.trial045:> sudo mkdir -p /var/lib/ceph/mon/ceph-d 2026-02-22T23:25:18.570 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i d --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2026-02-22T23:25:18.652 DEBUG:teuthology.orchestra.run.trial045:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-d 2026-02-22T23:25:18.717 DEBUG:teuthology.orchestra.run.trial045:> sudo mkdir -p /var/lib/ceph/mon/ceph-e 2026-02-22T23:25:18.782 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i e --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2026-02-22T23:25:18.864 DEBUG:teuthology.orchestra.run.trial045:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-e 2026-02-22T23:25:18.928 DEBUG:teuthology.orchestra.run.trial073:> sudo mkdir -p /var/lib/ceph/mon/ceph-f 2026-02-22T23:25:18.952 DEBUG:teuthology.orchestra.run.trial073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i f --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2026-02-22T23:25:19.033 DEBUG:teuthology.orchestra.run.trial073:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-f 2026-02-22T23:25:19.098 DEBUG:teuthology.orchestra.run.trial073:> sudo mkdir -p /var/lib/ceph/mon/ceph-g 2026-02-22T23:25:19.162 DEBUG:teuthology.orchestra.run.trial073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i g --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2026-02-22T23:25:19.243 DEBUG:teuthology.orchestra.run.trial073:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-g 2026-02-22T23:25:19.308 DEBUG:teuthology.orchestra.run.trial073:> sudo mkdir -p /var/lib/ceph/mon/ceph-h 2026-02-22T23:25:19.371 DEBUG:teuthology.orchestra.run.trial073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i h --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2026-02-22T23:25:19.452 DEBUG:teuthology.orchestra.run.trial073:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-h 2026-02-22T23:25:19.517 DEBUG:teuthology.orchestra.run.trial073:> sudo mkdir -p /var/lib/ceph/mon/ceph-i 2026-02-22T23:25:19.580 DEBUG:teuthology.orchestra.run.trial073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i i --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2026-02-22T23:25:19.661 DEBUG:teuthology.orchestra.run.trial073:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-i 2026-02-22T23:25:19.725 DEBUG:teuthology.orchestra.run.trial045:> rm -- /home/ubuntu/cephtest/ceph.monmap 2026-02-22T23:25:19.727 DEBUG:teuthology.orchestra.run.trial073:> rm -- /home/ubuntu/cephtest/ceph.monmap 2026-02-22T23:25:19.781 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2026-02-22T23:25:19.782 INFO:tasks.ceph.mon.a:Restarting daemon 2026-02-22T23:25:19.782 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2026-02-22T23:25:19.785 INFO:tasks.ceph.mon.a:Started 2026-02-22T23:25:19.785 INFO:tasks.ceph.mon.b:Restarting daemon 2026-02-22T23:25:19.785 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2026-02-22T23:25:19.788 INFO:tasks.ceph.mon.b:Started 2026-02-22T23:25:19.788 INFO:tasks.ceph.mon.c:Restarting daemon 2026-02-22T23:25:19.788 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2026-02-22T23:25:19.790 INFO:tasks.ceph.mon.c:Started 2026-02-22T23:25:19.790 INFO:tasks.ceph.mon.d:Restarting daemon 2026-02-22T23:25:19.790 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i d 2026-02-22T23:25:19.792 INFO:tasks.ceph.mon.d:Started 2026-02-22T23:25:19.792 INFO:tasks.ceph.mon.e:Restarting daemon 2026-02-22T23:25:19.793 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i e 2026-02-22T23:25:19.795 INFO:tasks.ceph.mon.e:Started 2026-02-22T23:25:19.795 INFO:tasks.ceph.mon.f:Restarting daemon 2026-02-22T23:25:19.795 DEBUG:teuthology.orchestra.run.trial073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i f 2026-02-22T23:25:19.824 INFO:tasks.ceph.mon.f:Started 2026-02-22T23:25:19.824 INFO:tasks.ceph.mon.g:Restarting daemon 2026-02-22T23:25:19.824 DEBUG:teuthology.orchestra.run.trial073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i g 2026-02-22T23:25:19.826 INFO:tasks.ceph.mon.g:Started 2026-02-22T23:25:19.827 INFO:tasks.ceph.mon.h:Restarting daemon 2026-02-22T23:25:19.827 DEBUG:teuthology.orchestra.run.trial073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i h 2026-02-22T23:25:19.829 INFO:tasks.ceph.mon.h:Started 2026-02-22T23:25:19.829 INFO:tasks.ceph.mon.i:Restarting daemon 2026-02-22T23:25:19.829 DEBUG:teuthology.orchestra.run.trial073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i i 2026-02-22T23:25:19.831 INFO:tasks.ceph.mon.i:Started 2026-02-22T23:25:19.832 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2026-02-22T23:25:19.832 INFO:tasks.ceph.mgr.x:Restarting daemon 2026-02-22T23:25:19.832 DEBUG:teuthology.orchestra.run.trial073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2026-02-22T23:25:19.834 INFO:tasks.ceph.mgr.x:Started 2026-02-22T23:25:19.834 INFO:tasks.ceph:Setting crush tunables to default 2026-02-22T23:25:19.835 DEBUG:teuthology.orchestra.run.trial045:> sudo ceph --cluster ceph osd crush tunables default 2026-02-22T23:25:19.901 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:19.901+0000 7f7c67d96640 10 monclient: get_monmap_and_config 2026-02-22T23:25:19.902 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:19.901+0000 7f7c67d96640 10 monclient: build_initial_monmap 2026-02-22T23:25:19.902 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:19.901+0000 7f7c67d96640 10 monclient: monmap: 2026-02-22T23:25:19.902 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-22T23:25:19.902 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:19.902 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:25:19.902320+0000 2026-02-22T23:25:19.902 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:25:19.902320+0000 2026-02-22T23:25:19.902 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-22T23:25:19.902 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:19.902 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-22T23:25:19.902 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.noname-f 2026-02-22T23:25:19.902 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.noname-b 2026-02-22T23:25:19.902 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.noname-g 2026-02-22T23:25:19.902 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.noname-c 2026-02-22T23:25:19.902 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.noname-h 2026-02-22T23:25:19.902 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.noname-d 2026-02-22T23:25:19.902 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.noname-i 2026-02-22T23:25:19.902 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.noname-e 2026-02-22T23:25:19.902 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:19.903 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:19.901+0000 7f7c67d96640 1 Processor -- start 2026-02-22T23:25:19.903 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:19.901+0000 7f7c67d96640 1 -- start start 2026-02-22T23:25:19.903 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:19.901+0000 7f7c67d96640 10 monclient: init 2026-02-22T23:25:19.903 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:19.901+0000 7f7c67d96640 10 monclient: _reopen_session rank -1 2026-02-22T23:25:19.903 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:19.901+0000 7f7c67d96640 10 monclient: _add_conns ranks=[0,2,4,3,1,5,7,8,6] 2026-02-22T23:25:19.903 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:19.901+0000 7f7c67d96640 10 monclient(hunting): picked mon.noname-a con 0x7f7c600a5d90 addr v1:10.20.193.45:6789/0 2026-02-22T23:25:19.903 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:19.901+0000 7f7c67d96640 10 monclient(hunting): picked mon.noname-b con 0x7f7c600a2150 addr v1:10.20.193.45:6790/0 2026-02-22T23:25:19.903 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:19.901+0000 7f7c67d96640 10 monclient(hunting): picked mon.noname-c con 0x7f7c600a6880 addr v1:10.20.193.45:6791/0 2026-02-22T23:25:19.903 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:19.901+0000 7f7c67d96640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7c600a8cb0 con 0x7f7c600a5d90 2026-02-22T23:25:19.903 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:19.901+0000 7f7c67d96640 1 -- --> v1:10.20.193.45:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7c600a3f50 con 0x7f7c600a2150 2026-02-22T23:25:19.903 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:19.901+0000 7f7c67d96640 1 -- --> v1:10.20.193.45:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7c600a3570 con 0x7f7c600a6880 2026-02-22T23:25:19.903 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:19.901+0000 7f7c67d96640 10 monclient(hunting): _renew_subs 2026-02-22T23:25:19.903 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:19.901+0000 7f7c67d96640 10 monclient(hunting): authenticate will time out at 651.518858s 2026-02-22T23:25:19.903 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:19.901+0000 7f7c65b0b640 1 --1- >> v1:10.20.193.45:6789/0 conn(0x7f7c600a5d90 0x7f7c600a6170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.45:6789/0 says I am v1:10.20.193.45:53322/0 (socket says 10.20.193.45:53322) 2026-02-22T23:25:19.903 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:19.901+0000 7f7c65b0b640 1 -- 10.20.193.45:0/368512 learned_addr learned my addr 10.20.193.45:0/368512 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-22T23:25:19.903 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:19.901+0000 7f7c6530a640 1 --1- 10.20.193.45:0/368512 >> v1:10.20.193.45:6790/0 conn(0x7f7c600a2150 0x7f7c6013e010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.45:6790/0 says I am v1:10.20.193.45:39702/0 (socket says 10.20.193.45:39702) 2026-02-22T23:25:22.903 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:22.902+0000 7f7c4f7fe640 10 monclient(hunting): tick 2026-02-22T23:25:22.904 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:22.902+0000 7f7c4f7fe640 10 monclient(hunting): _check_auth_tickets 2026-02-22T23:25:22.904 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:22.902+0000 7f7c4f7fe640 1 monclient(hunting): continuing hunt 2026-02-22T23:25:22.904 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:22.902+0000 7f7c4f7fe640 10 monclient(hunting): _reopen_session rank -1 2026-02-22T23:25:22.904 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:22.902+0000 7f7c4f7fe640 1 -- 10.20.193.45:0/368512 >> v1:10.20.193.45:6791/0 conn(0x7f7c600a6880 legacy=0x7f7c60141740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:22.904 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:22.902+0000 7f7c4f7fe640 1 -- 10.20.193.45:0/368512 >> v1:10.20.193.45:6790/0 conn(0x7f7c600a2150 legacy=0x7f7c6013e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:22.904 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:22.902+0000 7f7c4f7fe640 1 -- 10.20.193.45:0/368512 >> v1:10.20.193.45:6789/0 conn(0x7f7c600a5d90 legacy=0x7f7c600a6170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:22.904 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:22.902+0000 7f7c4f7fe640 10 monclient: _add_conns ranks=[1,6,5,3,7,8] 2026-02-22T23:25:22.904 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:22.902+0000 7f7c4f7fe640 10 monclient(hunting): picked mon.noname-f con 0x7f7c440038e0 addr v1:10.20.193.73:6789/0 2026-02-22T23:25:22.905 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:22.902+0000 7f7c4f7fe640 10 monclient(hunting): picked mon.noname-d con 0x7f7c44007510 addr v1:10.20.193.45:6792/0 2026-02-22T23:25:22.905 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:22.902+0000 7f7c4f7fe640 10 monclient(hunting): picked mon.noname-h con 0x7f7c4400b2a0 addr v1:10.20.193.73:6791/0 2026-02-22T23:25:22.905 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:22.902+0000 7f7c4f7fe640 1 -- 10.20.193.45:0/368512 --> v1:10.20.193.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7c600a6f60 con 0x7f7c440038e0 2026-02-22T23:25:22.905 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:22.902+0000 7f7c4f7fe640 1 -- 10.20.193.45:0/368512 --> v1:10.20.193.73:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7c440100e0 con 0x7f7c4400b2a0 2026-02-22T23:25:22.905 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:22.902+0000 7f7c4f7fe640 1 -- 10.20.193.45:0/368512 --> v1:10.20.193.45:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7c44011380 con 0x7f7c44007510 2026-02-22T23:25:22.905 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:22.902+0000 7f7c4f7fe640 10 monclient(hunting): _renew_subs 2026-02-22T23:25:25.076 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:25.069+0000 7f7c64b09640 1 -- 10.20.193.45:0/368512 <== mon.1 v1:10.20.193.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1062687098 0 0) 0x7f7c600a6f60 con 0x7f7c440038e0 2026-02-22T23:25:25.076 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:25.069+0000 7f7c64b09640 10 monclient(hunting): _negotiate 2026-02-22T23:25:25.076 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:25.069+0000 7f7c64b09640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:25.077 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:25.069+0000 7f7c64b09640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:25.077 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:25.069+0000 7f7c64b09640 10 monclient(hunting): my global_id is 4105 2026-02-22T23:25:25.077 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:25.069+0000 7f7c64b09640 1 -- 10.20.193.45:0/368512 --> v1:10.20.193.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7c48003620 con 0x7f7c440038e0 2026-02-22T23:25:25.077 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:25.069+0000 7f7c64b09640 1 -- 10.20.193.45:0/368512 <== mon.5 v1:10.20.193.73:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3780365319 0 0) 0x7f7c440100e0 con 0x7f7c4400b2a0 2026-02-22T23:25:25.077 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:25.069+0000 7f7c64b09640 10 monclient(hunting): _negotiate 2026-02-22T23:25:25.077 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:25.069+0000 7f7c64b09640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:25.077 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:25.069+0000 7f7c64b09640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:25.077 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:25.069+0000 7f7c64b09640 10 monclient(hunting): my global_id is 4118 2026-02-22T23:25:25.077 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:25.069+0000 7f7c64b09640 1 -- 10.20.193.45:0/368512 --> v1:10.20.193.73:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7c600a6f60 con 0x7f7c4400b2a0 2026-02-22T23:25:25.077 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:25.070+0000 7f7c64b09640 1 -- 10.20.193.45:0/368512 <== mon.1 v1:10.20.193.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1729099225 0 0) 0x7f7c48003620 con 0x7f7c440038e0 2026-02-22T23:25:25.077 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:25.070+0000 7f7c64b09640 1 -- 10.20.193.45:0/368512 >> v1:10.20.193.45:6792/0 conn(0x7f7c44007510 legacy=0x7f7c440099d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:25.077 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:25.070+0000 7f7c64b09640 1 -- 10.20.193.45:0/368512 >> v1:10.20.193.73:6791/0 conn(0x7f7c4400b2a0 legacy=0x7f7c4400d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:25.078 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:25.070+0000 7f7c64b09640 10 monclient: _finish_hunting 0 2026-02-22T23:25:25.078 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:25.070+0000 7f7c64b09640 1 monclient: found mon.noname-f 2026-02-22T23:25:25.078 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:25.070+0000 7f7c64b09640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T23:25:25.078 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:25.070+0000 7f7c64b09640 10 monclient: _send_mon_message to mon.noname-f at v1:10.20.193.73:6789/0 2026-02-22T23:25:25.078 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:25.070+0000 7f7c6630c640 1 -- 10.20.193.45:0/368512 reap_dead start 2026-02-22T23:25:25.078 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:25.070+0000 7f7c64b09640 1 -- 10.20.193.45:0/368512 --> v1:10.20.193.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c44012680 con 0x7f7c440038e0 2026-02-22T23:25:25.078 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:25.070+0000 7f7c64b09640 10 monclient: _finish_auth 0 2026-02-22T23:25:25.078 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:25.070+0000 7f7c64b09640 10 monclient: _check_auth_tickets 2026-02-22T23:25:25.078 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:25.070+0000 7f7c64b09640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T23:25:25.078 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:25.070+0000 7f7c64b09640 1 -- 10.20.193.45:0/368512 <== mon.1 v1:10.20.193.73:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f7c50003080 con 0x7f7c440038e0 2026-02-22T23:25:25.078 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:25.070+0000 7f7c64b09640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:25:25.078 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:25.070+0000 7f7c64b09640 10 monclient: got monmap 1 from mon.noname-f (according to old e1) 2026-02-22T23:25:25.078 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:25.070+0000 7f7c64b09640 10 monclient: dump: 2026-02-22T23:25:25.078 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:25.079 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:25.079 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:25.079 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:25.079 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:25.079 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:25.079 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:25.079 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:25.079 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:25.079 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:25.079 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:25.079 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:25.079 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:25.079 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:25.079 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:25.080 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:25.080 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:25.070+0000 7f7c67d96640 5 monclient: authenticate success, global_id 4105 2026-02-22T23:25:25.080 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:25.070+0000 7f7c67d96640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-22T23:25:25.080 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:25.070+0000 7f7c64b09640 1 -- 10.20.193.45:0/368512 <== mon.1 v1:10.20.193.73:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7c50003290 con 0x7f7c440038e0 2026-02-22T23:25:25.080 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:25.070+0000 7f7c64b09640 10 monclient: handle_config config(0 keys) 2026-02-22T23:25:25.080 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:25.070+0000 7f7c64b09640 1 -- 10.20.193.45:0/368512 <== mon.1 v1:10.20.193.73:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f7c50004ce0 con 0x7f7c440038e0 2026-02-22T23:25:25.080 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:25.070+0000 7f7c64b09640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:25:25.080 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:25.070+0000 7f7c64b09640 10 monclient: got monmap 1 from mon.f (according to old e1) 2026-02-22T23:25:25.080 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:25.070+0000 7f7c64b09640 10 monclient: dump: 2026-02-22T23:25:25.080 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:25.080 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:25.080 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:25.080 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:25.080 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:25.080 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:25.081 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:25.081 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:25.081 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:25.081 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:25.081 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:25.081 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:25.081 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:25.081 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:25.081 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:25.081 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:25.081 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:25.070+0000 7f7c67d96640 10 monclient: get_monmap_and_config success 2026-02-22T23:25:25.081 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:25.070+0000 7f7c67d96640 4 set_mon_vals no callback set 2026-02-22T23:25:25.081 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:25.070+0000 7f7c67d96640 10 monclient: shutdown 2026-02-22T23:25:25.081 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:25.070+0000 7f7c67d96640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T23:25:25.081 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:25.070+0000 7f7c67d96640 1 -- 10.20.193.45:0/368512 >> v1:10.20.193.73:6789/0 conn(0x7f7c440038e0 legacy=0x7f7c44005cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:25.082 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:25.070+0000 7f7c67d96640 1 -- 10.20.193.45:0/368512 shutdown_connections 2026-02-22T23:25:25.082 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:25.070+0000 7f7c67d96640 1 -- 10.20.193.45:0/368512 >> 10.20.193.45:0/368512 conn(0x7f7c600ab9c0 msgr2=0x7f7c600a7e90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:25:25.082 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:25.070+0000 7f7c67d96640 1 -- 10.20.193.45:0/368512 shutdown_connections 2026-02-22T23:25:25.082 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:25.070+0000 7f7c67d96640 1 -- 10.20.193.45:0/368512 wait complete. 2026-02-22T23:25:25.082 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:25.070+0000 7f7c67d96640 10 monclient: build_initial_monmap 2026-02-22T23:25:25.082 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:25.070+0000 7f7c67d96640 10 monclient: monmap: 2026-02-22T23:25:25.082 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-22T23:25:25.082 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T23:25:25.082 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-22T23:25:25.082 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-22T23:25:25.082 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-22T23:25:25.082 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-22T23:25:25.082 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-22T23:25:25.082 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.noname-f 2026-02-22T23:25:25.082 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.noname-b 2026-02-22T23:25:25.082 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.noname-g 2026-02-22T23:25:25.082 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.noname-c 2026-02-22T23:25:25.083 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.noname-h 2026-02-22T23:25:25.083 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.noname-d 2026-02-22T23:25:25.083 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.noname-i 2026-02-22T23:25:25.083 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.noname-e 2026-02-22T23:25:25.083 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:25.083 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:25.071+0000 7f7c67d96640 1 Processor -- start 2026-02-22T23:25:25.083 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:25.071+0000 7f7c67d96640 1 -- start start 2026-02-22T23:25:25.083 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:25.071+0000 7f7c67d96640 10 monclient: init 2026-02-22T23:25:25.083 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:25.071+0000 7f7c67d96640 10 monclient: _reopen_session rank -1 2026-02-22T23:25:25.083 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:25.071+0000 7f7c67d96640 10 monclient: _add_conns ranks=[6,0,3,1,8,4,5,2,7] 2026-02-22T23:25:25.083 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:25.071+0000 7f7c67d96640 10 monclient(hunting): picked mon.noname-d con 0x7f7c440038e0 addr v1:10.20.193.45:6792/0 2026-02-22T23:25:25.083 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:25.071+0000 7f7c67d96640 10 monclient(hunting): picked mon.noname-a con 0x7f7c601d0590 addr v1:10.20.193.45:6789/0 2026-02-22T23:25:25.083 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:25.071+0000 7f7c67d96640 10 monclient(hunting): picked mon.noname-g con 0x7f7c601d09d0 addr v1:10.20.193.73:6790/0 2026-02-22T23:25:25.083 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:25.071+0000 7f7c67d96640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7c60124b70 con 0x7f7c601d0590 2026-02-22T23:25:25.083 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:25.071+0000 7f7c67d96640 1 -- --> v1:10.20.193.73:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7c600aa470 con 0x7f7c601d09d0 2026-02-22T23:25:25.083 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:25.071+0000 7f7c67d96640 1 -- --> v1:10.20.193.45:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7c60126e60 con 0x7f7c440038e0 2026-02-22T23:25:25.083 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:25.071+0000 7f7c67d96640 10 monclient(hunting): _renew_subs 2026-02-22T23:25:25.084 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:25.071+0000 7f7c67d96640 10 monclient(hunting): authenticate will time out at 656.688495s 2026-02-22T23:25:25.084 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:25.071+0000 7f7c6530a640 1 --1- >> v1:10.20.193.45:6789/0 conn(0x7f7c601d0590 0x7f7c601d50c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.45:6789/0 says I am v1:10.20.193.45:60228/0 (socket says 10.20.193.45:60228) 2026-02-22T23:25:25.084 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:25.071+0000 7f7c65b0b640 1 --1- >> v1:10.20.193.45:6792/0 conn(0x7f7c440038e0 0x7f7c601cfe80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.45:6792/0 says I am v1:10.20.193.45:46746/0 (socket says 10.20.193.45:46746) 2026-02-22T23:25:25.084 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:25.071+0000 7f7c6530a640 1 -- 10.20.193.45:0/4021995105 learned_addr learned my addr 10.20.193.45:0/4021995105 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-22T23:25:25.084 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:25.071+0000 7f7c4e7fc640 1 -- 10.20.193.45:0/4021995105 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3190212703 0 0) 0x7f7c60124b70 con 0x7f7c601d0590 2026-02-22T23:25:25.084 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:25.071+0000 7f7c4e7fc640 10 monclient(hunting): _negotiate 2026-02-22T23:25:25.084 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:25.071+0000 7f7c4e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:25.084 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:25.071+0000 7f7c4e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:25.084 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:25.071+0000 7f7c4e7fc640 10 monclient(hunting): my global_id is 4104 2026-02-22T23:25:25.084 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:25.071+0000 7f7c4e7fc640 1 -- 10.20.193.45:0/4021995105 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7c30003620 con 0x7f7c601d0590 2026-02-22T23:25:25.084 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:25.071+0000 7f7c4e7fc640 1 -- 10.20.193.45:0/4021995105 <== mon.0 v1:10.20.193.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 852254985 0 0) 0x7f7c30003620 con 0x7f7c601d0590 2026-02-22T23:25:25.084 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:25.071+0000 7f7c4e7fc640 1 -- 10.20.193.45:0/4021995105 --> v1:10.20.193.45:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7c60124b70 con 0x7f7c601d0590 2026-02-22T23:25:25.084 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:25.071+0000 7f7c4e7fc640 1 -- 10.20.193.45:0/4021995105 <== mon.0 v1:10.20.193.45:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f7c54003230 con 0x7f7c601d0590 2026-02-22T23:25:25.084 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:25.071+0000 7f7c4e7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-22T23:25:25.084 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:25.071+0000 7f7c4e7fc640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T23:25:25.084 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:25.071+0000 7f7c4e7fc640 10 monclient(hunting): dump: 2026-02-22T23:25:25.085 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:25.085 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:25.085 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:25.085 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:25.085 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:25.085 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:25.085 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:25.085 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:25.085 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:25.085 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:25.085 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:25.085 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:25.085 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:25.085 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:25.085 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:25.085 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:25.085 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:25.071+0000 7f7c4e7fc640 10 monclient(hunting): _finish_auth 0 2026-02-22T23:25:25.085 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:25.072+0000 7f7c4e7fc640 1 -- 10.20.193.45:0/4021995105 <== mon.6 v1:10.20.193.45:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3471913162 0 0) 0x7f7c60126e60 con 0x7f7c440038e0 2026-02-22T23:25:25.086 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:25.072+0000 7f7c4e7fc640 10 monclient(hunting): _negotiate 2026-02-22T23:25:25.086 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:25.072+0000 7f7c4e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:25.086 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:25.072+0000 7f7c4e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:25.086 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:25.072+0000 7f7c4e7fc640 10 monclient(hunting): my global_id is 4119 2026-02-22T23:25:25.086 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:25.072+0000 7f7c4e7fc640 1 -- 10.20.193.45:0/4021995105 --> v1:10.20.193.45:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7c30003620 con 0x7f7c440038e0 2026-02-22T23:25:25.086 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:25.072+0000 7f7c4e7fc640 1 -- 10.20.193.45:0/4021995105 <== mon.0 v1:10.20.193.45:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 966833922 0 0) 0x7f7c60124b70 con 0x7f7c601d0590 2026-02-22T23:25:25.086 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:25.072+0000 7f7c4e7fc640 1 -- 10.20.193.45:0/4021995105 >> v1:10.20.193.45:6792/0 conn(0x7f7c440038e0 legacy=0x7f7c601cfe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:25.086 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:25.072+0000 7f7c4e7fc640 1 -- 10.20.193.45:0/4021995105 >> v1:10.20.193.73:6790/0 conn(0x7f7c601d09d0 legacy=0x7f7c601d87f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:25.086 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:25.072+0000 7f7c4e7fc640 10 monclient: _finish_hunting 0 2026-02-22T23:25:25.086 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:25.072+0000 7f7c4e7fc640 1 monclient: found mon.a 2026-02-22T23:25:25.086 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:25.072+0000 7f7c4e7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T23:25:25.086 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:25.072+0000 7f7c4e7fc640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-22T23:25:25.086 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:25.072+0000 7f7c4e7fc640 1 -- 10.20.193.45:0/4021995105 --> v1:10.20.193.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c601265c0 con 0x7f7c601d0590 2026-02-22T23:25:25.086 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:25.072+0000 7f7c4e7fc640 10 monclient: _finish_auth 0 2026-02-22T23:25:25.086 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:25.072+0000 7f7c4e7fc640 10 monclient: _check_auth_tickets 2026-02-22T23:25:25.086 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:25.072+0000 7f7c4e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T23:25:25.086 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:25.072+0000 7f7c67d96640 5 monclient: authenticate success, global_id 4104 2026-02-22T23:25:25.087 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:25.072+0000 7f7c67d96640 10 monclient: _renew_subs 2026-02-22T23:25:25.087 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:25.072+0000 7f7c67d96640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-22T23:25:25.087 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:25.072+0000 7f7c67d96640 1 -- 10.20.193.45:0/4021995105 --> v1:10.20.193.45:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f7c60125420 con 0x7f7c601d0590 2026-02-22T23:25:25.087 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:25.072+0000 7f7c67d96640 10 monclient: _renew_subs 2026-02-22T23:25:25.087 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:25.072+0000 7f7c67d96640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-22T23:25:25.087 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:25.072+0000 7f7c67d96640 1 -- 10.20.193.45:0/4021995105 --> v1:10.20.193.45:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f7c601258f0 con 0x7f7c601d0590 2026-02-22T23:25:25.087 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:25.072+0000 7f7c4e7fc640 1 -- 10.20.193.45:0/4021995105 <== mon.0 v1:10.20.193.45:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7c54004b90 con 0x7f7c601d0590 2026-02-22T23:25:25.087 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:25.072+0000 7f7c4e7fc640 10 monclient: handle_config config(0 keys) 2026-02-22T23:25:25.087 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:25.072+0000 7f7c4e7fc640 1 -- 10.20.193.45:0/4021995105 <== mon.0 v1:10.20.193.45:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f7c54005140 con 0x7f7c601d0590 2026-02-22T23:25:25.087 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:25.072+0000 7f7c4e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:25:25.087 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:25.072+0000 7f7c4e7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T23:25:25.087 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:25.072+0000 7f7c4ffff640 4 set_mon_vals no callback set 2026-02-22T23:25:25.087 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:25.072+0000 7f7c4e7fc640 10 monclient: dump: 2026-02-22T23:25:25.087 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:25.087 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:25.087 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:25.087 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:25.087 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:25.088 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:25.088 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:25.088 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:25.088 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:25.088 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:25.088 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:25.088 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:25.088 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:25.088 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:25.088 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:25.088 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:25.088 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:25.072+0000 7f7c4e7fc640 1 -- 10.20.193.45:0/4021995105 <== mon.0 v1:10.20.193.45:6789/0 7 ==== mgrmap(e 1) ==== 811+0+0 (unknown 4133961934 0 0) 0x7f7c54005910 con 0x7f7c601d0590 2026-02-22T23:25:25.088 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:25.072+0000 7f7c4e7fc640 1 -- 10.20.193.45:0/4021995105 <== mon.0 v1:10.20.193.45:6789/0 8 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (unknown 1310454537 0 0) 0x7f7c54006bf0 con 0x7f7c601d0590 2026-02-22T23:25:25.088 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:25.073+0000 7f7c67d96640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T23:25:25.089 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:25.073+0000 7f7c67d96640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T23:25:25.089 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:25.073+0000 7f7c67d96640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-22T23:25:25.089 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:25.073+0000 7f7c67d96640 1 -- 10.20.193.45:0/4021995105 --> v1:10.20.193.45:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c600008d0 con 0x7f7c601d0590 2026-02-22T23:25:25.089 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:25.074+0000 7f7c4e7fc640 1 -- 10.20.193.45:0/4021995105 <== mon.0 v1:10.20.193.45:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75931 (unknown 1092875540 0 4127419540) 0x7f7c600a3f50 con 0x7f7c601d0590 2026-02-22T23:25:25.089 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:25.074+0000 7f7c4e7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T23:25:25.089 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:25.074+0000 7f7c4e7fc640 10 monclient: _finish_command 1 = system:0 2026-02-22T23:25:25.106 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:25.104+0000 7f7c67d96640 10 start_mon_command cmd=[{"prefix": "osd crush tunables", "profile": "default"}] 2026-02-22T23:25:25.106 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:25.104+0000 7f7c67d96640 10 monclient: _send_command 2 [{"prefix": "osd crush tunables", "profile": "default"}] 2026-02-22T23:25:25.106 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:25.104+0000 7f7c67d96640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-22T23:25:25.106 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:25.104+0000 7f7c67d96640 1 -- 10.20.193.45:0/4021995105 --> v1:10.20.193.45:6789/0 -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f7c60127280 con 0x7f7c601d0590 2026-02-22T23:25:25.107 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:25.105+0000 7f7c4e7fc640 1 -- 10.20.193.45:0/4021995105 <== mon.0 v1:10.20.193.45:6789/0 10 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (unknown 2277712955 0 0) 0x7f7c54005c30 con 0x7f7c601d0590 2026-02-22T23:25:25.107 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:25.106+0000 7f7c4e7fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush tunables", "profile": "default"}] 2026-02-22T23:25:25.107 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:25.106+0000 7f7c4e7fc640 10 monclient: _finish_command 2 = system:0 adjusted tunables profile to default 2026-02-22T23:25:25.107 INFO:teuthology.orchestra.run.trial045.stderr:adjusted tunables profile to default 2026-02-22T23:25:25.108 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:25.106+0000 7f7c67d96640 10 monclient: shutdown 2026-02-22T23:25:25.108 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:25.106+0000 7f7c67d96640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T23:25:25.108 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:25.106+0000 7f7c67d96640 1 -- 10.20.193.45:0/4021995105 >> v1:10.20.193.45:6789/0 conn(0x7f7c601d0590 legacy=0x7f7c601d50c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:25.108 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:25.106+0000 7f7c67d96640 1 -- 10.20.193.45:0/4021995105 shutdown_connections 2026-02-22T23:25:25.108 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:25.106+0000 7f7c67d96640 1 -- 10.20.193.45:0/4021995105 >> 10.20.193.45:0/4021995105 conn(0x7f7c600ab9c0 msgr2=0x7f7c600a9260 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:25:25.108 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:25.106+0000 7f7c67d96640 1 -- 10.20.193.45:0/4021995105 shutdown_connections 2026-02-22T23:25:25.108 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:25.106+0000 7f7c67d96640 1 -- 10.20.193.45:0/4021995105 wait complete. 2026-02-22T23:25:25.115 INFO:tasks.ceph:check_enable_crimson: False 2026-02-22T23:25:25.116 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2026-02-22T23:25:25.116 DEBUG:teuthology.orchestra.run.trial045:> set -ex 2026-02-22T23:25:25.116 DEBUG:teuthology.orchestra.run.trial045:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2026-02-22T23:25:25.141 DEBUG:teuthology.orchestra.run.trial045:> set -ex 2026-02-22T23:25:25.142 DEBUG:teuthology.orchestra.run.trial045:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2026-02-22T23:25:25.206 DEBUG:teuthology.orchestra.run.trial045:> set -ex 2026-02-22T23:25:25.206 DEBUG:teuthology.orchestra.run.trial045:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2026-02-22T23:25:25.271 DEBUG:teuthology.orchestra.run.trial073:> set -ex 2026-02-22T23:25:25.271 DEBUG:teuthology.orchestra.run.trial073:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2026-02-22T23:25:25.296 DEBUG:teuthology.orchestra.run.trial073:> set -ex 2026-02-22T23:25:25.296 DEBUG:teuthology.orchestra.run.trial073:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2026-02-22T23:25:25.359 DEBUG:teuthology.orchestra.run.trial073:> set -ex 2026-02-22T23:25:25.359 DEBUG:teuthology.orchestra.run.trial073:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2026-02-22T23:25:25.423 DEBUG:teuthology.orchestra.run.trial073:> sudo ceph --cluster ceph osd new ef9d15a7-661e-40c5-a418-7f794c0975b7 0 2026-02-22T23:25:25.424 INFO:tasks.ceph.mgr.x.trial073.stderr:2026-02-22T23:25:25.421+0000 7f413a1cd140 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2026-02-22T23:25:25.534 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.525+0000 7f88b0457640 10 monclient: get_monmap_and_config 2026-02-22T23:25:25.534 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.525+0000 7f88b0457640 10 monclient: build_initial_monmap 2026-02-22T23:25:25.535 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.525+0000 7f88b0457640 10 monclient: monmap: 2026-02-22T23:25:25.535 INFO:teuthology.orchestra.run.trial073.stderr:epoch 0 2026-02-22T23:25:25.535 INFO:teuthology.orchestra.run.trial073.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:25.535 INFO:teuthology.orchestra.run.trial073.stderr:last_changed 2026-02-22T23:25:25.526787+0000 2026-02-22T23:25:25.535 INFO:teuthology.orchestra.run.trial073.stderr:created 2026-02-22T23:25:25.526787+0000 2026-02-22T23:25:25.535 INFO:teuthology.orchestra.run.trial073.stderr:min_mon_release 0 (unknown) 2026-02-22T23:25:25.535 INFO:teuthology.orchestra.run.trial073.stderr:election_strategy: 3 2026-02-22T23:25:25.535 INFO:teuthology.orchestra.run.trial073.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-22T23:25:25.535 INFO:teuthology.orchestra.run.trial073.stderr:1: v1:10.20.193.73:6789/0 mon.noname-f 2026-02-22T23:25:25.535 INFO:teuthology.orchestra.run.trial073.stderr:2: v1:10.20.193.45:6790/0 mon.noname-b 2026-02-22T23:25:25.535 INFO:teuthology.orchestra.run.trial073.stderr:3: v1:10.20.193.73:6790/0 mon.noname-g 2026-02-22T23:25:25.535 INFO:teuthology.orchestra.run.trial073.stderr:4: v1:10.20.193.45:6791/0 mon.noname-c 2026-02-22T23:25:25.536 INFO:teuthology.orchestra.run.trial073.stderr:5: v1:10.20.193.73:6791/0 mon.noname-h 2026-02-22T23:25:25.536 INFO:teuthology.orchestra.run.trial073.stderr:6: v1:10.20.193.45:6792/0 mon.noname-d 2026-02-22T23:25:25.536 INFO:teuthology.orchestra.run.trial073.stderr:7: v1:10.20.193.73:6792/0 mon.noname-i 2026-02-22T23:25:25.536 INFO:teuthology.orchestra.run.trial073.stderr:8: v1:10.20.193.45:6793/0 mon.noname-e 2026-02-22T23:25:25.536 INFO:teuthology.orchestra.run.trial073.stderr: 2026-02-22T23:25:25.536 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.526+0000 7f88b0457640 1 Processor -- start 2026-02-22T23:25:25.536 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.526+0000 7f88b0457640 1 -- start start 2026-02-22T23:25:25.536 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.526+0000 7f88b0457640 10 monclient: init 2026-02-22T23:25:25.536 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.526+0000 7f88b0457640 10 monclient: _reopen_session rank -1 2026-02-22T23:25:25.536 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.526+0000 7f88b0457640 10 monclient: _add_conns ranks=[1,6,7,4,5,3,0,8,2] 2026-02-22T23:25:25.536 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.526+0000 7f88b0457640 10 monclient(hunting): picked mon.noname-f con 0x7f88a80a5e00 addr v1:10.20.193.73:6789/0 2026-02-22T23:25:25.536 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.526+0000 7f88b0457640 10 monclient(hunting): picked mon.noname-d con 0x7f88a80a68f0 addr v1:10.20.193.45:6792/0 2026-02-22T23:25:25.536 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.526+0000 7f88b0457640 10 monclient(hunting): picked mon.noname-i con 0x7f88a80a6d00 addr v1:10.20.193.73:6792/0 2026-02-22T23:25:25.537 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.526+0000 7f88b0457640 1 -- --> v1:10.20.193.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f88a80a2d00 con 0x7f88a80a5e00 2026-02-22T23:25:25.537 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.526+0000 7f88b0457640 1 -- --> v1:10.20.193.45:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f88a80a2fe0 con 0x7f88a80a68f0 2026-02-22T23:25:25.537 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.526+0000 7f88b0457640 1 -- --> v1:10.20.193.73:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f88a80a32c0 con 0x7f88a80a6d00 2026-02-22T23:25:25.537 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.526+0000 7f88b0457640 10 monclient(hunting): _renew_subs 2026-02-22T23:25:25.537 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.526+0000 7f88b0457640 10 monclient(hunting): authenticate will time out at 654.275562s 2026-02-22T23:25:25.537 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.526+0000 7f88ae1cc640 1 --1- >> v1:10.20.193.73:6789/0 conn(0x7f88a80a5e00 0x7f88a80a61e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.73:6789/0 says I am v1:10.20.193.73:52436/0 (socket says 10.20.193.73:52436) 2026-02-22T23:25:25.537 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.526+0000 7f88ae9cd640 1 --1- >> v1:10.20.193.73:6792/0 conn(0x7f88a80a6d00 0x7f88a81417b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.73:6792/0 says I am v1:10.20.193.73:39178/0 (socket says 10.20.193.73:39178) 2026-02-22T23:25:25.537 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.526+0000 7f88ae1cc640 1 -- 10.20.193.73:0/2968788983 learned_addr learned my addr 10.20.193.73:0/2968788983 (peer_addr_for_me v1:10.20.193.73:0/0) 2026-02-22T23:25:25.537 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.526+0000 7f88ad1ca640 1 -- 10.20.193.73:0/2968788983 <== mon.7 v1:10.20.193.73:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2809675473 0 0) 0x7f88a80a32c0 con 0x7f88a80a6d00 2026-02-22T23:25:25.537 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.526+0000 7f88ad1ca640 10 monclient(hunting): _negotiate 2026-02-22T23:25:25.537 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.526+0000 7f88ad1ca640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:25.537 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.526+0000 7f88ad1ca640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:25.538 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.526+0000 7f88ad1ca640 10 monclient(hunting): my global_id is 4120 2026-02-22T23:25:25.538 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.526+0000 7f88ad1ca640 1 -- 10.20.193.73:0/2968788983 --> v1:10.20.193.73:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8890003620 con 0x7f88a80a6d00 2026-02-22T23:25:25.538 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.526+0000 7f88ad1ca640 1 -- 10.20.193.73:0/2968788983 <== mon.1 v1:10.20.193.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3281780737 0 0) 0x7f88a80a2d00 con 0x7f88a80a5e00 2026-02-22T23:25:25.538 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.526+0000 7f88ad1ca640 10 monclient(hunting): _negotiate 2026-02-22T23:25:25.538 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.526+0000 7f88ad1ca640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:25.538 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.526+0000 7f88ad1ca640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:25.538 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.526+0000 7f88ad1ca640 10 monclient(hunting): my global_id is 4114 2026-02-22T23:25:25.538 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.526+0000 7f88ad1ca640 1 -- 10.20.193.73:0/2968788983 --> v1:10.20.193.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f88a80a32c0 con 0x7f88a80a5e00 2026-02-22T23:25:25.538 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.527+0000 7f88ad1ca640 1 -- 10.20.193.73:0/2968788983 <== mon.7 v1:10.20.193.73:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2514467385 0 0) 0x7f8890003620 con 0x7f88a80a6d00 2026-02-22T23:25:25.538 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.527+0000 7f88ad1ca640 1 -- 10.20.193.73:0/2968788983 >> v1:10.20.193.45:6792/0 conn(0x7f88a80a68f0 legacy=0x7f88a813e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T23:25:25.538 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.527+0000 7f88ad1ca640 1 -- 10.20.193.73:0/2968788983 >> v1:10.20.193.73:6789/0 conn(0x7f88a80a5e00 legacy=0x7f88a80a61e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:25.538 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.527+0000 7f88ad1ca640 10 monclient: _finish_hunting 0 2026-02-22T23:25:25.538 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.527+0000 7f88ad1ca640 1 monclient: found mon.noname-i 2026-02-22T23:25:25.539 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.527+0000 7f88ad1ca640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T23:25:25.539 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.527+0000 7f88ad1ca640 10 monclient: _send_mon_message to mon.noname-i at v1:10.20.193.73:6792/0 2026-02-22T23:25:25.539 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.527+0000 7f88ad1ca640 1 -- 10.20.193.73:0/2968788983 --> v1:10.20.193.73:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88a80a35a0 con 0x7f88a80a6d00 2026-02-22T23:25:25.539 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.527+0000 7f88ad1ca640 10 monclient: _finish_auth 0 2026-02-22T23:25:25.539 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.527+0000 7f88ad1ca640 10 monclient: _check_auth_tickets 2026-02-22T23:25:25.539 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.527+0000 7f88ad1ca640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T23:25:25.539 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.527+0000 7f88b0457640 5 monclient: authenticate success, global_id 4120 2026-02-22T23:25:25.539 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.527+0000 7f88b0457640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-22T23:25:25.539 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.527+0000 7f88ad1ca640 1 -- 10.20.193.73:0/2968788983 <== mon.7 v1:10.20.193.73:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f88a40033c0 con 0x7f88a80a6d00 2026-02-22T23:25:25.539 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.527+0000 7f88ad1ca640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:25:25.539 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.527+0000 7f88ad1ca640 10 monclient: got monmap 1 from mon.noname-i (according to old e1) 2026-02-22T23:25:25.539 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.527+0000 7f88ad1ca640 10 monclient: dump: 2026-02-22T23:25:25.539 INFO:teuthology.orchestra.run.trial073.stderr:epoch 1 2026-02-22T23:25:25.540 INFO:teuthology.orchestra.run.trial073.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:25.540 INFO:teuthology.orchestra.run.trial073.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:25.540 INFO:teuthology.orchestra.run.trial073.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:25.540 INFO:teuthology.orchestra.run.trial073.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:25.540 INFO:teuthology.orchestra.run.trial073.stderr:election_strategy: 3 2026-02-22T23:25:25.540 INFO:teuthology.orchestra.run.trial073.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:25.540 INFO:teuthology.orchestra.run.trial073.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:25.540 INFO:teuthology.orchestra.run.trial073.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:25.540 INFO:teuthology.orchestra.run.trial073.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:25.540 INFO:teuthology.orchestra.run.trial073.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:25.540 INFO:teuthology.orchestra.run.trial073.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:25.540 INFO:teuthology.orchestra.run.trial073.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:25.540 INFO:teuthology.orchestra.run.trial073.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:25.540 INFO:teuthology.orchestra.run.trial073.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:25.541 INFO:teuthology.orchestra.run.trial073.stderr: 2026-02-22T23:25:25.541 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.527+0000 7f88b0457640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-22T23:25:25.541 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.527+0000 7f88ad1ca640 1 -- 10.20.193.73:0/2968788983 <== mon.7 v1:10.20.193.73:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f88a4003560 con 0x7f88a80a6d00 2026-02-22T23:25:25.541 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.527+0000 7f88ad1ca640 10 monclient: handle_config config(0 keys) 2026-02-22T23:25:25.541 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.527+0000 7f88ad1ca640 1 -- 10.20.193.73:0/2968788983 <== mon.7 v1:10.20.193.73:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f88a4004fa0 con 0x7f88a80a6d00 2026-02-22T23:25:25.541 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.527+0000 7f88b0457640 10 monclient: get_monmap_and_config success 2026-02-22T23:25:25.541 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.527+0000 7f88b0457640 4 set_mon_vals no callback set 2026-02-22T23:25:25.541 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.527+0000 7f88ad1ca640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:25:25.541 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.527+0000 7f88ad1ca640 10 monclient: got monmap 1 from mon.i (according to old e1) 2026-02-22T23:25:25.541 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.527+0000 7f88ad1ca640 10 monclient: dump: 2026-02-22T23:25:25.541 INFO:teuthology.orchestra.run.trial073.stderr:epoch 1 2026-02-22T23:25:25.541 INFO:teuthology.orchestra.run.trial073.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:25.541 INFO:teuthology.orchestra.run.trial073.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:25.542 INFO:teuthology.orchestra.run.trial073.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:25.542 INFO:teuthology.orchestra.run.trial073.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:25.542 INFO:teuthology.orchestra.run.trial073.stderr:election_strategy: 3 2026-02-22T23:25:25.542 INFO:teuthology.orchestra.run.trial073.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:25.542 INFO:teuthology.orchestra.run.trial073.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:25.542 INFO:teuthology.orchestra.run.trial073.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:25.542 INFO:teuthology.orchestra.run.trial073.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:25.542 INFO:teuthology.orchestra.run.trial073.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:25.542 INFO:teuthology.orchestra.run.trial073.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:25.542 INFO:teuthology.orchestra.run.trial073.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:25.542 INFO:teuthology.orchestra.run.trial073.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:25.542 INFO:teuthology.orchestra.run.trial073.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:25.543 INFO:teuthology.orchestra.run.trial073.stderr: 2026-02-22T23:25:25.543 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.527+0000 7f88b0457640 10 monclient: shutdown 2026-02-22T23:25:25.543 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.527+0000 7f88b0457640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T23:25:25.543 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.527+0000 7f88b0457640 1 -- 10.20.193.73:0/2968788983 >> v1:10.20.193.73:6792/0 conn(0x7f88a80a6d00 legacy=0x7f88a81417b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:25.543 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.527+0000 7f88b0457640 1 -- 10.20.193.73:0/2968788983 shutdown_connections 2026-02-22T23:25:25.543 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.527+0000 7f88b0457640 1 -- 10.20.193.73:0/2968788983 >> 10.20.193.73:0/2968788983 conn(0x7f88a80abb50 msgr2=0x7f88a80a7f00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:25:25.543 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.527+0000 7f88b0457640 1 -- 10.20.193.73:0/2968788983 shutdown_connections 2026-02-22T23:25:25.543 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.527+0000 7f88b0457640 1 -- 10.20.193.73:0/2968788983 wait complete. 2026-02-22T23:25:25.543 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.527+0000 7f88b0457640 10 monclient: build_initial_monmap 2026-02-22T23:25:25.543 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.527+0000 7f88b0457640 10 monclient: monmap: 2026-02-22T23:25:25.543 INFO:teuthology.orchestra.run.trial073.stderr:epoch 0 2026-02-22T23:25:25.543 INFO:teuthology.orchestra.run.trial073.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T23:25:25.543 INFO:teuthology.orchestra.run.trial073.stderr:last_changed 0.000000 2026-02-22T23:25:25.544 INFO:teuthology.orchestra.run.trial073.stderr:created 0.000000 2026-02-22T23:25:25.544 INFO:teuthology.orchestra.run.trial073.stderr:min_mon_release 0 (unknown) 2026-02-22T23:25:25.544 INFO:teuthology.orchestra.run.trial073.stderr:election_strategy: 1 2026-02-22T23:25:25.544 INFO:teuthology.orchestra.run.trial073.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-22T23:25:25.544 INFO:teuthology.orchestra.run.trial073.stderr:1: v1:10.20.193.73:6789/0 mon.noname-f 2026-02-22T23:25:25.544 INFO:teuthology.orchestra.run.trial073.stderr:2: v1:10.20.193.45:6790/0 mon.noname-b 2026-02-22T23:25:25.544 INFO:teuthology.orchestra.run.trial073.stderr:3: v1:10.20.193.73:6790/0 mon.noname-g 2026-02-22T23:25:25.544 INFO:teuthology.orchestra.run.trial073.stderr:4: v1:10.20.193.45:6791/0 mon.noname-c 2026-02-22T23:25:25.544 INFO:teuthology.orchestra.run.trial073.stderr:5: v1:10.20.193.73:6791/0 mon.noname-h 2026-02-22T23:25:25.544 INFO:teuthology.orchestra.run.trial073.stderr:6: v1:10.20.193.45:6792/0 mon.noname-d 2026-02-22T23:25:25.544 INFO:teuthology.orchestra.run.trial073.stderr:7: v1:10.20.193.73:6792/0 mon.noname-i 2026-02-22T23:25:25.544 INFO:teuthology.orchestra.run.trial073.stderr:8: v1:10.20.193.45:6793/0 mon.noname-e 2026-02-22T23:25:25.544 INFO:teuthology.orchestra.run.trial073.stderr: 2026-02-22T23:25:25.544 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.527+0000 7f88b0457640 1 Processor -- start 2026-02-22T23:25:25.545 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.527+0000 7f88b0457640 1 -- start start 2026-02-22T23:25:25.545 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.527+0000 7f88b0457640 10 monclient: init 2026-02-22T23:25:25.545 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.528+0000 7f88b0457640 10 monclient: _reopen_session rank -1 2026-02-22T23:25:25.545 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.528+0000 7f88b0457640 10 monclient: _add_conns ranks=[1,0,2,8,6,4,7,5,3] 2026-02-22T23:25:25.545 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.528+0000 7f88b0457640 10 monclient(hunting): picked mon.noname-f con 0x7f88a80a5e00 addr v1:10.20.193.73:6789/0 2026-02-22T23:25:25.545 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.528+0000 7f88b0457640 10 monclient(hunting): picked mon.noname-a con 0x7f88a80a68f0 addr v1:10.20.193.45:6789/0 2026-02-22T23:25:25.545 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.528+0000 7f88b0457640 10 monclient(hunting): picked mon.noname-b con 0x7f88a80a6d00 addr v1:10.20.193.45:6790/0 2026-02-22T23:25:25.545 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.528+0000 7f88b0457640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f88a8140ff0 con 0x7f88a80a68f0 2026-02-22T23:25:25.545 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.528+0000 7f88b0457640 1 -- --> v1:10.20.193.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f88a8129250 con 0x7f88a80a5e00 2026-02-22T23:25:25.545 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.528+0000 7f88b0457640 1 -- --> v1:10.20.193.45:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f88a80aa220 con 0x7f88a80a6d00 2026-02-22T23:25:25.545 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.528+0000 7f88b0457640 10 monclient(hunting): _renew_subs 2026-02-22T23:25:25.545 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.528+0000 7f88b0457640 10 monclient(hunting): authenticate will time out at 654.277250s 2026-02-22T23:25:25.546 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.528+0000 7f88ae1cc640 1 --1- >> v1:10.20.193.73:6789/0 conn(0x7f88a80a5e00 0x7f88a8125290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.73:6789/0 says I am v1:10.20.193.73:52440/0 (socket says 10.20.193.73:52440) 2026-02-22T23:25:25.546 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.528+0000 7f88ae1cc640 1 -- 10.20.193.73:0/3687490298 learned_addr learned my addr 10.20.193.73:0/3687490298 (peer_addr_for_me v1:10.20.193.73:0/0) 2026-02-22T23:25:25.546 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.528+0000 7f888effd640 1 -- 10.20.193.73:0/3687490298 <== mon.1 v1:10.20.193.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1201100893 0 0) 0x7f88a8129250 con 0x7f88a80a5e00 2026-02-22T23:25:25.546 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.528+0000 7f888effd640 10 monclient(hunting): _negotiate 2026-02-22T23:25:25.546 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.528+0000 7f888effd640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:25.546 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.528+0000 7f888effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:25.546 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.528+0000 7f888effd640 10 monclient(hunting): my global_id is 4123 2026-02-22T23:25:25.546 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.528+0000 7f888effd640 1 -- 10.20.193.73:0/3687490298 --> v1:10.20.193.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8878003620 con 0x7f88a80a5e00 2026-02-22T23:25:25.546 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.528+0000 7f888effd640 1 -- 10.20.193.73:0/3687490298 <== mon.1 v1:10.20.193.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 627951171 0 0) 0x7f8878003620 con 0x7f88a80a5e00 2026-02-22T23:25:25.546 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.528+0000 7f888effd640 1 -- 10.20.193.73:0/3687490298 --> v1:10.20.193.73:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f88a8129250 con 0x7f88a80a5e00 2026-02-22T23:25:25.546 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.528+0000 7f888effd640 1 -- 10.20.193.73:0/3687490298 <== mon.1 v1:10.20.193.73:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f88980032e0 con 0x7f88a80a5e00 2026-02-22T23:25:25.547 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.528+0000 7f888effd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-22T23:25:25.547 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.528+0000 7f888effd640 10 monclient(hunting): got monmap 1 from mon.noname-f (according to old e1) 2026-02-22T23:25:25.547 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.528+0000 7f888effd640 10 monclient(hunting): dump: 2026-02-22T23:25:25.547 INFO:teuthology.orchestra.run.trial073.stderr:epoch 1 2026-02-22T23:25:25.547 INFO:teuthology.orchestra.run.trial073.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:25.547 INFO:teuthology.orchestra.run.trial073.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:25.547 INFO:teuthology.orchestra.run.trial073.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:25.547 INFO:teuthology.orchestra.run.trial073.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:25.547 INFO:teuthology.orchestra.run.trial073.stderr:election_strategy: 3 2026-02-22T23:25:25.547 INFO:teuthology.orchestra.run.trial073.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:25.547 INFO:teuthology.orchestra.run.trial073.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:25.547 INFO:teuthology.orchestra.run.trial073.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:25.547 INFO:teuthology.orchestra.run.trial073.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:25.548 INFO:teuthology.orchestra.run.trial073.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:25.548 INFO:teuthology.orchestra.run.trial073.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:25.548 INFO:teuthology.orchestra.run.trial073.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:25.548 INFO:teuthology.orchestra.run.trial073.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:25.548 INFO:teuthology.orchestra.run.trial073.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:25.548 INFO:teuthology.orchestra.run.trial073.stderr: 2026-02-22T23:25:25.548 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.528+0000 7f888effd640 10 monclient(hunting): _finish_auth 0 2026-02-22T23:25:25.548 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.528+0000 7f888effd640 1 -- 10.20.193.73:0/3687490298 <== mon.1 v1:10.20.193.73:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3231510852 0 0) 0x7f88a8129250 con 0x7f88a80a5e00 2026-02-22T23:25:25.548 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.528+0000 7f888effd640 1 -- 10.20.193.73:0/3687490298 >> v1:10.20.193.45:6790/0 conn(0x7f88a80a6d00 legacy=0x7f88a81d7d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:25.548 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.528+0000 7f888effd640 1 -- 10.20.193.73:0/3687490298 >> v1:10.20.193.45:6789/0 conn(0x7f88a80a68f0 legacy=0x7f88a81259a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:25.548 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.528+0000 7f888effd640 10 monclient: _finish_hunting 0 2026-02-22T23:25:25.548 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.528+0000 7f888effd640 1 monclient: found mon.f 2026-02-22T23:25:25.549 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.528+0000 7f888effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T23:25:25.549 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.528+0000 7f888effd640 10 monclient: _send_mon_message to mon.f at v1:10.20.193.73:6789/0 2026-02-22T23:25:25.549 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.528+0000 7f888effd640 1 -- 10.20.193.73:0/3687490298 --> v1:10.20.193.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88a80a9cf0 con 0x7f88a80a5e00 2026-02-22T23:25:25.549 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.528+0000 7f888effd640 10 monclient: _finish_auth 0 2026-02-22T23:25:25.549 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.528+0000 7f888effd640 10 monclient: _check_auth_tickets 2026-02-22T23:25:25.549 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.528+0000 7f888effd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T23:25:25.549 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.528+0000 7f88b0457640 5 monclient: authenticate success, global_id 4123 2026-02-22T23:25:25.549 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.528+0000 7f88b0457640 10 monclient: _renew_subs 2026-02-22T23:25:25.549 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.528+0000 7f88b0457640 10 monclient: _send_mon_message to mon.f at v1:10.20.193.73:6789/0 2026-02-22T23:25:25.549 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.528+0000 7f88b0457640 1 -- 10.20.193.73:0/3687490298 --> v1:10.20.193.73:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f88a80a1cd0 con 0x7f88a80a5e00 2026-02-22T23:25:25.549 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.528+0000 7f88b0457640 10 monclient: _renew_subs 2026-02-22T23:25:25.549 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.528+0000 7f88b0457640 10 monclient: _send_mon_message to mon.f at v1:10.20.193.73:6789/0 2026-02-22T23:25:25.549 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.528+0000 7f88b0457640 1 -- 10.20.193.73:0/3687490298 --> v1:10.20.193.73:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f88a8128c90 con 0x7f88a80a5e00 2026-02-22T23:25:25.550 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.528+0000 7f888effd640 1 -- 10.20.193.73:0/3687490298 <== mon.1 v1:10.20.193.73:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f8898004b90 con 0x7f88a80a5e00 2026-02-22T23:25:25.550 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.528+0000 7f888effd640 10 monclient: handle_config config(0 keys) 2026-02-22T23:25:25.550 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.528+0000 7f888effd640 1 -- 10.20.193.73:0/3687490298 <== mon.1 v1:10.20.193.73:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f8898005080 con 0x7f88a80a5e00 2026-02-22T23:25:25.550 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.528+0000 7f888effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:25:25.550 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.528+0000 7f88ac9c9640 4 set_mon_vals no callback set 2026-02-22T23:25:25.550 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.528+0000 7f888effd640 10 monclient: got monmap 1 from mon.f (according to old e1) 2026-02-22T23:25:25.550 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.528+0000 7f888effd640 10 monclient: dump: 2026-02-22T23:25:25.550 INFO:teuthology.orchestra.run.trial073.stderr:epoch 1 2026-02-22T23:25:25.550 INFO:teuthology.orchestra.run.trial073.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:25.550 INFO:teuthology.orchestra.run.trial073.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:25.550 INFO:teuthology.orchestra.run.trial073.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:25.550 INFO:teuthology.orchestra.run.trial073.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:25.550 INFO:teuthology.orchestra.run.trial073.stderr:election_strategy: 3 2026-02-22T23:25:25.551 INFO:teuthology.orchestra.run.trial073.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:25.551 INFO:teuthology.orchestra.run.trial073.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:25.551 INFO:teuthology.orchestra.run.trial073.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:25.551 INFO:teuthology.orchestra.run.trial073.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:25.551 INFO:teuthology.orchestra.run.trial073.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:25.551 INFO:teuthology.orchestra.run.trial073.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:25.551 INFO:teuthology.orchestra.run.trial073.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:25.551 INFO:teuthology.orchestra.run.trial073.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:25.551 INFO:teuthology.orchestra.run.trial073.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:25.551 INFO:teuthology.orchestra.run.trial073.stderr: 2026-02-22T23:25:25.551 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.528+0000 7f888effd640 1 -- 10.20.193.73:0/3687490298 <== mon.1 v1:10.20.193.73:6789/0 7 ==== mgrmap(e 1) ==== 811+0+0 (unknown 4133961934 0 0) 0x7f88980055b0 con 0x7f88a80a5e00 2026-02-22T23:25:25.551 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.528+0000 7f888effd640 1 -- 10.20.193.73:0/3687490298 <== mon.1 v1:10.20.193.73:6789/0 8 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (unknown 801092767 0 0) 0x7f8898006c70 con 0x7f88a80a5e00 2026-02-22T23:25:25.551 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.529+0000 7f88b0457640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T23:25:25.552 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.529+0000 7f88b0457640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T23:25:25.552 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.529+0000 7f88b0457640 10 monclient: _send_mon_message to mon.f at v1:10.20.193.73:6789/0 2026-02-22T23:25:25.552 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.529+0000 7f88b0457640 1 -- 10.20.193.73:0/3687490298 --> v1:10.20.193.73:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f88a8127810 con 0x7f88a80a5e00 2026-02-22T23:25:25.552 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.530+0000 7f888effd640 1 -- 10.20.193.73:0/3687490298 <== mon.1 v1:10.20.193.73:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75931 (unknown 1092875540 0 4127419540) 0x7f8898005ab0 con 0x7f88a80a5e00 2026-02-22T23:25:25.552 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.530+0000 7f888effd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T23:25:25.552 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.530+0000 7f888effd640 10 monclient: _finish_command 1 = system:0 2026-02-22T23:25:25.552 INFO:tasks.ceph.mgr.x.trial073.stderr:2026-02-22T23:25:25.543+0000 7f413a1cd140 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2026-02-22T23:25:25.565 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.563+0000 7f88b0457640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "ef9d15a7-661e-40c5-a418-7f794c0975b7", "id": 0}] 2026-02-22T23:25:25.565 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.563+0000 7f88b0457640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "ef9d15a7-661e-40c5-a418-7f794c0975b7", "id": 0}] 2026-02-22T23:25:25.565 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.563+0000 7f88b0457640 10 monclient: _send_mon_message to mon.f at v1:10.20.193.73:6789/0 2026-02-22T23:25:25.565 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.563+0000 7f88b0457640 1 -- 10.20.193.73:0/3687490298 --> v1:10.20.193.73:6789/0 -- mon_command({"prefix": "osd new", "uuid": "ef9d15a7-661e-40c5-a418-7f794c0975b7", "id": 0} v 0) -- 0x7f88a8128fd0 con 0x7f88a80a5e00 2026-02-22T23:25:25.567 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.565+0000 7f888effd640 1 -- 10.20.193.73:0/3687490298 <== mon.1 v1:10.20.193.73:6789/0 10 ==== mon_command_ack([{"prefix": "osd new", "uuid": "ef9d15a7-661e-40c5-a418-7f794c0975b7", "id": 0}]=0 v3) ==== 112+0+2 (unknown 1778539085 0 732707515) 0x7f8898005de0 con 0x7f88a80a5e00 2026-02-22T23:25:25.567 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.565+0000 7f888effd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "ef9d15a7-661e-40c5-a418-7f794c0975b7", "id": 0}] 2026-02-22T23:25:25.567 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.565+0000 7f888effd640 10 monclient: _finish_command 2 = system:0 2026-02-22T23:25:25.568 INFO:teuthology.orchestra.run.trial073.stdout:0 2026-02-22T23:25:25.568 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.566+0000 7f88b0457640 10 monclient: shutdown 2026-02-22T23:25:25.569 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.566+0000 7f88b0457640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T23:25:25.569 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.566+0000 7f88b0457640 1 -- 10.20.193.73:0/3687490298 >> v1:10.20.193.73:6789/0 conn(0x7f88a80a5e00 legacy=0x7f88a8125290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:25.569 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.566+0000 7f88b0457640 1 -- 10.20.193.73:0/3687490298 shutdown_connections 2026-02-22T23:25:25.569 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.566+0000 7f88b0457640 1 -- 10.20.193.73:0/3687490298 >> 10.20.193.73:0/3687490298 conn(0x7f88a80abb50 msgr2=0x7f88a81425f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:25:25.569 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.566+0000 7f88b0457640 1 -- 10.20.193.73:0/3687490298 shutdown_connections 2026-02-22T23:25:25.569 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.566+0000 7f88b0457640 1 -- 10.20.193.73:0/3687490298 wait complete. 2026-02-22T23:25:25.573 INFO:tasks.ceph.mgr.x.trial073.stderr:2026-02-22T23:25:25.570+0000 7f413a1cd140 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2026-02-22T23:25:25.576 DEBUG:teuthology.orchestra.run.trial073:> sudo ceph --cluster ceph osd new 9e62cdef-b0a0-4f67-a778-ac4f7d97ed7e 1 2026-02-22T23:25:25.606 INFO:tasks.ceph.mgr.x.trial073.stderr:2026-02-22T23:25:25.604+0000 7f413a1cd140 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2026-02-22T23:25:25.630 INFO:tasks.ceph.mgr.x.trial073.stderr:2026-02-22T23:25:25.628+0000 7f413a1cd140 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2026-02-22T23:25:25.639 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.637+0000 7f5b277ce640 10 monclient: get_monmap_and_config 2026-02-22T23:25:25.639 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.637+0000 7f5b277ce640 10 monclient: build_initial_monmap 2026-02-22T23:25:25.639 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.637+0000 7f5b277ce640 10 monclient: monmap: 2026-02-22T23:25:25.639 INFO:teuthology.orchestra.run.trial073.stderr:epoch 0 2026-02-22T23:25:25.639 INFO:teuthology.orchestra.run.trial073.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:25.639 INFO:teuthology.orchestra.run.trial073.stderr:last_changed 2026-02-22T23:25:25.638258+0000 2026-02-22T23:25:25.639 INFO:teuthology.orchestra.run.trial073.stderr:created 2026-02-22T23:25:25.638258+0000 2026-02-22T23:25:25.639 INFO:teuthology.orchestra.run.trial073.stderr:min_mon_release 0 (unknown) 2026-02-22T23:25:25.639 INFO:teuthology.orchestra.run.trial073.stderr:election_strategy: 3 2026-02-22T23:25:25.639 INFO:teuthology.orchestra.run.trial073.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-22T23:25:25.640 INFO:teuthology.orchestra.run.trial073.stderr:1: v1:10.20.193.73:6789/0 mon.noname-f 2026-02-22T23:25:25.640 INFO:teuthology.orchestra.run.trial073.stderr:2: v1:10.20.193.45:6790/0 mon.noname-b 2026-02-22T23:25:25.640 INFO:teuthology.orchestra.run.trial073.stderr:3: v1:10.20.193.73:6790/0 mon.noname-g 2026-02-22T23:25:25.640 INFO:teuthology.orchestra.run.trial073.stderr:4: v1:10.20.193.45:6791/0 mon.noname-c 2026-02-22T23:25:25.640 INFO:teuthology.orchestra.run.trial073.stderr:5: v1:10.20.193.73:6791/0 mon.noname-h 2026-02-22T23:25:25.640 INFO:teuthology.orchestra.run.trial073.stderr:6: v1:10.20.193.45:6792/0 mon.noname-d 2026-02-22T23:25:25.640 INFO:teuthology.orchestra.run.trial073.stderr:7: v1:10.20.193.73:6792/0 mon.noname-i 2026-02-22T23:25:25.640 INFO:teuthology.orchestra.run.trial073.stderr:8: v1:10.20.193.45:6793/0 mon.noname-e 2026-02-22T23:25:25.640 INFO:teuthology.orchestra.run.trial073.stderr: 2026-02-22T23:25:25.648 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.637+0000 7f5b277ce640 1 Processor -- start 2026-02-22T23:25:25.648 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.637+0000 7f5b277ce640 1 -- start start 2026-02-22T23:25:25.648 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.637+0000 7f5b277ce640 10 monclient: init 2026-02-22T23:25:25.648 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.637+0000 7f5b277ce640 10 monclient: _reopen_session rank -1 2026-02-22T23:25:25.648 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.637+0000 7f5b277ce640 10 monclient: _add_conns ranks=[5,2,6,4,3,8,0,7,1] 2026-02-22T23:25:25.648 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.637+0000 7f5b277ce640 10 monclient(hunting): picked mon.noname-h con 0x7f5b200a1a60 addr v1:10.20.193.73:6791/0 2026-02-22T23:25:25.648 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.637+0000 7f5b277ce640 10 monclient(hunting): picked mon.noname-b con 0x7f5b2006f1e0 addr v1:10.20.193.45:6790/0 2026-02-22T23:25:25.648 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.637+0000 7f5b277ce640 10 monclient(hunting): picked mon.noname-d con 0x7f5b200a0980 addr v1:10.20.193.45:6792/0 2026-02-22T23:25:25.649 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.637+0000 7f5b277ce640 1 -- --> v1:10.20.193.45:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5b2009df00 con 0x7f5b2006f1e0 2026-02-22T23:25:25.649 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.637+0000 7f5b277ce640 1 -- --> v1:10.20.193.73:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5b20137660 con 0x7f5b200a1a60 2026-02-22T23:25:25.649 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.637+0000 7f5b277ce640 1 -- --> v1:10.20.193.45:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5b200a4510 con 0x7f5b200a0980 2026-02-22T23:25:25.649 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.637+0000 7f5b277ce640 10 monclient(hunting): _renew_subs 2026-02-22T23:25:25.649 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.637+0000 7f5b277ce640 10 monclient(hunting): authenticate will time out at 654.386954s 2026-02-22T23:25:25.649 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.638+0000 7f5b25543640 1 --1- >> v1:10.20.193.73:6791/0 conn(0x7f5b200a1a60 0x7f5b20136840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.73:6791/0 says I am v1:10.20.193.73:40264/0 (socket says 10.20.193.73:40264) 2026-02-22T23:25:25.649 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.638+0000 7f5b25543640 1 -- 10.20.193.73:0/3592501857 learned_addr learned my addr 10.20.193.73:0/3592501857 (peer_addr_for_me v1:10.20.193.73:0/0) 2026-02-22T23:25:25.649 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.638+0000 7f5b0ffff640 1 -- 10.20.193.73:0/3592501857 <== mon.5 v1:10.20.193.73:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1646689346 0 0) 0x7f5b20137660 con 0x7f5b200a1a60 2026-02-22T23:25:25.649 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.638+0000 7f5b0ffff640 10 monclient(hunting): _negotiate 2026-02-22T23:25:25.649 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.638+0000 7f5b0ffff640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:25.649 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.638+0000 7f5b0ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:25.649 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.638+0000 7f5b0ffff640 10 monclient(hunting): my global_id is 4127 2026-02-22T23:25:25.650 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.638+0000 7f5b0ffff640 1 -- 10.20.193.73:0/3592501857 --> v1:10.20.193.73:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5b08003620 con 0x7f5b200a1a60 2026-02-22T23:25:25.650 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.638+0000 7f5b0ffff640 1 -- 10.20.193.73:0/3592501857 <== mon.5 v1:10.20.193.73:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 822707352 0 0) 0x7f5b08003620 con 0x7f5b200a1a60 2026-02-22T23:25:25.650 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.638+0000 7f5b0ffff640 1 -- 10.20.193.73:0/3592501857 >> v1:10.20.193.45:6792/0 conn(0x7f5b200a0980 legacy=0x7f5b2013ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:25.650 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.638+0000 7f5b0ffff640 1 -- 10.20.193.73:0/3592501857 >> v1:10.20.193.45:6790/0 conn(0x7f5b2006f1e0 legacy=0x7f5b20136f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:25.650 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.638+0000 7f5b0ffff640 10 monclient: _finish_hunting 0 2026-02-22T23:25:25.650 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.638+0000 7f5b0ffff640 1 monclient: found mon.noname-h 2026-02-22T23:25:25.650 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.638+0000 7f5b0ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T23:25:25.650 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.638+0000 7f5b0ffff640 10 monclient: _send_mon_message to mon.noname-h at v1:10.20.193.73:6791/0 2026-02-22T23:25:25.650 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.638+0000 7f5b0ffff640 1 -- 10.20.193.73:0/3592501857 --> v1:10.20.193.73:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b20143400 con 0x7f5b200a1a60 2026-02-22T23:25:25.650 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.638+0000 7f5b0ffff640 10 monclient: _finish_auth 0 2026-02-22T23:25:25.650 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.638+0000 7f5b0ffff640 10 monclient: _check_auth_tickets 2026-02-22T23:25:25.650 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.638+0000 7f5b0ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T23:25:25.650 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.638+0000 7f5b0ffff640 1 -- 10.20.193.73:0/3592501857 <== mon.5 v1:10.20.193.73:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f5b10003040 con 0x7f5b200a1a60 2026-02-22T23:25:25.651 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.638+0000 7f5b0ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:25:25.651 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.638+0000 7f5b0ffff640 10 monclient: got monmap 1 from mon.noname-h (according to old e1) 2026-02-22T23:25:25.651 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.638+0000 7f5b0ffff640 10 monclient: dump: 2026-02-22T23:25:25.651 INFO:teuthology.orchestra.run.trial073.stderr:epoch 1 2026-02-22T23:25:25.651 INFO:teuthology.orchestra.run.trial073.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:25.651 INFO:teuthology.orchestra.run.trial073.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:25.651 INFO:teuthology.orchestra.run.trial073.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:25.651 INFO:teuthology.orchestra.run.trial073.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:25.651 INFO:teuthology.orchestra.run.trial073.stderr:election_strategy: 3 2026-02-22T23:25:25.651 INFO:teuthology.orchestra.run.trial073.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:25.651 INFO:teuthology.orchestra.run.trial073.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:25.651 INFO:teuthology.orchestra.run.trial073.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:25.652 INFO:teuthology.orchestra.run.trial073.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:25.652 INFO:teuthology.orchestra.run.trial073.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:25.652 INFO:teuthology.orchestra.run.trial073.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:25.652 INFO:teuthology.orchestra.run.trial073.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:25.652 INFO:teuthology.orchestra.run.trial073.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:25.652 INFO:teuthology.orchestra.run.trial073.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:25.652 INFO:teuthology.orchestra.run.trial073.stderr: 2026-02-22T23:25:25.652 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.638+0000 7f5b277ce640 5 monclient: authenticate success, global_id 4127 2026-02-22T23:25:25.652 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.638+0000 7f5b277ce640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-22T23:25:25.652 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.638+0000 7f5b0ffff640 1 -- 10.20.193.73:0/3592501857 <== mon.5 v1:10.20.193.73:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5b10003260 con 0x7f5b200a1a60 2026-02-22T23:25:25.652 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.638+0000 7f5b0ffff640 10 monclient: handle_config config(0 keys) 2026-02-22T23:25:25.652 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.638+0000 7f5b0ffff640 1 -- 10.20.193.73:0/3592501857 <== mon.5 v1:10.20.193.73:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f5b10004ce0 con 0x7f5b200a1a60 2026-02-22T23:25:25.652 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.638+0000 7f5b0ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:25:25.653 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.638+0000 7f5b0ffff640 10 monclient: got monmap 1 from mon.h (according to old e1) 2026-02-22T23:25:25.653 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.638+0000 7f5b0ffff640 10 monclient: dump: 2026-02-22T23:25:25.653 INFO:teuthology.orchestra.run.trial073.stderr:epoch 1 2026-02-22T23:25:25.653 INFO:teuthology.orchestra.run.trial073.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:25.653 INFO:teuthology.orchestra.run.trial073.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:25.653 INFO:teuthology.orchestra.run.trial073.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:25.653 INFO:teuthology.orchestra.run.trial073.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:25.653 INFO:teuthology.orchestra.run.trial073.stderr:election_strategy: 3 2026-02-22T23:25:25.653 INFO:teuthology.orchestra.run.trial073.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:25.653 INFO:teuthology.orchestra.run.trial073.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:25.653 INFO:teuthology.orchestra.run.trial073.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:25.653 INFO:teuthology.orchestra.run.trial073.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:25.653 INFO:teuthology.orchestra.run.trial073.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:25.654 INFO:teuthology.orchestra.run.trial073.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:25.654 INFO:teuthology.orchestra.run.trial073.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:25.654 INFO:teuthology.orchestra.run.trial073.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:25.654 INFO:teuthology.orchestra.run.trial073.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:25.654 INFO:teuthology.orchestra.run.trial073.stderr: 2026-02-22T23:25:25.654 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.638+0000 7f5b277ce640 10 monclient: get_monmap_and_config success 2026-02-22T23:25:25.654 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.638+0000 7f5b277ce640 4 set_mon_vals no callback set 2026-02-22T23:25:25.654 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.638+0000 7f5b277ce640 10 monclient: shutdown 2026-02-22T23:25:25.654 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.638+0000 7f5b277ce640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T23:25:25.654 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.638+0000 7f5b277ce640 1 -- 10.20.193.73:0/3592501857 >> v1:10.20.193.73:6791/0 conn(0x7f5b200a1a60 legacy=0x7f5b20136840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:25.654 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.638+0000 7f5b277ce640 1 -- 10.20.193.73:0/3592501857 shutdown_connections 2026-02-22T23:25:25.654 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.638+0000 7f5b277ce640 1 -- 10.20.193.73:0/3592501857 >> 10.20.193.73:0/3592501857 conn(0x7f5b200a7780 msgr2=0x7f5b200a3b60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:25:25.654 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.638+0000 7f5b277ce640 1 -- 10.20.193.73:0/3592501857 shutdown_connections 2026-02-22T23:25:25.655 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.638+0000 7f5b277ce640 1 -- 10.20.193.73:0/3592501857 wait complete. 2026-02-22T23:25:25.655 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.639+0000 7f5b277ce640 10 monclient: build_initial_monmap 2026-02-22T23:25:25.655 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.639+0000 7f5b277ce640 10 monclient: monmap: 2026-02-22T23:25:25.655 INFO:teuthology.orchestra.run.trial073.stderr:epoch 0 2026-02-22T23:25:25.655 INFO:teuthology.orchestra.run.trial073.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T23:25:25.655 INFO:teuthology.orchestra.run.trial073.stderr:last_changed 0.000000 2026-02-22T23:25:25.655 INFO:teuthology.orchestra.run.trial073.stderr:created 0.000000 2026-02-22T23:25:25.655 INFO:teuthology.orchestra.run.trial073.stderr:min_mon_release 0 (unknown) 2026-02-22T23:25:25.655 INFO:teuthology.orchestra.run.trial073.stderr:election_strategy: 1 2026-02-22T23:25:25.655 INFO:teuthology.orchestra.run.trial073.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-22T23:25:25.655 INFO:teuthology.orchestra.run.trial073.stderr:1: v1:10.20.193.73:6789/0 mon.noname-f 2026-02-22T23:25:25.655 INFO:teuthology.orchestra.run.trial073.stderr:2: v1:10.20.193.45:6790/0 mon.noname-b 2026-02-22T23:25:25.655 INFO:teuthology.orchestra.run.trial073.stderr:3: v1:10.20.193.73:6790/0 mon.noname-g 2026-02-22T23:25:25.656 INFO:teuthology.orchestra.run.trial073.stderr:4: v1:10.20.193.45:6791/0 mon.noname-c 2026-02-22T23:25:25.656 INFO:teuthology.orchestra.run.trial073.stderr:5: v1:10.20.193.73:6791/0 mon.noname-h 2026-02-22T23:25:25.656 INFO:teuthology.orchestra.run.trial073.stderr:6: v1:10.20.193.45:6792/0 mon.noname-d 2026-02-22T23:25:25.656 INFO:teuthology.orchestra.run.trial073.stderr:7: v1:10.20.193.73:6792/0 mon.noname-i 2026-02-22T23:25:25.656 INFO:teuthology.orchestra.run.trial073.stderr:8: v1:10.20.193.45:6793/0 mon.noname-e 2026-02-22T23:25:25.656 INFO:teuthology.orchestra.run.trial073.stderr: 2026-02-22T23:25:25.656 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.639+0000 7f5b277ce640 1 Processor -- start 2026-02-22T23:25:25.656 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.639+0000 7f5b277ce640 1 -- start start 2026-02-22T23:25:25.656 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.639+0000 7f5b277ce640 10 monclient: init 2026-02-22T23:25:25.656 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.639+0000 7f5b277ce640 10 monclient: _reopen_session rank -1 2026-02-22T23:25:25.656 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.639+0000 7f5b277ce640 10 monclient: _add_conns ranks=[5,7,3,2,0,6,4,1,8] 2026-02-22T23:25:25.656 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.639+0000 7f5b277ce640 10 monclient(hunting): picked mon.noname-h con 0x7f5b200a0980 addr v1:10.20.193.73:6791/0 2026-02-22T23:25:25.657 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.639+0000 7f5b277ce640 10 monclient(hunting): picked mon.noname-i con 0x7f5b200a1a60 addr v1:10.20.193.73:6792/0 2026-02-22T23:25:25.657 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.639+0000 7f5b277ce640 10 monclient(hunting): picked mon.noname-g con 0x7f5b201214b0 addr v1:10.20.193.73:6790/0 2026-02-22T23:25:25.657 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.639+0000 7f5b277ce640 1 -- --> v1:10.20.193.73:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5b20123ea0 con 0x7f5b201214b0 2026-02-22T23:25:25.657 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.639+0000 7f5b277ce640 1 -- --> v1:10.20.193.73:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5b20124180 con 0x7f5b200a0980 2026-02-22T23:25:25.657 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.639+0000 7f5b277ce640 1 -- --> v1:10.20.193.73:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5b2013fbe0 con 0x7f5b200a1a60 2026-02-22T23:25:25.657 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.639+0000 7f5b277ce640 10 monclient(hunting): _renew_subs 2026-02-22T23:25:25.657 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.639+0000 7f5b277ce640 10 monclient(hunting): authenticate will time out at 654.388742s 2026-02-22T23:25:25.657 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.639+0000 7f5b25543640 1 --1- >> v1:10.20.193.73:6791/0 conn(0x7f5b200a0980 0x7f5b2013c470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.73:6791/0 says I am v1:10.20.193.73:40278/0 (socket says 10.20.193.73:40278) 2026-02-22T23:25:25.657 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.639+0000 7f5b25543640 1 -- 10.20.193.73:0/1782682069 learned_addr learned my addr 10.20.193.73:0/1782682069 (peer_addr_for_me v1:10.20.193.73:0/0) 2026-02-22T23:25:25.657 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.639+0000 7f5b0dffb640 1 -- 10.20.193.73:0/1782682069 <== mon.5 v1:10.20.193.73:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 70712121 0 0) 0x7f5b20124180 con 0x7f5b200a0980 2026-02-22T23:25:25.657 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.639+0000 7f5b0dffb640 10 monclient(hunting): _negotiate 2026-02-22T23:25:25.657 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.639+0000 7f5b0dffb640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:25.658 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.639+0000 7f5b0dffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:25.658 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.639+0000 7f5b0dffb640 10 monclient(hunting): my global_id is 4136 2026-02-22T23:25:25.658 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.639+0000 7f5b0dffb640 1 -- 10.20.193.73:0/1782682069 --> v1:10.20.193.73:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5af0003620 con 0x7f5b200a0980 2026-02-22T23:25:25.658 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.639+0000 7f5b0dffb640 1 -- 10.20.193.73:0/1782682069 <== mon.7 v1:10.20.193.73:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2652044404 0 0) 0x7f5b2013fbe0 con 0x7f5b200a1a60 2026-02-22T23:25:25.658 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.639+0000 7f5b0dffb640 10 monclient(hunting): _negotiate 2026-02-22T23:25:25.658 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.639+0000 7f5b0dffb640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:25.658 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.639+0000 7f5b0dffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:25.658 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.639+0000 7f5b0dffb640 10 monclient(hunting): my global_id is 4129 2026-02-22T23:25:25.658 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.639+0000 7f5b0dffb640 1 -- 10.20.193.73:0/1782682069 --> v1:10.20.193.73:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5b20124180 con 0x7f5b200a1a60 2026-02-22T23:25:25.658 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.639+0000 7f5b0dffb640 1 -- 10.20.193.73:0/1782682069 <== mon.3 v1:10.20.193.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2206952634 0 0) 0x7f5b20123ea0 con 0x7f5b201214b0 2026-02-22T23:25:25.658 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.639+0000 7f5b0dffb640 10 monclient(hunting): _negotiate 2026-02-22T23:25:25.658 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.639+0000 7f5b0dffb640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:25.658 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.639+0000 7f5b0dffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:25.659 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.639+0000 7f5b0dffb640 10 monclient(hunting): my global_id is 4125 2026-02-22T23:25:25.659 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.639+0000 7f5b0dffb640 1 -- 10.20.193.73:0/1782682069 --> v1:10.20.193.73:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5b2013fbe0 con 0x7f5b201214b0 2026-02-22T23:25:25.659 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.639+0000 7f5b0dffb640 1 -- 10.20.193.73:0/1782682069 <== mon.5 v1:10.20.193.73:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4246129631 0 0) 0x7f5af0003620 con 0x7f5b200a0980 2026-02-22T23:25:25.659 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.639+0000 7f5b0dffb640 1 -- 10.20.193.73:0/1782682069 --> v1:10.20.193.73:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5b20123ea0 con 0x7f5b200a0980 2026-02-22T23:25:25.659 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.639+0000 7f5b0dffb640 1 -- 10.20.193.73:0/1782682069 <== mon.5 v1:10.20.193.73:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f5b10003410 con 0x7f5b200a0980 2026-02-22T23:25:25.659 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.639+0000 7f5b0dffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-22T23:25:25.659 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.639+0000 7f5b0dffb640 10 monclient(hunting): got monmap 1 from mon.noname-h (according to old e1) 2026-02-22T23:25:25.659 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.639+0000 7f5b0dffb640 10 monclient(hunting): dump: 2026-02-22T23:25:25.659 INFO:teuthology.orchestra.run.trial073.stderr:epoch 1 2026-02-22T23:25:25.659 INFO:teuthology.orchestra.run.trial073.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:25.659 INFO:teuthology.orchestra.run.trial073.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:25.659 INFO:teuthology.orchestra.run.trial073.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:25.659 INFO:teuthology.orchestra.run.trial073.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:25.660 INFO:teuthology.orchestra.run.trial073.stderr:election_strategy: 3 2026-02-22T23:25:25.660 INFO:teuthology.orchestra.run.trial073.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:25.660 INFO:teuthology.orchestra.run.trial073.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:25.660 INFO:teuthology.orchestra.run.trial073.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:25.660 INFO:teuthology.orchestra.run.trial073.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:25.660 INFO:teuthology.orchestra.run.trial073.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:25.660 INFO:teuthology.orchestra.run.trial073.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:25.660 INFO:teuthology.orchestra.run.trial073.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:25.660 INFO:teuthology.orchestra.run.trial073.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:25.660 INFO:teuthology.orchestra.run.trial073.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:25.660 INFO:teuthology.orchestra.run.trial073.stderr: 2026-02-22T23:25:25.660 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.639+0000 7f5b0dffb640 10 monclient(hunting): _finish_auth 0 2026-02-22T23:25:25.660 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.640+0000 7f5b0dffb640 1 -- 10.20.193.73:0/1782682069 <== mon.7 v1:10.20.193.73:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3466962327 0 0) 0x7f5b20124180 con 0x7f5b200a1a60 2026-02-22T23:25:25.660 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.640+0000 7f5b0dffb640 1 -- 10.20.193.73:0/1782682069 --> v1:10.20.193.73:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5af0003620 con 0x7f5b200a1a60 2026-02-22T23:25:25.661 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.640+0000 7f5b0dffb640 1 -- 10.20.193.73:0/1782682069 <== mon.3 v1:10.20.193.73:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1958548630 0 0) 0x7f5b2013fbe0 con 0x7f5b201214b0 2026-02-22T23:25:25.661 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.640+0000 7f5b0dffb640 1 -- 10.20.193.73:0/1782682069 --> v1:10.20.193.73:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5b20124180 con 0x7f5b201214b0 2026-02-22T23:25:25.661 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.640+0000 7f5b0dffb640 1 -- 10.20.193.73:0/1782682069 <== mon.5 v1:10.20.193.73:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 558039447 0 0) 0x7f5b20123ea0 con 0x7f5b200a0980 2026-02-22T23:25:25.661 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.640+0000 7f5b0dffb640 1 -- 10.20.193.73:0/1782682069 >> v1:10.20.193.73:6792/0 conn(0x7f5b200a1a60 legacy=0x7f5b201d26a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:25.661 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.640+0000 7f5b0dffb640 1 -- 10.20.193.73:0/1782682069 >> v1:10.20.193.73:6790/0 conn(0x7f5b201214b0 legacy=0x7f5b201d5dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:25.661 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.640+0000 7f5b0dffb640 10 monclient: _finish_hunting 0 2026-02-22T23:25:25.661 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.640+0000 7f5b0dffb640 1 monclient: found mon.h 2026-02-22T23:25:25.661 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.640+0000 7f5b0dffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T23:25:25.661 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.640+0000 7f5b0dffb640 10 monclient: _send_mon_message to mon.h at v1:10.20.193.73:6791/0 2026-02-22T23:25:25.661 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.640+0000 7f5b0dffb640 1 -- 10.20.193.73:0/1782682069 --> v1:10.20.193.73:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b2013cb80 con 0x7f5b200a0980 2026-02-22T23:25:25.661 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.640+0000 7f5b0dffb640 10 monclient: _finish_auth 0 2026-02-22T23:25:25.661 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.640+0000 7f5b0dffb640 10 monclient: _check_auth_tickets 2026-02-22T23:25:25.662 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.640+0000 7f5b0dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T23:25:25.662 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.640+0000 7f5b277ce640 5 monclient: authenticate success, global_id 4136 2026-02-22T23:25:25.662 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.640+0000 7f5b277ce640 10 monclient: _renew_subs 2026-02-22T23:25:25.662 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.640+0000 7f5b277ce640 10 monclient: _send_mon_message to mon.h at v1:10.20.193.73:6791/0 2026-02-22T23:25:25.662 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.640+0000 7f5b277ce640 1 -- 10.20.193.73:0/1782682069 --> v1:10.20.193.73:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f5b2013cdd0 con 0x7f5b200a0980 2026-02-22T23:25:25.662 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.640+0000 7f5b277ce640 10 monclient: _renew_subs 2026-02-22T23:25:25.662 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.640+0000 7f5b277ce640 10 monclient: _send_mon_message to mon.h at v1:10.20.193.73:6791/0 2026-02-22T23:25:25.662 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.640+0000 7f5b0dffb640 1 -- 10.20.193.73:0/1782682069 <== mon.5 v1:10.20.193.73:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5b10004ed0 con 0x7f5b200a0980 2026-02-22T23:25:25.662 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.640+0000 7f5b277ce640 1 -- 10.20.193.73:0/1782682069 --> v1:10.20.193.73:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7f5b201d76d0 con 0x7f5b200a0980 2026-02-22T23:25:25.662 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.640+0000 7f5b0dffb640 10 monclient: handle_config config(0 keys) 2026-02-22T23:25:25.662 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.640+0000 7f5b0dffb640 1 -- 10.20.193.73:0/1782682069 <== mon.5 v1:10.20.193.73:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f5b100053c0 con 0x7f5b200a0980 2026-02-22T23:25:25.662 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.640+0000 7f5b0dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:25:25.662 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.640+0000 7f5b0dffb640 10 monclient: got monmap 1 from mon.h (according to old e1) 2026-02-22T23:25:25.663 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.640+0000 7f5b0f7fe640 4 set_mon_vals no callback set 2026-02-22T23:25:25.663 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.640+0000 7f5b0dffb640 10 monclient: dump: 2026-02-22T23:25:25.663 INFO:teuthology.orchestra.run.trial073.stderr:epoch 1 2026-02-22T23:25:25.663 INFO:teuthology.orchestra.run.trial073.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:25.663 INFO:teuthology.orchestra.run.trial073.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:25.663 INFO:teuthology.orchestra.run.trial073.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:25.663 INFO:teuthology.orchestra.run.trial073.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:25.663 INFO:teuthology.orchestra.run.trial073.stderr:election_strategy: 3 2026-02-22T23:25:25.663 INFO:teuthology.orchestra.run.trial073.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:25.663 INFO:teuthology.orchestra.run.trial073.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:25.663 INFO:teuthology.orchestra.run.trial073.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:25.663 INFO:teuthology.orchestra.run.trial073.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:25.663 INFO:teuthology.orchestra.run.trial073.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:25.664 INFO:teuthology.orchestra.run.trial073.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:25.664 INFO:teuthology.orchestra.run.trial073.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:25.664 INFO:teuthology.orchestra.run.trial073.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:25.664 INFO:teuthology.orchestra.run.trial073.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:25.664 INFO:teuthology.orchestra.run.trial073.stderr: 2026-02-22T23:25:25.664 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.640+0000 7f5b0dffb640 1 -- 10.20.193.73:0/1782682069 <== mon.5 v1:10.20.193.73:6791/0 7 ==== mgrmap(e 1) ==== 811+0+0 (unknown 4133961934 0 0) 0x7f5b100058f0 con 0x7f5b200a0980 2026-02-22T23:25:25.664 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.640+0000 7f5b0dffb640 1 -- 10.20.193.73:0/1782682069 <== mon.5 v1:10.20.193.73:6791/0 8 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (unknown 2252407818 0 0) 0x7f5b10006ad0 con 0x7f5b200a0980 2026-02-22T23:25:25.664 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.640+0000 7f5b277ce640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T23:25:25.664 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.640+0000 7f5b277ce640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T23:25:25.664 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.640+0000 7f5b277ce640 10 monclient: _send_mon_message to mon.h at v1:10.20.193.73:6791/0 2026-02-22T23:25:25.664 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.640+0000 7f5b277ce640 1 -- 10.20.193.73:0/1782682069 --> v1:10.20.193.73:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b20142e50 con 0x7f5b200a0980 2026-02-22T23:25:25.664 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.641+0000 7f5b0dffb640 1 -- 10.20.193.73:0/1782682069 <== mon.5 v1:10.20.193.73:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75931 (unknown 1092875540 0 4127419540) 0x7f5b10005c10 con 0x7f5b200a0980 2026-02-22T23:25:25.664 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.641+0000 7f5b0dffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T23:25:25.665 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.641+0000 7f5b0dffb640 10 monclient: _finish_command 1 = system:0 2026-02-22T23:25:25.665 INFO:tasks.ceph.mgr.x.trial073.stderr:2026-02-22T23:25:25.654+0000 7f413a1cd140 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2026-02-22T23:25:25.676 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.674+0000 7f5b277ce640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "9e62cdef-b0a0-4f67-a778-ac4f7d97ed7e", "id": 1}] 2026-02-22T23:25:25.676 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.674+0000 7f5b277ce640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "9e62cdef-b0a0-4f67-a778-ac4f7d97ed7e", "id": 1}] 2026-02-22T23:25:25.676 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.674+0000 7f5b277ce640 10 monclient: _send_mon_message to mon.h at v1:10.20.193.73:6791/0 2026-02-22T23:25:25.677 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.674+0000 7f5b277ce640 1 -- 10.20.193.73:0/1782682069 --> v1:10.20.193.73:6791/0 -- mon_command({"prefix": "osd new", "uuid": "9e62cdef-b0a0-4f67-a778-ac4f7d97ed7e", "id": 1} v 0) -- 0x7f5b2006ce10 con 0x7f5b200a0980 2026-02-22T23:25:25.679 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.677+0000 7f5b0dffb640 1 -- 10.20.193.73:0/1782682069 <== mon.5 v1:10.20.193.73:6791/0 10 ==== mon_command_ack([{"prefix": "osd new", "uuid": "9e62cdef-b0a0-4f67-a778-ac4f7d97ed7e", "id": 1}]=0 v4) ==== 112+0+2 (unknown 3834217566 0 940483276) 0x7f5b10005ed0 con 0x7f5b200a0980 2026-02-22T23:25:25.679 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.677+0000 7f5b0dffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "9e62cdef-b0a0-4f67-a778-ac4f7d97ed7e", "id": 1}] 2026-02-22T23:25:25.679 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.677+0000 7f5b0dffb640 10 monclient: _finish_command 2 = system:0 2026-02-22T23:25:25.679 INFO:teuthology.orchestra.run.trial073.stdout:1 2026-02-22T23:25:25.680 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.677+0000 7f5b277ce640 10 monclient: shutdown 2026-02-22T23:25:25.680 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.677+0000 7f5b277ce640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T23:25:25.680 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.677+0000 7f5b277ce640 1 -- 10.20.193.73:0/1782682069 >> v1:10.20.193.73:6791/0 conn(0x7f5b200a0980 legacy=0x7f5b2013c470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:25.680 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.677+0000 7f5b277ce640 1 -- 10.20.193.73:0/1782682069 shutdown_connections 2026-02-22T23:25:25.680 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.677+0000 7f5b277ce640 1 -- 10.20.193.73:0/1782682069 >> 10.20.193.73:0/1782682069 conn(0x7f5b200a7780 msgr2=0x7f5b201417a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:25:25.680 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.677+0000 7f5b277ce640 1 -- 10.20.193.73:0/1782682069 shutdown_connections 2026-02-22T23:25:25.680 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.677+0000 7f5b277ce640 1 -- 10.20.193.73:0/1782682069 wait complete. 2026-02-22T23:25:25.687 DEBUG:teuthology.orchestra.run.trial073:> sudo ceph --cluster ceph osd new bfcf94e1-2623-4443-aaf8-f525210ab7b2 2 2026-02-22T23:25:25.713 INFO:tasks.ceph.mgr.x.trial073.stderr:2026-02-22T23:25:25.711+0000 7f413a1cd140 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2026-02-22T23:25:25.775 INFO:tasks.ceph.mgr.x.trial073.stderr:/usr/lib64/python3.9/site-packages/scipy/__init__.py:73: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2026-02-22T23:25:25.775 INFO:tasks.ceph.mgr.x.trial073.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2026-02-22T23:25:25.775 INFO:tasks.ceph.mgr.x.trial073.stderr: from numpy import show_config as show_numpy_config 2026-02-22T23:25:25.776 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.774+0000 7f4b5b98f640 10 monclient: get_monmap_and_config 2026-02-22T23:25:25.776 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.774+0000 7f4b5b98f640 10 monclient: build_initial_monmap 2026-02-22T23:25:25.776 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.774+0000 7f4b5b98f640 10 monclient: monmap: 2026-02-22T23:25:25.777 INFO:teuthology.orchestra.run.trial073.stderr:epoch 0 2026-02-22T23:25:25.777 INFO:teuthology.orchestra.run.trial073.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:25.777 INFO:teuthology.orchestra.run.trial073.stderr:last_changed 2026-02-22T23:25:25.775808+0000 2026-02-22T23:25:25.777 INFO:teuthology.orchestra.run.trial073.stderr:created 2026-02-22T23:25:25.775808+0000 2026-02-22T23:25:25.777 INFO:teuthology.orchestra.run.trial073.stderr:min_mon_release 0 (unknown) 2026-02-22T23:25:25.777 INFO:teuthology.orchestra.run.trial073.stderr:election_strategy: 3 2026-02-22T23:25:25.777 INFO:teuthology.orchestra.run.trial073.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-22T23:25:25.777 INFO:teuthology.orchestra.run.trial073.stderr:1: v1:10.20.193.73:6789/0 mon.noname-f 2026-02-22T23:25:25.777 INFO:teuthology.orchestra.run.trial073.stderr:2: v1:10.20.193.45:6790/0 mon.noname-b 2026-02-22T23:25:25.777 INFO:teuthology.orchestra.run.trial073.stderr:3: v1:10.20.193.73:6790/0 mon.noname-g 2026-02-22T23:25:25.778 INFO:teuthology.orchestra.run.trial073.stderr:4: v1:10.20.193.45:6791/0 mon.noname-c 2026-02-22T23:25:25.778 INFO:teuthology.orchestra.run.trial073.stderr:5: v1:10.20.193.73:6791/0 mon.noname-h 2026-02-22T23:25:25.778 INFO:teuthology.orchestra.run.trial073.stderr:6: v1:10.20.193.45:6792/0 mon.noname-d 2026-02-22T23:25:25.778 INFO:teuthology.orchestra.run.trial073.stderr:7: v1:10.20.193.73:6792/0 mon.noname-i 2026-02-22T23:25:25.778 INFO:teuthology.orchestra.run.trial073.stderr:8: v1:10.20.193.45:6793/0 mon.noname-e 2026-02-22T23:25:25.778 INFO:teuthology.orchestra.run.trial073.stderr: 2026-02-22T23:25:25.782 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.775+0000 7f4b5b98f640 1 Processor -- start 2026-02-22T23:25:25.782 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.775+0000 7f4b5b98f640 1 -- start start 2026-02-22T23:25:25.782 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.775+0000 7f4b5b98f640 10 monclient: init 2026-02-22T23:25:25.782 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.775+0000 7f4b5b98f640 10 monclient: _reopen_session rank -1 2026-02-22T23:25:25.782 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.775+0000 7f4b5b98f640 10 monclient: _add_conns ranks=[6,8,3,1,4,7,0,5,2] 2026-02-22T23:25:25.782 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.775+0000 7f4b5b98f640 10 monclient(hunting): picked mon.noname-d con 0x7f4b540a1a60 addr v1:10.20.193.45:6792/0 2026-02-22T23:25:25.782 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.775+0000 7f4b5b98f640 10 monclient(hunting): picked mon.noname-e con 0x7f4b5406f1e0 addr v1:10.20.193.45:6793/0 2026-02-22T23:25:25.782 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.775+0000 7f4b5b98f640 10 monclient(hunting): picked mon.noname-g con 0x7f4b540a0980 addr v1:10.20.193.73:6790/0 2026-02-22T23:25:25.783 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.775+0000 7f4b5b98f640 1 -- --> v1:10.20.193.73:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4b5409df00 con 0x7f4b540a0980 2026-02-22T23:25:25.783 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.775+0000 7f4b5b98f640 1 -- --> v1:10.20.193.45:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4b54137660 con 0x7f4b540a1a60 2026-02-22T23:25:25.783 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.775+0000 7f4b5b98f640 1 -- --> v1:10.20.193.45:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4b540a4510 con 0x7f4b5406f1e0 2026-02-22T23:25:25.783 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.775+0000 7f4b5b98f640 10 monclient(hunting): _renew_subs 2026-02-22T23:25:25.783 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.775+0000 7f4b5b98f640 10 monclient(hunting): authenticate will time out at 654.524515s 2026-02-22T23:25:25.783 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.775+0000 7f4b59f05640 1 --1- >> v1:10.20.193.73:6790/0 conn(0x7f4b540a0980 0x7f4b5413ecb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.73:6790/0 says I am v1:10.20.193.73:46264/0 (socket says 10.20.193.73:46264) 2026-02-22T23:25:25.783 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.775+0000 7f4b59f05640 1 -- 10.20.193.73:0/3407352529 learned_addr learned my addr 10.20.193.73:0/3407352529 (peer_addr_for_me v1:10.20.193.73:0/0) 2026-02-22T23:25:25.783 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.775+0000 7f4b43fff640 1 -- 10.20.193.73:0/3407352529 <== mon.3 v1:10.20.193.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2123647846 0 0) 0x7f4b50002ca0 con 0x7f4b540a0980 2026-02-22T23:25:25.783 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.775+0000 7f4b43fff640 10 monclient(hunting): _negotiate 2026-02-22T23:25:25.783 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.775+0000 7f4b43fff640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:25.783 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.775+0000 7f4b43fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:25.784 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.775+0000 7f4b43fff640 10 monclient(hunting): my global_id is 4134 2026-02-22T23:25:25.784 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.775+0000 7f4b43fff640 1 -- 10.20.193.73:0/3407352529 --> v1:10.20.193.73:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4b3c003620 con 0x7f4b540a0980 2026-02-22T23:25:25.784 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.775+0000 7f4b43fff640 1 -- 10.20.193.73:0/3407352529 <== mon.3 v1:10.20.193.73:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 919724850 0 0) 0x7f4b3c003620 con 0x7f4b540a0980 2026-02-22T23:25:25.784 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.775+0000 7f4b43fff640 1 -- 10.20.193.73:0/3407352529 >> v1:10.20.193.45:6793/0 conn(0x7f4b5406f1e0 legacy=0x7f4b54136f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:25.784 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.775+0000 7f4b43fff640 1 -- 10.20.193.73:0/3407352529 >> v1:10.20.193.45:6792/0 conn(0x7f4b540a1a60 legacy=0x7f4b54136840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:25.784 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.775+0000 7f4b43fff640 10 monclient: _finish_hunting 0 2026-02-22T23:25:25.784 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.775+0000 7f4b43fff640 1 monclient: found mon.noname-g 2026-02-22T23:25:25.784 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.775+0000 7f4b43fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T23:25:25.784 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.775+0000 7f4b43fff640 10 monclient: _send_mon_message to mon.noname-g at v1:10.20.193.73:6790/0 2026-02-22T23:25:25.784 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.775+0000 7f4b43fff640 1 -- 10.20.193.73:0/3407352529 --> v1:10.20.193.73:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b54143400 con 0x7f4b540a0980 2026-02-22T23:25:25.784 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.775+0000 7f4b43fff640 10 monclient: _finish_auth 0 2026-02-22T23:25:25.785 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.775+0000 7f4b43fff640 10 monclient: _check_auth_tickets 2026-02-22T23:25:25.785 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.775+0000 7f4b43fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T23:25:25.785 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.775+0000 7f4b5b98f640 5 monclient: authenticate success, global_id 4134 2026-02-22T23:25:25.785 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.775+0000 7f4b43fff640 1 -- 10.20.193.73:0/3407352529 <== mon.3 v1:10.20.193.73:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f4b50003590 con 0x7f4b540a0980 2026-02-22T23:25:25.785 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.775+0000 7f4b5b98f640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-22T23:25:25.785 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.775+0000 7f4b43fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:25:25.785 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.775+0000 7f4b43fff640 10 monclient: got monmap 1 from mon.noname-g (according to old e1) 2026-02-22T23:25:25.785 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.775+0000 7f4b43fff640 10 monclient: dump: 2026-02-22T23:25:25.785 INFO:teuthology.orchestra.run.trial073.stderr:epoch 1 2026-02-22T23:25:25.785 INFO:teuthology.orchestra.run.trial073.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:25.785 INFO:teuthology.orchestra.run.trial073.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:25.785 INFO:teuthology.orchestra.run.trial073.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:25.786 INFO:teuthology.orchestra.run.trial073.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:25.786 INFO:teuthology.orchestra.run.trial073.stderr:election_strategy: 3 2026-02-22T23:25:25.786 INFO:teuthology.orchestra.run.trial073.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:25.786 INFO:teuthology.orchestra.run.trial073.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:25.786 INFO:teuthology.orchestra.run.trial073.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:25.786 INFO:teuthology.orchestra.run.trial073.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:25.786 INFO:teuthology.orchestra.run.trial073.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:25.786 INFO:teuthology.orchestra.run.trial073.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:25.786 INFO:teuthology.orchestra.run.trial073.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:25.786 INFO:teuthology.orchestra.run.trial073.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:25.786 INFO:teuthology.orchestra.run.trial073.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:25.786 INFO:teuthology.orchestra.run.trial073.stderr: 2026-02-22T23:25:25.787 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.775+0000 7f4b5b98f640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-22T23:25:25.787 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.775+0000 7f4b43fff640 1 -- 10.20.193.73:0/3407352529 <== mon.3 v1:10.20.193.73:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4b500037b0 con 0x7f4b540a0980 2026-02-22T23:25:25.787 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.775+0000 7f4b43fff640 10 monclient: handle_config config(0 keys) 2026-02-22T23:25:25.787 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.775+0000 7f4b5b98f640 10 monclient: get_monmap_and_config success 2026-02-22T23:25:25.787 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.776+0000 7f4b5b98f640 4 set_mon_vals no callback set 2026-02-22T23:25:25.787 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.776+0000 7f4b43fff640 1 -- 10.20.193.73:0/3407352529 <== mon.3 v1:10.20.193.73:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f4b50005060 con 0x7f4b540a0980 2026-02-22T23:25:25.787 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.776+0000 7f4b43fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:25:25.787 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.776+0000 7f4b43fff640 10 monclient: got monmap 1 from mon.g (according to old e1) 2026-02-22T23:25:25.787 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.776+0000 7f4b43fff640 10 monclient: dump: 2026-02-22T23:25:25.787 INFO:teuthology.orchestra.run.trial073.stderr:epoch 1 2026-02-22T23:25:25.787 INFO:teuthology.orchestra.run.trial073.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:25.787 INFO:teuthology.orchestra.run.trial073.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:25.787 INFO:teuthology.orchestra.run.trial073.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:25.788 INFO:teuthology.orchestra.run.trial073.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:25.788 INFO:teuthology.orchestra.run.trial073.stderr:election_strategy: 3 2026-02-22T23:25:25.788 INFO:teuthology.orchestra.run.trial073.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:25.788 INFO:teuthology.orchestra.run.trial073.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:25.788 INFO:teuthology.orchestra.run.trial073.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:25.788 INFO:teuthology.orchestra.run.trial073.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:25.788 INFO:teuthology.orchestra.run.trial073.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:25.788 INFO:teuthology.orchestra.run.trial073.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:25.788 INFO:teuthology.orchestra.run.trial073.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:25.788 INFO:teuthology.orchestra.run.trial073.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:25.788 INFO:teuthology.orchestra.run.trial073.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:25.788 INFO:teuthology.orchestra.run.trial073.stderr: 2026-02-22T23:25:25.789 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.776+0000 7f4b5b98f640 10 monclient: shutdown 2026-02-22T23:25:25.789 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.776+0000 7f4b5b98f640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T23:25:25.789 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.776+0000 7f4b5b98f640 1 -- 10.20.193.73:0/3407352529 >> v1:10.20.193.73:6790/0 conn(0x7f4b540a0980 legacy=0x7f4b5413ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:25.789 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.776+0000 7f4b5b98f640 1 -- 10.20.193.73:0/3407352529 shutdown_connections 2026-02-22T23:25:25.789 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.776+0000 7f4b5b98f640 1 -- 10.20.193.73:0/3407352529 >> 10.20.193.73:0/3407352529 conn(0x7f4b540a7780 msgr2=0x7f4b540a3b60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:25:25.789 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.776+0000 7f4b5b98f640 1 -- 10.20.193.73:0/3407352529 shutdown_connections 2026-02-22T23:25:25.789 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.776+0000 7f4b5b98f640 1 -- 10.20.193.73:0/3407352529 wait complete. 2026-02-22T23:25:25.789 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.776+0000 7f4b5b98f640 10 monclient: build_initial_monmap 2026-02-22T23:25:25.789 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.776+0000 7f4b5b98f640 10 monclient: monmap: 2026-02-22T23:25:25.789 INFO:teuthology.orchestra.run.trial073.stderr:epoch 0 2026-02-22T23:25:25.789 INFO:teuthology.orchestra.run.trial073.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T23:25:25.789 INFO:teuthology.orchestra.run.trial073.stderr:last_changed 0.000000 2026-02-22T23:25:25.789 INFO:teuthology.orchestra.run.trial073.stderr:created 0.000000 2026-02-22T23:25:25.790 INFO:teuthology.orchestra.run.trial073.stderr:min_mon_release 0 (unknown) 2026-02-22T23:25:25.790 INFO:teuthology.orchestra.run.trial073.stderr:election_strategy: 1 2026-02-22T23:25:25.790 INFO:teuthology.orchestra.run.trial073.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-22T23:25:25.790 INFO:teuthology.orchestra.run.trial073.stderr:1: v1:10.20.193.73:6789/0 mon.noname-f 2026-02-22T23:25:25.790 INFO:teuthology.orchestra.run.trial073.stderr:2: v1:10.20.193.45:6790/0 mon.noname-b 2026-02-22T23:25:25.790 INFO:teuthology.orchestra.run.trial073.stderr:3: v1:10.20.193.73:6790/0 mon.noname-g 2026-02-22T23:25:25.790 INFO:teuthology.orchestra.run.trial073.stderr:4: v1:10.20.193.45:6791/0 mon.noname-c 2026-02-22T23:25:25.790 INFO:teuthology.orchestra.run.trial073.stderr:5: v1:10.20.193.73:6791/0 mon.noname-h 2026-02-22T23:25:25.790 INFO:teuthology.orchestra.run.trial073.stderr:6: v1:10.20.193.45:6792/0 mon.noname-d 2026-02-22T23:25:25.790 INFO:teuthology.orchestra.run.trial073.stderr:7: v1:10.20.193.73:6792/0 mon.noname-i 2026-02-22T23:25:25.790 INFO:teuthology.orchestra.run.trial073.stderr:8: v1:10.20.193.45:6793/0 mon.noname-e 2026-02-22T23:25:25.790 INFO:teuthology.orchestra.run.trial073.stderr: 2026-02-22T23:25:25.790 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.776+0000 7f4b5b98f640 1 Processor -- start 2026-02-22T23:25:25.791 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.776+0000 7f4b5b98f640 1 -- start start 2026-02-22T23:25:25.791 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.776+0000 7f4b5b98f640 10 monclient: init 2026-02-22T23:25:25.791 INFO:tasks.ceph.mgr.x.trial073.stderr:2026-02-22T23:25:25.776+0000 7f413a1cd140 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2026-02-22T23:25:25.795 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.776+0000 7f4b5b98f640 10 monclient: _reopen_session rank -1 2026-02-22T23:25:25.795 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.776+0000 7f4b5b98f640 10 monclient: _add_conns ranks=[3,1,6,5,8,7,4,0,2] 2026-02-22T23:25:25.795 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.776+0000 7f4b5b98f640 10 monclient(hunting): picked mon.noname-g con 0x7f4b540a0980 addr v1:10.20.193.73:6790/0 2026-02-22T23:25:25.795 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.776+0000 7f4b5b98f640 10 monclient(hunting): picked mon.noname-f con 0x7f4b540a1a60 addr v1:10.20.193.73:6789/0 2026-02-22T23:25:25.795 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.776+0000 7f4b5b98f640 10 monclient(hunting): picked mon.noname-d con 0x7f4b541cf5f0 addr v1:10.20.193.45:6792/0 2026-02-22T23:25:25.795 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.777+0000 7f4b5b98f640 1 -- --> v1:10.20.193.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4b54072090 con 0x7f4b540a1a60 2026-02-22T23:25:25.796 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.777+0000 7f4b5b98f640 1 -- --> v1:10.20.193.73:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4b5411e410 con 0x7f4b540a0980 2026-02-22T23:25:25.796 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.777+0000 7f4b5b98f640 1 -- --> v1:10.20.193.45:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4b540a6220 con 0x7f4b541cf5f0 2026-02-22T23:25:25.796 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.777+0000 7f4b5b98f640 10 monclient(hunting): _renew_subs 2026-02-22T23:25:25.796 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.777+0000 7f4b5b98f640 10 monclient(hunting): authenticate will time out at 654.526017s 2026-02-22T23:25:25.796 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.777+0000 7f4b59704640 1 --1- >> v1:10.20.193.73:6790/0 conn(0x7f4b540a0980 0x7f4b54136ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.73:6790/0 says I am v1:10.20.193.73:46272/0 (socket says 10.20.193.73:46272) 2026-02-22T23:25:25.796 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.777+0000 7f4b59704640 1 -- 10.20.193.73:0/3807895787 learned_addr learned my addr 10.20.193.73:0/3807895787 (peer_addr_for_me v1:10.20.193.73:0/0) 2026-02-22T23:25:25.796 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.777+0000 7f4b41ffb640 1 -- 10.20.193.73:0/3807895787 <== mon.3 v1:10.20.193.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2788722047 0 0) 0x7f4b5411e410 con 0x7f4b540a0980 2026-02-22T23:25:25.796 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.777+0000 7f4b41ffb640 10 monclient(hunting): _negotiate 2026-02-22T23:25:25.796 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.777+0000 7f4b41ffb640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:25.796 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.777+0000 7f4b41ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:25.796 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.777+0000 7f4b41ffb640 10 monclient(hunting): my global_id is 4143 2026-02-22T23:25:25.796 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.777+0000 7f4b41ffb640 1 -- 10.20.193.73:0/3807895787 --> v1:10.20.193.73:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4b24003620 con 0x7f4b540a0980 2026-02-22T23:25:25.797 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.777+0000 7f4b41ffb640 1 -- 10.20.193.73:0/3807895787 <== mon.1 v1:10.20.193.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4010366482 0 0) 0x7f4b54072090 con 0x7f4b540a1a60 2026-02-22T23:25:25.797 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.777+0000 7f4b41ffb640 10 monclient(hunting): _negotiate 2026-02-22T23:25:25.797 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.777+0000 7f4b41ffb640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:25.797 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.777+0000 7f4b41ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:25.797 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.777+0000 7f4b41ffb640 10 monclient(hunting): my global_id is 4132 2026-02-22T23:25:25.797 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.777+0000 7f4b41ffb640 1 -- 10.20.193.73:0/3807895787 --> v1:10.20.193.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4b5411e410 con 0x7f4b540a1a60 2026-02-22T23:25:25.797 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.777+0000 7f4b41ffb640 1 -- 10.20.193.73:0/3807895787 <== mon.3 v1:10.20.193.73:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1302235254 0 0) 0x7f4b24003620 con 0x7f4b540a0980 2026-02-22T23:25:25.797 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.777+0000 7f4b41ffb640 1 -- 10.20.193.73:0/3807895787 --> v1:10.20.193.73:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4b54072090 con 0x7f4b540a0980 2026-02-22T23:25:25.797 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.777+0000 7f4b41ffb640 1 -- 10.20.193.73:0/3807895787 <== mon.3 v1:10.20.193.73:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f4b44003300 con 0x7f4b540a0980 2026-02-22T23:25:25.797 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.777+0000 7f4b41ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-22T23:25:25.797 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.777+0000 7f4b41ffb640 10 monclient(hunting): got monmap 1 from mon.noname-g (according to old e1) 2026-02-22T23:25:25.797 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.777+0000 7f4b41ffb640 10 monclient(hunting): dump: 2026-02-22T23:25:25.797 INFO:teuthology.orchestra.run.trial073.stderr:epoch 1 2026-02-22T23:25:25.797 INFO:teuthology.orchestra.run.trial073.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:25.798 INFO:teuthology.orchestra.run.trial073.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:25.798 INFO:teuthology.orchestra.run.trial073.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:25.798 INFO:teuthology.orchestra.run.trial073.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:25.798 INFO:teuthology.orchestra.run.trial073.stderr:election_strategy: 3 2026-02-22T23:25:25.798 INFO:teuthology.orchestra.run.trial073.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:25.798 INFO:teuthology.orchestra.run.trial073.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:25.798 INFO:teuthology.orchestra.run.trial073.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:25.798 INFO:teuthology.orchestra.run.trial073.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:25.798 INFO:teuthology.orchestra.run.trial073.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:25.798 INFO:teuthology.orchestra.run.trial073.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:25.798 INFO:teuthology.orchestra.run.trial073.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:25.798 INFO:teuthology.orchestra.run.trial073.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:25.798 INFO:teuthology.orchestra.run.trial073.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:25.799 INFO:teuthology.orchestra.run.trial073.stderr: 2026-02-22T23:25:25.799 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.777+0000 7f4b41ffb640 10 monclient(hunting): _finish_auth 0 2026-02-22T23:25:25.799 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.777+0000 7f4b41ffb640 1 -- 10.20.193.73:0/3807895787 <== mon.1 v1:10.20.193.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3175091122 0 0) 0x7f4b5411e410 con 0x7f4b540a1a60 2026-02-22T23:25:25.799 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.777+0000 7f4b41ffb640 1 -- 10.20.193.73:0/3807895787 --> v1:10.20.193.73:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4b24003620 con 0x7f4b540a1a60 2026-02-22T23:25:25.799 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.777+0000 7f4b41ffb640 1 -- 10.20.193.73:0/3807895787 <== mon.1 v1:10.20.193.73:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f4b48003250 con 0x7f4b540a1a60 2026-02-22T23:25:25.799 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.777+0000 7f4b41ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-22T23:25:25.799 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.777+0000 7f4b41ffb640 10 monclient(hunting): got monmap 1 from mon.f (according to old e1) 2026-02-22T23:25:25.799 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.777+0000 7f4b41ffb640 10 monclient(hunting): dump: 2026-02-22T23:25:25.799 INFO:teuthology.orchestra.run.trial073.stderr:epoch 1 2026-02-22T23:25:25.799 INFO:teuthology.orchestra.run.trial073.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:25.799 INFO:teuthology.orchestra.run.trial073.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:25.799 INFO:teuthology.orchestra.run.trial073.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:25.800 INFO:teuthology.orchestra.run.trial073.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:25.800 INFO:teuthology.orchestra.run.trial073.stderr:election_strategy: 3 2026-02-22T23:25:25.800 INFO:teuthology.orchestra.run.trial073.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:25.800 INFO:teuthology.orchestra.run.trial073.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:25.800 INFO:teuthology.orchestra.run.trial073.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:25.800 INFO:teuthology.orchestra.run.trial073.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:25.800 INFO:teuthology.orchestra.run.trial073.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:25.800 INFO:teuthology.orchestra.run.trial073.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:25.800 INFO:teuthology.orchestra.run.trial073.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:25.800 INFO:teuthology.orchestra.run.trial073.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:25.800 INFO:teuthology.orchestra.run.trial073.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:25.800 INFO:teuthology.orchestra.run.trial073.stderr: 2026-02-22T23:25:25.800 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.777+0000 7f4b41ffb640 1 -- 10.20.193.73:0/3807895787 <== mon.3 v1:10.20.193.73:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 568670376 0 0) 0x7f4b54072090 con 0x7f4b540a0980 2026-02-22T23:25:25.801 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.777+0000 7f4b41ffb640 1 -- 10.20.193.73:0/3807895787 >> v1:10.20.193.45:6792/0 conn(0x7f4b541cf5f0 legacy=0x7f4b541d8060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:25.801 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.777+0000 7f4b41ffb640 1 -- 10.20.193.73:0/3807895787 >> v1:10.20.193.73:6789/0 conn(0x7f4b540a1a60 legacy=0x7f4b541d4930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:25.801 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.777+0000 7f4b41ffb640 10 monclient: _finish_hunting 0 2026-02-22T23:25:25.801 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.777+0000 7f4b41ffb640 1 monclient: found mon.g 2026-02-22T23:25:25.801 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.777+0000 7f4b41ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T23:25:25.801 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.777+0000 7f4b41ffb640 10 monclient: _send_mon_message to mon.g at v1:10.20.193.73:6790/0 2026-02-22T23:25:25.801 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.777+0000 7f4b41ffb640 1 -- 10.20.193.73:0/3807895787 --> v1:10.20.193.73:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b5411e130 con 0x7f4b540a0980 2026-02-22T23:25:25.801 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.777+0000 7f4b41ffb640 10 monclient: _finish_auth 0 2026-02-22T23:25:25.801 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.777+0000 7f4b41ffb640 10 monclient: _check_auth_tickets 2026-02-22T23:25:25.801 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.777+0000 7f4b41ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T23:25:25.801 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.777+0000 7f4b5b98f640 5 monclient: authenticate success, global_id 4143 2026-02-22T23:25:25.801 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.777+0000 7f4b5b98f640 10 monclient: _renew_subs 2026-02-22T23:25:25.801 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.777+0000 7f4b5b98f640 10 monclient: _send_mon_message to mon.g at v1:10.20.193.73:6790/0 2026-02-22T23:25:25.802 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.777+0000 7f4b5b98f640 1 -- 10.20.193.73:0/3807895787 --> v1:10.20.193.73:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f4b541371c0 con 0x7f4b540a0980 2026-02-22T23:25:25.802 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.777+0000 7f4b5b98f640 10 monclient: _renew_subs 2026-02-22T23:25:25.802 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.777+0000 7f4b5b98f640 10 monclient: _send_mon_message to mon.g at v1:10.20.193.73:6790/0 2026-02-22T23:25:25.802 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.777+0000 7f4b5b98f640 1 -- 10.20.193.73:0/3807895787 --> v1:10.20.193.73:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f4b541d9780 con 0x7f4b540a0980 2026-02-22T23:25:25.802 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.777+0000 7f4b41ffb640 1 -- 10.20.193.73:0/3807895787 <== mon.3 v1:10.20.193.73:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4b440039c0 con 0x7f4b540a0980 2026-02-22T23:25:25.802 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.777+0000 7f4b41ffb640 10 monclient: handle_config config(0 keys) 2026-02-22T23:25:25.802 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.777+0000 7f4b41ffb640 1 -- 10.20.193.73:0/3807895787 <== mon.3 v1:10.20.193.73:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f4b44003fb0 con 0x7f4b540a0980 2026-02-22T23:25:25.802 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.777+0000 7f4b41ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:25:25.802 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.777+0000 7f4b437fe640 4 set_mon_vals no callback set 2026-02-22T23:25:25.802 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.777+0000 7f4b41ffb640 10 monclient: got monmap 1 from mon.g (according to old e1) 2026-02-22T23:25:25.802 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.777+0000 7f4b41ffb640 10 monclient: dump: 2026-02-22T23:25:25.802 INFO:teuthology.orchestra.run.trial073.stderr:epoch 1 2026-02-22T23:25:25.803 INFO:teuthology.orchestra.run.trial073.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:25.803 INFO:teuthology.orchestra.run.trial073.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:25.803 INFO:teuthology.orchestra.run.trial073.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:25.803 INFO:teuthology.orchestra.run.trial073.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:25.803 INFO:teuthology.orchestra.run.trial073.stderr:election_strategy: 3 2026-02-22T23:25:25.803 INFO:teuthology.orchestra.run.trial073.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:25.803 INFO:teuthology.orchestra.run.trial073.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:25.803 INFO:teuthology.orchestra.run.trial073.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:25.803 INFO:teuthology.orchestra.run.trial073.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:25.803 INFO:teuthology.orchestra.run.trial073.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:25.803 INFO:teuthology.orchestra.run.trial073.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:25.803 INFO:teuthology.orchestra.run.trial073.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:25.803 INFO:teuthology.orchestra.run.trial073.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:25.804 INFO:teuthology.orchestra.run.trial073.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:25.804 INFO:teuthology.orchestra.run.trial073.stderr: 2026-02-22T23:25:25.804 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.777+0000 7f4b41ffb640 1 -- 10.20.193.73:0/3807895787 <== mon.3 v1:10.20.193.73:6790/0 7 ==== mgrmap(e 1) ==== 811+0+0 (unknown 4133961934 0 0) 0x7f4b440058c0 con 0x7f4b540a0980 2026-02-22T23:25:25.804 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.777+0000 7f4b41ffb640 1 -- 10.20.193.73:0/3807895787 <== mon.3 v1:10.20.193.73:6790/0 8 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (unknown 3674511042 0 0) 0x7f4b44006000 con 0x7f4b540a0980 2026-02-22T23:25:25.804 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.777+0000 7f4b5b98f640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T23:25:25.804 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.777+0000 7f4b5b98f640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T23:25:25.804 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.777+0000 7f4b5b98f640 10 monclient: _send_mon_message to mon.g at v1:10.20.193.73:6790/0 2026-02-22T23:25:25.804 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.777+0000 7f4b5b98f640 1 -- 10.20.193.73:0/3807895787 --> v1:10.20.193.73:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b5411d890 con 0x7f4b540a0980 2026-02-22T23:25:25.804 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.779+0000 7f4b41ffb640 1 -- 10.20.193.73:0/3807895787 <== mon.3 v1:10.20.193.73:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75931 (unknown 1092875540 0 4127419540) 0x7f4b440044e0 con 0x7f4b540a0980 2026-02-22T23:25:25.804 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.779+0000 7f4b41ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T23:25:25.804 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.779+0000 7f4b41ffb640 10 monclient: _finish_command 1 = system:0 2026-02-22T23:25:25.805 INFO:tasks.ceph.mgr.x.trial073.stderr:2026-02-22T23:25:25.802+0000 7f413a1cd140 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2026-02-22T23:25:25.813 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.811+0000 7f4b5b98f640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "bfcf94e1-2623-4443-aaf8-f525210ab7b2", "id": 2}] 2026-02-22T23:25:25.814 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.811+0000 7f4b5b98f640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "bfcf94e1-2623-4443-aaf8-f525210ab7b2", "id": 2}] 2026-02-22T23:25:25.814 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.811+0000 7f4b5b98f640 10 monclient: _send_mon_message to mon.g at v1:10.20.193.73:6790/0 2026-02-22T23:25:25.814 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.811+0000 7f4b5b98f640 1 -- 10.20.193.73:0/3807895787 --> v1:10.20.193.73:6790/0 -- mon_command({"prefix": "osd new", "uuid": "bfcf94e1-2623-4443-aaf8-f525210ab7b2", "id": 2} v 0) -- 0x7f4b5406ce10 con 0x7f4b540a0980 2026-02-22T23:25:25.816 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.814+0000 7f4b41ffb640 1 -- 10.20.193.73:0/3807895787 <== mon.3 v1:10.20.193.73:6790/0 10 ==== mon_command_ack([{"prefix": "osd new", "uuid": "bfcf94e1-2623-4443-aaf8-f525210ab7b2", "id": 2}]=0 v5) ==== 112+0+2 (unknown 3591439478 0 216599125) 0x7f4b44005be0 con 0x7f4b540a0980 2026-02-22T23:25:25.816 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.814+0000 7f4b41ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "bfcf94e1-2623-4443-aaf8-f525210ab7b2", "id": 2}] 2026-02-22T23:25:25.816 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.814+0000 7f4b41ffb640 10 monclient: _finish_command 2 = system:0 2026-02-22T23:25:25.816 INFO:teuthology.orchestra.run.trial073.stdout:2 2026-02-22T23:25:25.817 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.814+0000 7f4b5b98f640 10 monclient: shutdown 2026-02-22T23:25:25.817 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.814+0000 7f4b5b98f640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T23:25:25.817 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.814+0000 7f4b5b98f640 1 -- 10.20.193.73:0/3807895787 >> v1:10.20.193.73:6790/0 conn(0x7f4b540a0980 legacy=0x7f4b54136ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:25.817 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.814+0000 7f4b5b98f640 1 -- 10.20.193.73:0/3807895787 shutdown_connections 2026-02-22T23:25:25.817 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.814+0000 7f4b5b98f640 1 -- 10.20.193.73:0/3807895787 >> 10.20.193.73:0/3807895787 conn(0x7f4b540a7780 msgr2=0x7f4b540a4f60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:25:25.817 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.814+0000 7f4b5b98f640 1 -- 10.20.193.73:0/3807895787 shutdown_connections 2026-02-22T23:25:25.817 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.814+0000 7f4b5b98f640 1 -- 10.20.193.73:0/3807895787 wait complete. 2026-02-22T23:25:25.824 DEBUG:teuthology.orchestra.run.trial073:> sudo ceph --cluster ceph osd new 32e9109d-09f0-4c75-bfbe-bb0fa237ca08 3 2026-02-22T23:25:25.860 INFO:tasks.ceph.mgr.x.trial073.stderr:2026-02-22T23:25:25.858+0000 7f413a1cd140 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2026-02-22T23:25:25.889 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.887+0000 7f0cb6dce640 10 monclient: get_monmap_and_config 2026-02-22T23:25:25.890 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.887+0000 7f0cb6dce640 10 monclient: build_initial_monmap 2026-02-22T23:25:25.890 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.887+0000 7f0cb6dce640 10 monclient: monmap: 2026-02-22T23:25:25.890 INFO:teuthology.orchestra.run.trial073.stderr:epoch 0 2026-02-22T23:25:25.890 INFO:teuthology.orchestra.run.trial073.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:25.890 INFO:teuthology.orchestra.run.trial073.stderr:last_changed 2026-02-22T23:25:25.888969+0000 2026-02-22T23:25:25.890 INFO:teuthology.orchestra.run.trial073.stderr:created 2026-02-22T23:25:25.888969+0000 2026-02-22T23:25:25.890 INFO:teuthology.orchestra.run.trial073.stderr:min_mon_release 0 (unknown) 2026-02-22T23:25:25.890 INFO:teuthology.orchestra.run.trial073.stderr:election_strategy: 3 2026-02-22T23:25:25.890 INFO:teuthology.orchestra.run.trial073.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-22T23:25:25.890 INFO:teuthology.orchestra.run.trial073.stderr:1: v1:10.20.193.73:6789/0 mon.noname-f 2026-02-22T23:25:25.891 INFO:teuthology.orchestra.run.trial073.stderr:2: v1:10.20.193.45:6790/0 mon.noname-b 2026-02-22T23:25:25.891 INFO:teuthology.orchestra.run.trial073.stderr:3: v1:10.20.193.73:6790/0 mon.noname-g 2026-02-22T23:25:25.891 INFO:teuthology.orchestra.run.trial073.stderr:4: v1:10.20.193.45:6791/0 mon.noname-c 2026-02-22T23:25:25.891 INFO:teuthology.orchestra.run.trial073.stderr:5: v1:10.20.193.73:6791/0 mon.noname-h 2026-02-22T23:25:25.891 INFO:teuthology.orchestra.run.trial073.stderr:6: v1:10.20.193.45:6792/0 mon.noname-d 2026-02-22T23:25:25.891 INFO:teuthology.orchestra.run.trial073.stderr:7: v1:10.20.193.73:6792/0 mon.noname-i 2026-02-22T23:25:25.891 INFO:teuthology.orchestra.run.trial073.stderr:8: v1:10.20.193.45:6793/0 mon.noname-e 2026-02-22T23:25:25.891 INFO:teuthology.orchestra.run.trial073.stderr: 2026-02-22T23:25:25.899 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.888+0000 7f0cb6dce640 1 Processor -- start 2026-02-22T23:25:25.899 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.888+0000 7f0cb6dce640 1 -- start start 2026-02-22T23:25:25.899 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.888+0000 7f0cb6dce640 10 monclient: init 2026-02-22T23:25:25.899 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.888+0000 7f0cb6dce640 10 monclient: _reopen_session rank -1 2026-02-22T23:25:25.899 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.888+0000 7f0cb6dce640 10 monclient: _add_conns ranks=[1,2,5,0,8,3,7,4,6] 2026-02-22T23:25:25.899 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.888+0000 7f0cb6dce640 10 monclient(hunting): picked mon.noname-f con 0x7f0cb00a5e00 addr v1:10.20.193.73:6789/0 2026-02-22T23:25:25.899 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.888+0000 7f0cb6dce640 10 monclient(hunting): picked mon.noname-b con 0x7f0cb00a68f0 addr v1:10.20.193.45:6790/0 2026-02-22T23:25:25.899 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.888+0000 7f0cb6dce640 10 monclient(hunting): picked mon.noname-h con 0x7f0cb00a6d00 addr v1:10.20.193.73:6791/0 2026-02-22T23:25:25.900 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.888+0000 7f0cb6dce640 1 -- --> v1:10.20.193.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0cb00a2d00 con 0x7f0cb00a5e00 2026-02-22T23:25:25.900 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.888+0000 7f0cb6dce640 1 -- --> v1:10.20.193.45:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0cb00a2fe0 con 0x7f0cb00a68f0 2026-02-22T23:25:25.900 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.888+0000 7f0cb6dce640 1 -- --> v1:10.20.193.73:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0cb00a32c0 con 0x7f0cb00a6d00 2026-02-22T23:25:25.900 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.888+0000 7f0cb6dce640 10 monclient(hunting): _renew_subs 2026-02-22T23:25:25.900 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.888+0000 7f0cb6dce640 10 monclient(hunting): authenticate will time out at 654.637695s 2026-02-22T23:25:25.900 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.888+0000 7f0cb5344640 1 --1- >> v1:10.20.193.73:6791/0 conn(0x7f0cb00a6d00 0x7f0cb01417b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.73:6791/0 says I am v1:10.20.193.73:40286/0 (socket says 10.20.193.73:40286) 2026-02-22T23:25:25.900 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.888+0000 7f0cb5344640 1 -- 10.20.193.73:0/3178535113 learned_addr learned my addr 10.20.193.73:0/3178535113 (peer_addr_for_me v1:10.20.193.73:0/0) 2026-02-22T23:25:25.900 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.888+0000 7f0cb4b43640 1 --1- 10.20.193.73:0/3178535113 >> v1:10.20.193.73:6789/0 conn(0x7f0cb00a5e00 0x7f0cb00a61e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.73:6789/0 says I am v1:10.20.193.73:52468/0 (socket says 10.20.193.73:52468) 2026-02-22T23:25:25.900 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.888+0000 7f0ca77fe640 1 -- 10.20.193.73:0/3178535113 <== mon.5 v1:10.20.193.73:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2260811940 0 0) 0x7f0cb00a32c0 con 0x7f0cb00a6d00 2026-02-22T23:25:25.900 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.888+0000 7f0ca77fe640 10 monclient(hunting): _negotiate 2026-02-22T23:25:25.900 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.888+0000 7f0ca77fe640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:25.900 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.888+0000 7f0ca77fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:25.901 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.888+0000 7f0ca77fe640 10 monclient(hunting): my global_id is 4145 2026-02-22T23:25:25.901 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.888+0000 7f0ca77fe640 1 -- 10.20.193.73:0/3178535113 --> v1:10.20.193.73:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0c9c003620 con 0x7f0cb00a6d00 2026-02-22T23:25:25.901 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.888+0000 7f0ca77fe640 1 -- 10.20.193.73:0/3178535113 <== mon.1 v1:10.20.193.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2690941205 0 0) 0x7f0cb00a2d00 con 0x7f0cb00a5e00 2026-02-22T23:25:25.901 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.888+0000 7f0ca77fe640 10 monclient(hunting): _negotiate 2026-02-22T23:25:25.901 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.888+0000 7f0ca77fe640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:25.901 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.888+0000 7f0ca77fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:25.901 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.888+0000 7f0ca77fe640 10 monclient(hunting): my global_id is 4141 2026-02-22T23:25:25.901 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.888+0000 7f0ca77fe640 1 -- 10.20.193.73:0/3178535113 --> v1:10.20.193.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0cb00a32c0 con 0x7f0cb00a5e00 2026-02-22T23:25:25.901 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.889+0000 7f0ca77fe640 1 -- 10.20.193.73:0/3178535113 <== mon.5 v1:10.20.193.73:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4157954410 0 0) 0x7f0c9c003620 con 0x7f0cb00a6d00 2026-02-22T23:25:25.901 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.889+0000 7f0ca77fe640 1 -- 10.20.193.73:0/3178535113 >> v1:10.20.193.45:6790/0 conn(0x7f0cb00a68f0 legacy=0x7f0cb013e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:25.901 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.889+0000 7f0ca77fe640 1 -- 10.20.193.73:0/3178535113 >> v1:10.20.193.73:6789/0 conn(0x7f0cb00a5e00 legacy=0x7f0cb00a61e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:25.901 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.889+0000 7f0ca77fe640 10 monclient: _finish_hunting 0 2026-02-22T23:25:25.901 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.889+0000 7f0ca77fe640 1 monclient: found mon.noname-h 2026-02-22T23:25:25.902 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.889+0000 7f0ca77fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T23:25:25.902 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.889+0000 7f0ca77fe640 10 monclient: _send_mon_message to mon.noname-h at v1:10.20.193.73:6791/0 2026-02-22T23:25:25.902 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.889+0000 7f0ca77fe640 1 -- 10.20.193.73:0/3178535113 --> v1:10.20.193.73:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0cb00a35a0 con 0x7f0cb00a6d00 2026-02-22T23:25:25.902 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.889+0000 7f0ca77fe640 10 monclient: _finish_auth 0 2026-02-22T23:25:25.902 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.889+0000 7f0ca77fe640 10 monclient: _check_auth_tickets 2026-02-22T23:25:25.902 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.889+0000 7f0ca77fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T23:25:25.902 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.889+0000 7f0ca77fe640 1 -- 10.20.193.73:0/3178535113 <== mon.5 v1:10.20.193.73:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f0cac0033c0 con 0x7f0cb00a6d00 2026-02-22T23:25:25.902 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.889+0000 7f0cb6dce640 5 monclient: authenticate success, global_id 4145 2026-02-22T23:25:25.902 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.889+0000 7f0cb6dce640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-22T23:25:25.902 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.889+0000 7f0ca77fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:25:25.902 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.889+0000 7f0ca77fe640 10 monclient: got monmap 1 from mon.noname-h (according to old e1) 2026-02-22T23:25:25.902 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.889+0000 7f0ca77fe640 10 monclient: dump: 2026-02-22T23:25:25.903 INFO:teuthology.orchestra.run.trial073.stderr:epoch 1 2026-02-22T23:25:25.903 INFO:teuthology.orchestra.run.trial073.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:25.903 INFO:teuthology.orchestra.run.trial073.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:25.903 INFO:teuthology.orchestra.run.trial073.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:25.903 INFO:teuthology.orchestra.run.trial073.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:25.903 INFO:teuthology.orchestra.run.trial073.stderr:election_strategy: 3 2026-02-22T23:25:25.903 INFO:teuthology.orchestra.run.trial073.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:25.903 INFO:teuthology.orchestra.run.trial073.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:25.903 INFO:teuthology.orchestra.run.trial073.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:25.903 INFO:teuthology.orchestra.run.trial073.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:25.903 INFO:teuthology.orchestra.run.trial073.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:25.903 INFO:teuthology.orchestra.run.trial073.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:25.903 INFO:teuthology.orchestra.run.trial073.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:25.903 INFO:teuthology.orchestra.run.trial073.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:25.904 INFO:teuthology.orchestra.run.trial073.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:25.904 INFO:teuthology.orchestra.run.trial073.stderr: 2026-02-22T23:25:25.904 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.889+0000 7f0cb6dce640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-22T23:25:25.904 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.889+0000 7f0ca77fe640 1 -- 10.20.193.73:0/3178535113 <== mon.5 v1:10.20.193.73:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0cac0035e0 con 0x7f0cb00a6d00 2026-02-22T23:25:25.904 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.889+0000 7f0ca77fe640 10 monclient: handle_config config(0 keys) 2026-02-22T23:25:25.904 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.889+0000 7f0ca77fe640 1 -- 10.20.193.73:0/3178535113 <== mon.5 v1:10.20.193.73:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f0cac005060 con 0x7f0cb00a6d00 2026-02-22T23:25:25.904 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.889+0000 7f0ca77fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:25:25.904 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.889+0000 7f0ca77fe640 10 monclient: got monmap 1 from mon.h (according to old e1) 2026-02-22T23:25:25.904 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.889+0000 7f0ca77fe640 10 monclient: dump: 2026-02-22T23:25:25.904 INFO:teuthology.orchestra.run.trial073.stderr:epoch 1 2026-02-22T23:25:25.904 INFO:teuthology.orchestra.run.trial073.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:25.904 INFO:teuthology.orchestra.run.trial073.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:25.905 INFO:teuthology.orchestra.run.trial073.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:25.905 INFO:teuthology.orchestra.run.trial073.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:25.905 INFO:teuthology.orchestra.run.trial073.stderr:election_strategy: 3 2026-02-22T23:25:25.905 INFO:teuthology.orchestra.run.trial073.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:25.905 INFO:teuthology.orchestra.run.trial073.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:25.905 INFO:teuthology.orchestra.run.trial073.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:25.905 INFO:teuthology.orchestra.run.trial073.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:25.905 INFO:teuthology.orchestra.run.trial073.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:25.905 INFO:teuthology.orchestra.run.trial073.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:25.905 INFO:teuthology.orchestra.run.trial073.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:25.905 INFO:teuthology.orchestra.run.trial073.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:25.905 INFO:teuthology.orchestra.run.trial073.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:25.905 INFO:teuthology.orchestra.run.trial073.stderr: 2026-02-22T23:25:25.905 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.889+0000 7f0cb6dce640 10 monclient: get_monmap_and_config success 2026-02-22T23:25:25.906 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.889+0000 7f0cb6dce640 4 set_mon_vals no callback set 2026-02-22T23:25:25.906 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.889+0000 7f0cb6dce640 10 monclient: shutdown 2026-02-22T23:25:25.906 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.889+0000 7f0cb6dce640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T23:25:25.906 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.889+0000 7f0cb6dce640 1 -- 10.20.193.73:0/3178535113 >> v1:10.20.193.73:6791/0 conn(0x7f0cb00a6d00 legacy=0x7f0cb01417b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:25.906 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.889+0000 7f0cb6dce640 1 -- 10.20.193.73:0/3178535113 shutdown_connections 2026-02-22T23:25:25.906 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.889+0000 7f0cb6dce640 1 -- 10.20.193.73:0/3178535113 >> 10.20.193.73:0/3178535113 conn(0x7f0cb00abb50 msgr2=0x7f0cb00a7f00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:25:25.906 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.889+0000 7f0cb6dce640 1 -- 10.20.193.73:0/3178535113 shutdown_connections 2026-02-22T23:25:25.906 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.889+0000 7f0cb6dce640 1 -- 10.20.193.73:0/3178535113 wait complete. 2026-02-22T23:25:25.906 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.889+0000 7f0cb6dce640 10 monclient: build_initial_monmap 2026-02-22T23:25:25.906 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.889+0000 7f0cb6dce640 10 monclient: monmap: 2026-02-22T23:25:25.906 INFO:teuthology.orchestra.run.trial073.stderr:epoch 0 2026-02-22T23:25:25.906 INFO:teuthology.orchestra.run.trial073.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T23:25:25.907 INFO:teuthology.orchestra.run.trial073.stderr:last_changed 0.000000 2026-02-22T23:25:25.907 INFO:teuthology.orchestra.run.trial073.stderr:created 0.000000 2026-02-22T23:25:25.907 INFO:teuthology.orchestra.run.trial073.stderr:min_mon_release 0 (unknown) 2026-02-22T23:25:25.907 INFO:teuthology.orchestra.run.trial073.stderr:election_strategy: 1 2026-02-22T23:25:25.907 INFO:teuthology.orchestra.run.trial073.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-22T23:25:25.907 INFO:teuthology.orchestra.run.trial073.stderr:1: v1:10.20.193.73:6789/0 mon.noname-f 2026-02-22T23:25:25.907 INFO:teuthology.orchestra.run.trial073.stderr:2: v1:10.20.193.45:6790/0 mon.noname-b 2026-02-22T23:25:25.907 INFO:teuthology.orchestra.run.trial073.stderr:3: v1:10.20.193.73:6790/0 mon.noname-g 2026-02-22T23:25:25.907 INFO:teuthology.orchestra.run.trial073.stderr:4: v1:10.20.193.45:6791/0 mon.noname-c 2026-02-22T23:25:25.907 INFO:teuthology.orchestra.run.trial073.stderr:5: v1:10.20.193.73:6791/0 mon.noname-h 2026-02-22T23:25:25.907 INFO:teuthology.orchestra.run.trial073.stderr:6: v1:10.20.193.45:6792/0 mon.noname-d 2026-02-22T23:25:25.907 INFO:teuthology.orchestra.run.trial073.stderr:7: v1:10.20.193.73:6792/0 mon.noname-i 2026-02-22T23:25:25.907 INFO:teuthology.orchestra.run.trial073.stderr:8: v1:10.20.193.45:6793/0 mon.noname-e 2026-02-22T23:25:25.908 INFO:teuthology.orchestra.run.trial073.stderr: 2026-02-22T23:25:25.908 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.889+0000 7f0cb6dce640 1 Processor -- start 2026-02-22T23:25:25.908 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.889+0000 7f0cb6dce640 1 -- start start 2026-02-22T23:25:25.908 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.889+0000 7f0cb6dce640 10 monclient: init 2026-02-22T23:25:25.908 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.890+0000 7f0cb6dce640 10 monclient: _reopen_session rank -1 2026-02-22T23:25:25.908 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.890+0000 7f0cb6dce640 10 monclient: _add_conns ranks=[4,3,7,0,6,5,1,2,8] 2026-02-22T23:25:25.908 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.890+0000 7f0cb6dce640 10 monclient(hunting): picked mon.noname-c con 0x7f0cb00a5e00 addr v1:10.20.193.45:6791/0 2026-02-22T23:25:25.908 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.890+0000 7f0cb6dce640 10 monclient(hunting): picked mon.noname-g con 0x7f0cb00a68f0 addr v1:10.20.193.73:6790/0 2026-02-22T23:25:25.908 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.890+0000 7f0cb6dce640 10 monclient(hunting): picked mon.noname-i con 0x7f0cb00a6d00 addr v1:10.20.193.73:6792/0 2026-02-22T23:25:25.908 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.890+0000 7f0cb6dce640 1 -- --> v1:10.20.193.73:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0cb00a1d60 con 0x7f0cb00a68f0 2026-02-22T23:25:25.908 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.890+0000 7f0cb6dce640 1 -- --> v1:10.20.193.45:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0cb0128ea0 con 0x7f0cb00a5e00 2026-02-22T23:25:25.908 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.890+0000 7f0cb6dce640 1 -- --> v1:10.20.193.73:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0cb01d0b20 con 0x7f0cb00a6d00 2026-02-22T23:25:25.908 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.890+0000 7f0cb6dce640 10 monclient(hunting): _renew_subs 2026-02-22T23:25:25.909 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.890+0000 7f0cb6dce640 10 monclient(hunting): authenticate will time out at 654.639197s 2026-02-22T23:25:25.909 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.890+0000 7f0ca7fff640 1 --1- >> v1:10.20.193.73:6790/0 conn(0x7f0cb00a68f0 0x7f0cb01d0410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.73:6790/0 says I am v1:10.20.193.73:46284/0 (socket says 10.20.193.73:46284) 2026-02-22T23:25:25.909 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.890+0000 7f0ca7fff640 1 -- 10.20.193.73:0/1932252918 learned_addr learned my addr 10.20.193.73:0/1932252918 (peer_addr_for_me v1:10.20.193.73:0/0) 2026-02-22T23:25:25.909 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.890+0000 7f0cb5344640 1 --1- >> v1:10.20.193.73:6792/0 conn(0x7f0cb00a6d00 0x7f0cb01d7f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.73:6792/0 says I am v1:10.20.193.73:39196/0 (socket says 10.20.193.73:39196) 2026-02-22T23:25:25.909 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.890+0000 7f0ca57fa640 1 -- 10.20.193.73:0/1932252918 <== mon.7 v1:10.20.193.73:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1197071488 0 0) 0x7f0cb01d0b20 con 0x7f0cb00a6d00 2026-02-22T23:25:25.909 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.890+0000 7f0ca57fa640 10 monclient(hunting): _negotiate 2026-02-22T23:25:25.909 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.890+0000 7f0ca57fa640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:25.909 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.890+0000 7f0ca57fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:25.909 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.890+0000 7f0ca57fa640 10 monclient(hunting): my global_id is 4138 2026-02-22T23:25:25.909 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.890+0000 7f0ca57fa640 1 -- 10.20.193.73:0/1932252918 --> v1:10.20.193.73:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0c80003620 con 0x7f0cb00a6d00 2026-02-22T23:25:25.909 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.890+0000 7f0ca57fa640 1 -- 10.20.193.73:0/1932252918 <== mon.3 v1:10.20.193.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4195752729 0 0) 0x7f0cb00a2fe0 con 0x7f0cb00a68f0 2026-02-22T23:25:25.909 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.890+0000 7f0ca57fa640 10 monclient(hunting): _negotiate 2026-02-22T23:25:25.909 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.890+0000 7f0ca57fa640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:25.910 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.890+0000 7f0ca57fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:25.910 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.890+0000 7f0ca57fa640 10 monclient(hunting): my global_id is 4152 2026-02-22T23:25:25.910 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.890+0000 7f0ca57fa640 1 -- 10.20.193.73:0/1932252918 --> v1:10.20.193.73:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0cb01d0b20 con 0x7f0cb00a68f0 2026-02-22T23:25:25.910 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.890+0000 7f0ca57fa640 1 -- 10.20.193.73:0/1932252918 <== mon.3 v1:10.20.193.73:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4074805737 0 0) 0x7f0cb01d0b20 con 0x7f0cb00a68f0 2026-02-22T23:25:25.910 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.890+0000 7f0ca57fa640 1 -- 10.20.193.73:0/1932252918 --> v1:10.20.193.73:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0cb00a2fe0 con 0x7f0cb00a68f0 2026-02-22T23:25:25.910 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.890+0000 7f0ca57fa640 1 -- 10.20.193.73:0/1932252918 <== mon.7 v1:10.20.193.73:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 945401945 0 0) 0x7f0c80003620 con 0x7f0cb00a6d00 2026-02-22T23:25:25.910 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.890+0000 7f0ca57fa640 1 -- 10.20.193.73:0/1932252918 --> v1:10.20.193.73:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0cb01d0b20 con 0x7f0cb00a6d00 2026-02-22T23:25:25.910 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.890+0000 7f0ca57fa640 1 -- 10.20.193.73:0/1932252918 <== mon.3 v1:10.20.193.73:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f0c98003360 con 0x7f0cb00a68f0 2026-02-22T23:25:25.910 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.890+0000 7f0ca57fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-22T23:25:25.910 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.890+0000 7f0ca57fa640 10 monclient(hunting): got monmap 1 from mon.noname-g (according to old e1) 2026-02-22T23:25:25.910 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.890+0000 7f0ca57fa640 10 monclient(hunting): dump: 2026-02-22T23:25:25.910 INFO:teuthology.orchestra.run.trial073.stderr:epoch 1 2026-02-22T23:25:25.911 INFO:teuthology.orchestra.run.trial073.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:25.911 INFO:teuthology.orchestra.run.trial073.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:25.911 INFO:teuthology.orchestra.run.trial073.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:25.911 INFO:teuthology.orchestra.run.trial073.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:25.911 INFO:teuthology.orchestra.run.trial073.stderr:election_strategy: 3 2026-02-22T23:25:25.911 INFO:teuthology.orchestra.run.trial073.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:25.911 INFO:teuthology.orchestra.run.trial073.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:25.911 INFO:teuthology.orchestra.run.trial073.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:25.911 INFO:teuthology.orchestra.run.trial073.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:25.911 INFO:teuthology.orchestra.run.trial073.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:25.911 INFO:teuthology.orchestra.run.trial073.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:25.911 INFO:teuthology.orchestra.run.trial073.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:25.911 INFO:teuthology.orchestra.run.trial073.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:25.911 INFO:teuthology.orchestra.run.trial073.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:25.912 INFO:teuthology.orchestra.run.trial073.stderr: 2026-02-22T23:25:25.912 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.890+0000 7f0ca57fa640 10 monclient(hunting): _finish_auth 0 2026-02-22T23:25:25.912 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.890+0000 7f0ca57fa640 1 -- 10.20.193.73:0/1932252918 <== mon.7 v1:10.20.193.73:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f0cac004fa0 con 0x7f0cb00a6d00 2026-02-22T23:25:25.912 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.890+0000 7f0ca57fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-22T23:25:25.912 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.890+0000 7f0ca57fa640 10 monclient(hunting): got monmap 1 from mon.i (according to old e1) 2026-02-22T23:25:25.912 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.890+0000 7f0ca57fa640 10 monclient(hunting): dump: 2026-02-22T23:25:25.912 INFO:teuthology.orchestra.run.trial073.stderr:epoch 1 2026-02-22T23:25:25.912 INFO:teuthology.orchestra.run.trial073.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:25.912 INFO:teuthology.orchestra.run.trial073.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:25.912 INFO:teuthology.orchestra.run.trial073.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:25.912 INFO:teuthology.orchestra.run.trial073.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:25.912 INFO:teuthology.orchestra.run.trial073.stderr:election_strategy: 3 2026-02-22T23:25:25.913 INFO:teuthology.orchestra.run.trial073.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:25.913 INFO:teuthology.orchestra.run.trial073.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:25.913 INFO:teuthology.orchestra.run.trial073.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:25.913 INFO:teuthology.orchestra.run.trial073.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:25.913 INFO:teuthology.orchestra.run.trial073.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:25.913 INFO:teuthology.orchestra.run.trial073.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:25.913 INFO:teuthology.orchestra.run.trial073.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:25.913 INFO:teuthology.orchestra.run.trial073.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:25.913 INFO:teuthology.orchestra.run.trial073.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:25.913 INFO:teuthology.orchestra.run.trial073.stderr: 2026-02-22T23:25:25.913 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.890+0000 7f0ca57fa640 1 -- 10.20.193.73:0/1932252918 <== mon.3 v1:10.20.193.73:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2413982422 0 0) 0x7f0cb00a2fe0 con 0x7f0cb00a68f0 2026-02-22T23:25:25.913 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.890+0000 7f0ca57fa640 1 -- 10.20.193.73:0/1932252918 >> v1:10.20.193.73:6792/0 conn(0x7f0cb00a6d00 legacy=0x7f0cb01d7f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:25.913 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.890+0000 7f0ca57fa640 1 -- 10.20.193.73:0/1932252918 >> v1:10.20.193.45:6791/0 conn(0x7f0cb00a5e00 legacy=0x7f0cb01cfd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:25.914 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.890+0000 7f0ca57fa640 10 monclient: _finish_hunting 0 2026-02-22T23:25:25.914 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.890+0000 7f0ca57fa640 1 monclient: found mon.g 2026-02-22T23:25:25.914 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.890+0000 7f0ca57fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T23:25:25.914 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.890+0000 7f0ca57fa640 10 monclient: _send_mon_message to mon.g at v1:10.20.193.73:6790/0 2026-02-22T23:25:25.914 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.890+0000 7f0ca57fa640 1 -- 10.20.193.73:0/1932252918 --> v1:10.20.193.73:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0cb0127ef0 con 0x7f0cb00a68f0 2026-02-22T23:25:25.914 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.890+0000 7f0ca57fa640 10 monclient: _finish_auth 0 2026-02-22T23:25:25.914 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.890+0000 7f0ca57fa640 10 monclient: _check_auth_tickets 2026-02-22T23:25:25.914 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.890+0000 7f0ca57fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T23:25:25.914 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.890+0000 7f0cb6dce640 5 monclient: authenticate success, global_id 4152 2026-02-22T23:25:25.914 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.890+0000 7f0cb6dce640 10 monclient: _renew_subs 2026-02-22T23:25:25.914 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.890+0000 7f0cb6dce640 10 monclient: _send_mon_message to mon.g at v1:10.20.193.73:6790/0 2026-02-22T23:25:25.914 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.890+0000 7f0cb6dce640 1 -- 10.20.193.73:0/1932252918 --> v1:10.20.193.73:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f0cb00aa4a0 con 0x7f0cb00a68f0 2026-02-22T23:25:25.915 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.890+0000 7f0cb6dce640 10 monclient: _renew_subs 2026-02-22T23:25:25.915 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.890+0000 7f0cb6dce640 10 monclient: _send_mon_message to mon.g at v1:10.20.193.73:6790/0 2026-02-22T23:25:25.915 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.890+0000 7f0cb6dce640 1 -- 10.20.193.73:0/1932252918 --> v1:10.20.193.73:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f0cb0127a20 con 0x7f0cb00a68f0 2026-02-22T23:25:25.915 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.890+0000 7f0ca57fa640 1 -- 10.20.193.73:0/1932252918 <== mon.3 v1:10.20.193.73:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0c980039c0 con 0x7f0cb00a68f0 2026-02-22T23:25:25.915 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.890+0000 7f0ca57fa640 10 monclient: handle_config config(0 keys) 2026-02-22T23:25:25.915 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.890+0000 7f0ca57fa640 1 -- 10.20.193.73:0/1932252918 <== mon.3 v1:10.20.193.73:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f0c98003ef0 con 0x7f0cb00a68f0 2026-02-22T23:25:25.915 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.890+0000 7f0ca57fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:25:25.915 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.890+0000 7f0ca57fa640 10 monclient: got monmap 1 from mon.g (according to old e1) 2026-02-22T23:25:25.915 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.890+0000 7f0ca6ffd640 4 set_mon_vals no callback set 2026-02-22T23:25:25.915 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.890+0000 7f0ca57fa640 10 monclient: dump: 2026-02-22T23:25:25.915 INFO:teuthology.orchestra.run.trial073.stderr:epoch 1 2026-02-22T23:25:25.915 INFO:teuthology.orchestra.run.trial073.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:25.916 INFO:teuthology.orchestra.run.trial073.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:25.916 INFO:teuthology.orchestra.run.trial073.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:25.916 INFO:teuthology.orchestra.run.trial073.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:25.916 INFO:teuthology.orchestra.run.trial073.stderr:election_strategy: 3 2026-02-22T23:25:25.916 INFO:teuthology.orchestra.run.trial073.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:25.916 INFO:teuthology.orchestra.run.trial073.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:25.916 INFO:teuthology.orchestra.run.trial073.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:25.916 INFO:teuthology.orchestra.run.trial073.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:25.916 INFO:teuthology.orchestra.run.trial073.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:25.916 INFO:teuthology.orchestra.run.trial073.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:25.916 INFO:teuthology.orchestra.run.trial073.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:25.916 INFO:teuthology.orchestra.run.trial073.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:25.916 INFO:teuthology.orchestra.run.trial073.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:25.916 INFO:teuthology.orchestra.run.trial073.stderr: 2026-02-22T23:25:25.917 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.890+0000 7f0ca57fa640 1 -- 10.20.193.73:0/1932252918 <== mon.3 v1:10.20.193.73:6790/0 7 ==== mgrmap(e 1) ==== 811+0+0 (unknown 4133961934 0 0) 0x7f0c980058c0 con 0x7f0cb00a68f0 2026-02-22T23:25:25.917 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.890+0000 7f0ca57fa640 1 -- 10.20.193.73:0/1932252918 <== mon.3 v1:10.20.193.73:6790/0 8 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (unknown 1842580190 0 0) 0x7f0c98006070 con 0x7f0cb00a68f0 2026-02-22T23:25:25.917 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.891+0000 7f0cb6dce640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T23:25:25.917 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.891+0000 7f0cb6dce640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T23:25:25.917 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.891+0000 7f0cb6dce640 10 monclient: _send_mon_message to mon.g at v1:10.20.193.73:6790/0 2026-02-22T23:25:25.917 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.891+0000 7f0cb6dce640 1 -- 10.20.193.73:0/1932252918 --> v1:10.20.193.73:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0cb00008d0 con 0x7f0cb00a68f0 2026-02-22T23:25:25.917 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.892+0000 7f0ca57fa640 1 -- 10.20.193.73:0/1932252918 <== mon.3 v1:10.20.193.73:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75931 (unknown 1092875540 0 4127419540) 0x7f0cb00a1d60 con 0x7f0cb00a68f0 2026-02-22T23:25:25.917 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.892+0000 7f0ca57fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T23:25:25.917 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.892+0000 7f0ca57fa640 10 monclient: _finish_command 1 = system:0 2026-02-22T23:25:25.918 INFO:tasks.ceph.mgr.x.trial073.stderr:2026-02-22T23:25:25.902+0000 7f413a1cd140 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2026-02-22T23:25:25.926 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.924+0000 7f0cb6dce640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "32e9109d-09f0-4c75-bfbe-bb0fa237ca08", "id": 3}] 2026-02-22T23:25:25.926 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.924+0000 7f0cb6dce640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "32e9109d-09f0-4c75-bfbe-bb0fa237ca08", "id": 3}] 2026-02-22T23:25:25.926 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.924+0000 7f0cb6dce640 10 monclient: _send_mon_message to mon.g at v1:10.20.193.73:6790/0 2026-02-22T23:25:25.926 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.924+0000 7f0cb6dce640 1 -- 10.20.193.73:0/1932252918 --> v1:10.20.193.73:6790/0 -- mon_command({"prefix": "osd new", "uuid": "32e9109d-09f0-4c75-bfbe-bb0fa237ca08", "id": 3} v 0) -- 0x7f0cb00a5770 con 0x7f0cb00a68f0 2026-02-22T23:25:25.928 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.926+0000 7f0ca57fa640 1 -- 10.20.193.73:0/1932252918 <== mon.3 v1:10.20.193.73:6790/0 10 ==== mon_command_ack([{"prefix": "osd new", "uuid": "32e9109d-09f0-4c75-bfbe-bb0fa237ca08", "id": 3}]=0 v6) ==== 112+0+2 (unknown 1317208679 0 525046306) 0x7f0c980044e0 con 0x7f0cb00a68f0 2026-02-22T23:25:25.928 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.926+0000 7f0ca57fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "32e9109d-09f0-4c75-bfbe-bb0fa237ca08", "id": 3}] 2026-02-22T23:25:25.928 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.926+0000 7f0ca57fa640 10 monclient: _finish_command 2 = system:0 2026-02-22T23:25:25.929 INFO:teuthology.orchestra.run.trial073.stdout:3 2026-02-22T23:25:25.929 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.927+0000 7f0cb6dce640 10 monclient: shutdown 2026-02-22T23:25:25.930 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.927+0000 7f0cb6dce640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T23:25:25.930 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.927+0000 7f0cb6dce640 1 -- 10.20.193.73:0/1932252918 >> v1:10.20.193.73:6790/0 conn(0x7f0cb00a68f0 legacy=0x7f0cb01d0410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:25.930 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.927+0000 7f0cb6dce640 1 -- 10.20.193.73:0/1932252918 shutdown_connections 2026-02-22T23:25:25.930 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.927+0000 7f0cb6dce640 1 -- 10.20.193.73:0/1932252918 >> 10.20.193.73:0/1932252918 conn(0x7f0cb00abb50 msgr2=0x7f0cb0142610 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:25:25.930 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.927+0000 7f0cb6dce640 1 -- 10.20.193.73:0/1932252918 shutdown_connections 2026-02-22T23:25:25.930 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:25.927+0000 7f0cb6dce640 1 -- 10.20.193.73:0/1932252918 wait complete. 2026-02-22T23:25:25.930 INFO:tasks.ceph.mgr.x.trial073.stderr:2026-02-22T23:25:25.928+0000 7f413a1cd140 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2026-02-22T23:25:25.935 DEBUG:teuthology.orchestra.run.trial073:> sudo ceph --cluster ceph osd new 311ec782-d282-48e9-9545-41ac3acb1ac8 4 2026-02-22T23:25:25.955 INFO:tasks.ceph.mgr.x.trial073.stderr:2026-02-22T23:25:25.953+0000 7f413a1cd140 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2026-02-22T23:25:25.981 INFO:tasks.ceph.mgr.x.trial073.stderr:2026-02-22T23:25:25.979+0000 7f413a1cd140 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2026-02-22T23:25:26.004 INFO:tasks.ceph.mgr.x.trial073.stderr:2026-02-22T23:25:26.002+0000 7f413a1cd140 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2026-02-22T23:25:26.027 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.017+0000 7f175acd3640 10 monclient: get_monmap_and_config 2026-02-22T23:25:26.027 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.017+0000 7f175acd3640 10 monclient: build_initial_monmap 2026-02-22T23:25:26.027 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.017+0000 7f175acd3640 10 monclient: monmap: 2026-02-22T23:25:26.027 INFO:teuthology.orchestra.run.trial073.stderr:epoch 0 2026-02-22T23:25:26.027 INFO:teuthology.orchestra.run.trial073.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:26.027 INFO:teuthology.orchestra.run.trial073.stderr:last_changed 2026-02-22T23:25:26.018335+0000 2026-02-22T23:25:26.027 INFO:teuthology.orchestra.run.trial073.stderr:created 2026-02-22T23:25:26.018335+0000 2026-02-22T23:25:26.027 INFO:teuthology.orchestra.run.trial073.stderr:min_mon_release 0 (unknown) 2026-02-22T23:25:26.028 INFO:teuthology.orchestra.run.trial073.stderr:election_strategy: 3 2026-02-22T23:25:26.028 INFO:teuthology.orchestra.run.trial073.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-22T23:25:26.028 INFO:teuthology.orchestra.run.trial073.stderr:1: v1:10.20.193.73:6789/0 mon.noname-f 2026-02-22T23:25:26.028 INFO:teuthology.orchestra.run.trial073.stderr:2: v1:10.20.193.45:6790/0 mon.noname-b 2026-02-22T23:25:26.028 INFO:teuthology.orchestra.run.trial073.stderr:3: v1:10.20.193.73:6790/0 mon.noname-g 2026-02-22T23:25:26.028 INFO:teuthology.orchestra.run.trial073.stderr:4: v1:10.20.193.45:6791/0 mon.noname-c 2026-02-22T23:25:26.028 INFO:teuthology.orchestra.run.trial073.stderr:5: v1:10.20.193.73:6791/0 mon.noname-h 2026-02-22T23:25:26.028 INFO:teuthology.orchestra.run.trial073.stderr:6: v1:10.20.193.45:6792/0 mon.noname-d 2026-02-22T23:25:26.028 INFO:teuthology.orchestra.run.trial073.stderr:7: v1:10.20.193.73:6792/0 mon.noname-i 2026-02-22T23:25:26.028 INFO:teuthology.orchestra.run.trial073.stderr:8: v1:10.20.193.45:6793/0 mon.noname-e 2026-02-22T23:25:26.028 INFO:teuthology.orchestra.run.trial073.stderr: 2026-02-22T23:25:26.028 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.017+0000 7f175acd3640 1 Processor -- start 2026-02-22T23:25:26.029 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.017+0000 7f175acd3640 1 -- start start 2026-02-22T23:25:26.029 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.017+0000 7f175acd3640 10 monclient: init 2026-02-22T23:25:26.029 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.017+0000 7f175acd3640 10 monclient: _reopen_session rank -1 2026-02-22T23:25:26.029 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.017+0000 7f175acd3640 10 monclient: _add_conns ranks=[8,2,0,7,6,1,4,5,3] 2026-02-22T23:25:26.029 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.018+0000 7f175acd3640 10 monclient(hunting): picked mon.noname-e con 0x7f175409ce40 addr v1:10.20.193.45:6793/0 2026-02-22T23:25:26.029 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.018+0000 7f175acd3640 10 monclient(hunting): picked mon.noname-b con 0x7f17540a1e30 addr v1:10.20.193.45:6790/0 2026-02-22T23:25:26.029 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.018+0000 7f175acd3640 10 monclient(hunting): picked mon.noname-a con 0x7f175409d930 addr v1:10.20.193.45:6789/0 2026-02-22T23:25:26.029 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.018+0000 7f175acd3640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f17540a2db0 con 0x7f175409d930 2026-02-22T23:25:26.029 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.018+0000 7f175acd3640 1 -- --> v1:10.20.193.45:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f17540a3090 con 0x7f17540a1e30 2026-02-22T23:25:26.029 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.018+0000 7f175acd3640 1 -- --> v1:10.20.193.45:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f175409dfa0 con 0x7f175409ce40 2026-02-22T23:25:26.029 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.018+0000 7f175acd3640 10 monclient(hunting): _renew_subs 2026-02-22T23:25:26.029 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.018+0000 7f175acd3640 10 monclient(hunting): authenticate will time out at 654.767057s 2026-02-22T23:25:26.030 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.018+0000 7f174bfff640 1 --1- >> v1:10.20.193.45:6790/0 conn(0x7f17540a1e30 0x7f175413e0f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.45:6790/0 says I am v1:10.20.193.73:53154/0 (socket says 10.20.193.73:53154) 2026-02-22T23:25:26.030 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.018+0000 7f174bfff640 1 -- 10.20.193.73:0/457673334 learned_addr learned my addr 10.20.193.73:0/457673334 (peer_addr_for_me v1:10.20.193.73:0/0) 2026-02-22T23:25:26.030 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.018+0000 7f174b7fe640 1 -- 10.20.193.73:0/457673334 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 625887010 0 0) 0x7f17540a2db0 con 0x7f175409d930 2026-02-22T23:25:26.030 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.018+0000 7f174b7fe640 10 monclient(hunting): _negotiate 2026-02-22T23:25:26.030 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.018+0000 7f174b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:26.030 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.018+0000 7f174b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:26.030 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.018+0000 7f174b7fe640 10 monclient(hunting): my global_id is 4122 2026-02-22T23:25:26.030 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.018+0000 7f174b7fe640 1 -- 10.20.193.73:0/457673334 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1740003620 con 0x7f175409d930 2026-02-22T23:25:26.030 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.018+0000 7f174b7fe640 1 -- 10.20.193.73:0/457673334 <== mon.2 v1:10.20.193.45:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3980770490 0 0) 0x7f17540a3090 con 0x7f17540a1e30 2026-02-22T23:25:26.030 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.018+0000 7f174b7fe640 10 monclient(hunting): _negotiate 2026-02-22T23:25:26.030 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.018+0000 7f174b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:26.030 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.018+0000 7f174b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:26.030 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.018+0000 7f174b7fe640 10 monclient(hunting): my global_id is 4124 2026-02-22T23:25:26.031 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.018+0000 7f174b7fe640 1 -- 10.20.193.73:0/457673334 --> v1:10.20.193.45:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f17540a2db0 con 0x7f17540a1e30 2026-02-22T23:25:26.031 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.018+0000 7f174b7fe640 1 -- 10.20.193.73:0/457673334 <== mon.0 v1:10.20.193.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1317068972 0 0) 0x7f1740003620 con 0x7f175409d930 2026-02-22T23:25:26.031 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.018+0000 7f174b7fe640 1 -- 10.20.193.73:0/457673334 >> v1:10.20.193.45:6793/0 conn(0x7f175409ce40 legacy=0x7f175409d220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:26.031 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.018+0000 7f174b7fe640 1 -- 10.20.193.73:0/457673334 >> v1:10.20.193.45:6790/0 conn(0x7f17540a1e30 legacy=0x7f175413e0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:26.031 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.018+0000 7f174b7fe640 10 monclient: _finish_hunting 0 2026-02-22T23:25:26.031 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.018+0000 7f174b7fe640 1 monclient: found mon.noname-a 2026-02-22T23:25:26.031 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.018+0000 7f174b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T23:25:26.031 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.018+0000 7f174b7fe640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.45:6789/0 2026-02-22T23:25:26.031 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.018+0000 7f174b7fe640 1 -- 10.20.193.73:0/457673334 --> v1:10.20.193.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17540a3b30 con 0x7f175409d930 2026-02-22T23:25:26.031 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.018+0000 7f174b7fe640 10 monclient: _finish_auth 0 2026-02-22T23:25:26.031 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.018+0000 7f174b7fe640 10 monclient: _check_auth_tickets 2026-02-22T23:25:26.031 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.018+0000 7f174b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T23:25:26.032 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.018+0000 7f174b7fe640 1 -- 10.20.193.73:0/457673334 <== mon.0 v1:10.20.193.45:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f17500033c0 con 0x7f175409d930 2026-02-22T23:25:26.032 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.018+0000 7f174b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:25:26.032 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.018+0000 7f174b7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T23:25:26.032 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.018+0000 7f174b7fe640 10 monclient: dump: 2026-02-22T23:25:26.032 INFO:teuthology.orchestra.run.trial073.stderr:epoch 1 2026-02-22T23:25:26.032 INFO:teuthology.orchestra.run.trial073.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:26.032 INFO:teuthology.orchestra.run.trial073.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:26.032 INFO:teuthology.orchestra.run.trial073.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:26.032 INFO:teuthology.orchestra.run.trial073.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:26.032 INFO:teuthology.orchestra.run.trial073.stderr:election_strategy: 3 2026-02-22T23:25:26.032 INFO:teuthology.orchestra.run.trial073.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:26.032 INFO:teuthology.orchestra.run.trial073.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:26.032 INFO:teuthology.orchestra.run.trial073.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:26.033 INFO:teuthology.orchestra.run.trial073.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:26.033 INFO:teuthology.orchestra.run.trial073.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:26.033 INFO:teuthology.orchestra.run.trial073.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:26.033 INFO:teuthology.orchestra.run.trial073.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:26.033 INFO:teuthology.orchestra.run.trial073.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:26.033 INFO:teuthology.orchestra.run.trial073.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:26.033 INFO:teuthology.orchestra.run.trial073.stderr: 2026-02-22T23:25:26.033 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.018+0000 7f175acd3640 5 monclient: authenticate success, global_id 4122 2026-02-22T23:25:26.033 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.018+0000 7f175acd3640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-22T23:25:26.033 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.018+0000 7f174b7fe640 1 -- 10.20.193.73:0/457673334 <== mon.0 v1:10.20.193.45:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f17500035e0 con 0x7f175409d930 2026-02-22T23:25:26.033 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.018+0000 7f174b7fe640 10 monclient: handle_config config(0 keys) 2026-02-22T23:25:26.033 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.018+0000 7f175acd3640 10 monclient: get_monmap_and_config success 2026-02-22T23:25:26.033 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.018+0000 7f175acd3640 4 set_mon_vals no callback set 2026-02-22T23:25:26.034 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.018+0000 7f174b7fe640 1 -- 10.20.193.73:0/457673334 <== mon.0 v1:10.20.193.45:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f1750003dd0 con 0x7f175409d930 2026-02-22T23:25:26.034 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.018+0000 7f174b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:25:26.034 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.018+0000 7f174b7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T23:25:26.034 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.018+0000 7f174b7fe640 10 monclient: dump: 2026-02-22T23:25:26.034 INFO:teuthology.orchestra.run.trial073.stderr:epoch 1 2026-02-22T23:25:26.034 INFO:teuthology.orchestra.run.trial073.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:26.034 INFO:teuthology.orchestra.run.trial073.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:26.034 INFO:teuthology.orchestra.run.trial073.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:26.034 INFO:teuthology.orchestra.run.trial073.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:26.034 INFO:teuthology.orchestra.run.trial073.stderr:election_strategy: 3 2026-02-22T23:25:26.034 INFO:teuthology.orchestra.run.trial073.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:26.034 INFO:teuthology.orchestra.run.trial073.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:26.034 INFO:teuthology.orchestra.run.trial073.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:26.035 INFO:teuthology.orchestra.run.trial073.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:26.035 INFO:teuthology.orchestra.run.trial073.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:26.035 INFO:teuthology.orchestra.run.trial073.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:26.035 INFO:teuthology.orchestra.run.trial073.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:26.035 INFO:teuthology.orchestra.run.trial073.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:26.035 INFO:teuthology.orchestra.run.trial073.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:26.035 INFO:teuthology.orchestra.run.trial073.stderr: 2026-02-22T23:25:26.035 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.019+0000 7f175acd3640 10 monclient: shutdown 2026-02-22T23:25:26.035 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.019+0000 7f175acd3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T23:25:26.035 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.019+0000 7f175acd3640 1 -- 10.20.193.73:0/457673334 >> v1:10.20.193.45:6789/0 conn(0x7f175409d930 legacy=0x7f1754141820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:26.035 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.019+0000 7f175acd3640 1 -- 10.20.193.73:0/457673334 shutdown_connections 2026-02-22T23:25:26.035 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.019+0000 7f175acd3640 1 -- 10.20.193.73:0/457673334 >> 10.20.193.73:0/457673334 conn(0x7f17540a7430 msgr2=0x7f17540a7840 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:25:26.036 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.019+0000 7f175acd3640 1 -- 10.20.193.73:0/457673334 shutdown_connections 2026-02-22T23:25:26.036 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.019+0000 7f175acd3640 1 -- 10.20.193.73:0/457673334 wait complete. 2026-02-22T23:25:26.036 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.019+0000 7f175acd3640 10 monclient: build_initial_monmap 2026-02-22T23:25:26.036 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.019+0000 7f175acd3640 10 monclient: monmap: 2026-02-22T23:25:26.036 INFO:teuthology.orchestra.run.trial073.stderr:epoch 0 2026-02-22T23:25:26.036 INFO:teuthology.orchestra.run.trial073.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T23:25:26.036 INFO:teuthology.orchestra.run.trial073.stderr:last_changed 0.000000 2026-02-22T23:25:26.036 INFO:teuthology.orchestra.run.trial073.stderr:created 0.000000 2026-02-22T23:25:26.036 INFO:teuthology.orchestra.run.trial073.stderr:min_mon_release 0 (unknown) 2026-02-22T23:25:26.036 INFO:teuthology.orchestra.run.trial073.stderr:election_strategy: 1 2026-02-22T23:25:26.036 INFO:teuthology.orchestra.run.trial073.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-22T23:25:26.036 INFO:teuthology.orchestra.run.trial073.stderr:1: v1:10.20.193.73:6789/0 mon.noname-f 2026-02-22T23:25:26.036 INFO:teuthology.orchestra.run.trial073.stderr:2: v1:10.20.193.45:6790/0 mon.noname-b 2026-02-22T23:25:26.037 INFO:teuthology.orchestra.run.trial073.stderr:3: v1:10.20.193.73:6790/0 mon.noname-g 2026-02-22T23:25:26.037 INFO:teuthology.orchestra.run.trial073.stderr:4: v1:10.20.193.45:6791/0 mon.noname-c 2026-02-22T23:25:26.037 INFO:teuthology.orchestra.run.trial073.stderr:5: v1:10.20.193.73:6791/0 mon.noname-h 2026-02-22T23:25:26.037 INFO:teuthology.orchestra.run.trial073.stderr:6: v1:10.20.193.45:6792/0 mon.noname-d 2026-02-22T23:25:26.037 INFO:teuthology.orchestra.run.trial073.stderr:7: v1:10.20.193.73:6792/0 mon.noname-i 2026-02-22T23:25:26.037 INFO:teuthology.orchestra.run.trial073.stderr:8: v1:10.20.193.45:6793/0 mon.noname-e 2026-02-22T23:25:26.037 INFO:teuthology.orchestra.run.trial073.stderr: 2026-02-22T23:25:26.037 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.019+0000 7f175acd3640 1 Processor -- start 2026-02-22T23:25:26.037 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.019+0000 7f175acd3640 1 -- start start 2026-02-22T23:25:26.037 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.019+0000 7f175acd3640 10 monclient: init 2026-02-22T23:25:26.037 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.019+0000 7f175acd3640 10 monclient: _reopen_session rank -1 2026-02-22T23:25:26.037 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.019+0000 7f175acd3640 10 monclient: _add_conns ranks=[1,2,3,7,0,8,4,6,5] 2026-02-22T23:25:26.037 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.019+0000 7f175acd3640 10 monclient(hunting): picked mon.noname-f con 0x7f175409ce40 addr v1:10.20.193.73:6789/0 2026-02-22T23:25:26.038 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.019+0000 7f175acd3640 10 monclient(hunting): picked mon.noname-b con 0x7f175409d930 addr v1:10.20.193.45:6790/0 2026-02-22T23:25:26.038 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.019+0000 7f175acd3640 10 monclient(hunting): picked mon.noname-g con 0x7f17540a1e30 addr v1:10.20.193.73:6790/0 2026-02-22T23:25:26.038 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.019+0000 7f175acd3640 1 -- --> v1:10.20.193.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f175413c9a0 con 0x7f175409ce40 2026-02-22T23:25:26.038 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.019+0000 7f175acd3640 1 -- --> v1:10.20.193.45:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f17540a4880 con 0x7f175409d930 2026-02-22T23:25:26.038 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.019+0000 7f175acd3640 1 -- --> v1:10.20.193.73:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f17540a0510 con 0x7f17540a1e30 2026-02-22T23:25:26.038 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.019+0000 7f175acd3640 10 monclient(hunting): _renew_subs 2026-02-22T23:25:26.038 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.019+0000 7f175acd3640 10 monclient(hunting): authenticate will time out at 654.768811s 2026-02-22T23:25:26.038 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.019+0000 7f1758a48640 1 --1- >> v1:10.20.193.73:6789/0 conn(0x7f175409ce40 0x7f17541385c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.73:6789/0 says I am v1:10.20.193.73:52478/0 (socket says 10.20.193.73:52478) 2026-02-22T23:25:26.038 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.019+0000 7f1758a48640 1 -- 10.20.193.73:0/447751364 learned_addr learned my addr 10.20.193.73:0/447751364 (peer_addr_for_me v1:10.20.193.73:0/0) 2026-02-22T23:25:26.038 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.020+0000 7f17497fa640 1 -- 10.20.193.73:0/447751364 <== mon.1 v1:10.20.193.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 248909678 0 0) 0x7f175409dfa0 con 0x7f175409ce40 2026-02-22T23:25:26.038 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.020+0000 7f17497fa640 10 monclient(hunting): _negotiate 2026-02-22T23:25:26.038 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.020+0000 7f17497fa640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:26.038 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.020+0000 7f17497fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:26.039 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.020+0000 7f17497fa640 10 monclient(hunting): my global_id is 4150 2026-02-22T23:25:26.039 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.020+0000 7f17497fa640 1 -- 10.20.193.73:0/447751364 --> v1:10.20.193.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1724003620 con 0x7f175409ce40 2026-02-22T23:25:26.039 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.020+0000 7f17497fa640 1 -- 10.20.193.73:0/447751364 <== mon.3 v1:10.20.193.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 225933322 0 0) 0x7f17540a0510 con 0x7f17540a1e30 2026-02-22T23:25:26.039 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.020+0000 7f17497fa640 10 monclient(hunting): _negotiate 2026-02-22T23:25:26.039 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.020+0000 7f17497fa640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:26.039 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.020+0000 7f17497fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:26.039 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.020+0000 7f17497fa640 10 monclient(hunting): my global_id is 4161 2026-02-22T23:25:26.039 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.020+0000 7f17497fa640 1 -- 10.20.193.73:0/447751364 --> v1:10.20.193.73:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f175409dfa0 con 0x7f17540a1e30 2026-02-22T23:25:26.039 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.020+0000 7f17497fa640 1 -- 10.20.193.73:0/447751364 <== mon.2 v1:10.20.193.45:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1255517826 0 0) 0x7f17540a4880 con 0x7f175409d930 2026-02-22T23:25:26.039 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.020+0000 7f17497fa640 10 monclient(hunting): _negotiate 2026-02-22T23:25:26.039 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.020+0000 7f17497fa640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:26.039 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.020+0000 7f17497fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:26.039 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.020+0000 7f17497fa640 10 monclient(hunting): my global_id is 4133 2026-02-22T23:25:26.040 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.020+0000 7f17497fa640 1 -- 10.20.193.73:0/447751364 --> v1:10.20.193.45:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f17540a0510 con 0x7f175409d930 2026-02-22T23:25:26.040 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.020+0000 7f17497fa640 1 -- 10.20.193.73:0/447751364 <== mon.1 v1:10.20.193.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1937468256 0 0) 0x7f1724003620 con 0x7f175409ce40 2026-02-22T23:25:26.040 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.020+0000 7f17497fa640 1 -- 10.20.193.73:0/447751364 --> v1:10.20.193.73:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f17540a4880 con 0x7f175409ce40 2026-02-22T23:25:26.040 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.020+0000 7f17497fa640 1 -- 10.20.193.73:0/447751364 <== mon.3 v1:10.20.193.73:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4175043388 0 0) 0x7f175409dfa0 con 0x7f17540a1e30 2026-02-22T23:25:26.040 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.020+0000 7f17497fa640 1 -- 10.20.193.73:0/447751364 --> v1:10.20.193.73:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1724003620 con 0x7f17540a1e30 2026-02-22T23:25:26.040 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.020+0000 7f17497fa640 1 -- 10.20.193.73:0/447751364 <== mon.1 v1:10.20.193.73:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f17440033c0 con 0x7f175409ce40 2026-02-22T23:25:26.040 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.020+0000 7f17497fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-22T23:25:26.040 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.020+0000 7f17497fa640 10 monclient(hunting): got monmap 1 from mon.noname-f (according to old e1) 2026-02-22T23:25:26.040 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.020+0000 7f17497fa640 10 monclient(hunting): dump: 2026-02-22T23:25:26.040 INFO:teuthology.orchestra.run.trial073.stderr:epoch 1 2026-02-22T23:25:26.040 INFO:teuthology.orchestra.run.trial073.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:26.040 INFO:teuthology.orchestra.run.trial073.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:26.040 INFO:teuthology.orchestra.run.trial073.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:26.041 INFO:teuthology.orchestra.run.trial073.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:26.041 INFO:teuthology.orchestra.run.trial073.stderr:election_strategy: 3 2026-02-22T23:25:26.041 INFO:teuthology.orchestra.run.trial073.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:26.041 INFO:teuthology.orchestra.run.trial073.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:26.041 INFO:teuthology.orchestra.run.trial073.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:26.041 INFO:teuthology.orchestra.run.trial073.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:26.041 INFO:teuthology.orchestra.run.trial073.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:26.041 INFO:teuthology.orchestra.run.trial073.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:26.041 INFO:teuthology.orchestra.run.trial073.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:26.041 INFO:teuthology.orchestra.run.trial073.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:26.041 INFO:teuthology.orchestra.run.trial073.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:26.041 INFO:teuthology.orchestra.run.trial073.stderr: 2026-02-22T23:25:26.041 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.020+0000 7f17497fa640 10 monclient(hunting): _finish_auth 0 2026-02-22T23:25:26.042 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.020+0000 7f17497fa640 1 -- 10.20.193.73:0/447751364 <== mon.3 v1:10.20.193.73:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f1750003ad0 con 0x7f17540a1e30 2026-02-22T23:25:26.042 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.020+0000 7f17497fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-22T23:25:26.042 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.020+0000 7f17497fa640 10 monclient(hunting): got monmap 1 from mon.g (according to old e1) 2026-02-22T23:25:26.042 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.020+0000 7f17497fa640 10 monclient(hunting): dump: 2026-02-22T23:25:26.042 INFO:teuthology.orchestra.run.trial073.stderr:epoch 1 2026-02-22T23:25:26.042 INFO:teuthology.orchestra.run.trial073.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:26.042 INFO:teuthology.orchestra.run.trial073.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:26.042 INFO:teuthology.orchestra.run.trial073.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:26.042 INFO:teuthology.orchestra.run.trial073.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:26.042 INFO:teuthology.orchestra.run.trial073.stderr:election_strategy: 3 2026-02-22T23:25:26.042 INFO:teuthology.orchestra.run.trial073.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:26.042 INFO:teuthology.orchestra.run.trial073.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:26.042 INFO:teuthology.orchestra.run.trial073.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:26.043 INFO:teuthology.orchestra.run.trial073.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:26.043 INFO:teuthology.orchestra.run.trial073.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:26.043 INFO:teuthology.orchestra.run.trial073.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:26.043 INFO:teuthology.orchestra.run.trial073.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:26.043 INFO:teuthology.orchestra.run.trial073.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:26.043 INFO:teuthology.orchestra.run.trial073.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:26.043 INFO:teuthology.orchestra.run.trial073.stderr: 2026-02-22T23:25:26.043 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.020+0000 7f17497fa640 1 -- 10.20.193.73:0/447751364 <== mon.2 v1:10.20.193.45:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1060674294 0 0) 0x7f17540a0510 con 0x7f175409d930 2026-02-22T23:25:26.043 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.020+0000 7f17497fa640 1 -- 10.20.193.73:0/447751364 --> v1:10.20.193.45:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f175409dfa0 con 0x7f175409d930 2026-02-22T23:25:26.043 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.020+0000 7f17497fa640 1 -- 10.20.193.73:0/447751364 <== mon.2 v1:10.20.193.45:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f173c0030c0 con 0x7f175409d930 2026-02-22T23:25:26.043 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.020+0000 7f17497fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-22T23:25:26.043 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.020+0000 7f17497fa640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-22T23:25:26.044 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.020+0000 7f17497fa640 10 monclient(hunting): dump: 2026-02-22T23:25:26.044 INFO:teuthology.orchestra.run.trial073.stderr:epoch 1 2026-02-22T23:25:26.044 INFO:teuthology.orchestra.run.trial073.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:26.044 INFO:teuthology.orchestra.run.trial073.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:26.044 INFO:teuthology.orchestra.run.trial073.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:26.044 INFO:teuthology.orchestra.run.trial073.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:26.044 INFO:teuthology.orchestra.run.trial073.stderr:election_strategy: 3 2026-02-22T23:25:26.044 INFO:teuthology.orchestra.run.trial073.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:26.044 INFO:teuthology.orchestra.run.trial073.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:26.044 INFO:teuthology.orchestra.run.trial073.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:26.044 INFO:teuthology.orchestra.run.trial073.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:26.044 INFO:teuthology.orchestra.run.trial073.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:26.044 INFO:teuthology.orchestra.run.trial073.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:26.045 INFO:teuthology.orchestra.run.trial073.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:26.045 INFO:teuthology.orchestra.run.trial073.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:26.045 INFO:teuthology.orchestra.run.trial073.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:26.045 INFO:teuthology.orchestra.run.trial073.stderr: 2026-02-22T23:25:26.045 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.020+0000 7f17497fa640 1 -- 10.20.193.73:0/447751364 <== mon.1 v1:10.20.193.73:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3504608947 0 0) 0x7f17540a4880 con 0x7f175409ce40 2026-02-22T23:25:26.045 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.020+0000 7f17497fa640 1 -- 10.20.193.73:0/447751364 >> v1:10.20.193.73:6790/0 conn(0x7f17540a1e30 legacy=0x7f17541d7e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:26.045 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.020+0000 7f17497fa640 1 -- 10.20.193.73:0/447751364 >> v1:10.20.193.45:6790/0 conn(0x7f175409d930 legacy=0x7f1754138cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:26.045 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.020+0000 7f17497fa640 10 monclient: _finish_hunting 0 2026-02-22T23:25:26.045 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.020+0000 7f17497fa640 1 monclient: found mon.f 2026-02-22T23:25:26.045 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.020+0000 7f17497fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T23:25:26.045 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.020+0000 7f17497fa640 10 monclient: _send_mon_message to mon.f at v1:10.20.193.73:6789/0 2026-02-22T23:25:26.045 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.020+0000 7f17497fa640 1 -- 10.20.193.73:0/447751364 --> v1:10.20.193.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f175413ab40 con 0x7f175409ce40 2026-02-22T23:25:26.045 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.020+0000 7f17497fa640 10 monclient: _finish_auth 0 2026-02-22T23:25:26.046 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.020+0000 7f17497fa640 10 monclient: _check_auth_tickets 2026-02-22T23:25:26.046 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.020+0000 7f17497fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T23:25:26.046 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.020+0000 7f175acd3640 5 monclient: authenticate success, global_id 4150 2026-02-22T23:25:26.046 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.020+0000 7f175acd3640 10 monclient: _renew_subs 2026-02-22T23:25:26.046 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.020+0000 7f175acd3640 10 monclient: _send_mon_message to mon.f at v1:10.20.193.73:6789/0 2026-02-22T23:25:26.046 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.020+0000 7f175acd3640 1 -- 10.20.193.73:0/447751364 --> v1:10.20.193.73:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f17541393e0 con 0x7f175409ce40 2026-02-22T23:25:26.046 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.020+0000 7f175acd3640 10 monclient: _renew_subs 2026-02-22T23:25:26.046 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.020+0000 7f175acd3640 10 monclient: _send_mon_message to mon.f at v1:10.20.193.73:6789/0 2026-02-22T23:25:26.046 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.020+0000 7f175acd3640 1 -- 10.20.193.73:0/447751364 --> v1:10.20.193.73:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f175413c580 con 0x7f175409ce40 2026-02-22T23:25:26.046 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.020+0000 7f17497fa640 1 -- 10.20.193.73:0/447751364 <== mon.1 v1:10.20.193.73:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f17440039c0 con 0x7f175409ce40 2026-02-22T23:25:26.046 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.020+0000 7f17497fa640 10 monclient: handle_config config(0 keys) 2026-02-22T23:25:26.046 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.020+0000 7f17497fa640 1 -- 10.20.193.73:0/447751364 <== mon.1 v1:10.20.193.73:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f1744003ff0 con 0x7f175409ce40 2026-02-22T23:25:26.046 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.020+0000 7f17497fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:25:26.047 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.020+0000 7f174affd640 4 set_mon_vals no callback set 2026-02-22T23:25:26.047 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.020+0000 7f17497fa640 10 monclient: got monmap 1 from mon.f (according to old e1) 2026-02-22T23:25:26.047 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.020+0000 7f17497fa640 10 monclient: dump: 2026-02-22T23:25:26.047 INFO:teuthology.orchestra.run.trial073.stderr:epoch 1 2026-02-22T23:25:26.047 INFO:teuthology.orchestra.run.trial073.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:26.047 INFO:teuthology.orchestra.run.trial073.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:26.047 INFO:teuthology.orchestra.run.trial073.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:26.047 INFO:teuthology.orchestra.run.trial073.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:26.047 INFO:teuthology.orchestra.run.trial073.stderr:election_strategy: 3 2026-02-22T23:25:26.047 INFO:teuthology.orchestra.run.trial073.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:26.047 INFO:teuthology.orchestra.run.trial073.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:26.047 INFO:teuthology.orchestra.run.trial073.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:26.048 INFO:teuthology.orchestra.run.trial073.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:26.048 INFO:teuthology.orchestra.run.trial073.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:26.048 INFO:teuthology.orchestra.run.trial073.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:26.048 INFO:teuthology.orchestra.run.trial073.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:26.048 INFO:teuthology.orchestra.run.trial073.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:26.048 INFO:teuthology.orchestra.run.trial073.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:26.048 INFO:teuthology.orchestra.run.trial073.stderr: 2026-02-22T23:25:26.048 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.020+0000 7f17497fa640 1 -- 10.20.193.73:0/447751364 <== mon.1 v1:10.20.193.73:6789/0 7 ==== mgrmap(e 1) ==== 811+0+0 (unknown 4133961934 0 0) 0x7f17440058c0 con 0x7f175409ce40 2026-02-22T23:25:26.048 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.020+0000 7f17497fa640 1 -- 10.20.193.73:0/447751364 <== mon.1 v1:10.20.193.73:6789/0 8 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (unknown 861245022 0 0) 0x7f1744006e00 con 0x7f175409ce40 2026-02-22T23:25:26.048 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.021+0000 7f175acd3640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T23:25:26.049 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.021+0000 7f175acd3640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T23:25:26.049 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.021+0000 7f175acd3640 10 monclient: _send_mon_message to mon.f at v1:10.20.193.73:6789/0 2026-02-22T23:25:26.049 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.021+0000 7f175acd3640 1 -- 10.20.193.73:0/447751364 --> v1:10.20.193.73:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f17540008d0 con 0x7f175409ce40 2026-02-22T23:25:26.049 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.022+0000 7f17497fa640 1 -- 10.20.193.73:0/447751364 <== mon.1 v1:10.20.193.73:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75931 (unknown 1092875540 0 4127419540) 0x7f175413c9a0 con 0x7f175409ce40 2026-02-22T23:25:26.049 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.022+0000 7f17497fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T23:25:26.049 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.022+0000 7f17497fa640 10 monclient: _finish_command 1 = system:0 2026-02-22T23:25:26.058 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.056+0000 7f175acd3640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "311ec782-d282-48e9-9545-41ac3acb1ac8", "id": 4}] 2026-02-22T23:25:26.058 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.056+0000 7f175acd3640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "311ec782-d282-48e9-9545-41ac3acb1ac8", "id": 4}] 2026-02-22T23:25:26.058 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.056+0000 7f175acd3640 10 monclient: _send_mon_message to mon.f at v1:10.20.193.73:6789/0 2026-02-22T23:25:26.058 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.056+0000 7f175acd3640 1 -- 10.20.193.73:0/447751364 --> v1:10.20.193.73:6789/0 -- mon_command({"prefix": "osd new", "uuid": "311ec782-d282-48e9-9545-41ac3acb1ac8", "id": 4} v 0) -- 0x7f175413b010 con 0x7f175409ce40 2026-02-22T23:25:26.060 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.058+0000 7f17497fa640 1 -- 10.20.193.73:0/447751364 <== mon.1 v1:10.20.193.73:6789/0 10 ==== mon_command_ack([{"prefix": "osd new", "uuid": "311ec782-d282-48e9-9545-41ac3acb1ac8", "id": 4}]=0 v7) ==== 112+0+2 (unknown 1613471529 0 1697012583) 0x7f1744006a50 con 0x7f175409ce40 2026-02-22T23:25:26.060 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.058+0000 7f17497fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "311ec782-d282-48e9-9545-41ac3acb1ac8", "id": 4}] 2026-02-22T23:25:26.060 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.058+0000 7f17497fa640 10 monclient: _finish_command 2 = system:0 2026-02-22T23:25:26.061 INFO:teuthology.orchestra.run.trial073.stdout:4 2026-02-22T23:25:26.061 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.059+0000 7f175acd3640 10 monclient: shutdown 2026-02-22T23:25:26.061 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.059+0000 7f175acd3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T23:25:26.062 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.059+0000 7f175acd3640 1 -- 10.20.193.73:0/447751364 >> v1:10.20.193.73:6789/0 conn(0x7f175409ce40 legacy=0x7f17541385c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:26.062 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.059+0000 7f175acd3640 1 -- 10.20.193.73:0/447751364 shutdown_connections 2026-02-22T23:25:26.062 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.059+0000 7f175acd3640 1 -- 10.20.193.73:0/447751364 >> 10.20.193.73:0/447751364 conn(0x7f17540a7430 msgr2=0x7f1754142360 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:25:26.062 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.059+0000 7f175acd3640 1 -- 10.20.193.73:0/447751364 shutdown_connections 2026-02-22T23:25:26.062 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.059+0000 7f175acd3640 1 -- 10.20.193.73:0/447751364 wait complete. 2026-02-22T23:25:26.068 DEBUG:teuthology.orchestra.run.trial073:> sudo ceph --cluster ceph osd new 4569df35-5988-4308-9e5d-a6b26171c346 5 2026-02-22T23:25:26.171 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.169+0000 7fe625bfe640 10 monclient: get_monmap_and_config 2026-02-22T23:25:26.171 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.169+0000 7fe625bfe640 10 monclient: build_initial_monmap 2026-02-22T23:25:26.171 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.169+0000 7fe625bfe640 10 monclient: monmap: 2026-02-22T23:25:26.171 INFO:teuthology.orchestra.run.trial073.stderr:epoch 0 2026-02-22T23:25:26.171 INFO:teuthology.orchestra.run.trial073.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:26.171 INFO:teuthology.orchestra.run.trial073.stderr:last_changed 2026-02-22T23:25:26.170582+0000 2026-02-22T23:25:26.171 INFO:teuthology.orchestra.run.trial073.stderr:created 2026-02-22T23:25:26.170582+0000 2026-02-22T23:25:26.171 INFO:teuthology.orchestra.run.trial073.stderr:min_mon_release 0 (unknown) 2026-02-22T23:25:26.171 INFO:teuthology.orchestra.run.trial073.stderr:election_strategy: 3 2026-02-22T23:25:26.171 INFO:teuthology.orchestra.run.trial073.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-22T23:25:26.171 INFO:teuthology.orchestra.run.trial073.stderr:1: v1:10.20.193.73:6789/0 mon.noname-f 2026-02-22T23:25:26.171 INFO:teuthology.orchestra.run.trial073.stderr:2: v1:10.20.193.45:6790/0 mon.noname-b 2026-02-22T23:25:26.171 INFO:teuthology.orchestra.run.trial073.stderr:3: v1:10.20.193.73:6790/0 mon.noname-g 2026-02-22T23:25:26.171 INFO:teuthology.orchestra.run.trial073.stderr:4: v1:10.20.193.45:6791/0 mon.noname-c 2026-02-22T23:25:26.171 INFO:teuthology.orchestra.run.trial073.stderr:5: v1:10.20.193.73:6791/0 mon.noname-h 2026-02-22T23:25:26.171 INFO:teuthology.orchestra.run.trial073.stderr:6: v1:10.20.193.45:6792/0 mon.noname-d 2026-02-22T23:25:26.171 INFO:teuthology.orchestra.run.trial073.stderr:7: v1:10.20.193.73:6792/0 mon.noname-i 2026-02-22T23:25:26.171 INFO:teuthology.orchestra.run.trial073.stderr:8: v1:10.20.193.45:6793/0 mon.noname-e 2026-02-22T23:25:26.171 INFO:teuthology.orchestra.run.trial073.stderr: 2026-02-22T23:25:26.181 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.169+0000 7fe625bfe640 1 Processor -- start 2026-02-22T23:25:26.182 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.169+0000 7fe625bfe640 1 -- start start 2026-02-22T23:25:26.182 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.169+0000 7fe625bfe640 10 monclient: init 2026-02-22T23:25:26.182 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.170+0000 7fe625bfe640 10 monclient: _reopen_session rank -1 2026-02-22T23:25:26.182 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.170+0000 7fe625bfe640 10 monclient: _add_conns ranks=[2,1,4,6,7,0,8,5,3] 2026-02-22T23:25:26.182 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.170+0000 7fe625bfe640 10 monclient(hunting): picked mon.noname-b con 0x7fe6200a1a60 addr v1:10.20.193.45:6790/0 2026-02-22T23:25:26.182 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.170+0000 7fe625bfe640 10 monclient(hunting): picked mon.noname-f con 0x7fe62006f1e0 addr v1:10.20.193.73:6789/0 2026-02-22T23:25:26.182 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.170+0000 7fe625bfe640 10 monclient(hunting): picked mon.noname-c con 0x7fe6200a0980 addr v1:10.20.193.45:6791/0 2026-02-22T23:25:26.182 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.170+0000 7fe625bfe640 1 -- --> v1:10.20.193.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe62009df00 con 0x7fe62006f1e0 2026-02-22T23:25:26.182 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.170+0000 7fe625bfe640 1 -- --> v1:10.20.193.45:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe620137660 con 0x7fe6200a1a60 2026-02-22T23:25:26.182 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.170+0000 7fe625bfe640 1 -- --> v1:10.20.193.45:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe6200a4510 con 0x7fe6200a0980 2026-02-22T23:25:26.183 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.170+0000 7fe625bfe640 10 monclient(hunting): _renew_subs 2026-02-22T23:25:26.183 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.170+0000 7fe625bfe640 10 monclient(hunting): authenticate will time out at 654.919298s 2026-02-22T23:25:26.183 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.170+0000 7fe61effd640 1 --1- >> v1:10.20.193.73:6789/0 conn(0x7fe62006f1e0 0x7fe620136f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.73:6789/0 says I am v1:10.20.193.73:52486/0 (socket says 10.20.193.73:52486) 2026-02-22T23:25:26.183 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.170+0000 7fe61effd640 1 -- 10.20.193.73:0/3462979884 learned_addr learned my addr 10.20.193.73:0/3462979884 (peer_addr_for_me v1:10.20.193.73:0/0) 2026-02-22T23:25:26.183 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.170+0000 7fe61e7fc640 1 -- 10.20.193.73:0/3462979884 <== mon.1 v1:10.20.193.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1345822987 0 0) 0x7fe610002920 con 0x7fe62006f1e0 2026-02-22T23:25:26.183 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.170+0000 7fe61e7fc640 10 monclient(hunting): _negotiate 2026-02-22T23:25:26.183 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.170+0000 7fe61e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:26.183 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.170+0000 7fe61e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:26.183 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.170+0000 7fe61e7fc640 10 monclient(hunting): my global_id is 4159 2026-02-22T23:25:26.183 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.170+0000 7fe61e7fc640 1 -- 10.20.193.73:0/3462979884 --> v1:10.20.193.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe604003620 con 0x7fe62006f1e0 2026-02-22T23:25:26.183 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.170+0000 7fe61e7fc640 1 -- 10.20.193.73:0/3462979884 <== mon.1 v1:10.20.193.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2328612236 0 0) 0x7fe604003620 con 0x7fe62006f1e0 2026-02-22T23:25:26.184 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.170+0000 7fe61e7fc640 1 -- 10.20.193.73:0/3462979884 >> v1:10.20.193.45:6791/0 conn(0x7fe6200a0980 legacy=0x7fe62013ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:26.184 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.170+0000 7fe61e7fc640 1 -- 10.20.193.73:0/3462979884 >> v1:10.20.193.45:6790/0 conn(0x7fe6200a1a60 legacy=0x7fe620136840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:26.184 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.170+0000 7fe61e7fc640 10 monclient: _finish_hunting 0 2026-02-22T23:25:26.184 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.170+0000 7fe61e7fc640 1 monclient: found mon.noname-f 2026-02-22T23:25:26.184 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.170+0000 7fe61e7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T23:25:26.184 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.170+0000 7fe61e7fc640 10 monclient: _send_mon_message to mon.noname-f at v1:10.20.193.73:6789/0 2026-02-22T23:25:26.184 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.170+0000 7fe61e7fc640 1 -- 10.20.193.73:0/3462979884 --> v1:10.20.193.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe620143400 con 0x7fe62006f1e0 2026-02-22T23:25:26.184 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.170+0000 7fe61e7fc640 10 monclient: _finish_auth 0 2026-02-22T23:25:26.184 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.170+0000 7fe61e7fc640 10 monclient: _check_auth_tickets 2026-02-22T23:25:26.184 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.170+0000 7fe61e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T23:25:26.184 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.170+0000 7fe61e7fc640 1 -- 10.20.193.73:0/3462979884 <== mon.1 v1:10.20.193.73:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7fe610003210 con 0x7fe62006f1e0 2026-02-22T23:25:26.184 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.170+0000 7fe625bfe640 5 monclient: authenticate success, global_id 4159 2026-02-22T23:25:26.184 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.170+0000 7fe625bfe640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-22T23:25:26.185 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.170+0000 7fe61e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:25:26.185 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.170+0000 7fe61e7fc640 10 monclient: got monmap 1 from mon.noname-f (according to old e1) 2026-02-22T23:25:26.185 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.170+0000 7fe61e7fc640 10 monclient: dump: 2026-02-22T23:25:26.185 INFO:teuthology.orchestra.run.trial073.stderr:epoch 1 2026-02-22T23:25:26.185 INFO:teuthology.orchestra.run.trial073.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:26.185 INFO:teuthology.orchestra.run.trial073.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:26.185 INFO:teuthology.orchestra.run.trial073.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:26.185 INFO:teuthology.orchestra.run.trial073.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:26.185 INFO:teuthology.orchestra.run.trial073.stderr:election_strategy: 3 2026-02-22T23:25:26.185 INFO:teuthology.orchestra.run.trial073.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:26.185 INFO:teuthology.orchestra.run.trial073.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:26.185 INFO:teuthology.orchestra.run.trial073.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:26.186 INFO:teuthology.orchestra.run.trial073.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:26.186 INFO:teuthology.orchestra.run.trial073.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:26.186 INFO:teuthology.orchestra.run.trial073.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:26.186 INFO:teuthology.orchestra.run.trial073.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:26.186 INFO:teuthology.orchestra.run.trial073.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:26.186 INFO:teuthology.orchestra.run.trial073.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:26.186 INFO:teuthology.orchestra.run.trial073.stderr: 2026-02-22T23:25:26.186 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.170+0000 7fe625bfe640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-22T23:25:26.186 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.170+0000 7fe61e7fc640 1 -- 10.20.193.73:0/3462979884 <== mon.1 v1:10.20.193.73:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe610003430 con 0x7fe62006f1e0 2026-02-22T23:25:26.186 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.170+0000 7fe61e7fc640 10 monclient: handle_config config(0 keys) 2026-02-22T23:25:26.186 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.170+0000 7fe625bfe640 10 monclient: get_monmap_and_config success 2026-02-22T23:25:26.186 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.170+0000 7fe625bfe640 4 set_mon_vals no callback set 2026-02-22T23:25:26.187 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.170+0000 7fe61e7fc640 1 -- 10.20.193.73:0/3462979884 <== mon.1 v1:10.20.193.73:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7fe610004ce0 con 0x7fe62006f1e0 2026-02-22T23:25:26.187 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.170+0000 7fe61e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:25:26.187 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.170+0000 7fe61e7fc640 10 monclient: got monmap 1 from mon.f (according to old e1) 2026-02-22T23:25:26.187 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.170+0000 7fe61e7fc640 10 monclient: dump: 2026-02-22T23:25:26.187 INFO:teuthology.orchestra.run.trial073.stderr:epoch 1 2026-02-22T23:25:26.187 INFO:teuthology.orchestra.run.trial073.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:26.187 INFO:teuthology.orchestra.run.trial073.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:26.187 INFO:teuthology.orchestra.run.trial073.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:26.187 INFO:teuthology.orchestra.run.trial073.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:26.187 INFO:teuthology.orchestra.run.trial073.stderr:election_strategy: 3 2026-02-22T23:25:26.187 INFO:teuthology.orchestra.run.trial073.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:26.187 INFO:teuthology.orchestra.run.trial073.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:26.187 INFO:teuthology.orchestra.run.trial073.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:26.187 INFO:teuthology.orchestra.run.trial073.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:26.188 INFO:teuthology.orchestra.run.trial073.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:26.188 INFO:teuthology.orchestra.run.trial073.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:26.188 INFO:teuthology.orchestra.run.trial073.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:26.188 INFO:teuthology.orchestra.run.trial073.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:26.188 INFO:teuthology.orchestra.run.trial073.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:26.188 INFO:teuthology.orchestra.run.trial073.stderr: 2026-02-22T23:25:26.188 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.171+0000 7fe625bfe640 10 monclient: shutdown 2026-02-22T23:25:26.188 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.171+0000 7fe625bfe640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T23:25:26.188 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.171+0000 7fe625bfe640 1 -- 10.20.193.73:0/3462979884 >> v1:10.20.193.73:6789/0 conn(0x7fe62006f1e0 legacy=0x7fe620136f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:26.188 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.171+0000 7fe625bfe640 1 -- 10.20.193.73:0/3462979884 shutdown_connections 2026-02-22T23:25:26.188 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.171+0000 7fe625bfe640 1 -- 10.20.193.73:0/3462979884 >> 10.20.193.73:0/3462979884 conn(0x7fe6200a7780 msgr2=0x7fe6200a3b60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:25:26.188 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.171+0000 7fe625bfe640 1 -- 10.20.193.73:0/3462979884 shutdown_connections 2026-02-22T23:25:26.189 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.171+0000 7fe625bfe640 1 -- 10.20.193.73:0/3462979884 wait complete. 2026-02-22T23:25:26.189 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.171+0000 7fe625bfe640 10 monclient: build_initial_monmap 2026-02-22T23:25:26.189 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.171+0000 7fe625bfe640 10 monclient: monmap: 2026-02-22T23:25:26.189 INFO:teuthology.orchestra.run.trial073.stderr:epoch 0 2026-02-22T23:25:26.189 INFO:teuthology.orchestra.run.trial073.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T23:25:26.189 INFO:teuthology.orchestra.run.trial073.stderr:last_changed 0.000000 2026-02-22T23:25:26.189 INFO:teuthology.orchestra.run.trial073.stderr:created 0.000000 2026-02-22T23:25:26.189 INFO:teuthology.orchestra.run.trial073.stderr:min_mon_release 0 (unknown) 2026-02-22T23:25:26.189 INFO:teuthology.orchestra.run.trial073.stderr:election_strategy: 1 2026-02-22T23:25:26.189 INFO:teuthology.orchestra.run.trial073.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-22T23:25:26.189 INFO:teuthology.orchestra.run.trial073.stderr:1: v1:10.20.193.73:6789/0 mon.noname-f 2026-02-22T23:25:26.189 INFO:teuthology.orchestra.run.trial073.stderr:2: v1:10.20.193.45:6790/0 mon.noname-b 2026-02-22T23:25:26.189 INFO:teuthology.orchestra.run.trial073.stderr:3: v1:10.20.193.73:6790/0 mon.noname-g 2026-02-22T23:25:26.189 INFO:teuthology.orchestra.run.trial073.stderr:4: v1:10.20.193.45:6791/0 mon.noname-c 2026-02-22T23:25:26.190 INFO:teuthology.orchestra.run.trial073.stderr:5: v1:10.20.193.73:6791/0 mon.noname-h 2026-02-22T23:25:26.190 INFO:teuthology.orchestra.run.trial073.stderr:6: v1:10.20.193.45:6792/0 mon.noname-d 2026-02-22T23:25:26.190 INFO:teuthology.orchestra.run.trial073.stderr:7: v1:10.20.193.73:6792/0 mon.noname-i 2026-02-22T23:25:26.190 INFO:teuthology.orchestra.run.trial073.stderr:8: v1:10.20.193.45:6793/0 mon.noname-e 2026-02-22T23:25:26.190 INFO:teuthology.orchestra.run.trial073.stderr: 2026-02-22T23:25:26.190 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.171+0000 7fe625bfe640 1 Processor -- start 2026-02-22T23:25:26.190 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.171+0000 7fe625bfe640 1 -- start start 2026-02-22T23:25:26.190 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.171+0000 7fe625bfe640 10 monclient: init 2026-02-22T23:25:26.190 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.171+0000 7fe625bfe640 10 monclient: _reopen_session rank -1 2026-02-22T23:25:26.190 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.171+0000 7fe625bfe640 10 monclient: _add_conns ranks=[6,3,4,2,5,7,0,8,1] 2026-02-22T23:25:26.190 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.171+0000 7fe625bfe640 10 monclient(hunting): picked mon.noname-d con 0x7fe6200a0980 addr v1:10.20.193.45:6792/0 2026-02-22T23:25:26.190 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.171+0000 7fe625bfe640 10 monclient(hunting): picked mon.noname-g con 0x7fe6200a1a60 addr v1:10.20.193.73:6790/0 2026-02-22T23:25:26.191 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.171+0000 7fe625bfe640 10 monclient(hunting): picked mon.noname-c con 0x7fe6201cf350 addr v1:10.20.193.45:6791/0 2026-02-22T23:25:26.191 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.171+0000 7fe625bfe640 1 -- --> v1:10.20.193.73:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe62013f740 con 0x7fe6200a1a60 2026-02-22T23:25:26.191 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.171+0000 7fe625bfe640 1 -- --> v1:10.20.193.45:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe6201263d0 con 0x7fe6201cf350 2026-02-22T23:25:26.191 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.171+0000 7fe625bfe640 1 -- --> v1:10.20.193.45:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe6201266b0 con 0x7fe6200a0980 2026-02-22T23:25:26.191 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.171+0000 7fe625bfe640 10 monclient(hunting): _renew_subs 2026-02-22T23:25:26.191 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.171+0000 7fe625bfe640 10 monclient(hunting): authenticate will time out at 654.920941s 2026-02-22T23:25:26.191 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.172+0000 7fe61effd640 1 --1- >> v1:10.20.193.73:6790/0 conn(0x7fe6200a1a60 0x7fe6201d4690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.73:6790/0 says I am v1:10.20.193.73:46292/0 (socket says 10.20.193.73:46292) 2026-02-22T23:25:26.191 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.172+0000 7fe61effd640 1 -- 10.20.193.73:0/3684011497 learned_addr learned my addr 10.20.193.73:0/3684011497 (peer_addr_for_me v1:10.20.193.73:0/0) 2026-02-22T23:25:26.191 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.172+0000 7fe5fbfff640 1 -- 10.20.193.73:0/3684011497 <== mon.3 v1:10.20.193.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 992229020 0 0) 0x7fe62013f740 con 0x7fe6200a1a60 2026-02-22T23:25:26.191 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.172+0000 7fe5fbfff640 10 monclient(hunting): _negotiate 2026-02-22T23:25:26.191 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.172+0000 7fe5fbfff640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:26.191 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.172+0000 7fe5fbfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:26.191 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.172+0000 7fe5fbfff640 10 monclient(hunting): my global_id is 4170 2026-02-22T23:25:26.192 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.172+0000 7fe5fbfff640 1 -- 10.20.193.73:0/3684011497 --> v1:10.20.193.73:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe5f0003620 con 0x7fe6200a1a60 2026-02-22T23:25:26.192 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.172+0000 7fe5fbfff640 1 -- 10.20.193.73:0/3684011497 <== mon.4 v1:10.20.193.45:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 877352346 0 0) 0x7fe6201263d0 con 0x7fe6201cf350 2026-02-22T23:25:26.192 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.172+0000 7fe5fbfff640 10 monclient(hunting): _negotiate 2026-02-22T23:25:26.192 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.172+0000 7fe5fbfff640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:26.192 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.172+0000 7fe5fbfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:26.192 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.172+0000 7fe5fbfff640 10 monclient(hunting): my global_id is 4117 2026-02-22T23:25:26.192 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.172+0000 7fe5fbfff640 1 -- 10.20.193.73:0/3684011497 --> v1:10.20.193.45:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe62013f740 con 0x7fe6201cf350 2026-02-22T23:25:26.192 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.172+0000 7fe5fbfff640 1 -- 10.20.193.73:0/3684011497 <== mon.3 v1:10.20.193.73:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 926253947 0 0) 0x7fe5f0003620 con 0x7fe6200a1a60 2026-02-22T23:25:26.192 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.172+0000 7fe5fbfff640 1 -- 10.20.193.73:0/3684011497 --> v1:10.20.193.73:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe6201263d0 con 0x7fe6200a1a60 2026-02-22T23:25:26.192 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.172+0000 7fe5fbfff640 1 -- 10.20.193.73:0/3684011497 <== mon.3 v1:10.20.193.73:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7fe6100048e0 con 0x7fe6200a1a60 2026-02-22T23:25:26.192 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.172+0000 7fe5fbfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-22T23:25:26.192 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.172+0000 7fe5fbfff640 10 monclient(hunting): got monmap 1 from mon.noname-g (according to old e1) 2026-02-22T23:25:26.192 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.172+0000 7fe5fbfff640 10 monclient(hunting): dump: 2026-02-22T23:25:26.193 INFO:teuthology.orchestra.run.trial073.stderr:epoch 1 2026-02-22T23:25:26.193 INFO:teuthology.orchestra.run.trial073.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:26.193 INFO:teuthology.orchestra.run.trial073.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:26.193 INFO:teuthology.orchestra.run.trial073.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:26.193 INFO:teuthology.orchestra.run.trial073.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:26.193 INFO:teuthology.orchestra.run.trial073.stderr:election_strategy: 3 2026-02-22T23:25:26.193 INFO:teuthology.orchestra.run.trial073.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:26.193 INFO:teuthology.orchestra.run.trial073.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:26.193 INFO:teuthology.orchestra.run.trial073.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:26.193 INFO:teuthology.orchestra.run.trial073.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:26.193 INFO:teuthology.orchestra.run.trial073.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:26.193 INFO:teuthology.orchestra.run.trial073.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:26.193 INFO:teuthology.orchestra.run.trial073.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:26.194 INFO:teuthology.orchestra.run.trial073.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:26.194 INFO:teuthology.orchestra.run.trial073.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:26.194 INFO:teuthology.orchestra.run.trial073.stderr: 2026-02-22T23:25:26.194 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.172+0000 7fe5fbfff640 10 monclient(hunting): _finish_auth 0 2026-02-22T23:25:26.194 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.172+0000 7fe5fbfff640 1 -- 10.20.193.73:0/3684011497 <== mon.3 v1:10.20.193.73:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 362719925 0 0) 0x7fe6201263d0 con 0x7fe6200a1a60 2026-02-22T23:25:26.194 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.172+0000 7fe5fbfff640 1 -- 10.20.193.73:0/3684011497 >> v1:10.20.193.45:6792/0 conn(0x7fe6200a0980 legacy=0x7fe62013f030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:26.194 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.172+0000 7fe5fbfff640 1 -- 10.20.193.73:0/3684011497 >> v1:10.20.193.45:6791/0 conn(0x7fe6201cf350 legacy=0x7fe6201d7dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:26.194 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.172+0000 7fe5fbfff640 10 monclient: _finish_hunting 0 2026-02-22T23:25:26.194 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.172+0000 7fe5fbfff640 1 monclient: found mon.g 2026-02-22T23:25:26.194 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.172+0000 7fe5fbfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T23:25:26.194 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.172+0000 7fe5fbfff640 10 monclient: _send_mon_message to mon.g at v1:10.20.193.73:6790/0 2026-02-22T23:25:26.194 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.172+0000 7fe5fbfff640 1 -- 10.20.193.73:0/3684011497 --> v1:10.20.193.73:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe620125420 con 0x7fe6200a1a60 2026-02-22T23:25:26.195 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.172+0000 7fe5fbfff640 10 monclient: _finish_auth 0 2026-02-22T23:25:26.195 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.172+0000 7fe5fbfff640 10 monclient: _check_auth_tickets 2026-02-22T23:25:26.195 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.172+0000 7fe5fbfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T23:25:26.195 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.172+0000 7fe625bfe640 5 monclient: authenticate success, global_id 4170 2026-02-22T23:25:26.195 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.172+0000 7fe625bfe640 10 monclient: _renew_subs 2026-02-22T23:25:26.195 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.172+0000 7fe625bfe640 10 monclient: _send_mon_message to mon.g at v1:10.20.193.73:6790/0 2026-02-22T23:25:26.195 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.172+0000 7fe625bfe640 1 -- 10.20.193.73:0/3684011497 --> v1:10.20.193.73:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fe620143180 con 0x7fe6200a1a60 2026-02-22T23:25:26.195 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.172+0000 7fe625bfe640 10 monclient: _renew_subs 2026-02-22T23:25:26.195 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.172+0000 7fe625bfe640 10 monclient: _send_mon_message to mon.g at v1:10.20.193.73:6790/0 2026-02-22T23:25:26.195 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.172+0000 7fe625bfe640 1 -- 10.20.193.73:0/3684011497 --> v1:10.20.193.73:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fe620124f50 con 0x7fe6200a1a60 2026-02-22T23:25:26.195 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.172+0000 7fe5fbfff640 1 -- 10.20.193.73:0/3684011497 <== mon.3 v1:10.20.193.73:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe610004fa0 con 0x7fe6200a1a60 2026-02-22T23:25:26.196 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.172+0000 7fe5fbfff640 10 monclient: handle_config config(0 keys) 2026-02-22T23:25:26.196 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.172+0000 7fe5fbfff640 1 -- 10.20.193.73:0/3684011497 <== mon.3 v1:10.20.193.73:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7fe610005490 con 0x7fe6200a1a60 2026-02-22T23:25:26.196 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.172+0000 7fe5fbfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:25:26.196 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.172+0000 7fe5fbfff640 10 monclient: got monmap 1 from mon.g (according to old e1) 2026-02-22T23:25:26.196 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.172+0000 7fe61dffb640 4 set_mon_vals no callback set 2026-02-22T23:25:26.196 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.172+0000 7fe5fbfff640 10 monclient: dump: 2026-02-22T23:25:26.196 INFO:teuthology.orchestra.run.trial073.stderr:epoch 1 2026-02-22T23:25:26.196 INFO:teuthology.orchestra.run.trial073.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:26.196 INFO:teuthology.orchestra.run.trial073.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:26.197 INFO:teuthology.orchestra.run.trial073.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:26.197 INFO:teuthology.orchestra.run.trial073.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:26.197 INFO:teuthology.orchestra.run.trial073.stderr:election_strategy: 3 2026-02-22T23:25:26.197 INFO:teuthology.orchestra.run.trial073.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:26.197 INFO:teuthology.orchestra.run.trial073.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:26.197 INFO:teuthology.orchestra.run.trial073.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:26.197 INFO:teuthology.orchestra.run.trial073.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:26.198 INFO:teuthology.orchestra.run.trial073.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:26.198 INFO:teuthology.orchestra.run.trial073.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:26.198 INFO:teuthology.orchestra.run.trial073.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:26.198 INFO:teuthology.orchestra.run.trial073.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:26.198 INFO:teuthology.orchestra.run.trial073.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:26.198 INFO:teuthology.orchestra.run.trial073.stderr: 2026-02-22T23:25:26.198 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.172+0000 7fe5fbfff640 1 -- 10.20.193.73:0/3684011497 <== mon.3 v1:10.20.193.73:6790/0 7 ==== mgrmap(e 1) ==== 811+0+0 (unknown 4133961934 0 0) 0x7fe6100059c0 con 0x7fe6200a1a60 2026-02-22T23:25:26.198 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.172+0000 7fe5fbfff640 1 -- 10.20.193.73:0/3684011497 <== mon.3 v1:10.20.193.73:6790/0 8 ==== osd_map(7..7 src has 1..7) ==== 1300+0+0 (unknown 4289060862 0 0) 0x7fe6100067d0 con 0x7fe6200a1a60 2026-02-22T23:25:26.198 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.172+0000 7fe625bfe640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T23:25:26.198 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.172+0000 7fe625bfe640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T23:25:26.198 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.172+0000 7fe625bfe640 10 monclient: _send_mon_message to mon.g at v1:10.20.193.73:6790/0 2026-02-22T23:25:26.198 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.172+0000 7fe625bfe640 1 -- 10.20.193.73:0/3684011497 --> v1:10.20.193.73:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe6200008d0 con 0x7fe6200a1a60 2026-02-22T23:25:26.199 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.174+0000 7fe5fbfff640 1 -- 10.20.193.73:0/3684011497 <== mon.3 v1:10.20.193.73:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75931 (unknown 1092875540 0 4127419540) 0x7fe62009df00 con 0x7fe6200a1a60 2026-02-22T23:25:26.199 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.174+0000 7fe5fbfff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T23:25:26.199 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.174+0000 7fe5fbfff640 10 monclient: _finish_command 1 = system:0 2026-02-22T23:25:26.200 INFO:tasks.ceph.mgr.x.trial073.stderr:2026-02-22T23:25:26.198+0000 7f413a1cd140 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2026-02-22T23:25:26.208 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.206+0000 7fe625bfe640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "4569df35-5988-4308-9e5d-a6b26171c346", "id": 5}] 2026-02-22T23:25:26.208 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.206+0000 7fe625bfe640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "4569df35-5988-4308-9e5d-a6b26171c346", "id": 5}] 2026-02-22T23:25:26.208 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.206+0000 7fe625bfe640 10 monclient: _send_mon_message to mon.g at v1:10.20.193.73:6790/0 2026-02-22T23:25:26.208 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.206+0000 7fe625bfe640 1 -- 10.20.193.73:0/3684011497 --> v1:10.20.193.73:6790/0 -- mon_command({"prefix": "osd new", "uuid": "4569df35-5988-4308-9e5d-a6b26171c346", "id": 5} v 0) -- 0x7fe6201268f0 con 0x7fe6200a1a60 2026-02-22T23:25:26.210 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.208+0000 7fe5fbfff640 1 -- 10.20.193.73:0/3684011497 <== mon.3 v1:10.20.193.73:6790/0 10 ==== mon_command_ack([{"prefix": "osd new", "uuid": "4569df35-5988-4308-9e5d-a6b26171c346", "id": 5}]=0 v8) ==== 112+0+2 (unknown 3490819128 0 1988412176) 0x7fe610005ce0 con 0x7fe6200a1a60 2026-02-22T23:25:26.210 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.208+0000 7fe5fbfff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "4569df35-5988-4308-9e5d-a6b26171c346", "id": 5}] 2026-02-22T23:25:26.210 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.208+0000 7fe5fbfff640 10 monclient: _finish_command 2 = system:0 2026-02-22T23:25:26.211 INFO:teuthology.orchestra.run.trial073.stdout:5 2026-02-22T23:25:26.211 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.208+0000 7fe625bfe640 10 monclient: shutdown 2026-02-22T23:25:26.211 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.208+0000 7fe625bfe640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T23:25:26.212 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.208+0000 7fe625bfe640 1 -- 10.20.193.73:0/3684011497 >> v1:10.20.193.73:6790/0 conn(0x7fe6200a1a60 legacy=0x7fe6201d4690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:26.212 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.209+0000 7fe625bfe640 1 -- 10.20.193.73:0/3684011497 shutdown_connections 2026-02-22T23:25:26.212 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.209+0000 7fe625bfe640 1 -- 10.20.193.73:0/3684011497 >> 10.20.193.73:0/3684011497 conn(0x7fe6200a7780 msgr2=0x7fe6200a5aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:25:26.212 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.209+0000 7fe625bfe640 1 -- 10.20.193.73:0/3684011497 shutdown_connections 2026-02-22T23:25:26.212 INFO:teuthology.orchestra.run.trial073.stderr:2026-02-22T23:25:26.209+0000 7fe625bfe640 1 -- 10.20.193.73:0/3684011497 wait complete. 2026-02-22T23:25:26.218 INFO:tasks.ceph.osd.0:Restarting daemon 2026-02-22T23:25:26.218 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2026-02-22T23:25:26.221 INFO:tasks.ceph.osd.0:Started 2026-02-22T23:25:26.221 INFO:tasks.ceph.osd.1:Restarting daemon 2026-02-22T23:25:26.221 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2026-02-22T23:25:26.223 INFO:tasks.ceph.osd.1:Started 2026-02-22T23:25:26.224 INFO:tasks.ceph.osd.2:Restarting daemon 2026-02-22T23:25:26.224 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2026-02-22T23:25:26.226 INFO:tasks.ceph.osd.2:Started 2026-02-22T23:25:26.226 INFO:tasks.ceph.osd.3:Restarting daemon 2026-02-22T23:25:26.226 DEBUG:teuthology.orchestra.run.trial073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2026-02-22T23:25:26.228 INFO:tasks.ceph.osd.3:Started 2026-02-22T23:25:26.229 INFO:tasks.ceph.osd.4:Restarting daemon 2026-02-22T23:25:26.229 DEBUG:teuthology.orchestra.run.trial073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2026-02-22T23:25:26.231 INFO:tasks.ceph.osd.4:Started 2026-02-22T23:25:26.231 INFO:tasks.ceph.osd.5:Restarting daemon 2026-02-22T23:25:26.231 DEBUG:teuthology.orchestra.run.trial073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2026-02-22T23:25:26.233 INFO:tasks.ceph.osd.5:Started 2026-02-22T23:25:26.234 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-22T23:25:26.257 INFO:tasks.ceph.mgr.x.trial073.stderr:2026-02-22T23:25:26.255+0000 7f413a1cd140 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2026-02-22T23:25:26.281 INFO:tasks.ceph.mgr.x.trial073.stderr:2026-02-22T23:25:26.279+0000 7f413a1cd140 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2026-02-22T23:25:26.309 INFO:tasks.ceph.mgr.x.trial073.stderr:2026-02-22T23:25:26.303+0000 7f413a1cd140 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2026-02-22T23:25:26.313 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:26.302+0000 7fa2ac998640 10 monclient: get_monmap_and_config 2026-02-22T23:25:26.313 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:26.302+0000 7fa2ac998640 10 monclient: build_initial_monmap 2026-02-22T23:25:26.313 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:26.303+0000 7fa2ac998640 10 monclient: monmap: 2026-02-22T23:25:26.314 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-22T23:25:26.314 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:26.314 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:25:26.304226+0000 2026-02-22T23:25:26.314 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:25:26.304226+0000 2026-02-22T23:25:26.314 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-22T23:25:26.314 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:26.314 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-22T23:25:26.314 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.noname-f 2026-02-22T23:25:26.314 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.noname-b 2026-02-22T23:25:26.314 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.noname-g 2026-02-22T23:25:26.314 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.noname-c 2026-02-22T23:25:26.314 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.noname-h 2026-02-22T23:25:26.315 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.noname-d 2026-02-22T23:25:26.315 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.noname-i 2026-02-22T23:25:26.315 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.noname-e 2026-02-22T23:25:26.315 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:26.315 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:26.303+0000 7fa2ac998640 1 Processor -- start 2026-02-22T23:25:26.315 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:26.303+0000 7fa2ac998640 1 -- start start 2026-02-22T23:25:26.315 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:26.303+0000 7fa2ac998640 10 monclient: init 2026-02-22T23:25:26.315 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:26.303+0000 7fa2ac998640 10 monclient: _reopen_session rank -1 2026-02-22T23:25:26.315 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:26.303+0000 7fa2ac998640 10 monclient: _add_conns ranks=[6,1,8,2,5,7,0,3,4] 2026-02-22T23:25:26.315 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:26.303+0000 7fa2ac998640 10 monclient(hunting): picked mon.noname-d con 0x7fa2a40a5e00 addr v1:10.20.193.45:6792/0 2026-02-22T23:25:26.315 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:26.303+0000 7fa2ac998640 10 monclient(hunting): picked mon.noname-f con 0x7fa2a40a68f0 addr v1:10.20.193.73:6789/0 2026-02-22T23:25:26.315 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:26.303+0000 7fa2ac998640 10 monclient(hunting): picked mon.noname-e con 0x7fa2a40a6d00 addr v1:10.20.193.45:6793/0 2026-02-22T23:25:26.316 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:26.303+0000 7fa2ac998640 1 -- --> v1:10.20.193.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa2a40a2d00 con 0x7fa2a40a68f0 2026-02-22T23:25:26.316 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:26.303+0000 7fa2ac998640 1 -- --> v1:10.20.193.45:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa2a40a2fe0 con 0x7fa2a40a5e00 2026-02-22T23:25:26.316 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:26.303+0000 7fa2ac998640 1 -- --> v1:10.20.193.45:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa2a40a32c0 con 0x7fa2a40a6d00 2026-02-22T23:25:26.316 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:26.303+0000 7fa2ac998640 10 monclient(hunting): _renew_subs 2026-02-22T23:25:26.316 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:26.303+0000 7fa2ac998640 10 monclient(hunting): authenticate will time out at 657.920807s 2026-02-22T23:25:26.316 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:26.303+0000 7fa2aa70d640 1 --1- >> v1:10.20.193.45:6792/0 conn(0x7fa2a40a5e00 0x7fa2a40a61e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.45:6792/0 says I am v1:10.20.193.45:46750/0 (socket says 10.20.193.45:46750) 2026-02-22T23:25:26.316 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:26.303+0000 7fa2aa70d640 1 -- 10.20.193.45:0/2627472552 learned_addr learned my addr 10.20.193.45:0/2627472552 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-22T23:25:26.316 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:26.303+0000 7fa2a970b640 1 -- 10.20.193.45:0/2627472552 <== mon.6 v1:10.20.193.45:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2780940862 0 0) 0x7fa2a40a2fe0 con 0x7fa2a40a5e00 2026-02-22T23:25:26.316 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:26.303+0000 7fa2a970b640 10 monclient(hunting): _negotiate 2026-02-22T23:25:26.316 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:26.303+0000 7fa2a970b640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:26.316 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:26.303+0000 7fa2a970b640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:26.316 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:26.303+0000 7fa2a970b640 10 monclient(hunting): my global_id is 4164 2026-02-22T23:25:26.317 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:26.303+0000 7fa2a970b640 1 -- 10.20.193.45:0/2627472552 --> v1:10.20.193.45:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa294003620 con 0x7fa2a40a5e00 2026-02-22T23:25:26.317 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:26.304+0000 7fa2a970b640 1 -- 10.20.193.45:0/2627472552 <== mon.8 v1:10.20.193.45:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2059514371 0 0) 0x7fa2a40a32c0 con 0x7fa2a40a6d00 2026-02-22T23:25:26.317 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:26.304+0000 7fa2a970b640 10 monclient(hunting): _negotiate 2026-02-22T23:25:26.317 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:26.304+0000 7fa2a970b640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:26.317 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:26.304+0000 7fa2a970b640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:26.317 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:26.304+0000 7fa2a970b640 10 monclient(hunting): my global_id is 4148 2026-02-22T23:25:26.317 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:26.304+0000 7fa2a970b640 1 -- 10.20.193.45:0/2627472552 --> v1:10.20.193.45:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa2a40a2fe0 con 0x7fa2a40a6d00 2026-02-22T23:25:26.317 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:26.304+0000 7fa2a970b640 1 -- 10.20.193.45:0/2627472552 <== mon.6 v1:10.20.193.45:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4057211573 0 0) 0x7fa294003620 con 0x7fa2a40a5e00 2026-02-22T23:25:26.317 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:26.304+0000 7fa2a970b640 1 -- 10.20.193.45:0/2627472552 >> v1:10.20.193.45:6793/0 conn(0x7fa2a40a6d00 legacy=0x7fa2a41417b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:26.317 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:26.304+0000 7fa2a970b640 1 -- 10.20.193.45:0/2627472552 >> v1:10.20.193.73:6789/0 conn(0x7fa2a40a68f0 legacy=0x7fa2a413e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:26.317 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:26.304+0000 7fa2a970b640 10 monclient: _finish_hunting 0 2026-02-22T23:25:26.318 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:26.304+0000 7fa2a970b640 1 monclient: found mon.noname-d 2026-02-22T23:25:26.318 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:26.304+0000 7fa2a970b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T23:25:26.318 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:26.304+0000 7fa2a970b640 10 monclient: _send_mon_message to mon.noname-d at v1:10.20.193.45:6792/0 2026-02-22T23:25:26.318 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:26.304+0000 7fa2a970b640 1 -- 10.20.193.45:0/2627472552 --> v1:10.20.193.45:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2a40a35a0 con 0x7fa2a40a5e00 2026-02-22T23:25:26.318 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:26.304+0000 7fa2a970b640 10 monclient: _finish_auth 0 2026-02-22T23:25:26.318 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:26.304+0000 7fa2a970b640 10 monclient: _check_auth_tickets 2026-02-22T23:25:26.318 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:26.304+0000 7fa2a970b640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T23:25:26.319 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:26.304+0000 7fa2a970b640 1 -- 10.20.193.45:0/2627472552 <== mon.6 v1:10.20.193.45:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7fa29c003040 con 0x7fa2a40a5e00 2026-02-22T23:25:26.319 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:26.304+0000 7fa2a970b640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:25:26.319 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:26.304+0000 7fa2a970b640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2026-02-22T23:25:26.319 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:26.304+0000 7fa2a970b640 10 monclient: dump: 2026-02-22T23:25:26.319 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:26.320 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:26.320 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:26.320 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:26.320 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:26.320 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:26.320 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:26.320 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:26.321 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:26.321 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:26.321 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:26.321 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:26.321 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:26.321 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:26.321 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:26.322 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:26.322 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:26.304+0000 7fa2ac998640 5 monclient: authenticate success, global_id 4164 2026-02-22T23:25:26.322 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:26.304+0000 7fa2ac998640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-22T23:25:26.322 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:26.304+0000 7fa2a970b640 1 -- 10.20.193.45:0/2627472552 <== mon.6 v1:10.20.193.45:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa29c003260 con 0x7fa2a40a5e00 2026-02-22T23:25:26.322 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:26.304+0000 7fa2a970b640 10 monclient: handle_config config(0 keys) 2026-02-22T23:25:26.322 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:26.304+0000 7fa2a970b640 1 -- 10.20.193.45:0/2627472552 <== mon.6 v1:10.20.193.45:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7fa29c004ce0 con 0x7fa2a40a5e00 2026-02-22T23:25:26.322 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:26.304+0000 7fa2a970b640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:25:26.323 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:26.304+0000 7fa2a970b640 10 monclient: got monmap 1 from mon.d (according to old e1) 2026-02-22T23:25:26.323 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:26.304+0000 7fa2a970b640 10 monclient: dump: 2026-02-22T23:25:26.323 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:26.323 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:26.323 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:26.323 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:26.323 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:26.323 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:26.323 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:26.323 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:26.323 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:26.323 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:26.323 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:26.324 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:26.324 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:26.324 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:26.324 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:26.324 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:26.324 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:26.304+0000 7fa2ac998640 10 monclient: get_monmap_and_config success 2026-02-22T23:25:26.324 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:26.304+0000 7fa2ac998640 4 set_mon_vals no callback set 2026-02-22T23:25:26.324 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:26.304+0000 7fa2ac998640 10 monclient: shutdown 2026-02-22T23:25:26.324 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:26.304+0000 7fa2ac998640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T23:25:26.324 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:26.304+0000 7fa2ac998640 1 -- 10.20.193.45:0/2627472552 >> v1:10.20.193.45:6792/0 conn(0x7fa2a40a5e00 legacy=0x7fa2a40a61e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:26.324 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:26.304+0000 7fa2ac998640 1 -- 10.20.193.45:0/2627472552 shutdown_connections 2026-02-22T23:25:26.325 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:26.304+0000 7fa2ac998640 1 -- 10.20.193.45:0/2627472552 >> 10.20.193.45:0/2627472552 conn(0x7fa2a40abb50 msgr2=0x7fa2a40a7f00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:25:26.325 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:26.304+0000 7fa2ac998640 1 -- 10.20.193.45:0/2627472552 shutdown_connections 2026-02-22T23:25:26.325 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:26.304+0000 7fa2ac998640 1 -- 10.20.193.45:0/2627472552 wait complete. 2026-02-22T23:25:26.325 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:26.305+0000 7fa2ac998640 10 monclient: build_initial_monmap 2026-02-22T23:25:26.325 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:26.305+0000 7fa2ac998640 10 monclient: monmap: 2026-02-22T23:25:26.325 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-22T23:25:26.325 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T23:25:26.325 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-22T23:25:26.325 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-22T23:25:26.325 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-22T23:25:26.325 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-22T23:25:26.325 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-22T23:25:26.325 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.noname-f 2026-02-22T23:25:26.326 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.noname-b 2026-02-22T23:25:26.326 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.noname-g 2026-02-22T23:25:26.326 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.noname-c 2026-02-22T23:25:26.326 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.noname-h 2026-02-22T23:25:26.326 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.noname-d 2026-02-22T23:25:26.326 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.noname-i 2026-02-22T23:25:26.326 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.noname-e 2026-02-22T23:25:26.326 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:26.326 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:26.305+0000 7fa2ac998640 1 Processor -- start 2026-02-22T23:25:26.326 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:26.305+0000 7fa2ac998640 1 -- start start 2026-02-22T23:25:26.326 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:26.305+0000 7fa2ac998640 10 monclient: init 2026-02-22T23:25:26.326 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:26.305+0000 7fa2ac998640 10 monclient: _reopen_session rank -1 2026-02-22T23:25:26.327 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:26.305+0000 7fa2ac998640 10 monclient: _add_conns ranks=[4,7,3,5,2,1,0,8,6] 2026-02-22T23:25:26.327 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:26.305+0000 7fa2ac998640 10 monclient(hunting): picked mon.noname-c con 0x7fa2a40a5e00 addr v1:10.20.193.45:6791/0 2026-02-22T23:25:26.327 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:26.305+0000 7fa2ac998640 10 monclient(hunting): picked mon.noname-i con 0x7fa2a40a68f0 addr v1:10.20.193.73:6792/0 2026-02-22T23:25:26.327 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:26.305+0000 7fa2ac998640 10 monclient(hunting): picked mon.noname-g con 0x7fa2a40a6d00 addr v1:10.20.193.73:6790/0 2026-02-22T23:25:26.327 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:26.305+0000 7fa2ac998640 1 -- --> v1:10.20.193.73:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa2a40a9fd0 con 0x7fa2a40a6d00 2026-02-22T23:25:26.327 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:26.305+0000 7fa2ac998640 1 -- --> v1:10.20.193.45:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa2a41385f0 con 0x7fa2a40a5e00 2026-02-22T23:25:26.327 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:26.305+0000 7fa2ac998640 1 -- --> v1:10.20.193.73:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa2a4137d50 con 0x7fa2a40a68f0 2026-02-22T23:25:26.327 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:26.305+0000 7fa2ac998640 10 monclient(hunting): _renew_subs 2026-02-22T23:25:26.327 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:26.305+0000 7fa2ac998640 10 monclient(hunting): authenticate will time out at 657.922673s 2026-02-22T23:25:26.327 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:26.305+0000 7fa2aa70d640 1 --1- >> v1:10.20.193.45:6791/0 conn(0x7fa2a40a5e00 0x7fa2a4134a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.45:6791/0 says I am v1:10.20.193.45:54612/0 (socket says 10.20.193.45:54612) 2026-02-22T23:25:26.327 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:26.305+0000 7fa2aa70d640 1 -- 10.20.193.45:0/4130317458 learned_addr learned my addr 10.20.193.45:0/4130317458 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-22T23:25:26.327 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:26.305+0000 7fa28effd640 1 -- 10.20.193.45:0/4130317458 <== mon.4 v1:10.20.193.45:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 423585019 0 0) 0x7fa2a41385f0 con 0x7fa2a40a5e00 2026-02-22T23:25:26.327 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:26.305+0000 7fa28effd640 10 monclient(hunting): _negotiate 2026-02-22T23:25:26.328 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:26.305+0000 7fa28effd640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:26.328 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:26.305+0000 7fa28effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:26.328 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:26.305+0000 7fa28effd640 10 monclient(hunting): my global_id is 4153 2026-02-22T23:25:26.328 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:26.305+0000 7fa28effd640 1 -- 10.20.193.45:0/4130317458 --> v1:10.20.193.45:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa274003620 con 0x7fa2a40a5e00 2026-02-22T23:25:26.328 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:26.305+0000 7fa28effd640 1 -- 10.20.193.45:0/4130317458 <== mon.4 v1:10.20.193.45:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1346550314 0 0) 0x7fa274003620 con 0x7fa2a40a5e00 2026-02-22T23:25:26.328 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:26.305+0000 7fa28effd640 1 -- 10.20.193.45:0/4130317458 --> v1:10.20.193.45:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa2a41385f0 con 0x7fa2a40a5e00 2026-02-22T23:25:26.328 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:26.305+0000 7fa28effd640 1 -- 10.20.193.45:0/4130317458 <== mon.4 v1:10.20.193.45:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7fa29c003410 con 0x7fa2a40a5e00 2026-02-22T23:25:26.328 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:26.305+0000 7fa28effd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-22T23:25:26.328 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:26.305+0000 7fa28effd640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-22T23:25:26.328 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:26.305+0000 7fa28effd640 10 monclient(hunting): dump: 2026-02-22T23:25:26.328 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:26.328 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:26.329 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:26.329 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:26.329 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:26.329 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:26.329 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:26.329 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:26.329 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:26.329 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:26.329 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:26.329 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:26.329 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:26.329 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:26.329 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:26.330 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:26.330 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:26.305+0000 7fa28effd640 10 monclient(hunting): _finish_auth 0 2026-02-22T23:25:26.330 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:26.305+0000 7fa28effd640 1 -- 10.20.193.45:0/4130317458 <== mon.7 v1:10.20.193.73:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 156341499 0 0) 0x7fa2a4137d50 con 0x7fa2a40a68f0 2026-02-22T23:25:26.330 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:26.305+0000 7fa28effd640 10 monclient(hunting): _negotiate 2026-02-22T23:25:26.330 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:26.305+0000 7fa28effd640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:26.330 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:26.305+0000 7fa28effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:26.330 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:26.305+0000 7fa28effd640 10 monclient(hunting): my global_id is 4165 2026-02-22T23:25:26.330 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:26.306+0000 7fa28effd640 1 -- 10.20.193.45:0/4130317458 --> v1:10.20.193.73:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa274003620 con 0x7fa2a40a68f0 2026-02-22T23:25:26.330 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:26.306+0000 7fa28effd640 1 -- 10.20.193.45:0/4130317458 <== mon.3 v1:10.20.193.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1901207443 0 0) 0x7fa2a40a9fd0 con 0x7fa2a40a6d00 2026-02-22T23:25:26.330 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:26.306+0000 7fa28effd640 10 monclient(hunting): _negotiate 2026-02-22T23:25:26.330 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:26.306+0000 7fa28effd640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:26.331 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:26.306+0000 7fa28effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:26.331 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:26.306+0000 7fa28effd640 10 monclient(hunting): my global_id is 4188 2026-02-22T23:25:26.331 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:26.306+0000 7fa28effd640 1 -- 10.20.193.45:0/4130317458 --> v1:10.20.193.73:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa2a4137d50 con 0x7fa2a40a6d00 2026-02-22T23:25:26.331 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:26.306+0000 7fa28effd640 1 -- 10.20.193.45:0/4130317458 <== mon.4 v1:10.20.193.45:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 545432690 0 0) 0x7fa2a41385f0 con 0x7fa2a40a5e00 2026-02-22T23:25:26.331 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:26.306+0000 7fa28effd640 1 -- 10.20.193.45:0/4130317458 >> v1:10.20.193.73:6792/0 conn(0x7fa2a40a68f0 legacy=0x7fa2a4135180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:26.331 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:26.306+0000 7fa28effd640 1 -- 10.20.193.45:0/4130317458 >> v1:10.20.193.73:6790/0 conn(0x7fa2a40a6d00 legacy=0x7fa2a41d7d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:26.331 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:26.306+0000 7fa28effd640 10 monclient: _finish_hunting 0 2026-02-22T23:25:26.331 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:26.306+0000 7fa28effd640 1 monclient: found mon.c 2026-02-22T23:25:26.331 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:26.306+0000 7fa28effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T23:25:26.331 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:26.306+0000 7fa28effd640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.45:6791/0 2026-02-22T23:25:26.331 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:26.306+0000 7fa28effd640 1 -- 10.20.193.45:0/4130317458 --> v1:10.20.193.45:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2a4138030 con 0x7fa2a40a5e00 2026-02-22T23:25:26.331 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:26.306+0000 7fa28effd640 10 monclient: _finish_auth 0 2026-02-22T23:25:26.332 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:26.306+0000 7fa28effd640 10 monclient: _check_auth_tickets 2026-02-22T23:25:26.332 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:26.306+0000 7fa28effd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T23:25:26.332 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:26.306+0000 7fa2ac998640 5 monclient: authenticate success, global_id 4153 2026-02-22T23:25:26.332 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:26.306+0000 7fa2ac998640 10 monclient: _renew_subs 2026-02-22T23:25:26.332 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:26.306+0000 7fa2ac998640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.45:6791/0 2026-02-22T23:25:26.332 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:26.306+0000 7fa2ac998640 1 -- 10.20.193.45:0/4130317458 --> v1:10.20.193.45:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fa2a4137080 con 0x7fa2a40a5e00 2026-02-22T23:25:26.332 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:26.306+0000 7fa2ac998640 10 monclient: _renew_subs 2026-02-22T23:25:26.332 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:26.306+0000 7fa2ac998640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.45:6791/0 2026-02-22T23:25:26.332 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:26.306+0000 7fa2ac998640 1 -- 10.20.193.45:0/4130317458 --> v1:10.20.193.45:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7fa2a4136520 con 0x7fa2a40a5e00 2026-02-22T23:25:26.332 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:26.306+0000 7fa28effd640 1 -- 10.20.193.45:0/4130317458 <== mon.4 v1:10.20.193.45:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa29c004ed0 con 0x7fa2a40a5e00 2026-02-22T23:25:26.332 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:26.306+0000 7fa28effd640 10 monclient: handle_config config(0 keys) 2026-02-22T23:25:26.332 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:26.306+0000 7fa28effd640 1 -- 10.20.193.45:0/4130317458 <== mon.4 v1:10.20.193.45:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7fa29c0053c0 con 0x7fa2a40a5e00 2026-02-22T23:25:26.333 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:26.306+0000 7fa28effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:25:26.333 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:26.306+0000 7fa2a8f0a640 4 set_mon_vals no callback set 2026-02-22T23:25:26.333 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:26.306+0000 7fa28effd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T23:25:26.333 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:26.306+0000 7fa28effd640 10 monclient: dump: 2026-02-22T23:25:26.333 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:26.333 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:26.333 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:26.333 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:26.333 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:26.333 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:26.333 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:26.333 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:26.333 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:26.334 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:26.334 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:26.334 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:26.334 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:26.334 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:26.334 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:26.334 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:26.334 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:26.306+0000 7fa28effd640 1 -- 10.20.193.45:0/4130317458 <== mon.4 v1:10.20.193.45:6791/0 7 ==== mgrmap(e 1) ==== 811+0+0 (unknown 4133961934 0 0) 0x7fa29c0058f0 con 0x7fa2a40a5e00 2026-02-22T23:25:26.334 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:26.306+0000 7fa28effd640 1 -- 10.20.193.45:0/4130317458 <== mon.4 v1:10.20.193.45:6791/0 8 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (unknown 935347643 0 0) 0x7fa29c0031c0 con 0x7fa2a40a5e00 2026-02-22T23:25:26.335 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:26.306+0000 7fa2ac998640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T23:25:26.335 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:26.306+0000 7fa2ac998640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T23:25:26.335 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:26.306+0000 7fa2ac998640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.45:6791/0 2026-02-22T23:25:26.335 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:26.306+0000 7fa2ac998640 1 -- 10.20.193.45:0/4130317458 --> v1:10.20.193.45:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa2a406ce10 con 0x7fa2a40a5e00 2026-02-22T23:25:26.335 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:26.307+0000 7fa28effd640 1 -- 10.20.193.45:0/4130317458 <== mon.4 v1:10.20.193.45:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75931 (unknown 1092875540 0 4127419540) 0x7fa29c005c10 con 0x7fa2a40a5e00 2026-02-22T23:25:26.335 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:26.307+0000 7fa28effd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T23:25:26.335 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:26.307+0000 7fa28effd640 10 monclient: _finish_command 1 = system:0 2026-02-22T23:25:26.336 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:26.334+0000 7fa2ac998640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2026-02-22T23:25:26.336 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:26.334+0000 7fa2ac998640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-22T23:25:26.336 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:26.334+0000 7fa2ac998640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.45:6791/0 2026-02-22T23:25:26.336 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:26.334+0000 7fa2ac998640 1 -- 10.20.193.45:0/4130317458 --> v1:10.20.193.45:6791/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa2a40a7410 con 0x7fa2a40a5e00 2026-02-22T23:25:26.336 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:26.334+0000 7fa28effd640 1 -- 10.20.193.45:0/4130317458 <== mon.4 v1:10.20.193.45:6791/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v8) ==== 74+0+5605 (unknown 150273500 0 1319435991) 0x7fa29c005ef0 con 0x7fa2a40a5e00 2026-02-22T23:25:26.336 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:26.334+0000 7fa28effd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-22T23:25:26.337 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:26.334+0000 7fa28effd640 10 monclient: _finish_command 2 = system:0 2026-02-22T23:25:26.337 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-22T23:25:26.337 INFO:teuthology.orchestra.run.trial045.stdout:{"epoch":8,"fsid":"4b60f18f-6660-4731-b731-dc85c4078413","created":"2026-02-22T23:25:25.062615+0000","modified":"2026-02-22T23:25:26.208612+0000","last_up_change":"0.000000","last_in_change":"2026-02-22T23:25:26.208612+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"ef9d15a7-661e-40c5-a418-7f794c0975b7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"9e62cdef-b0a0-4f67-a778-ac4f7d97ed7e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"bfcf94e1-2623-4443-aaf8-f525210ab7b2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"32e9109d-09f0-4c75-bfbe-bb0fa237ca08","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"311ec782-d282-48e9-9545-41ac3acb1ac8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"4569df35-5988-4308-9e5d-a6b26171c346","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-22T23:25:26.338 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:26.335+0000 7fa2ac998640 10 monclient: shutdown 2026-02-22T23:25:26.338 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:26.335+0000 7fa2ac998640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T23:25:26.338 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:26.335+0000 7fa2ac998640 1 -- 10.20.193.45:0/4130317458 >> v1:10.20.193.45:6791/0 conn(0x7fa2a40a5e00 legacy=0x7fa2a4134a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:26.338 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:26.335+0000 7fa2ac998640 1 -- 10.20.193.45:0/4130317458 shutdown_connections 2026-02-22T23:25:26.338 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:26.335+0000 7fa2ac998640 1 -- 10.20.193.45:0/4130317458 >> 10.20.193.45:0/4130317458 conn(0x7fa2a40abb50 msgr2=0x7fa2a40a4010 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:25:26.338 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:26.335+0000 7fa2ac998640 1 -- 10.20.193.45:0/4130317458 shutdown_connections 2026-02-22T23:25:26.338 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:26.335+0000 7fa2ac998640 1 -- 10.20.193.45:0/4130317458 wait complete. 2026-02-22T23:25:26.343 INFO:tasks.ceph.ceph_manager.ceph:[] 2026-02-22T23:25:26.343 INFO:tasks.ceph:Waiting for OSDs to come up 2026-02-22T23:25:26.358 INFO:tasks.ceph.mgr.x.trial073.stderr:2026-02-22T23:25:26.356+0000 7f413a1cd140 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2026-02-22T23:25:26.379 INFO:tasks.ceph.mgr.x.trial073.stderr:2026-02-22T23:25:26.377+0000 7f413a1cd140 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2026-02-22T23:25:26.430 INFO:tasks.ceph.mgr.x.trial073.stderr:2026-02-22T23:25:26.429+0000 7f413a1cd140 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2026-02-22T23:25:26.829 INFO:tasks.ceph.mgr.x.trial073.stderr:2026-02-22T23:25:26.827+0000 7f413a1cd140 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2026-02-22T23:25:26.851 INFO:tasks.ceph.mgr.x.trial073.stderr:2026-02-22T23:25:26.849+0000 7f413a1cd140 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2026-02-22T23:25:26.947 DEBUG:teuthology.orchestra.run.trial045:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-22T23:25:27.014 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:27.007+0000 7f5672ba9640 10 monclient: get_monmap_and_config 2026-02-22T23:25:27.015 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:27.007+0000 7f5672ba9640 10 monclient: build_initial_monmap 2026-02-22T23:25:27.015 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:27.007+0000 7f5672ba9640 10 monclient: monmap: 2026-02-22T23:25:27.015 INFO:teuthology.misc.health.trial045.stderr:epoch 0 2026-02-22T23:25:27.015 INFO:teuthology.misc.health.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:27.015 INFO:teuthology.misc.health.trial045.stderr:last_changed 2026-02-22T23:25:27.008861+0000 2026-02-22T23:25:27.015 INFO:teuthology.misc.health.trial045.stderr:created 2026-02-22T23:25:27.008861+0000 2026-02-22T23:25:27.015 INFO:teuthology.misc.health.trial045.stderr:min_mon_release 0 (unknown) 2026-02-22T23:25:27.015 INFO:teuthology.misc.health.trial045.stderr:election_strategy: 3 2026-02-22T23:25:27.015 INFO:teuthology.misc.health.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-22T23:25:27.015 INFO:teuthology.misc.health.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.noname-f 2026-02-22T23:25:27.016 INFO:teuthology.misc.health.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.noname-b 2026-02-22T23:25:27.016 INFO:teuthology.misc.health.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.noname-g 2026-02-22T23:25:27.016 INFO:teuthology.misc.health.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.noname-c 2026-02-22T23:25:27.016 INFO:teuthology.misc.health.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.noname-h 2026-02-22T23:25:27.016 INFO:teuthology.misc.health.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.noname-d 2026-02-22T23:25:27.016 INFO:teuthology.misc.health.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.noname-i 2026-02-22T23:25:27.016 INFO:teuthology.misc.health.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.noname-e 2026-02-22T23:25:27.016 INFO:teuthology.misc.health.trial045.stderr: 2026-02-22T23:25:27.016 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:27.008+0000 7f5672ba9640 1 Processor -- start 2026-02-22T23:25:27.016 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:27.008+0000 7f5672ba9640 1 -- start start 2026-02-22T23:25:27.016 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:27.008+0000 7f5672ba9640 10 monclient: init 2026-02-22T23:25:27.016 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:27.008+0000 7f5672ba9640 10 monclient: _reopen_session rank -1 2026-02-22T23:25:27.017 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:27.008+0000 7f5672ba9640 10 monclient: _add_conns ranks=[4,0,3,6,5,7,8,2,1] 2026-02-22T23:25:27.017 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:27.008+0000 7f5672ba9640 10 monclient(hunting): picked mon.noname-c con 0x7f566c06c850 addr v1:10.20.193.45:6791/0 2026-02-22T23:25:27.017 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:27.008+0000 7f5672ba9640 10 monclient(hunting): picked mon.noname-a con 0x7f566c06d340 addr v1:10.20.193.45:6789/0 2026-02-22T23:25:27.017 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:27.008+0000 7f5672ba9640 10 monclient(hunting): picked mon.noname-g con 0x7f566c13f850 addr v1:10.20.193.73:6790/0 2026-02-22T23:25:27.017 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:27.008+0000 7f5672ba9640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f566c0a0bc0 con 0x7f566c06d340 2026-02-22T23:25:27.017 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:27.008+0000 7f5672ba9640 1 -- --> v1:10.20.193.73:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f566c06dc30 con 0x7f566c13f850 2026-02-22T23:25:27.017 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:27.008+0000 7f5672ba9640 1 -- --> v1:10.20.193.45:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f566c06d9b0 con 0x7f566c06c850 2026-02-22T23:25:27.017 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:27.008+0000 7f5672ba9640 10 monclient(hunting): _renew_subs 2026-02-22T23:25:27.017 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:27.008+0000 7f5672ba9640 10 monclient(hunting): authenticate will time out at 658.625406s 2026-02-22T23:25:27.017 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:27.008+0000 7f567091e640 1 --1- >> v1:10.20.193.45:6791/0 conn(0x7f566c06c850 0x7f566c06cc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.45:6791/0 says I am v1:10.20.193.45:54616/0 (socket says 10.20.193.45:54616) 2026-02-22T23:25:27.017 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:27.008+0000 7f567091e640 1 -- 10.20.193.45:0/389825918 learned_addr learned my addr 10.20.193.45:0/389825918 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-22T23:25:27.017 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:27.008+0000 7f5663fff640 1 --1- 10.20.193.45:0/389825918 >> v1:10.20.193.45:6789/0 conn(0x7f566c06d340 0x7f566c13e130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.45:6789/0 says I am v1:10.20.193.45:60240/0 (socket says 10.20.193.45:60240) 2026-02-22T23:25:27.018 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:27.008+0000 7f56637fe640 1 -- 10.20.193.45:0/389825918 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1217792038 0 0) 0x7f566c0a0bc0 con 0x7f566c06d340 2026-02-22T23:25:27.018 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:27.008+0000 7f56637fe640 10 monclient(hunting): _negotiate 2026-02-22T23:25:27.018 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:27.008+0000 7f56637fe640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:27.018 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:27.008+0000 7f56637fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:27.018 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:27.008+0000 7f56637fe640 10 monclient(hunting): my global_id is 4131 2026-02-22T23:25:27.018 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:27.008+0000 7f56637fe640 1 -- 10.20.193.45:0/389825918 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5658003620 con 0x7f566c06d340 2026-02-22T23:25:27.018 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:27.008+0000 7f56637fe640 1 -- 10.20.193.45:0/389825918 <== mon.4 v1:10.20.193.45:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3005004914 0 0) 0x7f566c06d9b0 con 0x7f566c06c850 2026-02-22T23:25:27.018 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:27.008+0000 7f56637fe640 10 monclient(hunting): _negotiate 2026-02-22T23:25:27.018 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:27.008+0000 7f56637fe640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:27.018 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:27.008+0000 7f56637fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:27.018 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:27.008+0000 7f56637fe640 10 monclient(hunting): my global_id is 4162 2026-02-22T23:25:27.018 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:27.008+0000 7f56637fe640 1 -- 10.20.193.45:0/389825918 --> v1:10.20.193.45:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f566c0a0bc0 con 0x7f566c06c850 2026-02-22T23:25:27.018 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:27.008+0000 7f56637fe640 1 -- 10.20.193.45:0/389825918 <== mon.0 v1:10.20.193.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3378579951 0 0) 0x7f5658003620 con 0x7f566c06d340 2026-02-22T23:25:27.019 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:27.008+0000 7f56637fe640 1 -- 10.20.193.45:0/389825918 >> v1:10.20.193.45:6791/0 conn(0x7f566c06c850 legacy=0x7f566c06cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:27.019 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:27.008+0000 7f56637fe640 1 -- 10.20.193.45:0/389825918 >> v1:10.20.193.73:6790/0 conn(0x7f566c13f850 legacy=0x7f566c141c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T23:25:27.019 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:27.008+0000 7f56637fe640 10 monclient: _finish_hunting 0 2026-02-22T23:25:27.019 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:27.008+0000 7f56637fe640 1 monclient: found mon.noname-a 2026-02-22T23:25:27.019 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:27.008+0000 7f56637fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T23:25:27.019 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:27.008+0000 7f56637fe640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.45:6789/0 2026-02-22T23:25:27.019 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:27.008+0000 7f56637fe640 1 -- 10.20.193.45:0/389825918 --> v1:10.20.193.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f566c0a08e0 con 0x7f566c06d340 2026-02-22T23:25:27.019 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:27.008+0000 7f56637fe640 10 monclient: _finish_auth 0 2026-02-22T23:25:27.019 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:27.008+0000 7f56637fe640 10 monclient: _check_auth_tickets 2026-02-22T23:25:27.019 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:27.008+0000 7f56637fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T23:25:27.019 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:27.008+0000 7f56637fe640 1 -- 10.20.193.45:0/389825918 <== mon.0 v1:10.20.193.45:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f5654003040 con 0x7f566c06d340 2026-02-22T23:25:27.019 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:27.008+0000 7f56637fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:25:27.019 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:27.008+0000 7f56637fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T23:25:27.020 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:27.008+0000 7f56637fe640 10 monclient: dump: 2026-02-22T23:25:27.020 INFO:teuthology.misc.health.trial045.stderr:epoch 1 2026-02-22T23:25:27.020 INFO:teuthology.misc.health.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:27.020 INFO:teuthology.misc.health.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:27.020 INFO:teuthology.misc.health.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:27.020 INFO:teuthology.misc.health.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:27.020 INFO:teuthology.misc.health.trial045.stderr:election_strategy: 3 2026-02-22T23:25:27.020 INFO:teuthology.misc.health.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:27.020 INFO:teuthology.misc.health.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:27.020 INFO:teuthology.misc.health.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:27.020 INFO:teuthology.misc.health.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:27.020 INFO:teuthology.misc.health.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:27.021 INFO:teuthology.misc.health.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:27.021 INFO:teuthology.misc.health.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:27.021 INFO:teuthology.misc.health.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:27.021 INFO:teuthology.misc.health.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:27.021 INFO:teuthology.misc.health.trial045.stderr: 2026-02-22T23:25:27.021 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:27.008+0000 7f5672ba9640 5 monclient: authenticate success, global_id 4131 2026-02-22T23:25:27.021 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:27.008+0000 7f5672ba9640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-22T23:25:27.021 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:27.008+0000 7f56637fe640 1 -- 10.20.193.45:0/389825918 <== mon.0 v1:10.20.193.45:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5654003260 con 0x7f566c06d340 2026-02-22T23:25:27.021 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:27.008+0000 7f56637fe640 10 monclient: handle_config config(0 keys) 2026-02-22T23:25:27.021 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:27.008+0000 7f56637fe640 1 -- 10.20.193.45:0/389825918 <== mon.0 v1:10.20.193.45:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f5654004c20 con 0x7f566c06d340 2026-02-22T23:25:27.021 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:27.008+0000 7f5672ba9640 10 monclient: get_monmap_and_config success 2026-02-22T23:25:27.021 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:27.008+0000 7f5672ba9640 4 set_mon_vals no callback set 2026-02-22T23:25:27.021 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:27.008+0000 7f56637fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:25:27.022 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:27.008+0000 7f56637fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T23:25:27.022 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:27.008+0000 7f56637fe640 10 monclient: dump: 2026-02-22T23:25:27.022 INFO:teuthology.misc.health.trial045.stderr:epoch 1 2026-02-22T23:25:27.022 INFO:teuthology.misc.health.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:27.022 INFO:teuthology.misc.health.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:27.022 INFO:teuthology.misc.health.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:27.022 INFO:teuthology.misc.health.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:27.022 INFO:teuthology.misc.health.trial045.stderr:election_strategy: 3 2026-02-22T23:25:27.022 INFO:teuthology.misc.health.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:27.022 INFO:teuthology.misc.health.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:27.022 INFO:teuthology.misc.health.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:27.022 INFO:teuthology.misc.health.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:27.022 INFO:teuthology.misc.health.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:27.023 INFO:teuthology.misc.health.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:27.023 INFO:teuthology.misc.health.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:27.023 INFO:teuthology.misc.health.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:27.023 INFO:teuthology.misc.health.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:27.023 INFO:teuthology.misc.health.trial045.stderr: 2026-02-22T23:25:27.023 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:27.009+0000 7f5672ba9640 10 monclient: shutdown 2026-02-22T23:25:27.023 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:27.009+0000 7f5672ba9640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T23:25:27.023 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:27.009+0000 7f5672ba9640 1 -- 10.20.193.45:0/389825918 >> v1:10.20.193.45:6789/0 conn(0x7f566c06d340 legacy=0x7f566c13e130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:27.023 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:27.009+0000 7f5672ba9640 1 -- 10.20.193.45:0/389825918 shutdown_connections 2026-02-22T23:25:27.023 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:27.009+0000 7f5672ba9640 1 -- 10.20.193.45:0/389825918 >> 10.20.193.45:0/389825918 conn(0x7f566c0a5c60 msgr2=0x7f566c0a6070 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:25:27.023 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:27.009+0000 7f5672ba9640 1 -- 10.20.193.45:0/389825918 shutdown_connections 2026-02-22T23:25:27.024 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:27.009+0000 7f5672ba9640 1 -- 10.20.193.45:0/389825918 wait complete. 2026-02-22T23:25:27.024 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:27.009+0000 7f5672ba9640 10 monclient: build_initial_monmap 2026-02-22T23:25:27.024 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:27.009+0000 7f5672ba9640 10 monclient: monmap: 2026-02-22T23:25:27.024 INFO:teuthology.misc.health.trial045.stderr:epoch 0 2026-02-22T23:25:27.024 INFO:teuthology.misc.health.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T23:25:27.024 INFO:teuthology.misc.health.trial045.stderr:last_changed 0.000000 2026-02-22T23:25:27.024 INFO:teuthology.misc.health.trial045.stderr:created 0.000000 2026-02-22T23:25:27.024 INFO:teuthology.misc.health.trial045.stderr:min_mon_release 0 (unknown) 2026-02-22T23:25:27.024 INFO:teuthology.misc.health.trial045.stderr:election_strategy: 1 2026-02-22T23:25:27.024 INFO:teuthology.misc.health.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-22T23:25:27.024 INFO:teuthology.misc.health.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.noname-f 2026-02-22T23:25:27.024 INFO:teuthology.misc.health.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.noname-b 2026-02-22T23:25:27.024 INFO:teuthology.misc.health.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.noname-g 2026-02-22T23:25:27.025 INFO:teuthology.misc.health.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.noname-c 2026-02-22T23:25:27.025 INFO:teuthology.misc.health.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.noname-h 2026-02-22T23:25:27.025 INFO:teuthology.misc.health.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.noname-d 2026-02-22T23:25:27.025 INFO:teuthology.misc.health.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.noname-i 2026-02-22T23:25:27.025 INFO:teuthology.misc.health.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.noname-e 2026-02-22T23:25:27.025 INFO:teuthology.misc.health.trial045.stderr: 2026-02-22T23:25:27.025 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:27.009+0000 7f5672ba9640 1 Processor -- start 2026-02-22T23:25:27.025 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:27.009+0000 7f5672ba9640 1 -- start start 2026-02-22T23:25:27.025 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:27.009+0000 7f5672ba9640 10 monclient: init 2026-02-22T23:25:27.025 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:27.009+0000 7f5672ba9640 10 monclient: _reopen_session rank -1 2026-02-22T23:25:27.025 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:27.009+0000 7f5672ba9640 10 monclient: _add_conns ranks=[6,1,0,5,3,4,8,2,7] 2026-02-22T23:25:27.025 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:27.009+0000 7f5672ba9640 10 monclient(hunting): picked mon.noname-d con 0x7f566c06c850 addr v1:10.20.193.45:6792/0 2026-02-22T23:25:27.025 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:27.009+0000 7f5672ba9640 10 monclient(hunting): picked mon.noname-f con 0x7f566c06d340 addr v1:10.20.193.73:6789/0 2026-02-22T23:25:27.026 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:27.009+0000 7f5672ba9640 10 monclient(hunting): picked mon.noname-a con 0x7f566c13f850 addr v1:10.20.193.45:6789/0 2026-02-22T23:25:27.026 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:27.009+0000 7f5672ba9640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f566c13f1f0 con 0x7f566c13f850 2026-02-22T23:25:27.026 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:27.009+0000 7f5672ba9640 1 -- --> v1:10.20.193.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f566c0734c0 con 0x7f566c06d340 2026-02-22T23:25:27.026 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:27.009+0000 7f5672ba9640 1 -- --> v1:10.20.193.45:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f566c074020 con 0x7f566c06c850 2026-02-22T23:25:27.026 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:27.009+0000 7f5672ba9640 10 monclient(hunting): _renew_subs 2026-02-22T23:25:27.026 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:27.009+0000 7f5672ba9640 10 monclient(hunting): authenticate will time out at 658.626963s 2026-02-22T23:25:27.026 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:27.009+0000 7f567091e640 1 --1- >> v1:10.20.193.45:6792/0 conn(0x7f566c06c850 0x7f566c070ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.45:6792/0 says I am v1:10.20.193.45:46762/0 (socket says 10.20.193.45:46762) 2026-02-22T23:25:27.026 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:27.009+0000 7f567091e640 1 -- 10.20.193.45:0/3992502727 learned_addr learned my addr 10.20.193.45:0/3992502727 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-22T23:25:27.026 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:27.009+0000 7f567111f640 1 --1- >> v1:10.20.193.45:6789/0 conn(0x7f566c13f850 0x7f566c1d7960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.45:6789/0 says I am v1:10.20.193.45:60250/0 (socket says 10.20.193.45:60250) 2026-02-22T23:25:27.026 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:27.010+0000 7f56617fa640 1 -- 10.20.193.45:0/3992502727 <== mon.6 v1:10.20.193.45:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 882040942 0 0) 0x7f566c074020 con 0x7f566c06c850 2026-02-22T23:25:27.026 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:27.010+0000 7f56617fa640 10 monclient(hunting): _negotiate 2026-02-22T23:25:27.026 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:27.010+0000 7f56617fa640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:27.027 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:27.010+0000 7f56617fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:27.027 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:27.010+0000 7f56617fa640 10 monclient(hunting): my global_id is 4173 2026-02-22T23:25:27.027 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:27.010+0000 7f56617fa640 1 -- 10.20.193.45:0/3992502727 --> v1:10.20.193.45:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f563c003620 con 0x7f566c06c850 2026-02-22T23:25:27.027 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:27.010+0000 7f56617fa640 1 -- 10.20.193.45:0/3992502727 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4182292686 0 0) 0x7f566c13f1f0 con 0x7f566c13f850 2026-02-22T23:25:27.027 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:27.010+0000 7f56617fa640 10 monclient(hunting): _negotiate 2026-02-22T23:25:27.027 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:27.010+0000 7f56617fa640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:27.027 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:27.010+0000 7f56617fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:27.027 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:27.010+0000 7f56617fa640 10 monclient(hunting): my global_id is 4140 2026-02-22T23:25:27.027 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:27.010+0000 7f56617fa640 1 -- 10.20.193.45:0/3992502727 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f566c074020 con 0x7f566c13f850 2026-02-22T23:25:27.027 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:27.010+0000 7f56617fa640 1 -- 10.20.193.45:0/3992502727 <== mon.6 v1:10.20.193.45:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 90696980 0 0) 0x7f563c003620 con 0x7f566c06c850 2026-02-22T23:25:27.027 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:27.010+0000 7f56617fa640 1 -- 10.20.193.45:0/3992502727 --> v1:10.20.193.45:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f566c13f1f0 con 0x7f566c06c850 2026-02-22T23:25:27.027 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:27.010+0000 7f56617fa640 1 -- 10.20.193.45:0/3992502727 <== mon.6 v1:10.20.193.45:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f565c0033a0 con 0x7f566c06c850 2026-02-22T23:25:27.027 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:27.010+0000 7f56617fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-22T23:25:27.028 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:27.010+0000 7f56617fa640 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2026-02-22T23:25:27.028 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:27.010+0000 7f56617fa640 10 monclient(hunting): dump: 2026-02-22T23:25:27.028 INFO:teuthology.misc.health.trial045.stderr:epoch 1 2026-02-22T23:25:27.028 INFO:teuthology.misc.health.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:27.028 INFO:teuthology.misc.health.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:27.028 INFO:teuthology.misc.health.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:27.028 INFO:teuthology.misc.health.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:27.028 INFO:teuthology.misc.health.trial045.stderr:election_strategy: 3 2026-02-22T23:25:27.028 INFO:teuthology.misc.health.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:27.028 INFO:teuthology.misc.health.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:27.028 INFO:teuthology.misc.health.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:27.028 INFO:teuthology.misc.health.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:27.028 INFO:teuthology.misc.health.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:27.029 INFO:teuthology.misc.health.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:27.029 INFO:teuthology.misc.health.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:27.029 INFO:teuthology.misc.health.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:27.029 INFO:teuthology.misc.health.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:27.029 INFO:teuthology.misc.health.trial045.stderr: 2026-02-22T23:25:27.029 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:27.010+0000 7f56617fa640 10 monclient(hunting): _finish_auth 0 2026-02-22T23:25:27.029 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:27.010+0000 7f56617fa640 1 -- 10.20.193.45:0/3992502727 <== mon.0 v1:10.20.193.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1256339831 0 0) 0x7f566c074020 con 0x7f566c13f850 2026-02-22T23:25:27.029 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:27.010+0000 7f56617fa640 1 -- 10.20.193.45:0/3992502727 --> v1:10.20.193.45:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f563c003620 con 0x7f566c13f850 2026-02-22T23:25:27.029 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:27.010+0000 7f56617fa640 1 -- 10.20.193.45:0/3992502727 <== mon.0 v1:10.20.193.45:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f5668004400 con 0x7f566c13f850 2026-02-22T23:25:27.029 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:27.010+0000 7f56617fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-22T23:25:27.029 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:27.010+0000 7f56617fa640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-22T23:25:27.029 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:27.010+0000 7f56617fa640 10 monclient(hunting): dump: 2026-02-22T23:25:27.030 INFO:teuthology.misc.health.trial045.stderr:epoch 1 2026-02-22T23:25:27.030 INFO:teuthology.misc.health.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:27.030 INFO:teuthology.misc.health.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:27.030 INFO:teuthology.misc.health.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:27.030 INFO:teuthology.misc.health.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:27.030 INFO:teuthology.misc.health.trial045.stderr:election_strategy: 3 2026-02-22T23:25:27.030 INFO:teuthology.misc.health.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:27.030 INFO:teuthology.misc.health.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:27.030 INFO:teuthology.misc.health.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:27.030 INFO:teuthology.misc.health.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:27.030 INFO:teuthology.misc.health.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:27.030 INFO:teuthology.misc.health.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:27.030 INFO:teuthology.misc.health.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:27.031 INFO:teuthology.misc.health.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:27.031 INFO:teuthology.misc.health.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:27.031 INFO:teuthology.misc.health.trial045.stderr: 2026-02-22T23:25:27.031 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:27.010+0000 7f56617fa640 1 -- 10.20.193.45:0/3992502727 <== mon.6 v1:10.20.193.45:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1247393164 0 0) 0x7f566c13f1f0 con 0x7f566c06c850 2026-02-22T23:25:27.031 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:27.010+0000 7f56617fa640 1 -- 10.20.193.45:0/3992502727 >> v1:10.20.193.73:6789/0 conn(0x7f566c06d340 legacy=0x7f566c071600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:27.031 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:27.010+0000 7f56617fa640 1 -- 10.20.193.45:0/3992502727 >> v1:10.20.193.45:6789/0 conn(0x7f566c13f850 legacy=0x7f566c1d7960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:27.031 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:27.010+0000 7f56617fa640 10 monclient: _finish_hunting 0 2026-02-22T23:25:27.031 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:27.010+0000 7f56617fa640 1 monclient: found mon.d 2026-02-22T23:25:27.031 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:27.010+0000 7f56617fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T23:25:27.031 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:27.010+0000 7f56617fa640 10 monclient: _send_mon_message to mon.d at v1:10.20.193.45:6792/0 2026-02-22T23:25:27.032 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:27.010+0000 7f56617fa640 1 -- 10.20.193.45:0/3992502727 --> v1:10.20.193.45:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f566c073780 con 0x7f566c06c850 2026-02-22T23:25:27.032 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:27.010+0000 7f56617fa640 10 monclient: _finish_auth 0 2026-02-22T23:25:27.032 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:27.010+0000 7f56617fa640 10 monclient: _check_auth_tickets 2026-02-22T23:25:27.032 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:27.010+0000 7f56617fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T23:25:27.032 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:27.010+0000 7f5672ba9640 5 monclient: authenticate success, global_id 4173 2026-02-22T23:25:27.032 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:27.010+0000 7f5672ba9640 10 monclient: _renew_subs 2026-02-22T23:25:27.032 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:27.010+0000 7f5672ba9640 10 monclient: _send_mon_message to mon.d at v1:10.20.193.45:6792/0 2026-02-22T23:25:27.032 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:27.010+0000 7f5672ba9640 1 -- 10.20.193.45:0/3992502727 --> v1:10.20.193.45:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f566c09f6a0 con 0x7f566c06c850 2026-02-22T23:25:27.032 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:27.010+0000 7f5672ba9640 10 monclient: _renew_subs 2026-02-22T23:25:27.032 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:27.010+0000 7f5672ba9640 10 monclient: _send_mon_message to mon.d at v1:10.20.193.45:6792/0 2026-02-22T23:25:27.032 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:27.010+0000 7f5672ba9640 1 -- 10.20.193.45:0/3992502727 --> v1:10.20.193.45:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7f566c071d10 con 0x7f566c06c850 2026-02-22T23:25:27.032 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:27.010+0000 7f56617fa640 1 -- 10.20.193.45:0/3992502727 <== mon.6 v1:10.20.193.45:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f565c004b90 con 0x7f566c06c850 2026-02-22T23:25:27.032 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:27.010+0000 7f56617fa640 10 monclient: handle_config config(0 keys) 2026-02-22T23:25:27.033 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:27.010+0000 7f56617fa640 1 -- 10.20.193.45:0/3992502727 <== mon.6 v1:10.20.193.45:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f565c005080 con 0x7f566c06c850 2026-02-22T23:25:27.033 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:27.010+0000 7f56617fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:25:27.033 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:27.010+0000 7f56617fa640 10 monclient: got monmap 1 from mon.d (according to old e1) 2026-02-22T23:25:27.033 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:27.010+0000 7f5662ffd640 4 set_mon_vals no callback set 2026-02-22T23:25:27.033 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:27.010+0000 7f56617fa640 10 monclient: dump: 2026-02-22T23:25:27.033 INFO:teuthology.misc.health.trial045.stderr:epoch 1 2026-02-22T23:25:27.033 INFO:teuthology.misc.health.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:27.033 INFO:teuthology.misc.health.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:27.033 INFO:teuthology.misc.health.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:27.033 INFO:teuthology.misc.health.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:27.033 INFO:teuthology.misc.health.trial045.stderr:election_strategy: 3 2026-02-22T23:25:27.033 INFO:teuthology.misc.health.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:27.034 INFO:teuthology.misc.health.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:27.034 INFO:teuthology.misc.health.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:27.034 INFO:teuthology.misc.health.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:27.034 INFO:teuthology.misc.health.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:27.034 INFO:teuthology.misc.health.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:27.034 INFO:teuthology.misc.health.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:27.034 INFO:teuthology.misc.health.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:27.034 INFO:teuthology.misc.health.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:27.034 INFO:teuthology.misc.health.trial045.stderr: 2026-02-22T23:25:27.034 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:27.010+0000 7f56617fa640 1 -- 10.20.193.45:0/3992502727 <== mon.6 v1:10.20.193.45:6792/0 7 ==== mgrmap(e 1) ==== 811+0+0 (unknown 4133961934 0 0) 0x7f565c0055b0 con 0x7f566c06c850 2026-02-22T23:25:27.034 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:27.010+0000 7f56617fa640 1 -- 10.20.193.45:0/3992502727 <== mon.6 v1:10.20.193.45:6792/0 8 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (unknown 935347643 0 0) 0x7f565c006f60 con 0x7f566c06c850 2026-02-22T23:25:27.034 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:27.010+0000 7f5672ba9640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T23:25:27.034 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:27.010+0000 7f5672ba9640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T23:25:27.035 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:27.010+0000 7f5672ba9640 10 monclient: _send_mon_message to mon.d at v1:10.20.193.45:6792/0 2026-02-22T23:25:27.035 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:27.010+0000 7f5672ba9640 1 -- 10.20.193.45:0/3992502727 --> v1:10.20.193.45:6792/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f566c072000 con 0x7f566c06c850 2026-02-22T23:25:27.035 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:27.012+0000 7f56617fa640 1 -- 10.20.193.45:0/3992502727 <== mon.6 v1:10.20.193.45:6792/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75931 (unknown 1092875540 0 4127419540) 0x7f565c0061a0 con 0x7f566c06c850 2026-02-22T23:25:27.035 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:27.012+0000 7f56617fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T23:25:27.035 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:27.012+0000 7f56617fa640 10 monclient: _finish_command 1 = system:0 2026-02-22T23:25:27.040 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:27.039+0000 7f5672ba9640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2026-02-22T23:25:27.040 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:27.039+0000 7f5672ba9640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-22T23:25:27.041 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:27.039+0000 7f5672ba9640 10 monclient: _send_mon_message to mon.d at v1:10.20.193.45:6792/0 2026-02-22T23:25:27.041 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:27.039+0000 7f5672ba9640 1 -- 10.20.193.45:0/3992502727 --> v1:10.20.193.45:6792/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f566c06f0b0 con 0x7f566c06c850 2026-02-22T23:25:27.041 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:27.039+0000 7f56617fa640 1 -- 10.20.193.45:0/3992502727 <== mon.6 v1:10.20.193.45:6792/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v8) ==== 74+0+5605 (unknown 150273500 0 1319435991) 0x7f565c006970 con 0x7f566c06c850 2026-02-22T23:25:27.041 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:27.039+0000 7f56617fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-22T23:25:27.041 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:27.039+0000 7f56617fa640 10 monclient: _finish_command 2 = system:0 2026-02-22T23:25:27.041 INFO:teuthology.misc.health.trial045.stdout: 2026-02-22T23:25:27.041 INFO:teuthology.misc.health.trial045.stdout:{"epoch":8,"fsid":"4b60f18f-6660-4731-b731-dc85c4078413","created":"2026-02-22T23:25:25.062615+0000","modified":"2026-02-22T23:25:26.208612+0000","last_up_change":"0.000000","last_in_change":"2026-02-22T23:25:26.208612+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"ef9d15a7-661e-40c5-a418-7f794c0975b7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"9e62cdef-b0a0-4f67-a778-ac4f7d97ed7e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"bfcf94e1-2623-4443-aaf8-f525210ab7b2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"32e9109d-09f0-4c75-bfbe-bb0fa237ca08","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"311ec782-d282-48e9-9545-41ac3acb1ac8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"4569df35-5988-4308-9e5d-a6b26171c346","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-22T23:25:27.042 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:27.040+0000 7f5672ba9640 10 monclient: shutdown 2026-02-22T23:25:27.042 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:27.040+0000 7f5672ba9640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T23:25:27.042 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:27.040+0000 7f5672ba9640 1 -- 10.20.193.45:0/3992502727 >> v1:10.20.193.45:6792/0 conn(0x7f566c06c850 legacy=0x7f566c070ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:27.043 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:27.040+0000 7f5672ba9640 1 -- 10.20.193.45:0/3992502727 shutdown_connections 2026-02-22T23:25:27.043 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:27.040+0000 7f5672ba9640 1 -- 10.20.193.45:0/3992502727 >> 10.20.193.45:0/3992502727 conn(0x7f566c0a5c60 msgr2=0x7f566c0a7780 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:25:27.043 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:27.040+0000 7f5672ba9640 1 -- 10.20.193.45:0/3992502727 shutdown_connections 2026-02-22T23:25:27.043 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:27.040+0000 7f5672ba9640 1 -- 10.20.193.45:0/3992502727 wait complete. 2026-02-22T23:25:27.046 DEBUG:teuthology.misc:0 of 6 OSDs are up 2026-02-22T23:25:27.189 INFO:tasks.ceph.mgr.x.trial073.stderr:2026-02-22T23:25:27.187+0000 7f413a1cd140 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2026-02-22T23:25:27.898 INFO:tasks.ceph.osd.0.trial045.stderr:2026-02-22T23:25:27.897+0000 7f917502c780 -1 Falling back to public interface 2026-02-22T23:25:27.898 INFO:tasks.ceph.osd.1.trial045.stderr:2026-02-22T23:25:27.897+0000 7f7554638780 -1 Falling back to public interface 2026-02-22T23:25:27.898 INFO:tasks.ceph.osd.0.trial045.stderr:2026-02-22T23:25:27.897+0000 7f9173581640 -1 PosixStack listen unable to listen on v1:0.0.0.0:6800/0: (98) Address already in use 2026-02-22T23:25:27.905 INFO:tasks.ceph.osd.4.trial073.stderr:2026-02-22T23:25:27.903+0000 7f443e80d780 -1 Falling back to public interface 2026-02-22T23:25:28.132 INFO:tasks.ceph.osd.2.trial045.stderr:2026-02-22T23:25:28.131+0000 7f2a697b4780 -1 Falling back to public interface 2026-02-22T23:25:28.138 INFO:tasks.ceph.osd.3.trial073.stderr:2026-02-22T23:25:28.136+0000 7f325c934780 -1 Falling back to public interface 2026-02-22T23:25:28.173 INFO:tasks.ceph.osd.5.trial073.stderr:2026-02-22T23:25:28.171+0000 7fa4d5413780 -1 Falling back to public interface 2026-02-22T23:25:28.197 INFO:tasks.ceph.mgr.x.trial073.stderr:2026-02-22T23:25:28.195+0000 7f4056dfe640 -1 mgr.server handle_report got status from non-daemon mon.g 2026-02-22T23:25:28.198 INFO:tasks.ceph.mgr.x.trial073.stderr:2026-02-22T23:25:28.195+0000 7f4056dfe640 -1 mgr.server handle_report got status from non-daemon mon.f 2026-02-22T23:25:28.198 INFO:tasks.ceph.mgr.x.trial073.stderr:2026-02-22T23:25:28.195+0000 7f4056dfe640 -1 mgr.server handle_report got status from non-daemon mon.d 2026-02-22T23:25:28.198 INFO:tasks.ceph.mgr.x.trial073.stderr:2026-02-22T23:25:28.196+0000 7f4056dfe640 -1 mgr.server handle_report got status from non-daemon mon.h 2026-02-22T23:25:28.198 INFO:tasks.ceph.mgr.x.trial073.stderr:2026-02-22T23:25:28.196+0000 7f4056dfe640 -1 mgr.server handle_report got status from non-daemon mon.b 2026-02-22T23:25:28.198 INFO:tasks.ceph.mgr.x.trial073.stderr:2026-02-22T23:25:28.196+0000 7f4056dfe640 -1 mgr.server handle_report got status from non-daemon mon.i 2026-02-22T23:25:28.198 INFO:tasks.ceph.mgr.x.trial073.stderr:2026-02-22T23:25:28.196+0000 7f4056dfe640 -1 mgr.server handle_report got status from non-daemon mon.e 2026-02-22T23:25:28.198 INFO:tasks.ceph.mgr.x.trial073.stderr:2026-02-22T23:25:28.196+0000 7f4056dfe640 -1 mgr.server handle_report got status from non-daemon mon.c 2026-02-22T23:25:31.633 INFO:tasks.ceph.osd.3.trial073.stderr:2026-02-22T23:25:31.631+0000 7f325c934780 -1 osd.3 0 log_to_monitors true 2026-02-22T23:25:31.698 INFO:tasks.ceph.osd.4.trial073.stderr:2026-02-22T23:25:31.696+0000 7f443e80d780 -1 osd.4 0 log_to_monitors true 2026-02-22T23:25:31.849 INFO:tasks.ceph.osd.2.trial045.stderr:2026-02-22T23:25:31.847+0000 7f2a697b4780 -1 osd.2 0 log_to_monitors true 2026-02-22T23:25:31.924 INFO:tasks.ceph.osd.0.trial045.stderr:2026-02-22T23:25:31.923+0000 7f917502c780 -1 osd.0 0 log_to_monitors true 2026-02-22T23:25:31.973 INFO:tasks.ceph.osd.5.trial073.stderr:2026-02-22T23:25:31.971+0000 7fa4d5413780 -1 osd.5 0 log_to_monitors true 2026-02-22T23:25:32.414 INFO:tasks.ceph.osd.1.trial045.stderr:2026-02-22T23:25:32.413+0000 7f7554638780 -1 osd.1 0 log_to_monitors true 2026-02-22T23:25:32.697 INFO:tasks.ceph.osd.3.trial073.stderr:2026-02-22T23:25:32.695+0000 7f32588c1640 -1 osd.3 0 waiting for initial osdmap 2026-02-22T23:25:32.699 INFO:tasks.ceph.osd.3.trial073.stderr:2026-02-22T23:25:32.697+0000 7f32546eb640 -1 osd.3 10 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-22T23:25:33.652 DEBUG:teuthology.orchestra.run.trial045:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-22T23:25:33.695 INFO:tasks.ceph.osd.5.trial073.stderr:2026-02-22T23:25:33.693+0000 7fa4d13a0640 -1 osd.5 0 waiting for initial osdmap 2026-02-22T23:25:33.696 INFO:tasks.ceph.osd.1.trial045.stderr:2026-02-22T23:25:33.694+0000 7f75505c7640 -1 osd.1 0 waiting for initial osdmap 2026-02-22T23:25:33.696 INFO:tasks.ceph.osd.4.trial073.stderr:2026-02-22T23:25:33.694+0000 7f443a045640 -1 osd.4 0 waiting for initial osdmap 2026-02-22T23:25:33.696 INFO:tasks.ceph.osd.0.trial045.stderr:2026-02-22T23:25:33.695+0000 7f9170569640 -1 osd.0 0 waiting for initial osdmap 2026-02-22T23:25:33.697 INFO:tasks.ceph.osd.2.trial045.stderr:2026-02-22T23:25:33.695+0000 7f2a65743640 -1 osd.2 0 waiting for initial osdmap 2026-02-22T23:25:33.697 INFO:tasks.ceph.osd.1.trial045.stderr:2026-02-22T23:25:33.696+0000 7f754c3f1640 -1 osd.1 11 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-22T23:25:33.698 INFO:tasks.ceph.osd.0.trial045.stderr:2026-02-22T23:25:33.697+0000 7f916838b640 -1 osd.0 11 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-22T23:25:33.698 INFO:tasks.ceph.osd.5.trial073.stderr:2026-02-22T23:25:33.696+0000 7fa4cd1ca640 -1 osd.5 11 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-22T23:25:33.698 INFO:tasks.ceph.osd.4.trial073.stderr:2026-02-22T23:25:33.696+0000 7f4431e67640 -1 osd.4 11 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-22T23:25:33.700 INFO:tasks.ceph.osd.2.trial045.stderr:2026-02-22T23:25:33.699+0000 7f2a5d565640 -1 osd.2 11 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-22T23:25:33.715 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:33.714+0000 7f502b4a9640 10 monclient: get_monmap_and_config 2026-02-22T23:25:33.715 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:33.714+0000 7f502b4a9640 10 monclient: build_initial_monmap 2026-02-22T23:25:33.715 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:33.714+0000 7f502b4a9640 10 monclient: monmap: 2026-02-22T23:25:33.715 INFO:teuthology.misc.health.trial045.stderr:epoch 0 2026-02-22T23:25:33.716 INFO:teuthology.misc.health.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:33.716 INFO:teuthology.misc.health.trial045.stderr:last_changed 2026-02-22T23:25:33.715808+0000 2026-02-22T23:25:33.716 INFO:teuthology.misc.health.trial045.stderr:created 2026-02-22T23:25:33.715808+0000 2026-02-22T23:25:33.716 INFO:teuthology.misc.health.trial045.stderr:min_mon_release 0 (unknown) 2026-02-22T23:25:33.716 INFO:teuthology.misc.health.trial045.stderr:election_strategy: 3 2026-02-22T23:25:33.716 INFO:teuthology.misc.health.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-22T23:25:33.716 INFO:teuthology.misc.health.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.noname-f 2026-02-22T23:25:33.716 INFO:teuthology.misc.health.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.noname-b 2026-02-22T23:25:33.716 INFO:teuthology.misc.health.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.noname-g 2026-02-22T23:25:33.716 INFO:teuthology.misc.health.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.noname-c 2026-02-22T23:25:33.716 INFO:teuthology.misc.health.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.noname-h 2026-02-22T23:25:33.716 INFO:teuthology.misc.health.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.noname-d 2026-02-22T23:25:33.717 INFO:teuthology.misc.health.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.noname-i 2026-02-22T23:25:33.717 INFO:teuthology.misc.health.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.noname-e 2026-02-22T23:25:33.717 INFO:teuthology.misc.health.trial045.stderr: 2026-02-22T23:25:33.724 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:33.714+0000 7f502b4a9640 1 Processor -- start 2026-02-22T23:25:33.724 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:33.715+0000 7f502b4a9640 1 -- start start 2026-02-22T23:25:33.724 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:33.715+0000 7f502b4a9640 10 monclient: init 2026-02-22T23:25:33.724 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:33.715+0000 7f502b4a9640 10 monclient: _reopen_session rank -1 2026-02-22T23:25:33.724 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:33.715+0000 7f502b4a9640 10 monclient: _add_conns ranks=[8,0,5,2,6,1,4,7,3] 2026-02-22T23:25:33.724 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:33.715+0000 7f502b4a9640 10 monclient(hunting): picked mon.noname-e con 0x7f50240a3b60 addr v1:10.20.193.45:6793/0 2026-02-22T23:25:33.724 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:33.715+0000 7f502b4a9640 10 monclient(hunting): picked mon.noname-a con 0x7f5024076d10 addr v1:10.20.193.45:6789/0 2026-02-22T23:25:33.724 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:33.715+0000 7f502b4a9640 10 monclient(hunting): picked mon.noname-h con 0x7f50240a4650 addr v1:10.20.193.73:6791/0 2026-02-22T23:25:33.725 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:33.715+0000 7f502b4a9640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f502409d480 con 0x7f5024076d10 2026-02-22T23:25:33.725 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:33.715+0000 7f502b4a9640 1 -- --> v1:10.20.193.73:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f502409e690 con 0x7f50240a4650 2026-02-22T23:25:33.725 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:33.715+0000 7f502b4a9640 1 -- --> v1:10.20.193.45:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f502409d6f0 con 0x7f50240a3b60 2026-02-22T23:25:33.725 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:33.715+0000 7f502b4a9640 10 monclient(hunting): _renew_subs 2026-02-22T23:25:33.725 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:33.715+0000 7f502b4a9640 10 monclient(hunting): authenticate will time out at 665.332357s 2026-02-22T23:25:33.725 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:33.715+0000 7f5028a1d640 1 --1- >> v1:10.20.193.45:6789/0 conn(0x7f5024076d10 0x7f502413e0c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.45:6789/0 says I am v1:10.20.193.45:45638/0 (socket says 10.20.193.45:45638) 2026-02-22T23:25:33.725 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:33.715+0000 7f5028a1d640 1 -- 10.20.193.45:0/4006307060 learned_addr learned my addr 10.20.193.45:0/4006307060 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-22T23:25:33.725 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:33.715+0000 7f5013fff640 1 -- 10.20.193.45:0/4006307060 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 907289123 0 0) 0x7f502409d480 con 0x7f5024076d10 2026-02-22T23:25:33.725 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:33.715+0000 7f5013fff640 10 monclient(hunting): _negotiate 2026-02-22T23:25:33.725 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:33.715+0000 7f5013fff640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:33.725 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:33.715+0000 7f5013fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:33.725 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:33.715+0000 7f5013fff640 10 monclient(hunting): my global_id is 4185 2026-02-22T23:25:33.726 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:33.715+0000 7f5013fff640 1 -- 10.20.193.45:0/4006307060 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f500c003620 con 0x7f5024076d10 2026-02-22T23:25:33.726 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:33.715+0000 7f5013fff640 1 -- 10.20.193.45:0/4006307060 <== mon.8 v1:10.20.193.45:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2324928100 0 0) 0x7f502409d6f0 con 0x7f50240a3b60 2026-02-22T23:25:33.726 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:33.715+0000 7f5013fff640 10 monclient(hunting): _negotiate 2026-02-22T23:25:33.726 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:33.715+0000 7f5013fff640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:33.726 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:33.715+0000 7f5013fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:33.726 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:33.715+0000 7f5013fff640 10 monclient(hunting): my global_id is 4202 2026-02-22T23:25:33.726 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:33.715+0000 7f5013fff640 1 -- 10.20.193.45:0/4006307060 --> v1:10.20.193.45:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f502409d480 con 0x7f50240a3b60 2026-02-22T23:25:33.726 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:33.715+0000 7f5013fff640 1 -- 10.20.193.45:0/4006307060 <== mon.0 v1:10.20.193.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3469835451 0 0) 0x7f500c003620 con 0x7f5024076d10 2026-02-22T23:25:33.726 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:33.715+0000 7f5013fff640 1 -- 10.20.193.45:0/4006307060 >> v1:10.20.193.45:6793/0 conn(0x7f50240a3b60 legacy=0x7f50240a3f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:33.726 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:33.715+0000 7f5013fff640 1 -- 10.20.193.45:0/4006307060 >> v1:10.20.193.73:6791/0 conn(0x7f50240a4650 legacy=0x7f50241417f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:33.726 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:33.715+0000 7f5013fff640 10 monclient: _finish_hunting 0 2026-02-22T23:25:33.726 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:33.715+0000 7f5013fff640 1 monclient: found mon.noname-a 2026-02-22T23:25:33.727 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:33.715+0000 7f5013fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T23:25:33.727 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:33.715+0000 7f5013fff640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.45:6789/0 2026-02-22T23:25:33.727 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:33.715+0000 7f5013fff640 1 -- 10.20.193.45:0/4006307060 --> v1:10.20.193.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f502409d9d0 con 0x7f5024076d10 2026-02-22T23:25:33.727 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:33.715+0000 7f5013fff640 10 monclient: _finish_auth 0 2026-02-22T23:25:33.727 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:33.715+0000 7f5013fff640 10 monclient: _check_auth_tickets 2026-02-22T23:25:33.727 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:33.715+0000 7f5013fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T23:25:33.727 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:33.715+0000 7f5013fff640 1 -- 10.20.193.45:0/4006307060 <== mon.0 v1:10.20.193.45:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f5018003040 con 0x7f5024076d10 2026-02-22T23:25:33.727 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:33.715+0000 7f5013fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:25:33.727 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:33.715+0000 7f5013fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T23:25:33.727 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:33.715+0000 7f5013fff640 10 monclient: dump: 2026-02-22T23:25:33.728 INFO:teuthology.misc.health.trial045.stderr:epoch 1 2026-02-22T23:25:33.728 INFO:teuthology.misc.health.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:33.728 INFO:teuthology.misc.health.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:33.728 INFO:teuthology.misc.health.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:33.728 INFO:teuthology.misc.health.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:33.728 INFO:teuthology.misc.health.trial045.stderr:election_strategy: 3 2026-02-22T23:25:33.728 INFO:teuthology.misc.health.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:33.728 INFO:teuthology.misc.health.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:33.728 INFO:teuthology.misc.health.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:33.728 INFO:teuthology.misc.health.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:33.728 INFO:teuthology.misc.health.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:33.728 INFO:teuthology.misc.health.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:33.728 INFO:teuthology.misc.health.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:33.729 INFO:teuthology.misc.health.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:33.729 INFO:teuthology.misc.health.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:33.729 INFO:teuthology.misc.health.trial045.stderr: 2026-02-22T23:25:33.729 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:33.715+0000 7f502b4a9640 5 monclient: authenticate success, global_id 4185 2026-02-22T23:25:33.729 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:33.715+0000 7f502b4a9640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-22T23:25:33.729 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:33.715+0000 7f5013fff640 1 -- 10.20.193.45:0/4006307060 <== mon.0 v1:10.20.193.45:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5018003260 con 0x7f5024076d10 2026-02-22T23:25:33.729 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:33.715+0000 7f5013fff640 10 monclient: handle_config config(0 keys) 2026-02-22T23:25:33.729 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:33.715+0000 7f5013fff640 1 -- 10.20.193.45:0/4006307060 <== mon.0 v1:10.20.193.45:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f5018004ce0 con 0x7f5024076d10 2026-02-22T23:25:33.729 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:33.715+0000 7f5013fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:25:33.729 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:33.715+0000 7f5013fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T23:25:33.729 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:33.715+0000 7f5013fff640 10 monclient: dump: 2026-02-22T23:25:33.729 INFO:teuthology.misc.health.trial045.stderr:epoch 1 2026-02-22T23:25:33.730 INFO:teuthology.misc.health.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:33.730 INFO:teuthology.misc.health.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:33.730 INFO:teuthology.misc.health.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:33.730 INFO:teuthology.misc.health.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:33.730 INFO:teuthology.misc.health.trial045.stderr:election_strategy: 3 2026-02-22T23:25:33.730 INFO:teuthology.misc.health.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:33.730 INFO:teuthology.misc.health.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:33.730 INFO:teuthology.misc.health.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:33.730 INFO:teuthology.misc.health.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:33.730 INFO:teuthology.misc.health.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:33.730 INFO:teuthology.misc.health.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:33.730 INFO:teuthology.misc.health.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:33.730 INFO:teuthology.misc.health.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:33.730 INFO:teuthology.misc.health.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:33.731 INFO:teuthology.misc.health.trial045.stderr: 2026-02-22T23:25:33.731 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:33.715+0000 7f502b4a9640 10 monclient: get_monmap_and_config success 2026-02-22T23:25:33.731 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:33.715+0000 7f502b4a9640 4 set_mon_vals no callback set 2026-02-22T23:25:33.731 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:33.716+0000 7f502b4a9640 10 monclient: shutdown 2026-02-22T23:25:33.731 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:33.716+0000 7f502b4a9640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T23:25:33.731 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:33.716+0000 7f502b4a9640 1 -- 10.20.193.45:0/4006307060 >> v1:10.20.193.45:6789/0 conn(0x7f5024076d10 legacy=0x7f502413e0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:33.731 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:33.716+0000 7f502b4a9640 1 -- 10.20.193.45:0/4006307060 shutdown_connections 2026-02-22T23:25:33.731 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:33.716+0000 7f502b4a9640 1 -- 10.20.193.45:0/4006307060 >> 10.20.193.45:0/4006307060 conn(0x7f50240a8780 msgr2=0x7f50240a4c50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:25:33.731 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:33.716+0000 7f502b4a9640 1 -- 10.20.193.45:0/4006307060 shutdown_connections 2026-02-22T23:25:33.731 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:33.716+0000 7f502b4a9640 1 -- 10.20.193.45:0/4006307060 wait complete. 2026-02-22T23:25:33.731 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:33.716+0000 7f502b4a9640 10 monclient: build_initial_monmap 2026-02-22T23:25:33.731 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:33.716+0000 7f502b4a9640 10 monclient: monmap: 2026-02-22T23:25:33.732 INFO:teuthology.misc.health.trial045.stderr:epoch 0 2026-02-22T23:25:33.732 INFO:teuthology.misc.health.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T23:25:33.732 INFO:teuthology.misc.health.trial045.stderr:last_changed 0.000000 2026-02-22T23:25:33.732 INFO:teuthology.misc.health.trial045.stderr:created 0.000000 2026-02-22T23:25:33.732 INFO:teuthology.misc.health.trial045.stderr:min_mon_release 0 (unknown) 2026-02-22T23:25:33.732 INFO:teuthology.misc.health.trial045.stderr:election_strategy: 1 2026-02-22T23:25:33.732 INFO:teuthology.misc.health.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-22T23:25:33.732 INFO:teuthology.misc.health.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.noname-f 2026-02-22T23:25:33.732 INFO:teuthology.misc.health.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.noname-b 2026-02-22T23:25:33.732 INFO:teuthology.misc.health.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.noname-g 2026-02-22T23:25:33.732 INFO:teuthology.misc.health.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.noname-c 2026-02-22T23:25:33.732 INFO:teuthology.misc.health.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.noname-h 2026-02-22T23:25:33.732 INFO:teuthology.misc.health.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.noname-d 2026-02-22T23:25:33.733 INFO:teuthology.misc.health.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.noname-i 2026-02-22T23:25:33.733 INFO:teuthology.misc.health.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.noname-e 2026-02-22T23:25:33.733 INFO:teuthology.misc.health.trial045.stderr: 2026-02-22T23:25:33.733 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:33.716+0000 7f502b4a9640 1 Processor -- start 2026-02-22T23:25:33.733 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:33.717+0000 7f502b4a9640 1 -- start start 2026-02-22T23:25:33.733 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:33.717+0000 7f502b4a9640 10 monclient: init 2026-02-22T23:25:33.733 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:33.717+0000 7f502b4a9640 10 monclient: _reopen_session rank -1 2026-02-22T23:25:33.733 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:33.717+0000 7f502b4a9640 10 monclient: _add_conns ranks=[2,8,7,6,5,3,1,0,4] 2026-02-22T23:25:33.733 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:33.717+0000 7f502b4a9640 10 monclient(hunting): picked mon.noname-b con 0x7f5024076d10 addr v1:10.20.193.45:6790/0 2026-02-22T23:25:33.733 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:33.717+0000 7f502b4a9640 10 monclient(hunting): picked mon.noname-e con 0x7f50240a3b60 addr v1:10.20.193.45:6793/0 2026-02-22T23:25:33.733 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:33.717+0000 7f502b4a9640 10 monclient(hunting): picked mon.noname-i con 0x7f50240a4650 addr v1:10.20.193.73:6792/0 2026-02-22T23:25:33.733 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:33.717+0000 7f502b4a9640 1 -- --> v1:10.20.193.45:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f50241250c0 con 0x7f5024076d10 2026-02-22T23:25:33.734 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:33.717+0000 7f502b4a9640 1 -- --> v1:10.20.193.73:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f50240a2350 con 0x7f50240a4650 2026-02-22T23:25:33.734 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:33.717+0000 7f502b4a9640 1 -- --> v1:10.20.193.45:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5024126290 con 0x7f50240a3b60 2026-02-22T23:25:33.734 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:33.717+0000 7f502b4a9640 10 monclient(hunting): _renew_subs 2026-02-22T23:25:33.734 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:33.717+0000 7f502b4a9640 10 monclient(hunting): authenticate will time out at 665.334378s 2026-02-22T23:25:33.734 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:33.717+0000 7f5028a1d640 1 --1- >> v1:10.20.193.45:6793/0 conn(0x7f50240a3b60 0x7f5024138e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.45:6793/0 says I am v1:10.20.193.45:45154/0 (socket says 10.20.193.45:45154) 2026-02-22T23:25:33.734 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:33.717+0000 7f5028a1d640 1 -- 10.20.193.45:0/3113852855 learned_addr learned my addr 10.20.193.45:0/3113852855 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-22T23:25:33.734 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:33.717+0000 7f5011ffb640 1 -- 10.20.193.45:0/3113852855 <== mon.8 v1:10.20.193.45:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 906091165 0 0) 0x7f5024126290 con 0x7f50240a3b60 2026-02-22T23:25:33.734 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:33.717+0000 7f5011ffb640 10 monclient(hunting): _negotiate 2026-02-22T23:25:33.734 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:33.717+0000 7f5011ffb640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:33.734 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:33.717+0000 7f5011ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:33.734 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:33.717+0000 7f5011ffb640 10 monclient(hunting): my global_id is 4211 2026-02-22T23:25:33.734 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:33.717+0000 7f5011ffb640 1 -- 10.20.193.45:0/3113852855 --> v1:10.20.193.45:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4ff4003620 con 0x7f50240a3b60 2026-02-22T23:25:33.734 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:33.717+0000 7f5011ffb640 1 -- 10.20.193.45:0/3113852855 <== mon.2 v1:10.20.193.45:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3285873297 0 0) 0x7f50241250c0 con 0x7f5024076d10 2026-02-22T23:25:33.735 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:33.717+0000 7f5011ffb640 10 monclient(hunting): _negotiate 2026-02-22T23:25:33.735 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:33.717+0000 7f5011ffb640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:33.735 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:33.717+0000 7f5011ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:33.735 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:33.717+0000 7f5011ffb640 10 monclient(hunting): my global_id is 4196 2026-02-22T23:25:33.735 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:33.717+0000 7f5011ffb640 1 -- 10.20.193.45:0/3113852855 --> v1:10.20.193.45:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5024126290 con 0x7f5024076d10 2026-02-22T23:25:33.735 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:33.717+0000 7f5011ffb640 1 -- 10.20.193.45:0/3113852855 <== mon.8 v1:10.20.193.45:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 359257973 0 0) 0x7f4ff4003620 con 0x7f50240a3b60 2026-02-22T23:25:33.735 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:33.717+0000 7f5011ffb640 1 -- 10.20.193.45:0/3113852855 --> v1:10.20.193.45:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f50241250c0 con 0x7f50240a3b60 2026-02-22T23:25:33.735 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:33.717+0000 7f5011ffb640 1 -- 10.20.193.45:0/3113852855 <== mon.8 v1:10.20.193.45:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f5018004c20 con 0x7f50240a3b60 2026-02-22T23:25:33.735 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:33.717+0000 7f5011ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-22T23:25:33.735 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:33.717+0000 7f5011ffb640 10 monclient(hunting): got monmap 1 from mon.noname-e (according to old e1) 2026-02-22T23:25:33.735 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:33.717+0000 7f5011ffb640 10 monclient(hunting): dump: 2026-02-22T23:25:33.735 INFO:teuthology.misc.health.trial045.stderr:epoch 1 2026-02-22T23:25:33.735 INFO:teuthology.misc.health.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:33.736 INFO:teuthology.misc.health.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:33.736 INFO:teuthology.misc.health.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:33.736 INFO:teuthology.misc.health.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:33.736 INFO:teuthology.misc.health.trial045.stderr:election_strategy: 3 2026-02-22T23:25:33.736 INFO:teuthology.misc.health.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:33.736 INFO:teuthology.misc.health.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:33.736 INFO:teuthology.misc.health.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:33.736 INFO:teuthology.misc.health.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:33.736 INFO:teuthology.misc.health.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:33.736 INFO:teuthology.misc.health.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:33.736 INFO:teuthology.misc.health.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:33.736 INFO:teuthology.misc.health.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:33.736 INFO:teuthology.misc.health.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:33.737 INFO:teuthology.misc.health.trial045.stderr: 2026-02-22T23:25:33.737 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:33.717+0000 7f5011ffb640 10 monclient(hunting): _finish_auth 0 2026-02-22T23:25:33.737 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:33.717+0000 7f5011ffb640 1 -- 10.20.193.45:0/3113852855 <== mon.2 v1:10.20.193.45:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1949963972 0 0) 0x7f5024126290 con 0x7f5024076d10 2026-02-22T23:25:33.737 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:33.717+0000 7f5011ffb640 1 -- 10.20.193.45:0/3113852855 --> v1:10.20.193.45:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4ff4003620 con 0x7f5024076d10 2026-02-22T23:25:33.737 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:33.717+0000 7f5011ffb640 1 -- 10.20.193.45:0/3113852855 <== mon.2 v1:10.20.193.45:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f50140032a0 con 0x7f5024076d10 2026-02-22T23:25:33.737 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:33.717+0000 7f5011ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-22T23:25:33.737 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:33.717+0000 7f5011ffb640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-22T23:25:33.737 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:33.717+0000 7f5011ffb640 10 monclient(hunting): dump: 2026-02-22T23:25:33.737 INFO:teuthology.misc.health.trial045.stderr:epoch 1 2026-02-22T23:25:33.737 INFO:teuthology.misc.health.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:33.737 INFO:teuthology.misc.health.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:33.737 INFO:teuthology.misc.health.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:33.737 INFO:teuthology.misc.health.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:33.738 INFO:teuthology.misc.health.trial045.stderr:election_strategy: 3 2026-02-22T23:25:33.738 INFO:teuthology.misc.health.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:33.738 INFO:teuthology.misc.health.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:33.738 INFO:teuthology.misc.health.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:33.738 INFO:teuthology.misc.health.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:33.738 INFO:teuthology.misc.health.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:33.738 INFO:teuthology.misc.health.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:33.738 INFO:teuthology.misc.health.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:33.738 INFO:teuthology.misc.health.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:33.738 INFO:teuthology.misc.health.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:33.738 INFO:teuthology.misc.health.trial045.stderr: 2026-02-22T23:25:33.738 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:33.717+0000 7f5011ffb640 1 -- 10.20.193.45:0/3113852855 <== mon.2 v1:10.20.193.45:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1606049347 0 0) 0x7f4ff4003620 con 0x7f5024076d10 2026-02-22T23:25:33.738 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:33.717+0000 7f5011ffb640 1 -- 10.20.193.45:0/3113852855 >> v1:10.20.193.45:6793/0 conn(0x7f50240a3b60 legacy=0x7f5024138e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:33.739 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:33.717+0000 7f5011ffb640 1 -- 10.20.193.45:0/3113852855 >> v1:10.20.193.73:6792/0 conn(0x7f50240a4650 legacy=0x7f50241d7710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:33.739 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:33.717+0000 7f5011ffb640 10 monclient: _finish_hunting 0 2026-02-22T23:25:33.739 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:33.717+0000 7f5011ffb640 1 monclient: found mon.b 2026-02-22T23:25:33.739 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:33.717+0000 7f5011ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T23:25:33.739 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:33.717+0000 7f5011ffb640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.45:6790/0 2026-02-22T23:25:33.739 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:33.717+0000 7f5011ffb640 1 -- 10.20.193.45:0/3113852855 --> v1:10.20.193.45:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5024125fb0 con 0x7f5024076d10 2026-02-22T23:25:33.739 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:33.717+0000 7f5011ffb640 10 monclient: _finish_auth 0 2026-02-22T23:25:33.739 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:33.717+0000 7f5011ffb640 10 monclient: _check_auth_tickets 2026-02-22T23:25:33.739 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:33.717+0000 7f5011ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T23:25:33.739 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:33.717+0000 7f502b4a9640 5 monclient: authenticate success, global_id 4196 2026-02-22T23:25:33.739 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:33.717+0000 7f502b4a9640 10 monclient: _renew_subs 2026-02-22T23:25:33.739 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:33.717+0000 7f502b4a9640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.45:6790/0 2026-02-22T23:25:33.740 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:33.717+0000 7f502b4a9640 1 -- 10.20.193.45:0/3113852855 --> v1:10.20.193.45:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f5024124e10 con 0x7f5024076d10 2026-02-22T23:25:33.740 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:33.717+0000 7f502b4a9640 10 monclient: _renew_subs 2026-02-22T23:25:33.740 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:33.717+0000 7f502b4a9640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.45:6790/0 2026-02-22T23:25:33.740 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:33.717+0000 7f502b4a9640 1 -- 10.20.193.45:0/3113852855 --> v1:10.20.193.45:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f5024139780 con 0x7f5024076d10 2026-02-22T23:25:33.740 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:33.717+0000 7f5011ffb640 1 -- 10.20.193.45:0/3113852855 <== mon.2 v1:10.20.193.45:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f50140036f0 con 0x7f5024076d10 2026-02-22T23:25:33.740 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:33.717+0000 7f5011ffb640 10 monclient: handle_config config(0 keys) 2026-02-22T23:25:33.740 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:33.717+0000 7f5011ffb640 1 -- 10.20.193.45:0/3113852855 <== mon.2 v1:10.20.193.45:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f5014003c20 con 0x7f5024076d10 2026-02-22T23:25:33.740 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:33.717+0000 7f5011ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:25:33.740 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:33.717+0000 7f50137fe640 4 set_mon_vals no callback set 2026-02-22T23:25:33.740 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:33.717+0000 7f5011ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-22T23:25:33.740 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:33.717+0000 7f5011ffb640 10 monclient: dump: 2026-02-22T23:25:33.740 INFO:teuthology.misc.health.trial045.stderr:epoch 1 2026-02-22T23:25:33.740 INFO:teuthology.misc.health.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:33.741 INFO:teuthology.misc.health.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:33.741 INFO:teuthology.misc.health.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:33.741 INFO:teuthology.misc.health.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:33.741 INFO:teuthology.misc.health.trial045.stderr:election_strategy: 3 2026-02-22T23:25:33.741 INFO:teuthology.misc.health.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:33.741 INFO:teuthology.misc.health.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:33.741 INFO:teuthology.misc.health.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:33.741 INFO:teuthology.misc.health.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:33.741 INFO:teuthology.misc.health.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:33.741 INFO:teuthology.misc.health.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:33.741 INFO:teuthology.misc.health.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:33.741 INFO:teuthology.misc.health.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:33.741 INFO:teuthology.misc.health.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:33.742 INFO:teuthology.misc.health.trial045.stderr: 2026-02-22T23:25:33.742 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:33.718+0000 7f5011ffb640 1 -- 10.20.193.45:0/3113852855 <== mon.2 v1:10.20.193.45:6790/0 7 ==== mgrmap(e 4) ==== 50169+0+0 (unknown 3143047564 0 0) 0x7f50140101d0 con 0x7f5024076d10 2026-02-22T23:25:33.742 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:33.718+0000 7f502b4a9640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T23:25:33.742 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:33.718+0000 7f502b4a9640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T23:25:33.742 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:33.718+0000 7f502b4a9640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.45:6790/0 2026-02-22T23:25:33.742 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:33.718+0000 7f502b4a9640 1 -- 10.20.193.45:0/3113852855 --> v1:10.20.193.45:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f50240008d0 con 0x7f5024076d10 2026-02-22T23:25:33.742 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:33.718+0000 7f5011ffb640 1 -- 10.20.193.45:0/3113852855 <== mon.2 v1:10.20.193.45:6790/0 8 ==== osd_map(11..11 src has 1..11) ==== 2063+0+0 (unknown 187216802 0 0) 0x7f501404c270 con 0x7f5024076d10 2026-02-22T23:25:33.742 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:33.718+0000 7f5028a1d640 10 monclient: get_auth_request con 0x7f4ff403fc40 auth_method 0 2026-02-22T23:25:33.742 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:33.721+0000 7f5011ffb640 1 -- 10.20.193.45:0/3113852855 <== mon.2 v1:10.20.193.45:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (unknown 1092875540 0 2568732696) 0x7f50140163d0 con 0x7f5024076d10 2026-02-22T23:25:33.742 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:33.721+0000 7f5011ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T23:25:33.742 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:33.721+0000 7f5011ffb640 10 monclient: _finish_command 1 = system:0 2026-02-22T23:25:33.807 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:33.806+0000 7f502b4a9640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2026-02-22T23:25:33.808 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:33.806+0000 7f502b4a9640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-22T23:25:33.808 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:33.806+0000 7f502b4a9640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.45:6790/0 2026-02-22T23:25:33.808 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:33.806+0000 7f502b4a9640 1 -- 10.20.193.45:0/3113852855 --> v1:10.20.193.45:6790/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f502409ce10 con 0x7f5024076d10 2026-02-22T23:25:33.808 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:33.806+0000 7f5011ffb640 1 -- 10.20.193.45:0/3113852855 <== mon.2 v1:10.20.193.45:6790/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v11) ==== 74+0+5863 (unknown 238102980 0 2050719554) 0x7f5014015cd0 con 0x7f5024076d10 2026-02-22T23:25:33.808 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:33.806+0000 7f5011ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-22T23:25:33.808 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:33.806+0000 7f5011ffb640 10 monclient: _finish_command 2 = system:0 2026-02-22T23:25:33.808 INFO:teuthology.misc.health.trial045.stdout: 2026-02-22T23:25:33.809 INFO:teuthology.misc.health.trial045.stdout:{"epoch":11,"fsid":"4b60f18f-6660-4731-b731-dc85c4078413","created":"2026-02-22T23:25:25.062615+0000","modified":"2026-02-22T23:25:33.691396+0000","last_up_change":"2026-02-22T23:25:33.691396+0000","last_in_change":"2026-02-22T23:25:26.208612+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"ef9d15a7-661e-40c5-a418-7f794c0975b7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"9e62cdef-b0a0-4f67-a778-ac4f7d97ed7e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"bfcf94e1-2623-4443-aaf8-f525210ab7b2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"32e9109d-09f0-4c75-bfbe-bb0fa237ca08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.73:6805","nonce":3607388566}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.73:6806","nonce":3607388566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.73:6808","nonce":3607388566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.73:6807","nonce":3607388566}]},"public_addr":"10.20.193.73:6805/3607388566","cluster_addr":"10.20.193.73:6806/3607388566","heartbeat_back_addr":"10.20.193.73:6808/3607388566","heartbeat_front_addr":"10.20.193.73:6807/3607388566","state":["exists","up"]},{"osd":4,"uuid":"311ec782-d282-48e9-9545-41ac3acb1ac8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"4569df35-5988-4308-9e5d-a6b26171c346","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-22T23:25:33.809 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:33.807+0000 7f502b4a9640 1 -- 10.20.193.45:0/3113852855 >> v1:10.20.193.73:6800/2222410180 conn(0x7f4ff403fc40 legacy=0x7f4ff4042100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:33.810 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:33.807+0000 7f502b4a9640 10 monclient: shutdown 2026-02-22T23:25:33.810 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:33.807+0000 7f502b4a9640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T23:25:33.810 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:33.807+0000 7f502b4a9640 1 -- 10.20.193.45:0/3113852855 >> v1:10.20.193.45:6790/0 conn(0x7f5024076d10 legacy=0x7f50241cf3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:33.810 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:33.807+0000 7f502b4a9640 1 -- 10.20.193.45:0/3113852855 shutdown_connections 2026-02-22T23:25:33.810 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:33.807+0000 7f502b4a9640 1 -- 10.20.193.45:0/3113852855 >> 10.20.193.45:0/3113852855 conn(0x7f50240a8780 msgr2=0x7f50240a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:25:33.810 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:33.807+0000 7f502b4a9640 1 -- 10.20.193.45:0/3113852855 shutdown_connections 2026-02-22T23:25:33.810 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:33.807+0000 7f502b4a9640 1 -- 10.20.193.45:0/3113852855 wait complete. 2026-02-22T23:25:33.815 DEBUG:teuthology.misc:1 of 6 OSDs are up 2026-02-22T23:25:40.420 DEBUG:teuthology.orchestra.run.trial045:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-22T23:25:40.482 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:40.481+0000 7f5738108640 10 monclient: get_monmap_and_config 2026-02-22T23:25:40.482 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:40.481+0000 7f5738108640 10 monclient: build_initial_monmap 2026-02-22T23:25:40.482 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:40.481+0000 7f5738108640 10 monclient: monmap: 2026-02-22T23:25:40.482 INFO:teuthology.misc.health.trial045.stderr:epoch 0 2026-02-22T23:25:40.482 INFO:teuthology.misc.health.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:40.482 INFO:teuthology.misc.health.trial045.stderr:last_changed 2026-02-22T23:25:40.482542+0000 2026-02-22T23:25:40.482 INFO:teuthology.misc.health.trial045.stderr:created 2026-02-22T23:25:40.482542+0000 2026-02-22T23:25:40.482 INFO:teuthology.misc.health.trial045.stderr:min_mon_release 0 (unknown) 2026-02-22T23:25:40.483 INFO:teuthology.misc.health.trial045.stderr:election_strategy: 3 2026-02-22T23:25:40.483 INFO:teuthology.misc.health.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-22T23:25:40.483 INFO:teuthology.misc.health.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.noname-f 2026-02-22T23:25:40.483 INFO:teuthology.misc.health.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.noname-b 2026-02-22T23:25:40.483 INFO:teuthology.misc.health.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.noname-g 2026-02-22T23:25:40.483 INFO:teuthology.misc.health.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.noname-c 2026-02-22T23:25:40.483 INFO:teuthology.misc.health.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.noname-h 2026-02-22T23:25:40.483 INFO:teuthology.misc.health.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.noname-d 2026-02-22T23:25:40.483 INFO:teuthology.misc.health.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.noname-i 2026-02-22T23:25:40.483 INFO:teuthology.misc.health.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.noname-e 2026-02-22T23:25:40.483 INFO:teuthology.misc.health.trial045.stderr: 2026-02-22T23:25:40.489 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:40.481+0000 7f5738108640 1 Processor -- start 2026-02-22T23:25:40.489 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:40.481+0000 7f5738108640 1 -- start start 2026-02-22T23:25:40.489 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:40.481+0000 7f5738108640 10 monclient: init 2026-02-22T23:25:40.489 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:40.482+0000 7f5738108640 10 monclient: _reopen_session rank -1 2026-02-22T23:25:40.489 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:40.482+0000 7f5738108640 10 monclient: _add_conns ranks=[6,1,5,4,3,0,7,8,2] 2026-02-22T23:25:40.489 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:40.482+0000 7f5738108640 10 monclient(hunting): picked mon.noname-d con 0x7f573012ce90 addr v1:10.20.193.45:6792/0 2026-02-22T23:25:40.489 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:40.482+0000 7f5738108640 10 monclient(hunting): picked mon.noname-f con 0x7f573012d270 addr v1:10.20.193.73:6789/0 2026-02-22T23:25:40.489 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:40.482+0000 7f5738108640 10 monclient(hunting): picked mon.noname-h con 0x7f573012d690 addr v1:10.20.193.73:6791/0 2026-02-22T23:25:40.489 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:40.482+0000 7f5738108640 1 -- --> v1:10.20.193.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f57300a3140 con 0x7f573012d270 2026-02-22T23:25:40.489 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:40.482+0000 7f5738108640 1 -- --> v1:10.20.193.73:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f57300634d0 con 0x7f573012d690 2026-02-22T23:25:40.489 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:40.482+0000 7f5738108640 1 -- --> v1:10.20.193.45:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f57300a1510 con 0x7f573012ce90 2026-02-22T23:25:40.489 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:40.482+0000 7f5738108640 10 monclient(hunting): _renew_subs 2026-02-22T23:25:40.489 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:40.482+0000 7f5738108640 10 monclient(hunting): authenticate will time out at 672.099088s 2026-02-22T23:25:40.490 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:40.482+0000 7f5735e7d640 1 --1- >> v1:10.20.193.45:6792/0 conn(0x7f573012ce90 0x7f57300a35d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.45:6792/0 says I am v1:10.20.193.45:39424/0 (socket says 10.20.193.45:39424) 2026-02-22T23:25:40.490 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:40.482+0000 7f5735e7d640 1 -- 10.20.193.45:0/4278230279 learned_addr learned my addr 10.20.193.45:0/4278230279 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-22T23:25:40.490 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:40.482+0000 7f5734e7b640 1 -- 10.20.193.45:0/4278230279 <== mon.6 v1:10.20.193.45:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3606019100 0 0) 0x7f57300a1510 con 0x7f573012ce90 2026-02-22T23:25:40.490 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:40.482+0000 7f5734e7b640 10 monclient(hunting): _negotiate 2026-02-22T23:25:40.490 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:40.482+0000 7f5734e7b640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:40.490 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:40.482+0000 7f5734e7b640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:40.490 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:40.482+0000 7f5734e7b640 10 monclient(hunting): my global_id is 4236 2026-02-22T23:25:40.490 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:40.482+0000 7f5734e7b640 1 -- 10.20.193.45:0/4278230279 --> v1:10.20.193.45:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5718003620 con 0x7f573012ce90 2026-02-22T23:25:40.490 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:40.482+0000 7f5734e7b640 1 -- 10.20.193.45:0/4278230279 <== mon.6 v1:10.20.193.45:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 604773249 0 0) 0x7f5718003620 con 0x7f573012ce90 2026-02-22T23:25:40.490 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:40.482+0000 7f5734e7b640 1 -- 10.20.193.45:0/4278230279 >> v1:10.20.193.73:6791/0 conn(0x7f573012d690 legacy=0x7f573013f240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:40.490 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:40.482+0000 7f5734e7b640 1 -- 10.20.193.45:0/4278230279 >> v1:10.20.193.73:6789/0 conn(0x7f573012d270 legacy=0x7f573013bb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:40.490 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:40.482+0000 7f5734e7b640 10 monclient: _finish_hunting 0 2026-02-22T23:25:40.490 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:40.482+0000 7f5734e7b640 1 monclient: found mon.noname-d 2026-02-22T23:25:40.490 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:40.482+0000 7f5734e7b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T23:25:40.490 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:40.482+0000 7f5734e7b640 10 monclient: _send_mon_message to mon.noname-d at v1:10.20.193.45:6792/0 2026-02-22T23:25:40.490 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:40.482+0000 7f5734e7b640 1 -- 10.20.193.45:0/4278230279 --> v1:10.20.193.45:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57300a17f0 con 0x7f573012ce90 2026-02-22T23:25:40.490 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:40.482+0000 7f5734e7b640 10 monclient: _finish_auth 0 2026-02-22T23:25:40.490 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:40.482+0000 7f5734e7b640 10 monclient: _check_auth_tickets 2026-02-22T23:25:40.491 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:40.482+0000 7f5734e7b640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T23:25:40.491 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:40.482+0000 7f5734e7b640 1 -- 10.20.193.45:0/4278230279 <== mon.6 v1:10.20.193.45:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f5720003040 con 0x7f573012ce90 2026-02-22T23:25:40.491 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:40.482+0000 7f5734e7b640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:25:40.491 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:40.482+0000 7f5734e7b640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2026-02-22T23:25:40.491 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:40.482+0000 7f5734e7b640 10 monclient: dump: 2026-02-22T23:25:40.491 INFO:teuthology.misc.health.trial045.stderr:epoch 1 2026-02-22T23:25:40.491 INFO:teuthology.misc.health.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:40.491 INFO:teuthology.misc.health.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:40.491 INFO:teuthology.misc.health.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:40.491 INFO:teuthology.misc.health.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:40.491 INFO:teuthology.misc.health.trial045.stderr:election_strategy: 3 2026-02-22T23:25:40.491 INFO:teuthology.misc.health.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:40.491 INFO:teuthology.misc.health.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:40.491 INFO:teuthology.misc.health.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:40.491 INFO:teuthology.misc.health.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:40.491 INFO:teuthology.misc.health.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:40.491 INFO:teuthology.misc.health.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:40.491 INFO:teuthology.misc.health.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:40.491 INFO:teuthology.misc.health.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:40.491 INFO:teuthology.misc.health.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:40.492 INFO:teuthology.misc.health.trial045.stderr: 2026-02-22T23:25:40.492 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:40.482+0000 7f5738108640 5 monclient: authenticate success, global_id 4236 2026-02-22T23:25:40.492 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:40.482+0000 7f5738108640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-22T23:25:40.492 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:40.482+0000 7f5734e7b640 1 -- 10.20.193.45:0/4278230279 <== mon.6 v1:10.20.193.45:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5720003260 con 0x7f573012ce90 2026-02-22T23:25:40.492 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:40.482+0000 7f5734e7b640 10 monclient: handle_config config(0 keys) 2026-02-22T23:25:40.492 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:40.482+0000 7f5738108640 10 monclient: get_monmap_and_config success 2026-02-22T23:25:40.492 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:40.482+0000 7f5738108640 4 set_mon_vals no callback set 2026-02-22T23:25:40.492 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:40.482+0000 7f5734e7b640 1 -- 10.20.193.45:0/4278230279 <== mon.6 v1:10.20.193.45:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f5720003550 con 0x7f573012ce90 2026-02-22T23:25:40.492 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:40.482+0000 7f5734e7b640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:25:40.492 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:40.482+0000 7f5734e7b640 10 monclient: got monmap 1 from mon.d (according to old e1) 2026-02-22T23:25:40.492 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:40.482+0000 7f5734e7b640 10 monclient: dump: 2026-02-22T23:25:40.492 INFO:teuthology.misc.health.trial045.stderr:epoch 1 2026-02-22T23:25:40.492 INFO:teuthology.misc.health.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:40.492 INFO:teuthology.misc.health.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:40.492 INFO:teuthology.misc.health.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:40.492 INFO:teuthology.misc.health.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:40.492 INFO:teuthology.misc.health.trial045.stderr:election_strategy: 3 2026-02-22T23:25:40.492 INFO:teuthology.misc.health.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:40.493 INFO:teuthology.misc.health.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:40.493 INFO:teuthology.misc.health.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:40.493 INFO:teuthology.misc.health.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:40.493 INFO:teuthology.misc.health.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:40.493 INFO:teuthology.misc.health.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:40.493 INFO:teuthology.misc.health.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:40.493 INFO:teuthology.misc.health.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:40.493 INFO:teuthology.misc.health.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:40.493 INFO:teuthology.misc.health.trial045.stderr: 2026-02-22T23:25:40.493 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:40.482+0000 7f5738108640 10 monclient: shutdown 2026-02-22T23:25:40.493 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:40.482+0000 7f5738108640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T23:25:40.493 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:40.482+0000 7f5738108640 1 -- 10.20.193.45:0/4278230279 >> v1:10.20.193.45:6792/0 conn(0x7f573012ce90 legacy=0x7f57300a35d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:40.493 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:40.482+0000 7f5738108640 1 -- 10.20.193.45:0/4278230279 shutdown_connections 2026-02-22T23:25:40.493 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:40.482+0000 7f5738108640 1 -- 10.20.193.45:0/4278230279 >> 10.20.193.45:0/4278230279 conn(0x7f57300a3f00 msgr2=0x7f57300a4310 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:25:40.493 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:40.482+0000 7f5738108640 1 -- 10.20.193.45:0/4278230279 shutdown_connections 2026-02-22T23:25:40.493 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:40.482+0000 7f5738108640 1 -- 10.20.193.45:0/4278230279 wait complete. 2026-02-22T23:25:40.493 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:40.483+0000 7f5738108640 10 monclient: build_initial_monmap 2026-02-22T23:25:40.493 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:40.483+0000 7f5738108640 10 monclient: monmap: 2026-02-22T23:25:40.493 INFO:teuthology.misc.health.trial045.stderr:epoch 0 2026-02-22T23:25:40.493 INFO:teuthology.misc.health.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T23:25:40.493 INFO:teuthology.misc.health.trial045.stderr:last_changed 0.000000 2026-02-22T23:25:40.494 INFO:teuthology.misc.health.trial045.stderr:created 0.000000 2026-02-22T23:25:40.494 INFO:teuthology.misc.health.trial045.stderr:min_mon_release 0 (unknown) 2026-02-22T23:25:40.494 INFO:teuthology.misc.health.trial045.stderr:election_strategy: 1 2026-02-22T23:25:40.494 INFO:teuthology.misc.health.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-22T23:25:40.494 INFO:teuthology.misc.health.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.noname-f 2026-02-22T23:25:40.494 INFO:teuthology.misc.health.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.noname-b 2026-02-22T23:25:40.494 INFO:teuthology.misc.health.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.noname-g 2026-02-22T23:25:40.494 INFO:teuthology.misc.health.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.noname-c 2026-02-22T23:25:40.494 INFO:teuthology.misc.health.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.noname-h 2026-02-22T23:25:40.494 INFO:teuthology.misc.health.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.noname-d 2026-02-22T23:25:40.494 INFO:teuthology.misc.health.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.noname-i 2026-02-22T23:25:40.494 INFO:teuthology.misc.health.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.noname-e 2026-02-22T23:25:40.494 INFO:teuthology.misc.health.trial045.stderr: 2026-02-22T23:25:40.494 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:40.483+0000 7f5738108640 1 Processor -- start 2026-02-22T23:25:40.494 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:40.483+0000 7f5738108640 1 -- start start 2026-02-22T23:25:40.494 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:40.483+0000 7f5738108640 10 monclient: init 2026-02-22T23:25:40.494 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:40.483+0000 7f5738108640 10 monclient: _reopen_session rank -1 2026-02-22T23:25:40.494 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:40.483+0000 7f5738108640 10 monclient: _add_conns ranks=[7,8,6,5,3,4,1,0,2] 2026-02-22T23:25:40.494 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:40.483+0000 7f5738108640 10 monclient(hunting): picked mon.noname-i con 0x7f573012ce90 addr v1:10.20.193.73:6792/0 2026-02-22T23:25:40.494 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:40.483+0000 7f5738108640 10 monclient(hunting): picked mon.noname-e con 0x7f573012d270 addr v1:10.20.193.45:6793/0 2026-02-22T23:25:40.494 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:40.483+0000 7f5738108640 10 monclient(hunting): picked mon.noname-d con 0x7f573012d690 addr v1:10.20.193.45:6792/0 2026-02-22T23:25:40.495 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:40.483+0000 7f5738108640 1 -- --> v1:10.20.193.45:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f573009fd40 con 0x7f573012d690 2026-02-22T23:25:40.495 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:40.483+0000 7f5738108640 1 -- --> v1:10.20.193.73:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f57300a5d30 con 0x7f573012ce90 2026-02-22T23:25:40.495 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:40.483+0000 7f5738108640 1 -- --> v1:10.20.193.45:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f57300a5800 con 0x7f573012d270 2026-02-22T23:25:40.495 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:40.483+0000 7f5738108640 10 monclient(hunting): _renew_subs 2026-02-22T23:25:40.495 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:40.483+0000 7f5738108640 10 monclient(hunting): authenticate will time out at 672.100974s 2026-02-22T23:25:40.495 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:40.484+0000 7f573667e640 1 --1- >> v1:10.20.193.45:6792/0 conn(0x7f573012d690 0x7f57301d82a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.45:6792/0 says I am v1:10.20.193.45:39428/0 (socket says 10.20.193.45:39428) 2026-02-22T23:25:40.495 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:40.484+0000 7f573567c640 1 --1- >> v1:10.20.193.45:6793/0 conn(0x7f573012d270 0x7f57301d4b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.45:6793/0 says I am v1:10.20.193.45:45168/0 (socket says 10.20.193.45:45168) 2026-02-22T23:25:40.495 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:40.484+0000 7f573667e640 1 -- 10.20.193.45:0/2204506440 learned_addr learned my addr 10.20.193.45:0/2204506440 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-22T23:25:40.495 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:40.484+0000 7f571e7fc640 1 -- 10.20.193.45:0/2204506440 <== mon.6 v1:10.20.193.45:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1650729482 0 0) 0x7f573009fd40 con 0x7f573012d690 2026-02-22T23:25:40.495 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:40.484+0000 7f571e7fc640 10 monclient(hunting): _negotiate 2026-02-22T23:25:40.495 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:40.484+0000 7f571e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:40.495 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:40.484+0000 7f571e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:40.495 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:40.484+0000 7f571e7fc640 10 monclient(hunting): my global_id is 4245 2026-02-22T23:25:40.495 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:40.484+0000 7f571e7fc640 1 -- 10.20.193.45:0/2204506440 --> v1:10.20.193.45:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5700003620 con 0x7f573012d690 2026-02-22T23:25:40.495 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:40.484+0000 7f571e7fc640 1 -- 10.20.193.45:0/2204506440 <== mon.8 v1:10.20.193.45:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1144850286 0 0) 0x7f57300a5800 con 0x7f573012d270 2026-02-22T23:25:40.495 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:40.484+0000 7f571e7fc640 10 monclient(hunting): _negotiate 2026-02-22T23:25:40.495 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:40.484+0000 7f571e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:40.495 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:40.484+0000 7f571e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:40.495 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:40.484+0000 7f571e7fc640 10 monclient(hunting): my global_id is 4229 2026-02-22T23:25:40.495 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:40.484+0000 7f571e7fc640 1 -- 10.20.193.45:0/2204506440 --> v1:10.20.193.45:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f573009fd40 con 0x7f573012d270 2026-02-22T23:25:40.496 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:40.484+0000 7f571e7fc640 1 -- 10.20.193.45:0/2204506440 <== mon.6 v1:10.20.193.45:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1483710501 0 0) 0x7f5700003620 con 0x7f573012d690 2026-02-22T23:25:40.496 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:40.484+0000 7f571e7fc640 1 -- 10.20.193.45:0/2204506440 --> v1:10.20.193.45:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f57300a5800 con 0x7f573012d690 2026-02-22T23:25:40.496 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:40.484+0000 7f571e7fc640 1 -- 10.20.193.45:0/2204506440 <== mon.6 v1:10.20.193.45:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f572c0035e0 con 0x7f573012d690 2026-02-22T23:25:40.496 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:40.484+0000 7f571e7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-22T23:25:40.496 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:40.484+0000 7f571e7fc640 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2026-02-22T23:25:40.496 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:40.484+0000 7f571e7fc640 10 monclient(hunting): dump: 2026-02-22T23:25:40.496 INFO:teuthology.misc.health.trial045.stderr:epoch 1 2026-02-22T23:25:40.496 INFO:teuthology.misc.health.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:40.496 INFO:teuthology.misc.health.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:40.496 INFO:teuthology.misc.health.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:40.496 INFO:teuthology.misc.health.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:40.496 INFO:teuthology.misc.health.trial045.stderr:election_strategy: 3 2026-02-22T23:25:40.496 INFO:teuthology.misc.health.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:40.496 INFO:teuthology.misc.health.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:40.496 INFO:teuthology.misc.health.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:40.496 INFO:teuthology.misc.health.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:40.496 INFO:teuthology.misc.health.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:40.496 INFO:teuthology.misc.health.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:40.496 INFO:teuthology.misc.health.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:40.496 INFO:teuthology.misc.health.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:40.496 INFO:teuthology.misc.health.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:40.497 INFO:teuthology.misc.health.trial045.stderr: 2026-02-22T23:25:40.497 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:40.484+0000 7f571e7fc640 10 monclient(hunting): _finish_auth 0 2026-02-22T23:25:40.497 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:40.484+0000 7f571e7fc640 1 -- 10.20.193.45:0/2204506440 <== mon.8 v1:10.20.193.45:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 540035887 0 0) 0x7f573009fd40 con 0x7f573012d270 2026-02-22T23:25:40.497 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:40.484+0000 7f571e7fc640 1 -- 10.20.193.45:0/2204506440 --> v1:10.20.193.45:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5700003620 con 0x7f573012d270 2026-02-22T23:25:40.497 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:40.484+0000 7f571e7fc640 1 -- 10.20.193.45:0/2204506440 <== mon.8 v1:10.20.193.45:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f5724003260 con 0x7f573012d270 2026-02-22T23:25:40.497 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:40.484+0000 7f571e7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-22T23:25:40.497 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:40.484+0000 7f571e7fc640 10 monclient(hunting): got monmap 1 from mon.e (according to old e1) 2026-02-22T23:25:40.497 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:40.484+0000 7f571e7fc640 10 monclient(hunting): dump: 2026-02-22T23:25:40.497 INFO:teuthology.misc.health.trial045.stderr:epoch 1 2026-02-22T23:25:40.497 INFO:teuthology.misc.health.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:40.497 INFO:teuthology.misc.health.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:40.497 INFO:teuthology.misc.health.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:40.497 INFO:teuthology.misc.health.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:40.497 INFO:teuthology.misc.health.trial045.stderr:election_strategy: 3 2026-02-22T23:25:40.497 INFO:teuthology.misc.health.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:40.497 INFO:teuthology.misc.health.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:40.497 INFO:teuthology.misc.health.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:40.497 INFO:teuthology.misc.health.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:40.497 INFO:teuthology.misc.health.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:40.497 INFO:teuthology.misc.health.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:40.498 INFO:teuthology.misc.health.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:40.498 INFO:teuthology.misc.health.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:40.498 INFO:teuthology.misc.health.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:40.498 INFO:teuthology.misc.health.trial045.stderr: 2026-02-22T23:25:40.498 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:40.484+0000 7f571e7fc640 1 -- 10.20.193.45:0/2204506440 <== mon.6 v1:10.20.193.45:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3531245192 0 0) 0x7f57300a5800 con 0x7f573012d690 2026-02-22T23:25:40.498 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:40.484+0000 7f571e7fc640 1 -- 10.20.193.45:0/2204506440 >> v1:10.20.193.45:6793/0 conn(0x7f573012d270 legacy=0x7f57301d4b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:40.498 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:40.484+0000 7f571e7fc640 1 -- 10.20.193.45:0/2204506440 >> v1:10.20.193.73:6792/0 conn(0x7f573012ce90 legacy=0x7f57301cfc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:40.498 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:40.484+0000 7f571e7fc640 10 monclient: _finish_hunting 0 2026-02-22T23:25:40.498 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:40.484+0000 7f571e7fc640 1 monclient: found mon.d 2026-02-22T23:25:40.498 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:40.484+0000 7f571e7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T23:25:40.498 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:40.484+0000 7f571e7fc640 10 monclient: _send_mon_message to mon.d at v1:10.20.193.45:6792/0 2026-02-22T23:25:40.498 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:40.484+0000 7f571e7fc640 1 -- 10.20.193.45:0/2204506440 --> v1:10.20.193.45:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5730133920 con 0x7f573012d690 2026-02-22T23:25:40.498 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:40.484+0000 7f571e7fc640 10 monclient: _finish_auth 0 2026-02-22T23:25:40.498 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:40.484+0000 7f571e7fc640 10 monclient: _check_auth_tickets 2026-02-22T23:25:40.498 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:40.484+0000 7f571e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T23:25:40.498 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:40.484+0000 7f5738108640 5 monclient: authenticate success, global_id 4245 2026-02-22T23:25:40.498 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:40.484+0000 7f5738108640 10 monclient: _renew_subs 2026-02-22T23:25:40.498 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:40.484+0000 7f5738108640 10 monclient: _send_mon_message to mon.d at v1:10.20.193.45:6792/0 2026-02-22T23:25:40.498 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:40.484+0000 7f5738108640 1 -- 10.20.193.45:0/2204506440 --> v1:10.20.193.45:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f5730138ef0 con 0x7f573012d690 2026-02-22T23:25:40.498 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:40.484+0000 7f5738108640 10 monclient: _renew_subs 2026-02-22T23:25:40.498 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:40.484+0000 7f5738108640 10 monclient: _send_mon_message to mon.d at v1:10.20.193.45:6792/0 2026-02-22T23:25:40.498 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:40.484+0000 7f571e7fc640 1 -- 10.20.193.45:0/2204506440 <== mon.6 v1:10.20.193.45:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f572c003d40 con 0x7f573012d690 2026-02-22T23:25:40.499 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:40.484+0000 7f5738108640 1 -- 10.20.193.45:0/2204506440 --> v1:10.20.193.45:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7f57301379d0 con 0x7f573012d690 2026-02-22T23:25:40.499 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:40.484+0000 7f571e7fc640 10 monclient: handle_config config(0 keys) 2026-02-22T23:25:40.499 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:40.484+0000 7f571e7fc640 1 -- 10.20.193.45:0/2204506440 <== mon.6 v1:10.20.193.45:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f572c0042b0 con 0x7f573012d690 2026-02-22T23:25:40.499 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:40.484+0000 7f571e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:25:40.499 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:40.484+0000 7f571ffff640 4 set_mon_vals no callback set 2026-02-22T23:25:40.499 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:40.484+0000 7f571e7fc640 10 monclient: got monmap 1 from mon.d (according to old e1) 2026-02-22T23:25:40.499 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:40.484+0000 7f571e7fc640 10 monclient: dump: 2026-02-22T23:25:40.499 INFO:teuthology.misc.health.trial045.stderr:epoch 1 2026-02-22T23:25:40.499 INFO:teuthology.misc.health.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:40.499 INFO:teuthology.misc.health.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:40.499 INFO:teuthology.misc.health.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:40.499 INFO:teuthology.misc.health.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:40.499 INFO:teuthology.misc.health.trial045.stderr:election_strategy: 3 2026-02-22T23:25:40.499 INFO:teuthology.misc.health.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:40.499 INFO:teuthology.misc.health.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:40.499 INFO:teuthology.misc.health.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:40.499 INFO:teuthology.misc.health.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:40.499 INFO:teuthology.misc.health.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:40.499 INFO:teuthology.misc.health.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:40.499 INFO:teuthology.misc.health.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:40.499 INFO:teuthology.misc.health.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:40.499 INFO:teuthology.misc.health.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:40.499 INFO:teuthology.misc.health.trial045.stderr: 2026-02-22T23:25:40.500 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:40.484+0000 7f5738108640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T23:25:40.500 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:40.484+0000 7f5738108640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T23:25:40.500 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:40.484+0000 7f5738108640 10 monclient: _send_mon_message to mon.d at v1:10.20.193.45:6792/0 2026-02-22T23:25:40.500 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:40.484+0000 7f5738108640 1 -- 10.20.193.45:0/2204506440 --> v1:10.20.193.45:6792/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f57300008d0 con 0x7f573012d690 2026-02-22T23:25:40.500 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:40.484+0000 7f571e7fc640 1 -- 10.20.193.45:0/2204506440 <== mon.6 v1:10.20.193.45:6792/0 7 ==== mgrmap(e 5) ==== 50225+0+0 (unknown 2330357642 0 0) 0x7f572c0044d0 con 0x7f573012d690 2026-02-22T23:25:40.500 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:40.485+0000 7f571e7fc640 1 -- 10.20.193.45:0/2204506440 <== mon.6 v1:10.20.193.45:6792/0 8 ==== osd_map(15..15 src has 1..15) ==== 3149+0+0 (unknown 3903605910 0 0) 0x7f572c04de50 con 0x7f573012d690 2026-02-22T23:25:40.500 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:40.485+0000 7f5735e7d640 10 monclient: get_auth_request con 0x7f570003fe50 auth_method 0 2026-02-22T23:25:40.500 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:40.487+0000 7f571e7fc640 1 -- 10.20.193.45:0/2204506440 <== mon.6 v1:10.20.193.45:6792/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (unknown 1092875540 0 2568732696) 0x7f572c017af0 con 0x7f573012d690 2026-02-22T23:25:40.500 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:40.487+0000 7f571e7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T23:25:40.500 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:40.487+0000 7f571e7fc640 10 monclient: _finish_command 1 = system:0 2026-02-22T23:25:40.571 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:40.569+0000 7f5738108640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2026-02-22T23:25:40.571 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:40.569+0000 7f5738108640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-22T23:25:40.571 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:40.569+0000 7f5738108640 10 monclient: _send_mon_message to mon.d at v1:10.20.193.45:6792/0 2026-02-22T23:25:40.571 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:40.569+0000 7f5738108640 1 -- 10.20.193.45:0/2204506440 --> v1:10.20.193.45:6792/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5730140960 con 0x7f573012d690 2026-02-22T23:25:40.572 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:40.570+0000 7f571e7fc640 1 -- 10.20.193.45:0/2204506440 <== mon.6 v1:10.20.193.45:6792/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v15) ==== 74+0+9025 (unknown 4221056075 0 641229284) 0x7f572c0173f0 con 0x7f573012d690 2026-02-22T23:25:40.572 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:40.570+0000 7f571e7fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-22T23:25:40.572 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:40.570+0000 7f571e7fc640 10 monclient: _finish_command 2 = system:0 2026-02-22T23:25:40.572 INFO:teuthology.misc.health.trial045.stdout: 2026-02-22T23:25:40.572 INFO:teuthology.misc.health.trial045.stdout:{"epoch":15,"fsid":"4b60f18f-6660-4731-b731-dc85c4078413","created":"2026-02-22T23:25:25.062615+0000","modified":"2026-02-22T23:25:37.713106+0000","last_up_change":"2026-02-22T23:25:34.696475+0000","last_in_change":"2026-02-22T23:25:26.208612+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-22T23:25:35.209511+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6.059999942779541,"score_stable":6.059999942779541,"optimal_score":0.33000001311302185,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ef9d15a7-661e-40c5-a418-7f794c0975b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.45:6801","nonce":1146005631}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.45:6803","nonce":1146005631}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.45:6807","nonce":1146005631}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.45:6805","nonce":1146005631}]},"public_addr":"10.20.193.45:6801/1146005631","cluster_addr":"10.20.193.45:6803/1146005631","heartbeat_back_addr":"10.20.193.45:6807/1146005631","heartbeat_front_addr":"10.20.193.45:6805/1146005631","state":["exists","up"]},{"osd":1,"uuid":"9e62cdef-b0a0-4f67-a778-ac4f7d97ed7e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.45:6800","nonce":628358795}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.45:6802","nonce":628358795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.45:6806","nonce":628358795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.45:6804","nonce":628358795}]},"public_addr":"10.20.193.45:6800/628358795","cluster_addr":"10.20.193.45:6802/628358795","heartbeat_back_addr":"10.20.193.45:6806/628358795","heartbeat_front_addr":"10.20.193.45:6804/628358795","state":["exists","up"]},{"osd":2,"uuid":"bfcf94e1-2623-4443-aaf8-f525210ab7b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.45:6808","nonce":2128209266}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.45:6809","nonce":2128209266}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.45:6811","nonce":2128209266}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.45:6810","nonce":2128209266}]},"public_addr":"10.20.193.45:6808/2128209266","cluster_addr":"10.20.193.45:6809/2128209266","heartbeat_back_addr":"10.20.193.45:6811/2128209266","heartbeat_front_addr":"10.20.193.45:6810/2128209266","state":["exists","up"]},{"osd":3,"uuid":"32e9109d-09f0-4c75-bfbe-bb0fa237ca08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.73:6805","nonce":3607388566}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.73:6806","nonce":3607388566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.73:6808","nonce":3607388566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.73:6807","nonce":3607388566}]},"public_addr":"10.20.193.73:6805/3607388566","cluster_addr":"10.20.193.73:6806/3607388566","heartbeat_back_addr":"10.20.193.73:6808/3607388566","heartbeat_front_addr":"10.20.193.73:6807/3607388566","state":["exists","up"]},{"osd":4,"uuid":"311ec782-d282-48e9-9545-41ac3acb1ac8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.73:6801","nonce":3756325394}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.73:6802","nonce":3756325394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.73:6804","nonce":3756325394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.73:6803","nonce":3756325394}]},"public_addr":"10.20.193.73:6801/3756325394","cluster_addr":"10.20.193.73:6802/3756325394","heartbeat_back_addr":"10.20.193.73:6804/3756325394","heartbeat_front_addr":"10.20.193.73:6803/3756325394","state":["exists","up"]},{"osd":5,"uuid":"4569df35-5988-4308-9e5d-a6b26171c346","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.73:6809","nonce":1794330816}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.73:6810","nonce":1794330816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.73:6812","nonce":1794330816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.73:6811","nonce":1794330816}]},"public_addr":"10.20.193.73:6809/1794330816","cluster_addr":"10.20.193.73:6810/1794330816","heartbeat_back_addr":"10.20.193.73:6812/1794330816","heartbeat_front_addr":"10.20.193.73:6811/1794330816","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-22T23:25:32.907422+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-22T23:25:33.439017+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-22T23:25:32.880978+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-22T23:25:32.610909+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-22T23:25:32.663485+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-22T23:25:33.016218+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-22T23:25:40.573 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:40.571+0000 7f5738108640 1 -- 10.20.193.45:0/2204506440 >> v1:10.20.193.73:6800/2222410180 conn(0x7f570003fe50 legacy=0x7f5700042310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:40.573 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:40.571+0000 7f5738108640 10 monclient: shutdown 2026-02-22T23:25:40.573 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:40.571+0000 7f5738108640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T23:25:40.573 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:40.571+0000 7f5738108640 1 -- 10.20.193.45:0/2204506440 >> v1:10.20.193.45:6792/0 conn(0x7f573012d690 legacy=0x7f57301d82a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:40.574 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:40.571+0000 7f5738108640 1 -- 10.20.193.45:0/2204506440 shutdown_connections 2026-02-22T23:25:40.574 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:40.571+0000 7f5738108640 1 -- 10.20.193.45:0/2204506440 >> 10.20.193.45:0/2204506440 conn(0x7f57300a3f00 msgr2=0x7f57300a60d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:25:40.574 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:40.571+0000 7f5738108640 1 -- 10.20.193.45:0/2204506440 shutdown_connections 2026-02-22T23:25:40.574 INFO:teuthology.misc.health.trial045.stderr:2026-02-22T23:25:40.571+0000 7f5738108640 1 -- 10.20.193.45:0/2204506440 wait complete. 2026-02-22T23:25:40.579 DEBUG:teuthology.misc:6 of 6 OSDs are up 2026-02-22T23:25:40.579 INFO:tasks.ceph:Creating RBD pool 2026-02-22T23:25:40.579 DEBUG:teuthology.orchestra.run.trial045:> sudo ceph --cluster ceph osd pool create rbd 8 2026-02-22T23:25:40.651 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:40.642+0000 7f6ab741a640 10 monclient: get_monmap_and_config 2026-02-22T23:25:40.651 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:40.642+0000 7f6ab741a640 10 monclient: build_initial_monmap 2026-02-22T23:25:40.651 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:40.642+0000 7f6ab741a640 10 monclient: monmap: 2026-02-22T23:25:40.651 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-22T23:25:40.651 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:40.651 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:25:40.643548+0000 2026-02-22T23:25:40.652 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:25:40.643548+0000 2026-02-22T23:25:40.652 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-22T23:25:40.652 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:40.652 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-22T23:25:40.652 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.noname-f 2026-02-22T23:25:40.652 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.noname-b 2026-02-22T23:25:40.652 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.noname-g 2026-02-22T23:25:40.652 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.noname-c 2026-02-22T23:25:40.652 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.noname-h 2026-02-22T23:25:40.653 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.noname-d 2026-02-22T23:25:40.653 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.noname-i 2026-02-22T23:25:40.653 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.noname-e 2026-02-22T23:25:40.653 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:40.653 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:40.642+0000 7f6ab741a640 1 Processor -- start 2026-02-22T23:25:40.653 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:40.642+0000 7f6ab741a640 1 -- start start 2026-02-22T23:25:40.653 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:40.642+0000 7f6ab741a640 10 monclient: init 2026-02-22T23:25:40.653 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:40.643+0000 7f6ab741a640 10 monclient: _reopen_session rank -1 2026-02-22T23:25:40.653 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:40.643+0000 7f6ab741a640 10 monclient: _add_conns ranks=[0,4,2,6,8,1,3,5,7] 2026-02-22T23:25:40.653 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:40.643+0000 7f6ab741a640 10 monclient(hunting): picked mon.noname-a con 0x7f6ab009db40 addr v1:10.20.193.45:6789/0 2026-02-22T23:25:40.653 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:40.643+0000 7f6ab741a640 10 monclient(hunting): picked mon.noname-c con 0x7f6ab0138fb0 addr v1:10.20.193.45:6791/0 2026-02-22T23:25:40.653 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:40.643+0000 7f6ab741a640 10 monclient(hunting): picked mon.noname-b con 0x7f6ab01393f0 addr v1:10.20.193.45:6790/0 2026-02-22T23:25:40.654 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:40.643+0000 7f6ab741a640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ab009bb20 con 0x7f6ab009db40 2026-02-22T23:25:40.654 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:40.643+0000 7f6ab741a640 1 -- --> v1:10.20.193.45:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ab009bd90 con 0x7f6ab01393f0 2026-02-22T23:25:40.654 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:40.643+0000 7f6ab741a640 1 -- --> v1:10.20.193.45:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ab009c070 con 0x7f6ab0138fb0 2026-02-22T23:25:40.654 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:40.643+0000 7f6ab741a640 10 monclient(hunting): _renew_subs 2026-02-22T23:25:40.654 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:40.643+0000 7f6ab741a640 10 monclient(hunting): authenticate will time out at 672.260091s 2026-02-22T23:25:40.654 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:40.643+0000 7f6ab518f640 1 --1- >> v1:10.20.193.45:6789/0 conn(0x7f6ab009db40 0x7f6ab009df20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.45:6789/0 says I am v1:10.20.193.45:45644/0 (socket says 10.20.193.45:45644) 2026-02-22T23:25:40.654 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:40.643+0000 7f6ab518f640 1 -- 10.20.193.45:0/4123269273 learned_addr learned my addr 10.20.193.45:0/4123269273 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-22T23:25:40.654 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:40.643+0000 7f6a9ffff640 1 -- 10.20.193.45:0/4123269273 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1509705562 0 0) 0x7f6ab009bb20 con 0x7f6ab009db40 2026-02-22T23:25:40.654 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:40.643+0000 7f6a9ffff640 10 monclient(hunting): _negotiate 2026-02-22T23:25:40.654 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:40.643+0000 7f6a9ffff640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:40.654 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:40.643+0000 7f6a9ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:40.654 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:40.643+0000 7f6a9ffff640 10 monclient(hunting): my global_id is 4203 2026-02-22T23:25:40.655 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:40.643+0000 7f6a9ffff640 1 -- 10.20.193.45:0/4123269273 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6a98003620 con 0x7f6ab009db40 2026-02-22T23:25:40.655 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:40.643+0000 7f6a9ffff640 1 -- 10.20.193.45:0/4123269273 <== mon.2 v1:10.20.193.45:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3217372140 0 0) 0x7f6ab009bd90 con 0x7f6ab01393f0 2026-02-22T23:25:40.655 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:40.643+0000 7f6a9ffff640 10 monclient(hunting): _negotiate 2026-02-22T23:25:40.655 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:40.643+0000 7f6a9ffff640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:40.655 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:40.643+0000 7f6a9ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:40.655 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:40.643+0000 7f6a9ffff640 10 monclient(hunting): my global_id is 4232 2026-02-22T23:25:40.655 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:40.643+0000 7f6a9ffff640 1 -- 10.20.193.45:0/4123269273 --> v1:10.20.193.45:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6ab009bb20 con 0x7f6ab01393f0 2026-02-22T23:25:40.655 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:40.643+0000 7f6a9ffff640 1 -- 10.20.193.45:0/4123269273 <== mon.4 v1:10.20.193.45:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3915853919 0 0) 0x7f6ab009c070 con 0x7f6ab0138fb0 2026-02-22T23:25:40.655 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:40.643+0000 7f6a9ffff640 10 monclient(hunting): _negotiate 2026-02-22T23:25:40.655 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:40.643+0000 7f6a9ffff640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:40.655 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:40.643+0000 7f6a9ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:40.655 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:40.643+0000 7f6a9ffff640 10 monclient(hunting): my global_id is 4225 2026-02-22T23:25:40.655 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:40.643+0000 7f6a9ffff640 1 -- 10.20.193.45:0/4123269273 --> v1:10.20.193.45:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6ab009bd90 con 0x7f6ab0138fb0 2026-02-22T23:25:40.656 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:40.643+0000 7f6a9ffff640 1 -- 10.20.193.45:0/4123269273 <== mon.0 v1:10.20.193.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3056998517 0 0) 0x7f6a98003620 con 0x7f6ab009db40 2026-02-22T23:25:40.656 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:40.643+0000 7f6a9ffff640 1 -- 10.20.193.45:0/4123269273 >> v1:10.20.193.45:6791/0 conn(0x7f6ab0138fb0 legacy=0x7f6ab013dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:40.656 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:40.643+0000 7f6a9ffff640 1 -- 10.20.193.45:0/4123269273 >> v1:10.20.193.45:6790/0 conn(0x7f6ab01393f0 legacy=0x7f6ab0141460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:40.656 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:40.643+0000 7f6a9ffff640 10 monclient: _finish_hunting 0 2026-02-22T23:25:40.656 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:40.643+0000 7f6a9ffff640 1 monclient: found mon.noname-a 2026-02-22T23:25:40.656 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:40.643+0000 7f6a9ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T23:25:40.656 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:40.643+0000 7f6a9ffff640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.45:6789/0 2026-02-22T23:25:40.656 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:40.643+0000 7f6a9ffff640 1 -- 10.20.193.45:0/4123269273 --> v1:10.20.193.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ab009c350 con 0x7f6ab009db40 2026-02-22T23:25:40.656 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:40.643+0000 7f6a9ffff640 10 monclient: _finish_auth 0 2026-02-22T23:25:40.656 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:40.643+0000 7f6a9ffff640 10 monclient: _check_auth_tickets 2026-02-22T23:25:40.656 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:40.643+0000 7f6a9ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T23:25:40.656 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:40.643+0000 7f6a9ffff640 1 -- 10.20.193.45:0/4123269273 <== mon.0 v1:10.20.193.45:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f6aa0003040 con 0x7f6ab009db40 2026-02-22T23:25:40.656 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:40.643+0000 7f6a9ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:25:40.656 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:40.643+0000 7f6a9ffff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T23:25:40.657 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:40.643+0000 7f6a9ffff640 10 monclient: dump: 2026-02-22T23:25:40.657 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:40.657 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:40.657 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:40.657 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:40.657 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:40.657 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:40.657 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:40.657 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:40.657 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:40.657 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:40.657 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:40.657 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:40.658 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:40.658 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:40.658 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:40.658 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:40.658 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:40.643+0000 7f6ab741a640 5 monclient: authenticate success, global_id 4203 2026-02-22T23:25:40.658 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:40.643+0000 7f6ab741a640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-22T23:25:40.658 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:40.643+0000 7f6a9ffff640 1 -- 10.20.193.45:0/4123269273 <== mon.0 v1:10.20.193.45:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6aa0003260 con 0x7f6ab009db40 2026-02-22T23:25:40.658 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:40.643+0000 7f6a9ffff640 10 monclient: handle_config config(0 keys) 2026-02-22T23:25:40.658 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:40.643+0000 7f6ab741a640 10 monclient: get_monmap_and_config success 2026-02-22T23:25:40.658 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:40.643+0000 7f6a9ffff640 1 -- 10.20.193.45:0/4123269273 <== mon.0 v1:10.20.193.45:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f6aa0004ce0 con 0x7f6ab009db40 2026-02-22T23:25:40.658 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:40.643+0000 7f6ab741a640 4 set_mon_vals no callback set 2026-02-22T23:25:40.658 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:40.643+0000 7f6a9ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:25:40.659 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:40.643+0000 7f6a9ffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T23:25:40.659 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:40.643+0000 7f6a9ffff640 10 monclient: dump: 2026-02-22T23:25:40.659 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:40.659 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:40.659 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:40.659 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:40.659 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:40.659 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:40.659 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:40.659 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:40.659 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:40.659 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:40.659 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:40.660 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:40.660 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:40.660 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:40.660 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:40.660 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:40.660 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:40.643+0000 7f6ab741a640 10 monclient: shutdown 2026-02-22T23:25:40.660 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:40.643+0000 7f6ab741a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T23:25:40.660 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:40.643+0000 7f6ab741a640 1 -- 10.20.193.45:0/4123269273 >> v1:10.20.193.45:6789/0 conn(0x7f6ab009db40 legacy=0x7f6ab009df20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:40.660 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:40.643+0000 7f6ab741a640 1 -- 10.20.193.45:0/4123269273 shutdown_connections 2026-02-22T23:25:40.660 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:40.643+0000 7f6ab741a640 1 -- 10.20.193.45:0/4123269273 >> 10.20.193.45:0/4123269273 conn(0x7f6ab00a4320 msgr2=0x7f6ab00a4730 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:25:40.660 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:40.643+0000 7f6ab741a640 1 -- 10.20.193.45:0/4123269273 shutdown_connections 2026-02-22T23:25:40.660 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:40.643+0000 7f6ab741a640 1 -- 10.20.193.45:0/4123269273 wait complete. 2026-02-22T23:25:40.660 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:40.644+0000 7f6ab741a640 10 monclient: build_initial_monmap 2026-02-22T23:25:40.661 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:40.644+0000 7f6ab741a640 10 monclient: monmap: 2026-02-22T23:25:40.661 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-22T23:25:40.661 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T23:25:40.661 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-22T23:25:40.661 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-22T23:25:40.661 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-22T23:25:40.661 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-22T23:25:40.661 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-22T23:25:40.661 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.noname-f 2026-02-22T23:25:40.661 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.noname-b 2026-02-22T23:25:40.661 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.noname-g 2026-02-22T23:25:40.661 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.noname-c 2026-02-22T23:25:40.661 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.noname-h 2026-02-22T23:25:40.662 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.noname-d 2026-02-22T23:25:40.662 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.noname-i 2026-02-22T23:25:40.662 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.noname-e 2026-02-22T23:25:40.662 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:40.662 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:40.644+0000 7f6ab741a640 1 Processor -- start 2026-02-22T23:25:40.662 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:40.644+0000 7f6ab741a640 1 -- start start 2026-02-22T23:25:40.662 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:40.644+0000 7f6ab741a640 10 monclient: init 2026-02-22T23:25:40.662 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:40.644+0000 7f6ab741a640 10 monclient: _reopen_session rank -1 2026-02-22T23:25:40.662 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:40.644+0000 7f6ab741a640 10 monclient: _add_conns ranks=[5,4,0,2,3,7,6,8,1] 2026-02-22T23:25:40.662 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:40.644+0000 7f6ab741a640 10 monclient(hunting): picked mon.noname-h con 0x7f6ab009db40 addr v1:10.20.193.73:6791/0 2026-02-22T23:25:40.662 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:40.644+0000 7f6ab741a640 10 monclient(hunting): picked mon.noname-c con 0x7f6ab0138fb0 addr v1:10.20.193.45:6791/0 2026-02-22T23:25:40.662 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:40.644+0000 7f6ab741a640 10 monclient(hunting): picked mon.noname-a con 0x7f6ab01393f0 addr v1:10.20.193.45:6789/0 2026-02-22T23:25:40.662 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:40.644+0000 7f6ab741a640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ab00909b0 con 0x7f6ab01393f0 2026-02-22T23:25:40.663 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:40.644+0000 7f6ab741a640 1 -- --> v1:10.20.193.45:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ab0090110 con 0x7f6ab0138fb0 2026-02-22T23:25:40.663 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:40.644+0000 7f6ab741a640 1 -- --> v1:10.20.193.73:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ab00903f0 con 0x7f6ab009db40 2026-02-22T23:25:40.663 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:40.644+0000 7f6ab741a640 10 monclient(hunting): _renew_subs 2026-02-22T23:25:40.663 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:40.644+0000 7f6ab741a640 10 monclient(hunting): authenticate will time out at 672.261705s 2026-02-22T23:25:40.663 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:40.644+0000 7f6ab498e640 1 --1- >> v1:10.20.193.45:6791/0 conn(0x7f6ab0138fb0 0x7f6ab009a690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.45:6791/0 says I am v1:10.20.193.45:45652/0 (socket says 10.20.193.45:45652) 2026-02-22T23:25:40.663 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:40.644+0000 7f6ab498e640 1 -- 10.20.193.45:0/3124119600 learned_addr learned my addr 10.20.193.45:0/3124119600 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-22T23:25:40.663 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:40.644+0000 7f6a9dffb640 1 -- 10.20.193.45:0/3124119600 <== mon.4 v1:10.20.193.45:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2580866755 0 0) 0x7f6ab0090110 con 0x7f6ab0138fb0 2026-02-22T23:25:40.663 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:40.644+0000 7f6a9dffb640 10 monclient(hunting): _negotiate 2026-02-22T23:25:40.663 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:40.644+0000 7f6a9dffb640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:40.663 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:40.644+0000 7f6a9dffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:40.663 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:40.644+0000 7f6a9dffb640 10 monclient(hunting): my global_id is 4234 2026-02-22T23:25:40.663 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:40.644+0000 7f6a9dffb640 1 -- 10.20.193.45:0/3124119600 --> v1:10.20.193.45:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6a80003620 con 0x7f6ab0138fb0 2026-02-22T23:25:40.663 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:40.644+0000 7f6a9dffb640 1 -- 10.20.193.45:0/3124119600 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3320035599 0 0) 0x7f6ab00909b0 con 0x7f6ab01393f0 2026-02-22T23:25:40.664 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:40.644+0000 7f6a9dffb640 10 monclient(hunting): _negotiate 2026-02-22T23:25:40.664 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:40.644+0000 7f6a9dffb640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:40.664 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:40.644+0000 7f6a9dffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:40.664 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:40.644+0000 7f6a9dffb640 10 monclient(hunting): my global_id is 4212 2026-02-22T23:25:40.664 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:40.644+0000 7f6a9dffb640 1 -- 10.20.193.45:0/3124119600 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6ab0090110 con 0x7f6ab01393f0 2026-02-22T23:25:40.664 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:40.644+0000 7f6a9dffb640 1 -- 10.20.193.45:0/3124119600 <== mon.4 v1:10.20.193.45:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2025020859 0 0) 0x7f6a80003620 con 0x7f6ab0138fb0 2026-02-22T23:25:40.664 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:40.644+0000 7f6a9dffb640 1 -- 10.20.193.45:0/3124119600 --> v1:10.20.193.45:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6ab00909b0 con 0x7f6ab0138fb0 2026-02-22T23:25:40.664 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:40.644+0000 7f6a9dffb640 1 -- 10.20.193.45:0/3124119600 <== mon.4 v1:10.20.193.45:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f6aa4003330 con 0x7f6ab0138fb0 2026-02-22T23:25:40.664 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:40.644+0000 7f6a9dffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-22T23:25:40.664 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:40.644+0000 7f6a9dffb640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-22T23:25:40.664 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:40.644+0000 7f6a9dffb640 10 monclient(hunting): dump: 2026-02-22T23:25:40.664 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:40.664 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:40.665 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:40.665 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:40.665 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:40.665 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:40.665 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:40.665 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:40.665 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:40.665 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:40.665 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:40.665 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:40.665 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:40.665 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:40.666 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:40.666 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:40.666 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:40.644+0000 7f6a9dffb640 10 monclient(hunting): _finish_auth 0 2026-02-22T23:25:40.666 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:40.644+0000 7f6a9dffb640 1 -- 10.20.193.45:0/3124119600 <== mon.4 v1:10.20.193.45:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1383839408 0 0) 0x7f6ab00909b0 con 0x7f6ab0138fb0 2026-02-22T23:25:40.666 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:40.644+0000 7f6a9dffb640 1 -- 10.20.193.45:0/3124119600 >> v1:10.20.193.73:6791/0 conn(0x7f6ab009db40 legacy=0x7f6ab0099f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:40.666 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:40.645+0000 7f6a9dffb640 1 -- 10.20.193.45:0/3124119600 >> v1:10.20.193.45:6789/0 conn(0x7f6ab01393f0 legacy=0x7f6ab01d7d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:40.666 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:40.645+0000 7f6a9dffb640 10 monclient: _finish_hunting 0 2026-02-22T23:25:40.666 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:40.645+0000 7f6a9dffb640 1 monclient: found mon.c 2026-02-22T23:25:40.666 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:40.645+0000 7f6a9dffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T23:25:40.666 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:40.645+0000 7f6a9dffb640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.45:6791/0 2026-02-22T23:25:40.666 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:40.645+0000 7f6a9dffb640 1 -- 10.20.193.45:0/3124119600 --> v1:10.20.193.45:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ab0094130 con 0x7f6ab0138fb0 2026-02-22T23:25:40.666 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:40.645+0000 7f6a9dffb640 10 monclient: _finish_auth 0 2026-02-22T23:25:40.666 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:40.645+0000 7f6a9dffb640 10 monclient: _check_auth_tickets 2026-02-22T23:25:40.666 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:40.645+0000 7f6a9dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T23:25:40.667 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:40.645+0000 7f6ab741a640 5 monclient: authenticate success, global_id 4234 2026-02-22T23:25:40.667 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:40.645+0000 7f6ab741a640 10 monclient: _renew_subs 2026-02-22T23:25:40.667 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:40.645+0000 7f6ab741a640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.45:6791/0 2026-02-22T23:25:40.667 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:40.645+0000 7f6ab741a640 1 -- 10.20.193.45:0/3124119600 --> v1:10.20.193.45:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f6ab0090dd0 con 0x7f6ab0138fb0 2026-02-22T23:25:40.667 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:40.645+0000 7f6a9dffb640 1 -- 10.20.193.45:0/3124119600 <== mon.4 v1:10.20.193.45:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6aa40039c0 con 0x7f6ab0138fb0 2026-02-22T23:25:40.667 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:40.645+0000 7f6a9dffb640 10 monclient: handle_config config(0 keys) 2026-02-22T23:25:40.667 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:40.645+0000 7f6a9dffb640 1 -- 10.20.193.45:0/3124119600 <== mon.4 v1:10.20.193.45:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f6aa4003f70 con 0x7f6ab0138fb0 2026-02-22T23:25:40.667 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:40.645+0000 7f6a9dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:25:40.667 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:40.645+0000 7f6a9dffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T23:25:40.667 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:40.645+0000 7f6a9f7fe640 4 set_mon_vals no callback set 2026-02-22T23:25:40.667 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:40.645+0000 7f6a9dffb640 10 monclient: dump: 2026-02-22T23:25:40.667 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:40.667 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:40.667 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:40.668 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:40.668 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:40.668 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:40.668 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:40.668 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:40.668 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:40.668 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:40.668 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:40.668 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:40.668 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:40.668 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:40.668 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:40.668 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:40.668 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:40.645+0000 7f6ab741a640 10 monclient: _renew_subs 2026-02-22T23:25:40.669 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:40.645+0000 7f6ab741a640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.45:6791/0 2026-02-22T23:25:40.669 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:40.645+0000 7f6ab741a640 1 -- 10.20.193.45:0/3124119600 --> v1:10.20.193.45:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7f6ab009af80 con 0x7f6ab0138fb0 2026-02-22T23:25:40.669 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:40.645+0000 7f6ab741a640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T23:25:40.669 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:40.645+0000 7f6ab741a640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T23:25:40.669 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:40.645+0000 7f6ab741a640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.45:6791/0 2026-02-22T23:25:40.669 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:40.645+0000 7f6ab741a640 1 -- 10.20.193.45:0/3124119600 --> v1:10.20.193.45:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ab008e750 con 0x7f6ab0138fb0 2026-02-22T23:25:40.669 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:40.645+0000 7f6a9dffb640 1 -- 10.20.193.45:0/3124119600 <== mon.4 v1:10.20.193.45:6791/0 7 ==== mgrmap(e 5) ==== 50225+0+0 (unknown 2330357642 0 0) 0x7f6aa4004110 con 0x7f6ab0138fb0 2026-02-22T23:25:40.669 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:40.645+0000 7f6a9dffb640 1 -- 10.20.193.45:0/3124119600 <== mon.4 v1:10.20.193.45:6791/0 8 ==== osd_map(15..15 src has 1..15) ==== 3149+0+0 (unknown 3903605910 0 0) 0x7f6aa404db50 con 0x7f6ab0138fb0 2026-02-22T23:25:40.669 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:40.645+0000 7f6ab518f640 10 monclient: get_auth_request con 0x7f6a8003f920 auth_method 0 2026-02-22T23:25:40.669 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:40.648+0000 7f6a9dffb640 1 -- 10.20.193.45:0/3124119600 <== mon.4 v1:10.20.193.45:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (unknown 1092875540 0 2568732696) 0x7f6aa4017850 con 0x7f6ab0138fb0 2026-02-22T23:25:40.669 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:40.648+0000 7f6a9dffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T23:25:40.669 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:40.648+0000 7f6a9dffb640 10 monclient: _finish_command 1 = system:0 2026-02-22T23:25:40.732 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:40.731+0000 7f6ab741a640 10 start_mon_command cmd=[{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}] 2026-02-22T23:25:40.732 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:40.731+0000 7f6ab741a640 10 monclient: _send_command 2 [{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}] 2026-02-22T23:25:40.732 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:40.731+0000 7f6ab741a640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.45:6791/0 2026-02-22T23:25:40.732 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:40.731+0000 7f6ab741a640 1 -- 10.20.193.45:0/3124119600 --> v1:10.20.193.45:6791/0 -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) -- 0x7f6ab00744b0 con 0x7f6ab0138fb0 2026-02-22T23:25:41.728 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:41.727+0000 7f6a9dffb640 1 -- 10.20.193.45:0/3124119600 <== mon.4 v1:10.20.193.45:6791/0 10 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v16) ==== 109+0+0 (unknown 231814880 0 0) 0x7f6aa4017150 con 0x7f6ab0138fb0 2026-02-22T23:25:41.728 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:41.727+0000 7f6a9dffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}] 2026-02-22T23:25:41.729 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:41.727+0000 7f6a9dffb640 10 monclient: _finish_command 2 = system:0 pool 'rbd' created 2026-02-22T23:25:41.729 INFO:teuthology.orchestra.run.trial045.stderr:pool 'rbd' created 2026-02-22T23:25:41.730 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:41.729+0000 7f6ab741a640 1 -- 10.20.193.45:0/3124119600 >> v1:10.20.193.73:6800/2222410180 conn(0x7f6a8003f920 legacy=0x7f6a80041de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:41.730 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:41.729+0000 7f6ab741a640 10 monclient: shutdown 2026-02-22T23:25:41.730 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:41.729+0000 7f6ab741a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T23:25:41.730 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:41.729+0000 7f6ab741a640 1 -- 10.20.193.45:0/3124119600 >> v1:10.20.193.45:6791/0 conn(0x7f6ab0138fb0 legacy=0x7f6ab009a690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:41.730 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:41.729+0000 7f6ab741a640 1 -- 10.20.193.45:0/3124119600 shutdown_connections 2026-02-22T23:25:41.731 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:41.729+0000 7f6ab741a640 1 -- 10.20.193.45:0/3124119600 >> 10.20.193.45:0/3124119600 conn(0x7f6ab00a4320 msgr2=0x7f6ab00a0c30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:25:41.731 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:41.729+0000 7f6ab741a640 1 -- 10.20.193.45:0/3124119600 shutdown_connections 2026-02-22T23:25:41.731 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:41.729+0000 7f6ab741a640 1 -- 10.20.193.45:0/3124119600 wait complete. 2026-02-22T23:25:41.739 DEBUG:teuthology.orchestra.run.trial045:> rbd --cluster ceph pool init rbd 2026-02-22T23:25:41.776 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:41.769+0000 7f212b47d0c0 10 monclient: get_monmap_and_config 2026-02-22T23:25:41.777 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:41.769+0000 7f212b47d0c0 10 monclient: build_initial_monmap 2026-02-22T23:25:41.777 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:41.769+0000 7f212b47d0c0 10 monclient: monmap: 2026-02-22T23:25:41.777 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-22T23:25:41.777 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:41.777 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:25:41.770362+0000 2026-02-22T23:25:41.777 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:25:41.770362+0000 2026-02-22T23:25:41.777 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-22T23:25:41.777 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:41.777 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-22T23:25:41.777 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.noname-f 2026-02-22T23:25:41.777 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.noname-b 2026-02-22T23:25:41.778 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.noname-g 2026-02-22T23:25:41.778 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.noname-c 2026-02-22T23:25:41.778 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.noname-h 2026-02-22T23:25:41.778 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.noname-d 2026-02-22T23:25:41.778 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.noname-i 2026-02-22T23:25:41.778 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.noname-e 2026-02-22T23:25:41.778 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:41.778 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:41.769+0000 7f212b47d0c0 1 Processor -- start 2026-02-22T23:25:41.778 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:41.769+0000 7f212b47d0c0 1 -- start start 2026-02-22T23:25:41.778 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:41.769+0000 7f212b47d0c0 10 monclient: init 2026-02-22T23:25:41.778 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:41.769+0000 7f212b47d0c0 10 monclient: _reopen_session rank -1 2026-02-22T23:25:41.778 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:41.769+0000 7f212b47d0c0 10 monclient: _add_conns ranks=[5,6,2,7,0,4,1,8,3] 2026-02-22T23:25:41.779 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:41.769+0000 7f212b47d0c0 10 monclient(hunting): picked mon.noname-h con 0x559c1be51070 addr v1:10.20.193.73:6791/0 2026-02-22T23:25:41.779 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:41.769+0000 7f212b47d0c0 10 monclient(hunting): picked mon.noname-d con 0x559c1bdbd700 addr v1:10.20.193.45:6792/0 2026-02-22T23:25:41.779 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:41.769+0000 7f212b47d0c0 10 monclient(hunting): picked mon.noname-b con 0x559c1be51b60 addr v1:10.20.193.45:6790/0 2026-02-22T23:25:41.779 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:41.769+0000 7f212b47d0c0 1 -- --> v1:10.20.193.45:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x559c1bc06d20 con 0x559c1be51b60 2026-02-22T23:25:41.779 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:41.769+0000 7f212b47d0c0 1 -- --> v1:10.20.193.73:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x559c1bdbca40 con 0x559c1be51070 2026-02-22T23:25:41.779 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:41.769+0000 7f212b47d0c0 1 -- --> v1:10.20.193.45:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x559c1bdbcd20 con 0x559c1bdbd700 2026-02-22T23:25:41.779 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:41.770+0000 7f212b47d0c0 10 monclient(hunting): _renew_subs 2026-02-22T23:25:41.779 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:41.770+0000 7f212b47d0c0 10 monclient(hunting): authenticate will time out at 673.387014s 2026-02-22T23:25:41.779 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:41.770+0000 7f2129744640 1 --1- >> v1:10.20.193.45:6792/0 conn(0x559c1bdbd700 0x559c1be565a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.45:6792/0 says I am v1:10.20.193.45:56796/0 (socket says 10.20.193.45:56796) 2026-02-22T23:25:41.779 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:41.770+0000 7f2129744640 1 -- 10.20.193.45:0/1068313335 learned_addr learned my addr 10.20.193.45:0/1068313335 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-22T23:25:41.779 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:41.770+0000 7f2128f43640 1 -- 10.20.193.45:0/1068313335 <== mon.6 v1:10.20.193.45:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2516754923 0 0) 0x559c1bdbcd20 con 0x559c1bdbd700 2026-02-22T23:25:41.779 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:41.770+0000 7f2128f43640 10 monclient(hunting): _negotiate 2026-02-22T23:25:41.780 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:41.770+0000 7f2128f43640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:41.780 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:41.770+0000 7f2128f43640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:41.780 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:41.770+0000 7f2128f43640 10 monclient(hunting): my global_id is 4254 2026-02-22T23:25:41.780 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:41.770+0000 7f2128f43640 1 -- 10.20.193.45:0/1068313335 --> v1:10.20.193.45:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2110001e10 con 0x559c1bdbd700 2026-02-22T23:25:41.780 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:41.770+0000 7f2128f43640 1 -- 10.20.193.45:0/1068313335 <== mon.2 v1:10.20.193.45:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3589595188 0 0) 0x559c1bc06d20 con 0x559c1be51b60 2026-02-22T23:25:41.780 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:41.770+0000 7f2128f43640 10 monclient(hunting): _negotiate 2026-02-22T23:25:41.780 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:41.770+0000 7f2128f43640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:41.780 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:41.770+0000 7f2128f43640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:41.780 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:41.770+0000 7f2128f43640 10 monclient(hunting): my global_id is 4241 2026-02-22T23:25:41.780 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:41.770+0000 7f2128f43640 1 -- 10.20.193.45:0/1068313335 --> v1:10.20.193.45:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x559c1bdbcd20 con 0x559c1be51b60 2026-02-22T23:25:41.780 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:41.770+0000 7f2128f43640 1 -- 10.20.193.45:0/1068313335 <== mon.6 v1:10.20.193.45:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 681265840 0 0) 0x7f2110001e10 con 0x559c1bdbd700 2026-02-22T23:25:41.780 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:41.770+0000 7f2128f43640 1 -- 10.20.193.45:0/1068313335 >> v1:10.20.193.73:6791/0 conn(0x559c1be51070 legacy=0x559c1be51450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:41.780 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:41.770+0000 7f2128f43640 1 -- 10.20.193.45:0/1068313335 >> v1:10.20.193.45:6790/0 conn(0x559c1be51b60 legacy=0x559c1be59cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:41.781 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:41.770+0000 7f2128f43640 10 monclient: _finish_hunting 0 2026-02-22T23:25:41.781 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:41.770+0000 7f2128f43640 1 monclient: found mon.noname-d 2026-02-22T23:25:41.781 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:41.770+0000 7f2128f43640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T23:25:41.781 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:41.770+0000 7f2128f43640 10 monclient: _send_mon_message to mon.noname-d at v1:10.20.193.45:6792/0 2026-02-22T23:25:41.781 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:41.770+0000 7f2128f43640 1 -- 10.20.193.45:0/1068313335 --> v1:10.20.193.45:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x559c1bdbd000 con 0x559c1bdbd700 2026-02-22T23:25:41.781 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:41.770+0000 7f2128f43640 10 monclient: _finish_auth 0 2026-02-22T23:25:41.781 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:41.770+0000 7f2128f43640 10 monclient: _check_auth_tickets 2026-02-22T23:25:41.781 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:41.770+0000 7f2128f43640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T23:25:41.781 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:41.770+0000 7f2128f43640 1 -- 10.20.193.45:0/1068313335 <== mon.6 v1:10.20.193.45:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f2114001830 con 0x559c1bdbd700 2026-02-22T23:25:41.781 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:41.770+0000 7f2128f43640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:25:41.781 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:41.770+0000 7f2128f43640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2026-02-22T23:25:41.781 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:41.770+0000 7f2128f43640 10 monclient: dump: 2026-02-22T23:25:41.781 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:41.782 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:41.782 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:41.782 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:41.782 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:41.782 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:41.782 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:41.782 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:41.782 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:41.782 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:41.782 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:41.782 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:41.782 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:41.782 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:41.783 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:41.783 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:41.783 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:41.770+0000 7f212b47d0c0 5 monclient: authenticate success, global_id 4254 2026-02-22T23:25:41.783 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:41.770+0000 7f212b47d0c0 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-22T23:25:41.783 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:41.770+0000 7f2128f43640 1 -- 10.20.193.45:0/1068313335 <== mon.6 v1:10.20.193.45:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2114001a50 con 0x559c1bdbd700 2026-02-22T23:25:41.783 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:41.770+0000 7f2128f43640 10 monclient: handle_config config(0 keys) 2026-02-22T23:25:41.783 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:41.770+0000 7f2128f43640 1 -- 10.20.193.45:0/1068313335 <== mon.6 v1:10.20.193.45:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f21140034d0 con 0x559c1bdbd700 2026-02-22T23:25:41.783 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:41.770+0000 7f2128f43640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:25:41.783 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:41.770+0000 7f2128f43640 10 monclient: got monmap 1 from mon.d (according to old e1) 2026-02-22T23:25:41.783 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:41.770+0000 7f2128f43640 10 monclient: dump: 2026-02-22T23:25:41.783 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:41.783 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:41.784 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:41.784 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:41.784 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:41.784 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:41.784 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:41.784 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:41.784 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:41.784 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:41.784 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:41.784 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:41.784 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:41.784 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:41.784 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:41.785 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:41.785 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:41.770+0000 7f212b47d0c0 10 monclient: get_monmap_and_config success 2026-02-22T23:25:41.785 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:41.770+0000 7f212b47d0c0 4 set_mon_vals no callback set 2026-02-22T23:25:41.785 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:41.770+0000 7f212b47d0c0 10 monclient: shutdown 2026-02-22T23:25:41.785 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:41.770+0000 7f212b47d0c0 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T23:25:41.785 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:41.770+0000 7f212b47d0c0 1 -- 10.20.193.45:0/1068313335 >> v1:10.20.193.45:6792/0 conn(0x559c1bdbd700 legacy=0x559c1be565a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:41.785 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:41.770+0000 7f212b47d0c0 1 -- 10.20.193.45:0/1068313335 shutdown_connections 2026-02-22T23:25:41.785 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:41.770+0000 7f212b47d0c0 1 -- 10.20.193.45:0/1068313335 >> 10.20.193.45:0/1068313335 conn(0x559c1bd9e140 msgr2=0x559c1bd9e550 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:25:41.785 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:41.770+0000 7f212b47d0c0 1 -- 10.20.193.45:0/1068313335 shutdown_connections 2026-02-22T23:25:41.785 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:41.770+0000 7f212b47d0c0 1 -- 10.20.193.45:0/1068313335 wait complete. 2026-02-22T23:25:41.785 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:41.771+0000 7f212b47d0c0 10 monclient: build_initial_monmap 2026-02-22T23:25:41.785 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:41.771+0000 7f212b47d0c0 10 monclient: monmap: 2026-02-22T23:25:41.786 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-22T23:25:41.786 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T23:25:41.786 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-22T23:25:41.786 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-22T23:25:41.786 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-22T23:25:41.786 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-22T23:25:41.786 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-22T23:25:41.786 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.noname-f 2026-02-22T23:25:41.786 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.noname-b 2026-02-22T23:25:41.786 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.noname-g 2026-02-22T23:25:41.786 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.noname-c 2026-02-22T23:25:41.786 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.noname-h 2026-02-22T23:25:41.786 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.noname-d 2026-02-22T23:25:41.787 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.noname-i 2026-02-22T23:25:41.787 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.noname-e 2026-02-22T23:25:41.787 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:41.787 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:41.771+0000 7f212b47d0c0 1 Processor -- start 2026-02-22T23:25:41.787 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:41.771+0000 7f212b47d0c0 1 -- start start 2026-02-22T23:25:41.787 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:41.771+0000 7f212b47d0c0 10 monclient: init 2026-02-22T23:25:41.787 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:41.771+0000 7f212b47d0c0 10 monclient: _reopen_session rank -1 2026-02-22T23:25:41.787 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:41.771+0000 7f212b47d0c0 10 monclient: _add_conns ranks=[0,1,5,3,6,4,8,7,2] 2026-02-22T23:25:41.787 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:41.771+0000 7f212b47d0c0 10 monclient(hunting): picked mon.noname-a con 0x559c1bdbd700 addr v1:10.20.193.45:6789/0 2026-02-22T23:25:41.787 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:41.771+0000 7f212b47d0c0 10 monclient(hunting): picked mon.noname-f con 0x559c1be51070 addr v1:10.20.193.73:6789/0 2026-02-22T23:25:41.787 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:41.771+0000 7f212b47d0c0 10 monclient(hunting): picked mon.noname-h con 0x559c1be51b60 addr v1:10.20.193.73:6791/0 2026-02-22T23:25:41.787 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:41.771+0000 7f212b47d0c0 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x559c1be3ed70 con 0x559c1bdbd700 2026-02-22T23:25:41.788 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:41.771+0000 7f212b47d0c0 1 -- --> v1:10.20.193.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x559c1be3f050 con 0x559c1be51070 2026-02-22T23:25:41.788 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:41.771+0000 7f212b47d0c0 1 -- --> v1:10.20.193.73:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x559c1bdc1e90 con 0x559c1be51b60 2026-02-22T23:25:41.788 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:41.771+0000 7f212b47d0c0 10 monclient(hunting): _renew_subs 2026-02-22T23:25:41.788 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:41.771+0000 7f212b47d0c0 10 monclient(hunting): authenticate will time out at 673.388636s 2026-02-22T23:25:41.788 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:41.771+0000 7f2129f45640 1 --1- >> v1:10.20.193.45:6789/0 conn(0x559c1bdbd700 0x559c1be3b4f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.45:6789/0 says I am v1:10.20.193.45:58134/0 (socket says 10.20.193.45:58134) 2026-02-22T23:25:41.788 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:41.771+0000 7f2129f45640 1 -- 10.20.193.45:0/1879169055 learned_addr learned my addr 10.20.193.45:0/1879169055 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-22T23:25:41.788 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:41.771+0000 7f2119ffb640 1 -- 10.20.193.45:0/1879169055 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1780587750 0 0) 0x559c1be3ed70 con 0x559c1bdbd700 2026-02-22T23:25:41.788 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:41.771+0000 7f2119ffb640 10 monclient(hunting): _negotiate 2026-02-22T23:25:41.788 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:41.771+0000 7f2119ffb640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:41.788 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:41.771+0000 7f2119ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:41.788 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:41.771+0000 7f2119ffb640 10 monclient(hunting): my global_id is 4221 2026-02-22T23:25:41.788 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:41.771+0000 7f2119ffb640 1 -- 10.20.193.45:0/1879169055 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2108001e10 con 0x559c1bdbd700 2026-02-22T23:25:41.788 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:41.771+0000 7f2119ffb640 1 -- 10.20.193.45:0/1879169055 <== mon.0 v1:10.20.193.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3409683085 0 0) 0x7f2108001e10 con 0x559c1bdbd700 2026-02-22T23:25:41.789 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:41.771+0000 7f2119ffb640 1 -- 10.20.193.45:0/1879169055 --> v1:10.20.193.45:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x559c1be3ed70 con 0x559c1bdbd700 2026-02-22T23:25:41.789 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:41.771+0000 7f2119ffb640 1 -- 10.20.193.45:0/1879169055 <== mon.0 v1:10.20.193.45:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f2120001b70 con 0x559c1bdbd700 2026-02-22T23:25:41.789 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:41.771+0000 7f2119ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-22T23:25:41.789 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:41.772+0000 7f2119ffb640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T23:25:41.789 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:41.772+0000 7f2119ffb640 10 monclient(hunting): dump: 2026-02-22T23:25:41.789 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:41.789 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:41.789 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:41.789 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:41.789 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:41.789 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:41.789 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:41.790 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:41.790 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:41.790 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:41.790 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:41.790 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:41.790 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:41.790 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:41.790 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:41.790 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:41.790 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:41.772+0000 7f2119ffb640 10 monclient(hunting): _finish_auth 0 2026-02-22T23:25:41.790 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:41.772+0000 7f2119ffb640 1 -- 10.20.193.45:0/1879169055 <== mon.0 v1:10.20.193.45:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1828637997 0 0) 0x559c1be3ed70 con 0x559c1bdbd700 2026-02-22T23:25:41.790 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:41.772+0000 7f2119ffb640 1 -- 10.20.193.45:0/1879169055 >> v1:10.20.193.73:6791/0 conn(0x559c1be51b60 legacy=0x559c1be684a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:41.791 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:41.772+0000 7f2119ffb640 1 -- 10.20.193.45:0/1879169055 >> v1:10.20.193.73:6789/0 conn(0x559c1be51070 legacy=0x559c1be3bc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:41.791 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:41.772+0000 7f2119ffb640 10 monclient: _finish_hunting 0 2026-02-22T23:25:41.791 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:41.772+0000 7f2119ffb640 1 monclient: found mon.a 2026-02-22T23:25:41.791 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:41.772+0000 7f2119ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T23:25:41.791 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:41.772+0000 7f2119ffb640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-22T23:25:41.791 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:41.772+0000 7f2119ffb640 1 -- 10.20.193.45:0/1879169055 --> v1:10.20.193.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x559c1be3cd60 con 0x559c1bdbd700 2026-02-22T23:25:41.791 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:41.772+0000 7f2119ffb640 10 monclient: _finish_auth 0 2026-02-22T23:25:41.791 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:41.772+0000 7f2119ffb640 10 monclient: _check_auth_tickets 2026-02-22T23:25:41.791 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:41.772+0000 7f2119ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T23:25:41.791 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:41.772+0000 7f212b47d0c0 5 monclient: authenticate success, global_id 4221 2026-02-22T23:25:41.791 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:41.772+0000 7f212b47d0c0 10 monclient: _renew_subs 2026-02-22T23:25:41.791 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:41.772+0000 7f212b47d0c0 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-22T23:25:41.791 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:41.772+0000 7f212b47d0c0 1 -- 10.20.193.45:0/1879169055 --> v1:10.20.193.45:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x559c1be3ea90 con 0x559c1bdbd700 2026-02-22T23:25:41.792 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:41.772+0000 7f212b47d0c0 10 monclient: _renew_subs 2026-02-22T23:25:41.792 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:41.772+0000 7f212b47d0c0 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-22T23:25:41.792 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:41.772+0000 7f212b47d0c0 1 -- 10.20.193.45:0/1879169055 --> v1:10.20.193.45:6789/0 -- mon_subscribe({osdmap=0}) -- 0x559c1be3c540 con 0x559c1bdbd700 2026-02-22T23:25:41.792 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:41.772+0000 7f2119ffb640 1 -- 10.20.193.45:0/1879169055 <== mon.0 v1:10.20.193.45:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f21200021b0 con 0x559c1bdbd700 2026-02-22T23:25:41.792 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:41.772+0000 7f2119ffb640 10 monclient: handle_config config(0 keys) 2026-02-22T23:25:41.792 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:41.772+0000 7f2119ffb640 1 -- 10.20.193.45:0/1879169055 <== mon.0 v1:10.20.193.45:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f2120002760 con 0x559c1bdbd700 2026-02-22T23:25:41.792 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:41.772+0000 7f2119ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:25:41.792 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:41.772+0000 7f2119ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T23:25:41.792 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:41.772+0000 7f2119ffb640 10 monclient: dump: 2026-02-22T23:25:41.792 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:41.792 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:41.792 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:41.792 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:41.793 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:41.793 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:41.793 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:41.793 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:41.793 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:41.793 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:41.793 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:41.793 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:41.793 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:41.793 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:41.793 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:41.793 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:41.793 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:41.772+0000 7f211bfff640 4 set_mon_vals no callback set 2026-02-22T23:25:41.794 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:41.772+0000 7f2119ffb640 1 -- 10.20.193.45:0/1879169055 <== mon.0 v1:10.20.193.45:6789/0 7 ==== mgrmap(e 5) ==== 50225+0+0 (unknown 2330357642 0 0) 0x7f2120002980 con 0x559c1bdbd700 2026-02-22T23:25:41.794 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:41.772+0000 7f2119ffb640 1 -- 10.20.193.45:0/1879169055 <== mon.0 v1:10.20.193.45:6789/0 8 ==== osd_map(16..16 src has 1..16) ==== 3491+0+0 (unknown 1311195152 0 0) 0x7f212004c520 con 0x559c1bdbd700 2026-02-22T23:25:41.794 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:41.773+0000 7f212b47d0c0 10 start_mon_command cmd=[{"prefix": "osd pool application enable","pool": "rbd","app": "rbd"}] 2026-02-22T23:25:41.794 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:41.773+0000 7f212b47d0c0 10 monclient: _send_command 1 [{"prefix": "osd pool application enable","pool": "rbd","app": "rbd"}] 2026-02-22T23:25:41.794 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:41.773+0000 7f212b47d0c0 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-22T23:25:41.794 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:41.773+0000 7f212b47d0c0 1 -- 10.20.193.45:0/1879169055 --> v1:10.20.193.45:6789/0 -- mon_command({"prefix": "osd pool application enable","pool": "rbd","app": "rbd"} v 0) -- 0x559c1be69dd0 con 0x559c1bdbd700 2026-02-22T23:25:41.794 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:41.773+0000 7f2129744640 10 monclient: get_auth_request con 0x7f210803df20 auth_method 0 2026-02-22T23:25:42.729 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:42.727+0000 7f2119ffb640 1 -- 10.20.193.45:0/1879169055 <== mon.0 v1:10.20.193.45:6789/0 9 ==== mon_command_ack([{"prefix": "osd pool application enable","pool": "rbd","app": "rbd"}]=0 enabled application 'rbd' on pool 'rbd' v17) ==== 141+0+0 (unknown 1851909647 0 0) 0x7f2120019d90 con 0x559c1bdbd700 2026-02-22T23:25:42.729 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:42.727+0000 7f2119ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "osd pool application enable","pool": "rbd","app": "rbd"}] 2026-02-22T23:25:42.729 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:42.727+0000 7f2119ffb640 10 monclient: _finish_command 1 = system:0 enabled application 'rbd' on pool 'rbd' 2026-02-22T23:25:42.729 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:42.727+0000 7f212b47d0c0 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-22T23:25:42.729 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:42.727+0000 7f212b47d0c0 1 -- 10.20.193.45:0/1879169055 --> v1:10.20.193.45:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f2114001a50 con 0x559c1bdbd700 2026-02-22T23:25:42.731 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:42.730+0000 7f2119ffb640 1 -- 10.20.193.45:0/1879169055 <== mon.0 v1:10.20.193.45:6789/0 10 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (unknown 391748328 0 0) 0x7f2120015890 con 0x559c1bdbd700 2026-02-22T23:25:42.732 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:42.730+0000 7f2119ffb640 10 monclient: handle_get_version_reply finishing 1 version 17 2026-02-22T23:25:42.732 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:42.730+0000 7f211bfff640 10 monclient: _renew_subs 2026-02-22T23:25:42.732 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:42.730+0000 7f211bfff640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-22T23:25:42.732 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:42.730+0000 7f211bfff640 1 -- 10.20.193.45:0/1879169055 --> v1:10.20.193.45:6789/0 -- mon_subscribe({osdmap=17}) -- 0x7f2104002bc0 con 0x559c1bdbd700 2026-02-22T23:25:42.732 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:42.730+0000 7f2119ffb640 1 -- 10.20.193.45:0/1879169055 <== mon.0 v1:10.20.193.45:6789/0 11 ==== osd_map(17..17 src has 1..17) ==== 674+0+0 (unknown 3702324090 0 0) 0x7f2120011e50 con 0x559c1bdbd700 2026-02-22T23:25:42.732 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:42.730+0000 7f212b47d0c0 1 -- 10.20.193.45:0/1879169055 --> v1:10.20.193.45:6800/628358795 -- osd_op(unknown.0.0:1 2.3 2:c4c92e5a:::rbd_trash:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17) -- 0x559c1be6e470 con 0x559c1be6a960 2026-02-22T23:25:42.732 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:42.730+0000 7f212b1ce640 10 monclient: get_auth_request con 0x559c1be6a960 auth_method 0 2026-02-22T23:25:42.733 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:42.733+0000 7f212b1ce640 1 -- 10.20.193.45:0/1879169055 <== osd.1 v1:10.20.193.45:6800/628358795 1 ==== osd_op_reply(1 rbd_trash [create] v17'1 uv1 ondisk = 0) ==== 153+0+0 (unknown 1703302865 0 0) 0x7f211c001810 con 0x559c1be6a960 2026-02-22T23:25:42.736 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:42.734+0000 7f212b47d0c0 1 -- 10.20.193.45:0/1879169055 --> v1:10.20.193.45:6801/1146005631 -- osd_op(unknown.0.0:2 2.2 2:5cea7035:::rbd_info:head [call rbd.metadata_list in=33b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e17) -- 0x559c1bec43b0 con 0x559c1bec07b0 2026-02-22T23:25:42.736 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:42.734+0000 7f2129f45640 10 monclient: get_auth_request con 0x559c1bec07b0 auth_method 0 2026-02-22T23:25:42.736 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:42.734+0000 7f2129f45640 1 -- 10.20.193.45:0/1879169055 <== osd.0 v1:10.20.193.45:6801/1146005631 1 ==== osd_op_reply(2 rbd_info [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (unknown 4274215525 0 0) 0x7f2120015480 con 0x559c1bec07b0 2026-02-22T23:25:42.736 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:42.734+0000 7f212b47d0c0 1 -- 10.20.193.45:0/1879169055 --> v1:10.20.193.45:6801/1146005631 -- osd_op(unknown.0.0:3 2.2 2:5cea7035:::rbd_info:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e17) -- 0x559c1bebf240 con 0x559c1bec07b0 2026-02-22T23:25:42.736 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:42.734+0000 7f2129f45640 1 -- 10.20.193.45:0/1879169055 <== osd.0 v1:10.20.193.45:6801/1146005631 2 ==== osd_op_reply(3 rbd_info [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (unknown 4287864937 0 0) 0x7f2120015480 con 0x559c1bec07b0 2026-02-22T23:25:42.737 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:42.734+0000 7f211b7fe640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-22T23:25:42.737 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:42.734+0000 7f211b7fe640 1 -- 10.20.193.45:0/1879169055 --> v1:10.20.193.45:6789/0 -- pool_op(create unmanaged snap pool 2 tid 4 name v0) -- 0x7f20fc001f00 con 0x559c1bdbd700 2026-02-22T23:25:43.731 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:43.730+0000 7f2119ffb640 1 -- 10.20.193.45:0/1879169055 <== mon.0 v1:10.20.193.45:6789/0 12 ==== pool_op_reply(tid 4 (0) Success v18) ==== 55+0+0 (unknown 3895382500 0 0) 0x7f212001e8e0 con 0x559c1bdbd700 2026-02-22T23:25:43.731 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:43.730+0000 7f2119ffb640 10 monclient: _renew_subs 2026-02-22T23:25:43.731 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:43.730+0000 7f2119ffb640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-22T23:25:43.731 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:43.730+0000 7f2119ffb640 1 -- 10.20.193.45:0/1879169055 --> v1:10.20.193.45:6789/0 -- mon_subscribe({osdmap=18}) -- 0x559c1be3ed70 con 0x559c1bdbd700 2026-02-22T23:25:43.732 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:43.731+0000 7f2119ffb640 1 -- 10.20.193.45:0/1879169055 <== mon.0 v1:10.20.193.45:6789/0 13 ==== osd_map(18..18 src has 1..18) ==== 626+0+0 (unknown 1457820699 0 0) 0x7f2120014540 con 0x559c1bdbd700 2026-02-22T23:25:43.732 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:43.731+0000 7f211bfff640 1 -- 10.20.193.45:0/1879169055 --> v1:10.20.193.45:6801/1146005631 -- osd_op(unknown.0.0:5 2.2 2:5cea7035:::rbd_info:head [create,write 0~8 in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18) -- 0x7f2104005890 con 0x559c1bec07b0 2026-02-22T23:25:43.733 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:43.732+0000 7f2129f45640 1 -- 10.20.193.45:0/1879169055 <== osd.0 v1:10.20.193.45:6801/1146005631 3 ==== osd_op_reply(5 rbd_info [create,write 0~8] v18'1 uv1 ondisk = 0) ==== 194+0+0 (unknown 2910594948 0 0) 0x7f2120015480 con 0x559c1bec07b0 2026-02-22T23:25:43.734 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:43.732+0000 7f211b7fe640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-22T23:25:43.734 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:43.732+0000 7f211b7fe640 1 -- 10.20.193.45:0/1879169055 --> v1:10.20.193.45:6789/0 -- pool_op(delete unmanaged snap pool 2 tid 6 name v18) -- 0x7f20fc003370 con 0x559c1bdbd700 2026-02-22T23:25:44.734 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:44.733+0000 7f2119ffb640 1 -- 10.20.193.45:0/1879169055 <== mon.0 v1:10.20.193.45:6789/0 14 ==== pool_op_reply(tid 6 (0) Success v19) ==== 43+0+0 (unknown 2476575938 0 0) 0x7f2120014740 con 0x559c1bdbd700 2026-02-22T23:25:44.734 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:44.733+0000 7f2119ffb640 10 monclient: _renew_subs 2026-02-22T23:25:44.734 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:44.733+0000 7f2119ffb640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-22T23:25:44.734 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:44.733+0000 7f2119ffb640 1 -- 10.20.193.45:0/1879169055 --> v1:10.20.193.45:6789/0 -- mon_subscribe({osdmap=19}) -- 0x559c1be3f050 con 0x559c1bdbd700 2026-02-22T23:25:44.734 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:44.733+0000 7f2119ffb640 1 -- 10.20.193.45:0/1879169055 <== mon.0 v1:10.20.193.45:6789/0 15 ==== osd_map(19..19 src has 1..19) ==== 654+0+0 (unknown 3292345709 0 0) 0x7f212001b210 con 0x559c1bdbd700 2026-02-22T23:25:44.734 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:44.733+0000 7f211bfff640 1 -- 10.20.193.45:0/1879169055 --> v1:10.20.193.45:6801/1146005631 -- osd_op(unknown.0.0:7 2.2 2:5cea7035:::rbd_info:head [write 0~19 in=19b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e19) -- 0x7f2104005c50 con 0x559c1bec07b0 2026-02-22T23:25:44.736 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:44.735+0000 7f2129f45640 1 -- 10.20.193.45:0/1879169055 <== osd.0 v1:10.20.193.45:6801/1146005631 4 ==== osd_op_reply(7 rbd_info [write 0~19] v19'2 uv2 ondisk = 0) ==== 152+0+0 (unknown 900577457 0 0) 0x7f2120015480 con 0x559c1bec07b0 2026-02-22T23:25:44.736 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:44.735+0000 7f212b47d0c0 1 -- 10.20.193.45:0/1879169055 >> v1:10.20.193.45:6801/1146005631 conn(0x559c1bec07b0 legacy=0x559c1bec2c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:44.736 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:44.735+0000 7f212b47d0c0 1 -- 10.20.193.45:0/1879169055 >> v1:10.20.193.45:6800/628358795 conn(0x559c1be6a960 legacy=0x559c1be6cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:44.736 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:44.735+0000 7f212b47d0c0 1 -- 10.20.193.45:0/1879169055 >> v1:10.20.193.73:6800/2222410180 conn(0x7f210803df20 legacy=0x7f21080403e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:44.736 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:44.735+0000 7f212b47d0c0 10 monclient: shutdown 2026-02-22T23:25:44.736 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:44.735+0000 7f212b47d0c0 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T23:25:44.736 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:44.735+0000 7f212b47d0c0 1 -- 10.20.193.45:0/1879169055 >> v1:10.20.193.45:6789/0 conn(0x559c1bdbd700 legacy=0x559c1be3b4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:44.736 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:44.735+0000 7f212b1ce640 1 -- 10.20.193.45:0/1879169055 reap_dead start 2026-02-22T23:25:44.736 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:44.735+0000 7f212b47d0c0 1 -- 10.20.193.45:0/1879169055 shutdown_connections 2026-02-22T23:25:44.736 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:44.735+0000 7f212b47d0c0 1 -- 10.20.193.45:0/1879169055 >> 10.20.193.45:0/1879169055 conn(0x559c1bd9e140 msgr2=0x559c1bdb5960 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:25:44.736 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:44.735+0000 7f212b47d0c0 1 -- 10.20.193.45:0/1879169055 shutdown_connections 2026-02-22T23:25:44.736 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:44.735+0000 7f212b47d0c0 1 -- 10.20.193.45:0/1879169055 wait complete. 2026-02-22T23:25:44.739 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2026-02-22T23:25:44.739 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2026-02-22T23:25:44.740 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2026-02-22T23:25:44.740 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2026-02-22T23:25:44.740 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2026-02-22T23:25:44.854 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:44.846+0000 7fa1cddeb640 10 monclient: get_monmap_and_config 2026-02-22T23:25:44.855 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:44.846+0000 7fa1cddeb640 10 monclient: build_initial_monmap 2026-02-22T23:25:44.855 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:44.846+0000 7fa1cddeb640 10 monclient: monmap: 2026-02-22T23:25:44.855 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-22T23:25:44.855 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:44.855 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:25:44.847356+0000 2026-02-22T23:25:44.855 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:25:44.847356+0000 2026-02-22T23:25:44.855 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-22T23:25:44.855 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:44.855 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-22T23:25:44.855 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.noname-f 2026-02-22T23:25:44.856 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.noname-b 2026-02-22T23:25:44.856 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.noname-g 2026-02-22T23:25:44.856 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.noname-c 2026-02-22T23:25:44.856 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.noname-h 2026-02-22T23:25:44.856 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.noname-d 2026-02-22T23:25:44.856 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.noname-i 2026-02-22T23:25:44.856 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.noname-e 2026-02-22T23:25:44.856 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:44.856 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:44.846+0000 7fa1cddeb640 1 Processor -- start 2026-02-22T23:25:44.856 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:44.846+0000 7fa1cddeb640 1 -- start start 2026-02-22T23:25:44.856 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:44.846+0000 7fa1cddeb640 10 monclient: init 2026-02-22T23:25:44.857 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:44.846+0000 7fa1cddeb640 10 monclient: _reopen_session rank -1 2026-02-22T23:25:44.857 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:44.846+0000 7fa1cddeb640 10 monclient: _add_conns ranks=[1,3,4,7,8,5,0,2,6] 2026-02-22T23:25:44.857 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:44.846+0000 7fa1cddeb640 10 monclient(hunting): picked mon.noname-f con 0x7fa1c8135c80 addr v1:10.20.193.73:6789/0 2026-02-22T23:25:44.857 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:44.846+0000 7fa1cddeb640 10 monclient(hunting): picked mon.noname-g con 0x7fa1c8068e80 addr v1:10.20.193.73:6790/0 2026-02-22T23:25:44.857 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:44.846+0000 7fa1cddeb640 10 monclient(hunting): picked mon.noname-c con 0x7fa1c813f410 addr v1:10.20.193.45:6791/0 2026-02-22T23:25:44.857 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:44.846+0000 7fa1cddeb640 1 -- --> v1:10.20.193.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa1c809d360 con 0x7fa1c8135c80 2026-02-22T23:25:44.857 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:44.846+0000 7fa1cddeb640 1 -- --> v1:10.20.193.73:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa1c809d640 con 0x7fa1c8068e80 2026-02-22T23:25:44.857 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:44.846+0000 7fa1cddeb640 1 -- --> v1:10.20.193.45:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa1c809d920 con 0x7fa1c813f410 2026-02-22T23:25:44.857 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:44.846+0000 7fa1cddeb640 10 monclient(hunting): _renew_subs 2026-02-22T23:25:44.857 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:44.846+0000 7fa1cddeb640 10 monclient(hunting): authenticate will time out at 676.463881s 2026-02-22T23:25:44.857 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:44.846+0000 7fa1c7fff640 1 --1- >> v1:10.20.193.45:6791/0 conn(0x7fa1c813f410 0x7fa1c8141800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.45:6791/0 says I am v1:10.20.193.45:37844/0 (socket says 10.20.193.45:37844) 2026-02-22T23:25:44.858 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:44.846+0000 7fa1c7fff640 1 -- 10.20.193.45:0/881349411 learned_addr learned my addr 10.20.193.45:0/881349411 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-22T23:25:44.858 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:44.847+0000 7fa1c67fc640 1 -- 10.20.193.45:0/881349411 <== mon.4 v1:10.20.193.45:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 859877986 0 0) 0x7fa1c809d920 con 0x7fa1c813f410 2026-02-22T23:25:44.858 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:44.847+0000 7fa1c67fc640 10 monclient(hunting): _negotiate 2026-02-22T23:25:44.858 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:44.847+0000 7fa1c67fc640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:44.858 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:44.847+0000 7fa1c67fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:44.858 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:44.847+0000 7fa1c67fc640 10 monclient(hunting): my global_id is 4243 2026-02-22T23:25:44.858 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:44.847+0000 7fa1c67fc640 1 -- 10.20.193.45:0/881349411 --> v1:10.20.193.45:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa1ac003620 con 0x7fa1c813f410 2026-02-22T23:25:44.858 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:44.847+0000 7fa1c67fc640 1 -- 10.20.193.45:0/881349411 <== mon.1 v1:10.20.193.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3214056976 0 0) 0x7fa1c809d360 con 0x7fa1c8135c80 2026-02-22T23:25:44.858 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:44.847+0000 7fa1c67fc640 10 monclient(hunting): _negotiate 2026-02-22T23:25:44.858 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:44.847+0000 7fa1c67fc640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:44.858 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:44.847+0000 7fa1c67fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:44.858 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:44.847+0000 7fa1c67fc640 10 monclient(hunting): my global_id is 4285 2026-02-22T23:25:44.859 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:44.847+0000 7fa1c67fc640 1 -- 10.20.193.45:0/881349411 --> v1:10.20.193.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa1c809d920 con 0x7fa1c8135c80 2026-02-22T23:25:44.859 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:44.847+0000 7fa1c67fc640 1 -- 10.20.193.45:0/881349411 <== mon.3 v1:10.20.193.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3982308028 0 0) 0x7fa1c809d640 con 0x7fa1c8068e80 2026-02-22T23:25:44.859 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:44.847+0000 7fa1c67fc640 10 monclient(hunting): _negotiate 2026-02-22T23:25:44.859 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:44.847+0000 7fa1c67fc640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:44.859 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:44.847+0000 7fa1c67fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:44.859 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:44.847+0000 7fa1c67fc640 10 monclient(hunting): my global_id is 4242 2026-02-22T23:25:44.859 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:44.847+0000 7fa1c67fc640 1 -- 10.20.193.45:0/881349411 --> v1:10.20.193.73:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa1c809d360 con 0x7fa1c8068e80 2026-02-22T23:25:44.859 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:44.847+0000 7fa1c67fc640 1 -- 10.20.193.45:0/881349411 <== mon.4 v1:10.20.193.45:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3664650154 0 0) 0x7fa1ac003620 con 0x7fa1c813f410 2026-02-22T23:25:44.859 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:44.847+0000 7fa1c67fc640 1 -- 10.20.193.45:0/881349411 >> v1:10.20.193.73:6790/0 conn(0x7fa1c8068e80 legacy=0x7fa1c813dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:44.859 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:44.847+0000 7fa1c67fc640 1 -- 10.20.193.45:0/881349411 >> v1:10.20.193.73:6789/0 conn(0x7fa1c8135c80 legacy=0x7fa1c8136060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:44.859 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:44.847+0000 7fa1c67fc640 10 monclient: _finish_hunting 0 2026-02-22T23:25:44.859 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:44.847+0000 7fa1c67fc640 1 monclient: found mon.noname-c 2026-02-22T23:25:44.859 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:44.847+0000 7fa1c67fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T23:25:44.860 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:44.847+0000 7fa1c67fc640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.45:6791/0 2026-02-22T23:25:44.860 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:44.847+0000 7fa1c67fc640 1 -- 10.20.193.45:0/881349411 --> v1:10.20.193.45:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1c80a54f0 con 0x7fa1c813f410 2026-02-22T23:25:44.860 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:44.847+0000 7fa1c67fc640 10 monclient: _finish_auth 0 2026-02-22T23:25:44.860 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:44.847+0000 7fa1c67fc640 10 monclient: _check_auth_tickets 2026-02-22T23:25:44.860 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:44.847+0000 7fa1c67fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T23:25:44.860 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:44.847+0000 7fa1c67fc640 1 -- 10.20.193.45:0/881349411 <== mon.4 v1:10.20.193.45:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7fa1bc0033c0 con 0x7fa1c813f410 2026-02-22T23:25:44.860 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:44.847+0000 7fa1c67fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:25:44.860 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:44.847+0000 7fa1c67fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-22T23:25:44.860 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:44.847+0000 7fa1c67fc640 10 monclient: dump: 2026-02-22T23:25:44.860 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:44.860 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:44.860 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:44.861 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:44.861 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:44.861 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:44.861 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:44.861 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:44.861 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:44.861 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:44.861 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:44.861 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:44.861 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:44.861 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:44.861 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:44.861 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:44.862 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:44.847+0000 7fa1cddeb640 5 monclient: authenticate success, global_id 4243 2026-02-22T23:25:44.862 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:44.847+0000 7fa1cddeb640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-22T23:25:44.862 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:44.847+0000 7fa1c67fc640 1 -- 10.20.193.45:0/881349411 <== mon.4 v1:10.20.193.45:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa1bc0035e0 con 0x7fa1c813f410 2026-02-22T23:25:44.862 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:44.847+0000 7fa1c67fc640 10 monclient: handle_config config(0 keys) 2026-02-22T23:25:44.862 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:44.847+0000 7fa1c67fc640 1 -- 10.20.193.45:0/881349411 <== mon.4 v1:10.20.193.45:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7fa1bc005060 con 0x7fa1c813f410 2026-02-22T23:25:44.862 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:44.847+0000 7fa1c67fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:25:44.862 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:44.847+0000 7fa1c67fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T23:25:44.862 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:44.847+0000 7fa1c67fc640 10 monclient: dump: 2026-02-22T23:25:44.862 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:44.862 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:44.862 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:44.862 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:44.863 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:44.863 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:44.863 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:44.863 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:44.863 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:44.863 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:44.863 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:44.863 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:44.863 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:44.863 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:44.863 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:44.863 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:44.863 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:44.847+0000 7fa1cddeb640 10 monclient: get_monmap_and_config success 2026-02-22T23:25:44.864 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:44.847+0000 7fa1cddeb640 4 set_mon_vals no callback set 2026-02-22T23:25:44.864 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:44.847+0000 7fa1cddeb640 10 monclient: shutdown 2026-02-22T23:25:44.864 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:44.847+0000 7fa1cddeb640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T23:25:44.864 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:44.847+0000 7fa1cddeb640 1 -- 10.20.193.45:0/881349411 >> v1:10.20.193.45:6791/0 conn(0x7fa1c813f410 legacy=0x7fa1c8141800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:44.864 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:44.847+0000 7fa1cddeb640 1 -- 10.20.193.45:0/881349411 shutdown_connections 2026-02-22T23:25:44.864 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:44.847+0000 7fa1cddeb640 1 -- 10.20.193.45:0/881349411 >> 10.20.193.45:0/881349411 conn(0x7fa1c80a86a0 msgr2=0x7fa1c80a4b70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:25:44.864 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:44.847+0000 7fa1cddeb640 1 -- 10.20.193.45:0/881349411 shutdown_connections 2026-02-22T23:25:44.864 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:44.847+0000 7fa1cddeb640 1 -- 10.20.193.45:0/881349411 wait complete. 2026-02-22T23:25:44.864 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:44.848+0000 7fa1cddeb640 10 monclient: build_initial_monmap 2026-02-22T23:25:44.864 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:44.848+0000 7fa1cddeb640 10 monclient: monmap: 2026-02-22T23:25:44.864 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-22T23:25:44.864 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T23:25:44.864 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-22T23:25:44.865 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-22T23:25:44.865 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-22T23:25:44.865 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-22T23:25:44.865 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-22T23:25:44.865 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.noname-f 2026-02-22T23:25:44.865 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.noname-b 2026-02-22T23:25:44.865 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.noname-g 2026-02-22T23:25:44.865 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.noname-c 2026-02-22T23:25:44.865 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.noname-h 2026-02-22T23:25:44.865 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.noname-d 2026-02-22T23:25:44.865 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.noname-i 2026-02-22T23:25:44.865 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.noname-e 2026-02-22T23:25:44.865 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:44.866 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:44.848+0000 7fa1cddeb640 1 Processor -- start 2026-02-22T23:25:44.866 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:44.848+0000 7fa1cddeb640 1 -- start start 2026-02-22T23:25:44.866 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:44.848+0000 7fa1cddeb640 10 monclient: init 2026-02-22T23:25:44.866 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:44.848+0000 7fa1cddeb640 10 monclient: _reopen_session rank -1 2026-02-22T23:25:44.866 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:44.848+0000 7fa1cddeb640 10 monclient: _add_conns ranks=[7,5,2,8,0,1,3,4,6] 2026-02-22T23:25:44.866 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:44.848+0000 7fa1cddeb640 10 monclient(hunting): picked mon.noname-i con 0x7fa1c8068e80 addr v1:10.20.193.73:6792/0 2026-02-22T23:25:44.866 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:44.848+0000 7fa1cddeb640 10 monclient(hunting): picked mon.noname-h con 0x7fa1c8135c80 addr v1:10.20.193.73:6791/0 2026-02-22T23:25:44.866 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:44.848+0000 7fa1cddeb640 10 monclient(hunting): picked mon.noname-b con 0x7fa1c813f410 addr v1:10.20.193.45:6790/0 2026-02-22T23:25:44.866 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:44.848+0000 7fa1cddeb640 1 -- --> v1:10.20.193.45:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa1c8137230 con 0x7fa1c813f410 2026-02-22T23:25:44.866 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:44.848+0000 7fa1cddeb640 1 -- --> v1:10.20.193.73:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa1c8136e80 con 0x7fa1c8135c80 2026-02-22T23:25:44.866 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:44.848+0000 7fa1cddeb640 1 -- --> v1:10.20.193.73:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa1c813eff0 con 0x7fa1c8068e80 2026-02-22T23:25:44.866 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:44.848+0000 7fa1cddeb640 10 monclient(hunting): _renew_subs 2026-02-22T23:25:44.866 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:44.848+0000 7fa1cddeb640 10 monclient(hunting): authenticate will time out at 676.465836s 2026-02-22T23:25:44.867 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:44.848+0000 7fa1c7fff640 1 --1- >> v1:10.20.193.45:6790/0 conn(0x7fa1c813f410 0x7fa1c81d80a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.45:6790/0 says I am v1:10.20.193.45:50812/0 (socket says 10.20.193.45:50812) 2026-02-22T23:25:44.867 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:44.848+0000 7fa1c7fff640 1 -- 10.20.193.45:0/3643655015 learned_addr learned my addr 10.20.193.45:0/3643655015 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-22T23:25:44.867 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:44.849+0000 7fa1a3fff640 1 -- 10.20.193.45:0/3643655015 <== mon.2 v1:10.20.193.45:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2274844945 0 0) 0x7fa1c80a54f0 con 0x7fa1c813f410 2026-02-22T23:25:44.867 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:44.849+0000 7fa1a3fff640 10 monclient(hunting): _negotiate 2026-02-22T23:25:44.867 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:44.849+0000 7fa1a3fff640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:44.867 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:44.849+0000 7fa1a3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:44.867 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:44.849+0000 7fa1a3fff640 10 monclient(hunting): my global_id is 4250 2026-02-22T23:25:44.867 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:44.849+0000 7fa1a3fff640 1 -- 10.20.193.45:0/3643655015 --> v1:10.20.193.45:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa198003620 con 0x7fa1c813f410 2026-02-22T23:25:44.867 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:44.849+0000 7fa1a3fff640 1 -- 10.20.193.45:0/3643655015 <== mon.7 v1:10.20.193.73:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1694660375 0 0) 0x7fa1c813eff0 con 0x7fa1c8068e80 2026-02-22T23:25:44.867 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:44.849+0000 7fa1a3fff640 10 monclient(hunting): _negotiate 2026-02-22T23:25:44.867 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:44.849+0000 7fa1a3fff640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:44.867 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:44.849+0000 7fa1a3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:44.868 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:44.849+0000 7fa1a3fff640 10 monclient(hunting): my global_id is 4210 2026-02-22T23:25:44.868 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:44.849+0000 7fa1a3fff640 1 -- 10.20.193.45:0/3643655015 --> v1:10.20.193.73:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa1c80a54f0 con 0x7fa1c8068e80 2026-02-22T23:25:44.868 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:44.849+0000 7fa1a3fff640 1 -- 10.20.193.45:0/3643655015 <== mon.5 v1:10.20.193.73:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2105682977 0 0) 0x7fa1c8136e80 con 0x7fa1c8135c80 2026-02-22T23:25:44.868 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:44.849+0000 7fa1a3fff640 10 monclient(hunting): _negotiate 2026-02-22T23:25:44.868 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:44.849+0000 7fa1a3fff640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:44.868 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:44.849+0000 7fa1a3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:44.868 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:44.849+0000 7fa1a3fff640 10 monclient(hunting): my global_id is 4244 2026-02-22T23:25:44.868 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:44.849+0000 7fa1a3fff640 1 -- 10.20.193.45:0/3643655015 --> v1:10.20.193.73:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa1c813eff0 con 0x7fa1c8135c80 2026-02-22T23:25:44.868 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:44.849+0000 7fa1a3fff640 1 -- 10.20.193.45:0/3643655015 <== mon.2 v1:10.20.193.45:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 669270656 0 0) 0x7fa198003620 con 0x7fa1c813f410 2026-02-22T23:25:44.868 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:44.849+0000 7fa1a3fff640 1 -- 10.20.193.45:0/3643655015 --> v1:10.20.193.45:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa1c8136e80 con 0x7fa1c813f410 2026-02-22T23:25:44.868 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:44.849+0000 7fa1a3fff640 1 -- 10.20.193.45:0/3643655015 <== mon.2 v1:10.20.193.45:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7fa1bc003790 con 0x7fa1c813f410 2026-02-22T23:25:44.868 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:44.849+0000 7fa1a3fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-22T23:25:44.868 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:44.849+0000 7fa1a3fff640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-22T23:25:44.868 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:44.849+0000 7fa1a3fff640 10 monclient(hunting): dump: 2026-02-22T23:25:44.869 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:44.869 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:44.869 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:44.869 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:44.869 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:44.869 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:44.869 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:44.869 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:44.869 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:44.869 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:44.869 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:44.869 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:44.869 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:44.870 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:44.870 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:44.870 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:44.870 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:44.849+0000 7fa1a3fff640 10 monclient(hunting): _finish_auth 0 2026-02-22T23:25:44.870 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:44.849+0000 7fa1a3fff640 1 -- 10.20.193.45:0/3643655015 <== mon.2 v1:10.20.193.45:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2786932217 0 0) 0x7fa1c8136e80 con 0x7fa1c813f410 2026-02-22T23:25:44.870 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:44.849+0000 7fa1a3fff640 1 -- 10.20.193.45:0/3643655015 >> v1:10.20.193.73:6792/0 conn(0x7fa1c8068e80 legacy=0x7fa1c8136060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:44.870 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:44.849+0000 7fa1a3fff640 1 -- 10.20.193.45:0/3643655015 >> v1:10.20.193.73:6791/0 conn(0x7fa1c8135c80 legacy=0x7fa1c8136770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:44.870 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:44.849+0000 7fa1a3fff640 10 monclient: _finish_hunting 0 2026-02-22T23:25:44.870 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:44.849+0000 7fa1a3fff640 1 monclient: found mon.b 2026-02-22T23:25:44.870 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:44.849+0000 7fa1a3fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T23:25:44.870 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:44.849+0000 7fa1a3fff640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.45:6790/0 2026-02-22T23:25:44.870 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:44.849+0000 7fa1a3fff640 1 -- 10.20.193.45:0/3643655015 --> v1:10.20.193.45:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1c81387a0 con 0x7fa1c813f410 2026-02-22T23:25:44.871 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:44.849+0000 7fa1a3fff640 10 monclient: _finish_auth 0 2026-02-22T23:25:44.871 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:44.849+0000 7fa1a3fff640 10 monclient: _check_auth_tickets 2026-02-22T23:25:44.871 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:44.849+0000 7fa1a3fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T23:25:44.871 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:44.849+0000 7fa1cddeb640 5 monclient: authenticate success, global_id 4250 2026-02-22T23:25:44.871 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:44.849+0000 7fa1cddeb640 10 monclient: _renew_subs 2026-02-22T23:25:44.871 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:44.849+0000 7fa1cddeb640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.45:6790/0 2026-02-22T23:25:44.871 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:44.849+0000 7fa1cddeb640 1 -- 10.20.193.45:0/3643655015 --> v1:10.20.193.45:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fa1c8138ae0 con 0x7fa1c813f410 2026-02-22T23:25:44.871 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:44.849+0000 7fa1cddeb640 10 monclient: _renew_subs 2026-02-22T23:25:44.871 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:44.849+0000 7fa1cddeb640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.45:6790/0 2026-02-22T23:25:44.871 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:44.849+0000 7fa1cddeb640 1 -- 10.20.193.45:0/3643655015 --> v1:10.20.193.45:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fa1c8135540 con 0x7fa1c813f410 2026-02-22T23:25:44.871 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:44.849+0000 7fa1a3fff640 1 -- 10.20.193.45:0/3643655015 <== mon.2 v1:10.20.193.45:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa1bc003400 con 0x7fa1c813f410 2026-02-22T23:25:44.871 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:44.849+0000 7fa1a3fff640 10 monclient: handle_config config(0 keys) 2026-02-22T23:25:44.871 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:44.849+0000 7fa1a3fff640 1 -- 10.20.193.45:0/3643655015 <== mon.2 v1:10.20.193.45:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7fa1bc005590 con 0x7fa1c813f410 2026-02-22T23:25:44.872 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:44.849+0000 7fa1a3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:25:44.872 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:44.849+0000 7fa1c5ffb640 4 set_mon_vals no callback set 2026-02-22T23:25:44.872 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:44.849+0000 7fa1a3fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-22T23:25:44.872 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:44.849+0000 7fa1a3fff640 10 monclient: dump: 2026-02-22T23:25:44.872 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:44.872 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:44.872 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:44.872 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:44.872 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:44.872 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:44.872 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:44.872 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:44.872 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:44.873 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:44.873 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:44.873 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:44.873 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:44.873 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:44.873 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:44.873 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:44.873 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:44.849+0000 7fa1cddeb640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T23:25:44.873 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:44.849+0000 7fa1cddeb640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T23:25:44.873 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:44.849+0000 7fa1cddeb640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.45:6790/0 2026-02-22T23:25:44.873 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:44.849+0000 7fa1cddeb640 1 -- 10.20.193.45:0/3643655015 --> v1:10.20.193.45:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa1c80692d0 con 0x7fa1c813f410 2026-02-22T23:25:44.873 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:44.850+0000 7fa1a3fff640 1 -- 10.20.193.45:0/3643655015 <== mon.2 v1:10.20.193.45:6790/0 7 ==== mgrmap(e 5) ==== 50225+0+0 (unknown 2330357642 0 0) 0x7fa1bc011b70 con 0x7fa1c813f410 2026-02-22T23:25:44.873 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:44.850+0000 7fa1a3fff640 1 -- 10.20.193.45:0/3643655015 <== mon.2 v1:10.20.193.45:6790/0 8 ==== osd_map(19..19 src has 1..19) ==== 3558+0+0 (unknown 1288710973 0 0) 0x7fa1bc04de40 con 0x7fa1c813f410 2026-02-22T23:25:44.874 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:44.850+0000 7fa1c77fe640 10 monclient: get_auth_request con 0x7fa19803fab0 auth_method 0 2026-02-22T23:25:44.874 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:44.852+0000 7fa1a3fff640 1 -- 10.20.193.45:0/3643655015 <== mon.2 v1:10.20.193.45:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (unknown 1092875540 0 2568732696) 0x7fa1c80692d0 con 0x7fa1c813f410 2026-02-22T23:25:44.874 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:44.852+0000 7fa1a3fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T23:25:44.874 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:44.852+0000 7fa1a3fff640 10 monclient: _finish_command 1 = system:0 2026-02-22T23:25:44.958 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:44.957+0000 7fa1cddeb640 10 start_mon_command cmd=[{"prefix": "mgr dump", "format": "json"}] 2026-02-22T23:25:44.958 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:44.957+0000 7fa1cddeb640 10 monclient: _send_command 2 [{"prefix": "mgr dump", "format": "json"}] 2026-02-22T23:25:44.958 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:44.957+0000 7fa1cddeb640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.45:6790/0 2026-02-22T23:25:44.958 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:44.957+0000 7fa1cddeb640 1 -- 10.20.193.45:0/3643655015 --> v1:10.20.193.45:6790/0 -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7fa1c8138e10 con 0x7fa1c813f410 2026-02-22T23:25:44.959 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:44.958+0000 7fa1a3fff640 1 -- 10.20.193.45:0/3643655015 <== mon.2 v1:10.20.193.45:6790/0 10 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+96629 (unknown 481731318 0 1348790622) 0x7fa1c8138ae0 con 0x7fa1c813f410 2026-02-22T23:25:44.959 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:44.958+0000 7fa1a3fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "mgr dump", "format": "json"}] 2026-02-22T23:25:44.959 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:44.958+0000 7fa1a3fff640 10 monclient: _finish_command 2 = system:0 2026-02-22T23:25:44.959 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-22T23:25:44.959 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:44.959+0000 7fa1cddeb640 1 -- 10.20.193.45:0/3643655015 >> v1:10.20.193.73:6800/2222410180 conn(0x7fa19803fab0 legacy=0x7fa198041f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:44.960 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:44.959+0000 7fa1cddeb640 10 monclient: shutdown 2026-02-22T23:25:44.960 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:44.959+0000 7fa1cddeb640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T23:25:44.960 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:44.959+0000 7fa1cddeb640 1 -- 10.20.193.45:0/3643655015 >> v1:10.20.193.45:6790/0 conn(0x7fa1c813f410 legacy=0x7fa1c81d80a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:44.960 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:44.959+0000 7fa1cddeb640 1 -- 10.20.193.45:0/3643655015 shutdown_connections 2026-02-22T23:25:44.960 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:44.959+0000 7fa1cddeb640 1 -- 10.20.193.45:0/3643655015 >> 10.20.193.45:0/3643655015 conn(0x7fa1c80a86a0 msgr2=0x7fa1c80a5e70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:25:44.960 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:44.959+0000 7fa1cddeb640 1 -- 10.20.193.45:0/3643655015 shutdown_connections 2026-02-22T23:25:44.960 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:44.959+0000 7fa1cddeb640 1 -- 10.20.193.45:0/3643655015 wait complete. 2026-02-22T23:25:44.967 INFO:teuthology.orchestra.run.trial045.stdout:{"epoch":5,"flags":0,"active_gid":4111,"active_name":"x","active_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.73:6800","nonce":2222410180}]},"active_addr":"10.20.193.73:6800/2222410180","active_change":"2026-02-22T23:25:27.190769+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_pg_upmap_activity":{"name":"update_pg_upmap_activity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Updates pg_upmap activity stats to be used in `balancer status detail`","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"quay.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":true,"error_string":"","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number. if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"force_disabled_modules":{},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"10.20.193.73:0","nonce":4171628975}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"10.20.193.73:0","nonce":2977077405}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"10.20.193.73:0","nonce":3921287198}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"10.20.193.73:0","nonce":2914136527}]}]} 2026-02-22T23:25:44.969 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2026-02-22T23:25:44.969 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2026-02-22T23:25:44.969 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-22T23:25:45.035 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.034+0000 7fc1fa933640 10 monclient: get_monmap_and_config 2026-02-22T23:25:45.035 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.034+0000 7fc1fa933640 10 monclient: build_initial_monmap 2026-02-22T23:25:45.035 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.034+0000 7fc1fa933640 10 monclient: monmap: 2026-02-22T23:25:45.035 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-22T23:25:45.035 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:45.035 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:25:45.035292+0000 2026-02-22T23:25:45.035 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:25:45.035292+0000 2026-02-22T23:25:45.035 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-22T23:25:45.035 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:45.035 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-22T23:25:45.035 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.noname-f 2026-02-22T23:25:45.035 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.noname-b 2026-02-22T23:25:45.036 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.noname-g 2026-02-22T23:25:45.036 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.noname-c 2026-02-22T23:25:45.036 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.noname-h 2026-02-22T23:25:45.036 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.noname-d 2026-02-22T23:25:45.036 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.noname-i 2026-02-22T23:25:45.036 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.noname-e 2026-02-22T23:25:45.036 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:45.041 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.034+0000 7fc1fa933640 1 Processor -- start 2026-02-22T23:25:45.041 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.034+0000 7fc1fa933640 1 -- start start 2026-02-22T23:25:45.041 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.034+0000 7fc1fa933640 10 monclient: init 2026-02-22T23:25:45.041 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.034+0000 7fc1fa933640 10 monclient: _reopen_session rank -1 2026-02-22T23:25:45.041 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.034+0000 7fc1fa933640 10 monclient: _add_conns ranks=[1,0,7,5,2,6,4,8,3] 2026-02-22T23:25:45.041 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.034+0000 7fc1fa933640 10 monclient(hunting): picked mon.noname-f con 0x7fc1f40a41a0 addr v1:10.20.193.73:6789/0 2026-02-22T23:25:45.041 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.034+0000 7fc1fa933640 10 monclient(hunting): picked mon.noname-a con 0x7fc1f40a4c90 addr v1:10.20.193.45:6789/0 2026-02-22T23:25:45.041 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.034+0000 7fc1fa933640 10 monclient(hunting): picked mon.noname-i con 0x7fc1f40a50a0 addr v1:10.20.193.73:6792/0 2026-02-22T23:25:45.041 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.034+0000 7fc1fa933640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc1f406e1b0 con 0x7fc1f40a4c90 2026-02-22T23:25:45.041 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.034+0000 7fc1fa933640 1 -- --> v1:10.20.193.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc1f406e490 con 0x7fc1f40a41a0 2026-02-22T23:25:45.042 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.034+0000 7fc1fa933640 1 -- --> v1:10.20.193.73:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc1f40a5530 con 0x7fc1f40a50a0 2026-02-22T23:25:45.042 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.034+0000 7fc1fa933640 10 monclient(hunting): _renew_subs 2026-02-22T23:25:45.042 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.034+0000 7fc1fa933640 10 monclient(hunting): authenticate will time out at 676.651880s 2026-02-22T23:25:45.042 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.034+0000 7fc1f37fe640 1 --1- >> v1:10.20.193.45:6789/0 conn(0x7fc1f40a4c90 0x7fc1f413dfe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.45:6789/0 says I am v1:10.20.193.45:58156/0 (socket says 10.20.193.45:58156) 2026-02-22T23:25:45.042 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.034+0000 7fc1f37fe640 1 -- 10.20.193.45:0/1225199947 learned_addr learned my addr 10.20.193.45:0/1225199947 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-22T23:25:45.042 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.035+0000 7fc1f2ffd640 1 -- 10.20.193.45:0/1225199947 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 958114244 0 0) 0x7fc1f406e1b0 con 0x7fc1f40a4c90 2026-02-22T23:25:45.042 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.035+0000 7fc1f2ffd640 10 monclient(hunting): _negotiate 2026-02-22T23:25:45.042 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.035+0000 7fc1f2ffd640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:45.042 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.035+0000 7fc1f2ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:45.042 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.035+0000 7fc1f2ffd640 10 monclient(hunting): my global_id is 4230 2026-02-22T23:25:45.042 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.035+0000 7fc1f2ffd640 1 -- 10.20.193.45:0/1225199947 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc1d8003620 con 0x7fc1f40a4c90 2026-02-22T23:25:45.042 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.035+0000 7fc1f2ffd640 1 -- 10.20.193.45:0/1225199947 <== mon.0 v1:10.20.193.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2776751675 0 0) 0x7fc1d8003620 con 0x7fc1f40a4c90 2026-02-22T23:25:45.042 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.035+0000 7fc1f2ffd640 1 -- 10.20.193.45:0/1225199947 >> v1:10.20.193.73:6792/0 conn(0x7fc1f40a50a0 legacy=0x7fc1f4141710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:45.042 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.035+0000 7fc1f2ffd640 1 -- 10.20.193.45:0/1225199947 >> v1:10.20.193.73:6789/0 conn(0x7fc1f40a41a0 legacy=0x7fc1f40a4580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:45.042 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.035+0000 7fc1f2ffd640 10 monclient: _finish_hunting 0 2026-02-22T23:25:45.042 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.035+0000 7fc1f2ffd640 1 monclient: found mon.noname-a 2026-02-22T23:25:45.042 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.035+0000 7fc1f2ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T23:25:45.042 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.035+0000 7fc1f2ffd640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.45:6789/0 2026-02-22T23:25:45.042 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.035+0000 7fc1f2ffd640 1 -- 10.20.193.45:0/1225199947 --> v1:10.20.193.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1f406ced0 con 0x7fc1f40a4c90 2026-02-22T23:25:45.043 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.035+0000 7fc1f2ffd640 10 monclient: _finish_auth 0 2026-02-22T23:25:45.043 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.035+0000 7fc1f2ffd640 10 monclient: _check_auth_tickets 2026-02-22T23:25:45.043 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.035+0000 7fc1f2ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T23:25:45.043 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.035+0000 7fc1f2ffd640 1 -- 10.20.193.45:0/1225199947 <== mon.0 v1:10.20.193.45:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7fc1e4003040 con 0x7fc1f40a4c90 2026-02-22T23:25:45.043 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.035+0000 7fc1fa933640 5 monclient: authenticate success, global_id 4230 2026-02-22T23:25:45.043 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.035+0000 7fc1fa933640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-22T23:25:45.043 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.035+0000 7fc1f2ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:25:45.043 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.035+0000 7fc1f2ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T23:25:45.043 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.035+0000 7fc1f2ffd640 10 monclient: dump: 2026-02-22T23:25:45.043 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:45.043 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:45.043 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:45.043 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:45.043 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:45.043 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:45.043 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:45.043 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:45.044 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:45.044 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:45.044 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:45.044 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:45.044 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:45.044 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:45.044 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:45.044 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:45.044 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.035+0000 7fc1fa933640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-22T23:25:45.044 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.035+0000 7fc1f2ffd640 1 -- 10.20.193.45:0/1225199947 <== mon.0 v1:10.20.193.45:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc1e4003260 con 0x7fc1f40a4c90 2026-02-22T23:25:45.044 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.035+0000 7fc1f2ffd640 10 monclient: handle_config config(0 keys) 2026-02-22T23:25:45.044 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.035+0000 7fc1f2ffd640 1 -- 10.20.193.45:0/1225199947 <== mon.0 v1:10.20.193.45:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7fc1e4004ce0 con 0x7fc1f40a4c90 2026-02-22T23:25:45.044 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.035+0000 7fc1f2ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:25:45.044 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.035+0000 7fc1f2ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T23:25:45.044 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.035+0000 7fc1f2ffd640 10 monclient: dump: 2026-02-22T23:25:45.044 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:45.044 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:45.044 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:45.044 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:45.045 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:45.045 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:45.045 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:45.045 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:45.045 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:45.045 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:45.045 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:45.045 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:45.045 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:45.045 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:45.045 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:45.045 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:45.045 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.035+0000 7fc1fa933640 10 monclient: get_monmap_and_config success 2026-02-22T23:25:45.045 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.035+0000 7fc1fa933640 4 set_mon_vals no callback set 2026-02-22T23:25:45.045 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.035+0000 7fc1fa933640 10 monclient: shutdown 2026-02-22T23:25:45.045 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.035+0000 7fc1fa933640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T23:25:45.045 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.035+0000 7fc1fa933640 1 -- 10.20.193.45:0/1225199947 >> v1:10.20.193.45:6789/0 conn(0x7fc1f40a4c90 legacy=0x7fc1f413dfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:45.045 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.035+0000 7fc1fa933640 1 -- 10.20.193.45:0/1225199947 shutdown_connections 2026-02-22T23:25:45.045 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.035+0000 7fc1fa933640 1 -- 10.20.193.45:0/1225199947 >> 10.20.193.45:0/1225199947 conn(0x7fc1f40a9720 msgr2=0x7fc1f40a9b30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:25:45.046 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.035+0000 7fc1fa933640 1 -- 10.20.193.45:0/1225199947 shutdown_connections 2026-02-22T23:25:45.046 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.035+0000 7fc1fa933640 1 -- 10.20.193.45:0/1225199947 wait complete. 2026-02-22T23:25:45.046 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.035+0000 7fc1fa933640 10 monclient: build_initial_monmap 2026-02-22T23:25:45.046 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.035+0000 7fc1fa933640 10 monclient: monmap: 2026-02-22T23:25:45.046 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-22T23:25:45.046 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T23:25:45.046 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-22T23:25:45.046 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-22T23:25:45.046 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-22T23:25:45.046 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-22T23:25:45.046 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-22T23:25:45.046 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.noname-f 2026-02-22T23:25:45.046 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.noname-b 2026-02-22T23:25:45.046 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.noname-g 2026-02-22T23:25:45.046 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.noname-c 2026-02-22T23:25:45.046 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.noname-h 2026-02-22T23:25:45.046 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.noname-d 2026-02-22T23:25:45.046 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.noname-i 2026-02-22T23:25:45.046 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.noname-e 2026-02-22T23:25:45.046 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:45.047 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.036+0000 7fc1fa933640 1 Processor -- start 2026-02-22T23:25:45.047 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.036+0000 7fc1fa933640 1 -- start start 2026-02-22T23:25:45.047 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.036+0000 7fc1fa933640 10 monclient: init 2026-02-22T23:25:45.047 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.036+0000 7fc1fa933640 10 monclient: _reopen_session rank -1 2026-02-22T23:25:45.047 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.036+0000 7fc1fa933640 10 monclient: _add_conns ranks=[6,4,8,0,5,2,7,3,1] 2026-02-22T23:25:45.047 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.036+0000 7fc1fa933640 10 monclient(hunting): picked mon.noname-d con 0x7fc1f40a41a0 addr v1:10.20.193.45:6792/0 2026-02-22T23:25:45.047 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.036+0000 7fc1fa933640 10 monclient(hunting): picked mon.noname-c con 0x7fc1f40a4c90 addr v1:10.20.193.45:6791/0 2026-02-22T23:25:45.047 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.036+0000 7fc1fa933640 10 monclient(hunting): picked mon.noname-e con 0x7fc1f40a50a0 addr v1:10.20.193.45:6793/0 2026-02-22T23:25:45.047 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.036+0000 7fc1fa933640 1 -- --> v1:10.20.193.45:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc1f40a66e0 con 0x7fc1f40a4c90 2026-02-22T23:25:45.047 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.036+0000 7fc1fa933640 1 -- --> v1:10.20.193.45:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc1f4141dd0 con 0x7fc1f40a41a0 2026-02-22T23:25:45.047 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.036+0000 7fc1fa933640 1 -- --> v1:10.20.193.45:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc1f4142390 con 0x7fc1f40a50a0 2026-02-22T23:25:45.047 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.036+0000 7fc1fa933640 10 monclient(hunting): _renew_subs 2026-02-22T23:25:45.047 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.036+0000 7fc1fa933640 10 monclient(hunting): authenticate will time out at 676.653473s 2026-02-22T23:25:45.047 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.036+0000 7fc1f3fff640 1 --1- >> v1:10.20.193.45:6792/0 conn(0x7fc1f40a41a0 0x7fc1f413e6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.45:6792/0 says I am v1:10.20.193.45:56804/0 (socket says 10.20.193.45:56804) 2026-02-22T23:25:45.047 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.036+0000 7fc1f3fff640 1 -- 10.20.193.45:0/2094208182 learned_addr learned my addr 10.20.193.45:0/2094208182 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-22T23:25:45.047 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.036+0000 7fc1f0ff9640 1 -- 10.20.193.45:0/2094208182 <== mon.4 v1:10.20.193.45:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3189948511 0 0) 0x7fc1f406ced0 con 0x7fc1f40a4c90 2026-02-22T23:25:45.048 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.036+0000 7fc1f0ff9640 10 monclient(hunting): _negotiate 2026-02-22T23:25:45.048 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.036+0000 7fc1f0ff9640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:45.048 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.036+0000 7fc1f0ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:45.048 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.036+0000 7fc1f0ff9640 10 monclient(hunting): my global_id is 4252 2026-02-22T23:25:45.048 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.036+0000 7fc1f0ff9640 1 -- 10.20.193.45:0/2094208182 --> v1:10.20.193.45:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc1c4003620 con 0x7fc1f40a4c90 2026-02-22T23:25:45.048 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.036+0000 7fc1f0ff9640 1 -- 10.20.193.45:0/2094208182 <== mon.6 v1:10.20.193.45:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1202755837 0 0) 0x7fc1f4141dd0 con 0x7fc1f40a41a0 2026-02-22T23:25:45.048 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.036+0000 7fc1f0ff9640 10 monclient(hunting): _negotiate 2026-02-22T23:25:45.048 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.036+0000 7fc1f0ff9640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:45.048 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.036+0000 7fc1f0ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:45.048 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.036+0000 7fc1f0ff9640 10 monclient(hunting): my global_id is 4263 2026-02-22T23:25:45.048 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.036+0000 7fc1f0ff9640 1 -- 10.20.193.45:0/2094208182 --> v1:10.20.193.45:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc1f406ced0 con 0x7fc1f40a41a0 2026-02-22T23:25:45.048 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.036+0000 7fc1f0ff9640 1 -- 10.20.193.45:0/2094208182 <== mon.8 v1:10.20.193.45:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3020613912 0 0) 0x7fc1f4142390 con 0x7fc1f40a50a0 2026-02-22T23:25:45.048 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.036+0000 7fc1f0ff9640 10 monclient(hunting): _negotiate 2026-02-22T23:25:45.048 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.036+0000 7fc1f0ff9640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:45.048 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.036+0000 7fc1f0ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:45.048 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.036+0000 7fc1f0ff9640 10 monclient(hunting): my global_id is 4238 2026-02-22T23:25:45.049 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.036+0000 7fc1f0ff9640 1 -- 10.20.193.45:0/2094208182 --> v1:10.20.193.45:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc1f4141dd0 con 0x7fc1f40a50a0 2026-02-22T23:25:45.049 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.036+0000 7fc1f0ff9640 1 -- 10.20.193.45:0/2094208182 <== mon.4 v1:10.20.193.45:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4130207185 0 0) 0x7fc1c4003620 con 0x7fc1f40a4c90 2026-02-22T23:25:45.049 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.036+0000 7fc1f0ff9640 1 -- 10.20.193.45:0/2094208182 --> v1:10.20.193.45:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc1f4142390 con 0x7fc1f40a4c90 2026-02-22T23:25:45.049 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.036+0000 7fc1f0ff9640 1 -- 10.20.193.45:0/2094208182 <== mon.4 v1:10.20.193.45:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7fc1e4004c20 con 0x7fc1f40a4c90 2026-02-22T23:25:45.049 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.036+0000 7fc1f0ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-22T23:25:45.049 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.036+0000 7fc1f0ff9640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-22T23:25:45.049 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.036+0000 7fc1f0ff9640 10 monclient(hunting): dump: 2026-02-22T23:25:45.049 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:45.049 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:45.049 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:45.049 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:45.049 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:45.049 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:45.049 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:45.050 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:45.050 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:45.050 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:45.050 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:45.050 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:45.050 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:45.050 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:45.050 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:45.050 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:45.050 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.036+0000 7fc1f0ff9640 10 monclient(hunting): _finish_auth 0 2026-02-22T23:25:45.050 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.036+0000 7fc1f0ff9640 1 -- 10.20.193.45:0/2094208182 <== mon.8 v1:10.20.193.45:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3336216791 0 0) 0x7fc1f4141dd0 con 0x7fc1f40a50a0 2026-02-22T23:25:45.050 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.036+0000 7fc1f0ff9640 1 -- 10.20.193.45:0/2094208182 --> v1:10.20.193.45:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc1c4003620 con 0x7fc1f40a50a0 2026-02-22T23:25:45.050 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.036+0000 7fc1f0ff9640 1 -- 10.20.193.45:0/2094208182 <== mon.6 v1:10.20.193.45:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4060607390 0 0) 0x7fc1f406ced0 con 0x7fc1f40a41a0 2026-02-22T23:25:45.051 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.036+0000 7fc1f0ff9640 1 -- 10.20.193.45:0/2094208182 --> v1:10.20.193.45:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc1f4141dd0 con 0x7fc1f40a41a0 2026-02-22T23:25:45.051 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.036+0000 7fc1f0ff9640 1 -- 10.20.193.45:0/2094208182 <== mon.8 v1:10.20.193.45:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7fc1e8003480 con 0x7fc1f40a50a0 2026-02-22T23:25:45.051 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.036+0000 7fc1f0ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-22T23:25:45.051 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.036+0000 7fc1f0ff9640 10 monclient(hunting): got monmap 1 from mon.e (according to old e1) 2026-02-22T23:25:45.051 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.036+0000 7fc1f0ff9640 10 monclient(hunting): dump: 2026-02-22T23:25:45.051 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:45.051 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:45.051 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:45.051 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:45.051 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:45.051 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:45.051 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:45.051 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:45.052 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:45.052 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:45.052 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:45.052 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:45.052 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:45.052 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:45.052 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:45.052 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:45.052 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.036+0000 7fc1f0ff9640 1 -- 10.20.193.45:0/2094208182 <== mon.6 v1:10.20.193.45:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7fc1e00032a0 con 0x7fc1f40a41a0 2026-02-22T23:25:45.052 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.036+0000 7fc1f0ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-22T23:25:45.052 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.036+0000 7fc1f0ff9640 10 monclient(hunting): got monmap 1 from mon.d (according to old e1) 2026-02-22T23:25:45.052 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.036+0000 7fc1f0ff9640 10 monclient(hunting): dump: 2026-02-22T23:25:45.052 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:45.053 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:45.053 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:45.053 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:45.053 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:45.053 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:45.053 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:45.053 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:45.053 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:45.053 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:45.053 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:45.053 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:45.053 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:45.053 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:45.053 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:45.054 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:45.054 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.036+0000 7fc1f0ff9640 1 -- 10.20.193.45:0/2094208182 <== mon.4 v1:10.20.193.45:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 53501568 0 0) 0x7fc1f4142390 con 0x7fc1f40a4c90 2026-02-22T23:25:45.054 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.036+0000 7fc1f0ff9640 1 -- 10.20.193.45:0/2094208182 >> v1:10.20.193.45:6793/0 conn(0x7fc1f40a50a0 legacy=0x7fc1f41d7cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:45.054 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.036+0000 7fc1f0ff9640 1 -- 10.20.193.45:0/2094208182 >> v1:10.20.193.45:6792/0 conn(0x7fc1f40a41a0 legacy=0x7fc1f413e6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:45.054 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.036+0000 7fc1f0ff9640 10 monclient: _finish_hunting 0 2026-02-22T23:25:45.054 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.036+0000 7fc1f0ff9640 1 monclient: found mon.c 2026-02-22T23:25:45.054 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.036+0000 7fc1f0ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T23:25:45.054 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.036+0000 7fc1f0ff9640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.45:6791/0 2026-02-22T23:25:45.054 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.036+0000 7fc1f0ff9640 1 -- 10.20.193.45:0/2094208182 --> v1:10.20.193.45:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1f40a8d10 con 0x7fc1f40a4c90 2026-02-22T23:25:45.054 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.036+0000 7fc1f0ff9640 10 monclient: _finish_auth 0 2026-02-22T23:25:45.054 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.036+0000 7fc1f0ff9640 10 monclient: _check_auth_tickets 2026-02-22T23:25:45.054 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.036+0000 7fc1f0ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T23:25:45.054 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.036+0000 7fc1fa933640 5 monclient: authenticate success, global_id 4252 2026-02-22T23:25:45.054 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.036+0000 7fc1fa933640 10 monclient: _renew_subs 2026-02-22T23:25:45.055 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.036+0000 7fc1fa933640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.45:6791/0 2026-02-22T23:25:45.055 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.036+0000 7fc1fa933640 1 -- 10.20.193.45:0/2094208182 --> v1:10.20.193.45:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fc1f4141af0 con 0x7fc1f40a4c90 2026-02-22T23:25:45.055 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.036+0000 7fc1f0ff9640 1 -- 10.20.193.45:0/2094208182 <== mon.4 v1:10.20.193.45:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc1e4004fa0 con 0x7fc1f40a4c90 2026-02-22T23:25:45.055 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.036+0000 7fc1f0ff9640 10 monclient: handle_config config(0 keys) 2026-02-22T23:25:45.055 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.036+0000 7fc1f0ff9640 1 -- 10.20.193.45:0/2094208182 <== mon.4 v1:10.20.193.45:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7fc1e4005490 con 0x7fc1f40a4c90 2026-02-22T23:25:45.055 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.036+0000 7fc1f0ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:25:45.055 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.036+0000 7fc1f0ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T23:25:45.055 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.036+0000 7fc1f27fc640 4 set_mon_vals no callback set 2026-02-22T23:25:45.055 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.036+0000 7fc1f0ff9640 10 monclient: dump: 2026-02-22T23:25:45.055 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:45.055 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:45.055 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:45.055 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:45.055 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:45.055 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:45.056 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:45.056 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:45.056 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:45.056 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:45.056 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:45.056 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:45.056 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:45.056 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:45.056 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:45.056 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:45.056 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.037+0000 7fc1fa933640 10 monclient: _renew_subs 2026-02-22T23:25:45.056 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.037+0000 7fc1fa933640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.45:6791/0 2026-02-22T23:25:45.056 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.037+0000 7fc1fa933640 1 -- 10.20.193.45:0/2094208182 --> v1:10.20.193.45:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7fc1f4140f40 con 0x7fc1f40a4c90 2026-02-22T23:25:45.056 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.037+0000 7fc1fa933640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T23:25:45.056 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.037+0000 7fc1fa933640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T23:25:45.057 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.037+0000 7fc1fa933640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.45:6791/0 2026-02-22T23:25:45.057 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.037+0000 7fc1f0ff9640 1 -- 10.20.193.45:0/2094208182 <== mon.4 v1:10.20.193.45:6791/0 7 ==== mgrmap(e 5) ==== 50225+0+0 (unknown 2330357642 0 0) 0x7fc1e4011a70 con 0x7fc1f40a4c90 2026-02-22T23:25:45.057 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.037+0000 7fc1fa933640 1 -- 10.20.193.45:0/2094208182 --> v1:10.20.193.45:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc1f406ea50 con 0x7fc1f40a4c90 2026-02-22T23:25:45.057 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.037+0000 7fc1f0ff9640 1 -- 10.20.193.45:0/2094208182 <== mon.4 v1:10.20.193.45:6791/0 8 ==== osd_map(19..19 src has 1..19) ==== 3558+0+0 (unknown 1288710973 0 0) 0x7fc1e404dc60 con 0x7fc1f40a4c90 2026-02-22T23:25:45.057 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.037+0000 7fc1f3fff640 10 monclient: get_auth_request con 0x7fc1c40401f0 auth_method 0 2026-02-22T23:25:45.057 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.040+0000 7fc1f0ff9640 1 -- 10.20.193.45:0/2094208182 <== mon.4 v1:10.20.193.45:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (unknown 1092875540 0 2568732696) 0x7fc1f40a66e0 con 0x7fc1f40a4c90 2026-02-22T23:25:45.058 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.040+0000 7fc1f0ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T23:25:45.058 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.040+0000 7fc1f0ff9640 10 monclient: _finish_command 1 = system:0 2026-02-22T23:25:45.125 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.123+0000 7fc1fa933640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2026-02-22T23:25:45.125 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.123+0000 7fc1fa933640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-22T23:25:45.125 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.123+0000 7fc1fa933640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.45:6791/0 2026-02-22T23:25:45.125 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.123+0000 7fc1fa933640 1 -- 10.20.193.45:0/2094208182 --> v1:10.20.193.45:6791/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc1f4142d50 con 0x7fc1f40a4c90 2026-02-22T23:25:45.125 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.123+0000 7fc1f0ff9640 1 -- 10.20.193.45:0/2094208182 <== mon.4 v1:10.20.193.45:6791/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) ==== 74+0+10931 (unknown 941590788 0 2623996707) 0x7fc1e4017820 con 0x7fc1f40a4c90 2026-02-22T23:25:45.125 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.124+0000 7fc1f0ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-22T23:25:45.125 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.124+0000 7fc1f0ff9640 10 monclient: _finish_command 2 = system:0 2026-02-22T23:25:45.126 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-22T23:25:45.126 INFO:teuthology.orchestra.run.trial045.stdout:{"epoch":19,"fsid":"4b60f18f-6660-4731-b731-dc85c4078413","created":"2026-02-22T23:25:25.062615+0000","modified":"2026-02-22T23:25:44.732868+0000","last_up_change":"2026-02-22T23:25:34.696475+0000","last_in_change":"2026-02-22T23:25:26.208612+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-22T23:25:35.209511+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6.059999942779541,"score_stable":6.059999942779541,"optimal_score":0.33000001311302185,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2026-02-22T23:25:40.737184+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":19,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ef9d15a7-661e-40c5-a418-7f794c0975b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.45:6801","nonce":1146005631}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.45:6803","nonce":1146005631}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.45:6807","nonce":1146005631}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.45:6805","nonce":1146005631}]},"public_addr":"10.20.193.45:6801/1146005631","cluster_addr":"10.20.193.45:6803/1146005631","heartbeat_back_addr":"10.20.193.45:6807/1146005631","heartbeat_front_addr":"10.20.193.45:6805/1146005631","state":["exists","up"]},{"osd":1,"uuid":"9e62cdef-b0a0-4f67-a778-ac4f7d97ed7e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.45:6800","nonce":628358795}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.45:6802","nonce":628358795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.45:6806","nonce":628358795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.45:6804","nonce":628358795}]},"public_addr":"10.20.193.45:6800/628358795","cluster_addr":"10.20.193.45:6802/628358795","heartbeat_back_addr":"10.20.193.45:6806/628358795","heartbeat_front_addr":"10.20.193.45:6804/628358795","state":["exists","up"]},{"osd":2,"uuid":"bfcf94e1-2623-4443-aaf8-f525210ab7b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.45:6808","nonce":2128209266}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.45:6809","nonce":2128209266}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.45:6811","nonce":2128209266}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.45:6810","nonce":2128209266}]},"public_addr":"10.20.193.45:6808/2128209266","cluster_addr":"10.20.193.45:6809/2128209266","heartbeat_back_addr":"10.20.193.45:6811/2128209266","heartbeat_front_addr":"10.20.193.45:6810/2128209266","state":["exists","up"]},{"osd":3,"uuid":"32e9109d-09f0-4c75-bfbe-bb0fa237ca08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.73:6805","nonce":3607388566}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.73:6806","nonce":3607388566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.73:6808","nonce":3607388566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.73:6807","nonce":3607388566}]},"public_addr":"10.20.193.73:6805/3607388566","cluster_addr":"10.20.193.73:6806/3607388566","heartbeat_back_addr":"10.20.193.73:6808/3607388566","heartbeat_front_addr":"10.20.193.73:6807/3607388566","state":["exists","up"]},{"osd":4,"uuid":"311ec782-d282-48e9-9545-41ac3acb1ac8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.73:6801","nonce":3756325394}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.73:6802","nonce":3756325394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.73:6804","nonce":3756325394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.73:6803","nonce":3756325394}]},"public_addr":"10.20.193.73:6801/3756325394","cluster_addr":"10.20.193.73:6802/3756325394","heartbeat_back_addr":"10.20.193.73:6804/3756325394","heartbeat_front_addr":"10.20.193.73:6803/3756325394","state":["exists","up"]},{"osd":5,"uuid":"4569df35-5988-4308-9e5d-a6b26171c346","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.73:6809","nonce":1794330816}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.73:6810","nonce":1794330816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.73:6812","nonce":1794330816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.73:6811","nonce":1794330816}]},"public_addr":"10.20.193.73:6809/1794330816","cluster_addr":"10.20.193.73:6810/1794330816","heartbeat_back_addr":"10.20.193.73:6812/1794330816","heartbeat_front_addr":"10.20.193.73:6811/1794330816","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-22T23:25:32.907422+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-22T23:25:33.439017+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-22T23:25:32.880978+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-22T23:25:32.610909+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-22T23:25:32.663485+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-22T23:25:33.016218+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-22T23:25:45.127 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.124+0000 7fc1fa933640 1 -- 10.20.193.45:0/2094208182 >> v1:10.20.193.73:6800/2222410180 conn(0x7fc1c40401f0 legacy=0x7fc1c40426b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:45.127 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.124+0000 7fc1fa933640 10 monclient: shutdown 2026-02-22T23:25:45.127 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.124+0000 7fc1fa933640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T23:25:45.127 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.124+0000 7fc1fa933640 1 -- 10.20.193.45:0/2094208182 >> v1:10.20.193.45:6791/0 conn(0x7fc1f40a4c90 legacy=0x7fc1f413ee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:45.127 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.124+0000 7fc1fa933640 1 -- 10.20.193.45:0/2094208182 shutdown_connections 2026-02-22T23:25:45.127 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.124+0000 7fc1fa933640 1 -- 10.20.193.45:0/2094208182 >> 10.20.193.45:0/2094208182 conn(0x7fc1f40a9720 msgr2=0x7fc1f409f270 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:25:45.127 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.124+0000 7fc1fa933640 1 -- 10.20.193.45:0/2094208182 shutdown_connections 2026-02-22T23:25:45.127 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.124+0000 7fc1fa933640 1 -- 10.20.193.45:0/2094208182 wait complete. 2026-02-22T23:25:45.134 INFO:tasks.ceph.ceph_manager.ceph:all up! 2026-02-22T23:25:45.135 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-22T23:25:45.204 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.203+0000 7f521a95c640 10 monclient: get_monmap_and_config 2026-02-22T23:25:45.204 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.203+0000 7f521a95c640 10 monclient: build_initial_monmap 2026-02-22T23:25:45.204 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.203+0000 7f521a95c640 10 monclient: monmap: 2026-02-22T23:25:45.204 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-22T23:25:45.204 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:45.204 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:25:45.204463+0000 2026-02-22T23:25:45.204 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:25:45.204463+0000 2026-02-22T23:25:45.204 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-22T23:25:45.204 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:45.204 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-22T23:25:45.204 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.noname-f 2026-02-22T23:25:45.204 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.noname-b 2026-02-22T23:25:45.204 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.noname-g 2026-02-22T23:25:45.204 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.noname-c 2026-02-22T23:25:45.204 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.noname-h 2026-02-22T23:25:45.204 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.noname-d 2026-02-22T23:25:45.204 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.noname-i 2026-02-22T23:25:45.204 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.noname-e 2026-02-22T23:25:45.204 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:45.205 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.203+0000 7f521a95c640 1 Processor -- start 2026-02-22T23:25:45.205 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.203+0000 7f521a95c640 1 -- start start 2026-02-22T23:25:45.205 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.203+0000 7f521a95c640 10 monclient: init 2026-02-22T23:25:45.205 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.203+0000 7f521a95c640 10 monclient: _reopen_session rank -1 2026-02-22T23:25:45.206 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.203+0000 7f521a95c640 10 monclient: _add_conns ranks=[1,4,3,5,6,0,2,7,8] 2026-02-22T23:25:45.206 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.204+0000 7f521a95c640 10 monclient(hunting): picked mon.noname-f con 0x7f52140a5e00 addr v1:10.20.193.73:6789/0 2026-02-22T23:25:45.206 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.204+0000 7f521a95c640 10 monclient(hunting): picked mon.noname-c con 0x7f52140a68f0 addr v1:10.20.193.45:6791/0 2026-02-22T23:25:45.206 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.204+0000 7f521a95c640 10 monclient(hunting): picked mon.noname-g con 0x7f52140a6d00 addr v1:10.20.193.73:6790/0 2026-02-22T23:25:45.206 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.204+0000 7f521a95c640 1 -- --> v1:10.20.193.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f52140a2d00 con 0x7f52140a5e00 2026-02-22T23:25:45.206 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.204+0000 7f521a95c640 1 -- --> v1:10.20.193.73:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f52140a2fe0 con 0x7f52140a6d00 2026-02-22T23:25:45.206 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.204+0000 7f521a95c640 1 -- --> v1:10.20.193.45:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f52140a32c0 con 0x7f52140a68f0 2026-02-22T23:25:45.206 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.204+0000 7f521a95c640 10 monclient(hunting): _renew_subs 2026-02-22T23:25:45.206 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.204+0000 7f521a95c640 10 monclient(hunting): authenticate will time out at 676.821053s 2026-02-22T23:25:45.206 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.204+0000 7f52137fe640 1 --1- >> v1:10.20.193.45:6791/0 conn(0x7f52140a68f0 0x7f521413e080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.45:6791/0 says I am v1:10.20.193.45:37858/0 (socket says 10.20.193.45:37858) 2026-02-22T23:25:45.206 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.204+0000 7f52137fe640 1 -- 10.20.193.45:0/1128619685 learned_addr learned my addr 10.20.193.45:0/1128619685 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-22T23:25:45.206 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.204+0000 7f5212ffd640 1 -- 10.20.193.45:0/1128619685 <== mon.4 v1:10.20.193.45:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 545176262 0 0) 0x7f52140a32c0 con 0x7f52140a68f0 2026-02-22T23:25:45.206 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.204+0000 7f5212ffd640 10 monclient(hunting): _negotiate 2026-02-22T23:25:45.206 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.204+0000 7f5212ffd640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:45.206 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.204+0000 7f5212ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:45.206 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.204+0000 7f5212ffd640 10 monclient(hunting): my global_id is 4261 2026-02-22T23:25:45.206 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.204+0000 7f5212ffd640 1 -- 10.20.193.45:0/1128619685 --> v1:10.20.193.45:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f51f8003620 con 0x7f52140a68f0 2026-02-22T23:25:45.206 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.204+0000 7f5212ffd640 1 -- 10.20.193.45:0/1128619685 <== mon.4 v1:10.20.193.45:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 579499605 0 0) 0x7f51f8003620 con 0x7f52140a68f0 2026-02-22T23:25:45.206 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.204+0000 7f5212ffd640 1 -- 10.20.193.45:0/1128619685 >> v1:10.20.193.73:6790/0 conn(0x7f52140a6d00 legacy=0x7f52141417b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:45.206 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.204+0000 7f5212ffd640 1 -- 10.20.193.45:0/1128619685 >> v1:10.20.193.73:6789/0 conn(0x7f52140a5e00 legacy=0x7f52140a61e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T23:25:45.206 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.204+0000 7f5212ffd640 10 monclient: _finish_hunting 0 2026-02-22T23:25:45.206 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.204+0000 7f5212ffd640 1 monclient: found mon.noname-c 2026-02-22T23:25:45.206 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.204+0000 7f5212ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T23:25:45.206 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.204+0000 7f5212ffd640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.45:6791/0 2026-02-22T23:25:45.206 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.204+0000 7f5212ffd640 1 -- 10.20.193.45:0/1128619685 --> v1:10.20.193.45:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52140a35a0 con 0x7f52140a68f0 2026-02-22T23:25:45.206 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.204+0000 7f5212ffd640 10 monclient: _finish_auth 0 2026-02-22T23:25:45.206 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.204+0000 7f5212ffd640 10 monclient: _check_auth_tickets 2026-02-22T23:25:45.206 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.204+0000 7f5212ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T23:25:45.206 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.204+0000 7f5212ffd640 1 -- 10.20.193.45:0/1128619685 <== mon.4 v1:10.20.193.45:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f5204003040 con 0x7f52140a68f0 2026-02-22T23:25:45.206 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.204+0000 7f5212ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:25:45.206 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.204+0000 7f5212ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-22T23:25:45.206 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.204+0000 7f5212ffd640 10 monclient: dump: 2026-02-22T23:25:45.206 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:45.206 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:45.206 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:45.207 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:45.207 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:45.207 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:45.207 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:45.207 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:45.207 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:45.207 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:45.207 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:45.207 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:45.207 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:45.207 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:45.207 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:45.207 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:45.207 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.204+0000 7f521a95c640 5 monclient: authenticate success, global_id 4261 2026-02-22T23:25:45.207 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.204+0000 7f521a95c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-22T23:25:45.207 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.204+0000 7f5212ffd640 1 -- 10.20.193.45:0/1128619685 <== mon.4 v1:10.20.193.45:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f52040032a0 con 0x7f52140a68f0 2026-02-22T23:25:45.207 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.204+0000 7f5212ffd640 10 monclient: handle_config config(0 keys) 2026-02-22T23:25:45.207 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.204+0000 7f5212ffd640 1 -- 10.20.193.45:0/1128619685 <== mon.4 v1:10.20.193.45:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f5204003550 con 0x7f52140a68f0 2026-02-22T23:25:45.207 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.204+0000 7f521a95c640 10 monclient: get_monmap_and_config success 2026-02-22T23:25:45.207 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.204+0000 7f521a95c640 4 set_mon_vals no callback set 2026-02-22T23:25:45.207 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.204+0000 7f5212ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:25:45.207 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.204+0000 7f5212ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T23:25:45.207 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.204+0000 7f5212ffd640 10 monclient: dump: 2026-02-22T23:25:45.207 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:45.207 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:45.207 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:45.207 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:45.207 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:45.207 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:45.207 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:45.207 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:45.207 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:45.207 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:45.207 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:45.207 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:45.207 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:45.207 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:45.207 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:45.207 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:45.207 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.204+0000 7f521a95c640 10 monclient: shutdown 2026-02-22T23:25:45.208 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.204+0000 7f521a95c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T23:25:45.208 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.204+0000 7f521a95c640 1 -- 10.20.193.45:0/1128619685 >> v1:10.20.193.45:6791/0 conn(0x7f52140a68f0 legacy=0x7f521413e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:45.208 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.204+0000 7f521a95c640 1 -- 10.20.193.45:0/1128619685 shutdown_connections 2026-02-22T23:25:45.208 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.204+0000 7f521a95c640 1 -- 10.20.193.45:0/1128619685 >> 10.20.193.45:0/1128619685 conn(0x7f52140abb50 msgr2=0x7f52140a7f00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:25:45.208 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.204+0000 7f521a95c640 1 -- 10.20.193.45:0/1128619685 shutdown_connections 2026-02-22T23:25:45.208 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.204+0000 7f521a95c640 1 -- 10.20.193.45:0/1128619685 wait complete. 2026-02-22T23:25:45.208 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.205+0000 7f521a95c640 10 monclient: build_initial_monmap 2026-02-22T23:25:45.208 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.205+0000 7f521a95c640 10 monclient: monmap: 2026-02-22T23:25:45.208 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-22T23:25:45.208 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T23:25:45.208 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-22T23:25:45.208 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-22T23:25:45.208 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-22T23:25:45.208 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-22T23:25:45.208 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-22T23:25:45.208 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.noname-f 2026-02-22T23:25:45.208 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.noname-b 2026-02-22T23:25:45.208 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.noname-g 2026-02-22T23:25:45.208 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.noname-c 2026-02-22T23:25:45.208 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.noname-h 2026-02-22T23:25:45.208 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.noname-d 2026-02-22T23:25:45.208 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.noname-i 2026-02-22T23:25:45.208 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.noname-e 2026-02-22T23:25:45.208 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:45.209 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.205+0000 7f521a95c640 1 Processor -- start 2026-02-22T23:25:45.209 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.205+0000 7f521a95c640 1 -- start start 2026-02-22T23:25:45.209 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.205+0000 7f521a95c640 10 monclient: init 2026-02-22T23:25:45.209 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.205+0000 7f521a95c640 10 monclient: _reopen_session rank -1 2026-02-22T23:25:45.209 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.205+0000 7f521a95c640 10 monclient: _add_conns ranks=[1,5,7,3,8,6,4,2,0] 2026-02-22T23:25:45.209 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.205+0000 7f521a95c640 10 monclient(hunting): picked mon.noname-f con 0x7f52140a5e00 addr v1:10.20.193.73:6789/0 2026-02-22T23:25:45.209 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.205+0000 7f521a95c640 10 monclient(hunting): picked mon.noname-h con 0x7f52140a68f0 addr v1:10.20.193.73:6791/0 2026-02-22T23:25:45.209 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.205+0000 7f521a95c640 10 monclient(hunting): picked mon.noname-i con 0x7f52140a6d00 addr v1:10.20.193.73:6792/0 2026-02-22T23:25:45.209 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.205+0000 7f521a95c640 1 -- --> v1:10.20.193.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f52140aa160 con 0x7f52140a5e00 2026-02-22T23:25:45.210 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.205+0000 7f521a95c640 1 -- --> v1:10.20.193.73:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f52140a9c10 con 0x7f52140a68f0 2026-02-22T23:25:45.210 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.205+0000 7f521a95c640 1 -- --> v1:10.20.193.73:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f52141277f0 con 0x7f52140a6d00 2026-02-22T23:25:45.210 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.205+0000 7f521a95c640 10 monclient(hunting): _renew_subs 2026-02-22T23:25:45.210 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.205+0000 7f521a95c640 10 monclient(hunting): authenticate will time out at 676.822635s 2026-02-22T23:25:45.210 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.205+0000 7f5213fff640 1 --1- >> v1:10.20.193.73:6789/0 conn(0x7f52140a5e00 0x7f5214125270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.73:6789/0 says I am v1:10.20.193.45:44242/0 (socket says 10.20.193.45:44242) 2026-02-22T23:25:45.210 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.205+0000 7f5213fff640 1 -- 10.20.193.45:0/2547881925 learned_addr learned my addr 10.20.193.45:0/2547881925 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-22T23:25:45.210 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.206+0000 7f5210ff9640 1 -- 10.20.193.45:0/2547881925 <== mon.5 v1:10.20.193.73:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2134592229 0 0) 0x7f52140a9c10 con 0x7f52140a68f0 2026-02-22T23:25:45.210 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.206+0000 7f5210ff9640 10 monclient(hunting): _negotiate 2026-02-22T23:25:45.210 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.206+0000 7f5210ff9640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:45.210 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.206+0000 7f5210ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:45.210 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.206+0000 7f5210ff9640 10 monclient(hunting): my global_id is 4253 2026-02-22T23:25:45.210 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.206+0000 7f5210ff9640 1 -- 10.20.193.45:0/2547881925 --> v1:10.20.193.73:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f51e4003620 con 0x7f52140a68f0 2026-02-22T23:25:45.210 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.206+0000 7f5210ff9640 1 -- 10.20.193.45:0/2547881925 <== mon.5 v1:10.20.193.73:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2053808688 0 0) 0x7f51e4003620 con 0x7f52140a68f0 2026-02-22T23:25:45.210 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.206+0000 7f5210ff9640 1 -- 10.20.193.45:0/2547881925 --> v1:10.20.193.73:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f52140a9c10 con 0x7f52140a68f0 2026-02-22T23:25:45.210 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.206+0000 7f5210ff9640 1 -- 10.20.193.45:0/2547881925 <== mon.5 v1:10.20.193.73:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f5204003000 con 0x7f52140a68f0 2026-02-22T23:25:45.210 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.206+0000 7f5210ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-22T23:25:45.210 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.206+0000 7f5210ff9640 10 monclient(hunting): got monmap 1 from mon.noname-h (according to old e1) 2026-02-22T23:25:45.210 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.206+0000 7f5210ff9640 10 monclient(hunting): dump: 2026-02-22T23:25:45.210 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:45.210 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:45.210 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:45.210 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:45.210 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:45.210 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:45.210 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:45.210 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:45.210 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:45.210 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:45.210 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:45.210 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:45.210 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:45.210 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:45.210 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:45.210 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:45.210 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.206+0000 7f5210ff9640 10 monclient(hunting): _finish_auth 0 2026-02-22T23:25:45.210 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.206+0000 7f5210ff9640 1 -- 10.20.193.45:0/2547881925 <== mon.1 v1:10.20.193.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 978089270 0 0) 0x7f52140aa160 con 0x7f52140a5e00 2026-02-22T23:25:45.210 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.206+0000 7f5210ff9640 10 monclient(hunting): _negotiate 2026-02-22T23:25:45.210 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.206+0000 7f5210ff9640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:45.210 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.206+0000 7f5210ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:45.210 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.206+0000 7f5210ff9640 10 monclient(hunting): my global_id is 4294 2026-02-22T23:25:45.211 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.206+0000 7f5210ff9640 1 -- 10.20.193.45:0/2547881925 --> v1:10.20.193.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f51e4003620 con 0x7f52140a5e00 2026-02-22T23:25:45.211 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.206+0000 7f5210ff9640 1 -- 10.20.193.45:0/2547881925 <== mon.5 v1:10.20.193.73:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 233462799 0 0) 0x7f52140a9c10 con 0x7f52140a68f0 2026-02-22T23:25:45.211 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.206+0000 7f5210ff9640 1 -- 10.20.193.45:0/2547881925 >> v1:10.20.193.73:6792/0 conn(0x7f52140a6d00 legacy=0x7f52141d7d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:45.211 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.206+0000 7f5210ff9640 1 -- 10.20.193.45:0/2547881925 >> v1:10.20.193.73:6789/0 conn(0x7f52140a5e00 legacy=0x7f5214125270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:45.211 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.206+0000 7f5210ff9640 10 monclient: _finish_hunting 0 2026-02-22T23:25:45.211 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.206+0000 7f5210ff9640 1 monclient: found mon.h 2026-02-22T23:25:45.211 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.206+0000 7f5210ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T23:25:45.211 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.206+0000 7f5210ff9640 10 monclient: _send_mon_message to mon.h at v1:10.20.193.73:6791/0 2026-02-22T23:25:45.211 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.206+0000 7f5210ff9640 1 -- 10.20.193.45:0/2547881925 --> v1:10.20.193.73:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5214126090 con 0x7f52140a68f0 2026-02-22T23:25:45.211 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.206+0000 7f5210ff9640 10 monclient: _finish_auth 0 2026-02-22T23:25:45.211 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.206+0000 7f5210ff9640 10 monclient: _check_auth_tickets 2026-02-22T23:25:45.211 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.206+0000 7f5210ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T23:25:45.211 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.206+0000 7f521a95c640 5 monclient: authenticate success, global_id 4253 2026-02-22T23:25:45.211 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.206+0000 7f521a95c640 10 monclient: _renew_subs 2026-02-22T23:25:45.211 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.206+0000 7f521a95c640 10 monclient: _send_mon_message to mon.h at v1:10.20.193.73:6791/0 2026-02-22T23:25:45.211 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.206+0000 7f521a95c640 1 -- 10.20.193.45:0/2547881925 --> v1:10.20.193.73:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f5214128c70 con 0x7f52140a68f0 2026-02-22T23:25:45.211 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.206+0000 7f521a95c640 10 monclient: _renew_subs 2026-02-22T23:25:45.211 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.206+0000 7f521a95c640 10 monclient: _send_mon_message to mon.h at v1:10.20.193.73:6791/0 2026-02-22T23:25:45.211 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.206+0000 7f521a95c640 1 -- 10.20.193.45:0/2547881925 --> v1:10.20.193.73:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7f5214141b90 con 0x7f52140a68f0 2026-02-22T23:25:45.211 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.206+0000 7f5210ff9640 1 -- 10.20.193.45:0/2547881925 <== mon.5 v1:10.20.193.73:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5204003220 con 0x7f52140a68f0 2026-02-22T23:25:45.211 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.206+0000 7f5210ff9640 10 monclient: handle_config config(0 keys) 2026-02-22T23:25:45.211 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.206+0000 7f5210ff9640 1 -- 10.20.193.45:0/2547881925 <== mon.5 v1:10.20.193.73:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f5204005140 con 0x7f52140a68f0 2026-02-22T23:25:45.211 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.206+0000 7f5210ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:25:45.211 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.206+0000 7f5210ff9640 10 monclient: got monmap 1 from mon.h (according to old e1) 2026-02-22T23:25:45.211 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.206+0000 7f52127fc640 4 set_mon_vals no callback set 2026-02-22T23:25:45.211 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.206+0000 7f5210ff9640 10 monclient: dump: 2026-02-22T23:25:45.211 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:45.211 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:45.211 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:45.211 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:45.211 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:45.211 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:45.211 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:45.211 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:45.211 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:45.211 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:45.211 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:45.211 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:45.211 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:45.211 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:45.212 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:45.212 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:45.212 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.206+0000 7f521a95c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T23:25:45.212 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.206+0000 7f521a95c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T23:25:45.212 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.206+0000 7f521a95c640 10 monclient: _send_mon_message to mon.h at v1:10.20.193.73:6791/0 2026-02-22T23:25:45.212 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.206+0000 7f521a95c640 1 -- 10.20.193.45:0/2547881925 --> v1:10.20.193.73:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5214128990 con 0x7f52140a68f0 2026-02-22T23:25:45.212 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.207+0000 7f5210ff9640 1 -- 10.20.193.45:0/2547881925 <== mon.5 v1:10.20.193.73:6791/0 7 ==== mgrmap(e 5) ==== 50225+0+0 (unknown 2330357642 0 0) 0x7f5204011720 con 0x7f52140a68f0 2026-02-22T23:25:45.212 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.207+0000 7f5210ff9640 1 -- 10.20.193.45:0/2547881925 <== mon.5 v1:10.20.193.73:6791/0 8 ==== osd_map(19..19 src has 1..19) ==== 3558+0+0 (unknown 1288710973 0 0) 0x7f520404dd70 con 0x7f52140a68f0 2026-02-22T23:25:45.212 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.207+0000 7f5213fff640 10 monclient: get_auth_request con 0x7f51e403f790 auth_method 0 2026-02-22T23:25:45.212 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.210+0000 7f5210ff9640 1 -- 10.20.193.45:0/2547881925 <== mon.5 v1:10.20.193.73:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (unknown 1092875540 0 2568732696) 0x7f5204017810 con 0x7f52140a68f0 2026-02-22T23:25:45.212 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.210+0000 7f5210ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T23:25:45.212 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.210+0000 7f5210ff9640 10 monclient: _finish_command 1 = system:0 2026-02-22T23:25:45.296 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.295+0000 7f521a95c640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2026-02-22T23:25:45.296 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.295+0000 7f521a95c640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-22T23:25:45.296 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.295+0000 7f521a95c640 10 monclient: _send_mon_message to mon.h at v1:10.20.193.73:6791/0 2026-02-22T23:25:45.296 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.295+0000 7f521a95c640 1 -- 10.20.193.45:0/2547881925 --> v1:10.20.193.73:6791/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5214127aa0 con 0x7f52140a68f0 2026-02-22T23:25:45.296 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.295+0000 7f5210ff9640 1 -- 10.20.193.45:0/2547881925 <== mon.5 v1:10.20.193.73:6791/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) ==== 74+0+10931 (unknown 941590788 0 2623996707) 0x7f520401b460 con 0x7f52140a68f0 2026-02-22T23:25:45.297 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.295+0000 7f5210ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-22T23:25:45.297 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.295+0000 7f5210ff9640 10 monclient: _finish_command 2 = system:0 2026-02-22T23:25:45.297 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-22T23:25:45.297 INFO:teuthology.orchestra.run.trial045.stdout:{"epoch":19,"fsid":"4b60f18f-6660-4731-b731-dc85c4078413","created":"2026-02-22T23:25:25.062615+0000","modified":"2026-02-22T23:25:44.732868+0000","last_up_change":"2026-02-22T23:25:34.696475+0000","last_in_change":"2026-02-22T23:25:26.208612+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-22T23:25:35.209511+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6.059999942779541,"score_stable":6.059999942779541,"optimal_score":0.33000001311302185,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2026-02-22T23:25:40.737184+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":19,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ef9d15a7-661e-40c5-a418-7f794c0975b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.45:6801","nonce":1146005631}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.45:6803","nonce":1146005631}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.45:6807","nonce":1146005631}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.45:6805","nonce":1146005631}]},"public_addr":"10.20.193.45:6801/1146005631","cluster_addr":"10.20.193.45:6803/1146005631","heartbeat_back_addr":"10.20.193.45:6807/1146005631","heartbeat_front_addr":"10.20.193.45:6805/1146005631","state":["exists","up"]},{"osd":1,"uuid":"9e62cdef-b0a0-4f67-a778-ac4f7d97ed7e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.45:6800","nonce":628358795}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.45:6802","nonce":628358795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.45:6806","nonce":628358795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.45:6804","nonce":628358795}]},"public_addr":"10.20.193.45:6800/628358795","cluster_addr":"10.20.193.45:6802/628358795","heartbeat_back_addr":"10.20.193.45:6806/628358795","heartbeat_front_addr":"10.20.193.45:6804/628358795","state":["exists","up"]},{"osd":2,"uuid":"bfcf94e1-2623-4443-aaf8-f525210ab7b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.45:6808","nonce":2128209266}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.45:6809","nonce":2128209266}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.45:6811","nonce":2128209266}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.45:6810","nonce":2128209266}]},"public_addr":"10.20.193.45:6808/2128209266","cluster_addr":"10.20.193.45:6809/2128209266","heartbeat_back_addr":"10.20.193.45:6811/2128209266","heartbeat_front_addr":"10.20.193.45:6810/2128209266","state":["exists","up"]},{"osd":3,"uuid":"32e9109d-09f0-4c75-bfbe-bb0fa237ca08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.73:6805","nonce":3607388566}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.73:6806","nonce":3607388566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.73:6808","nonce":3607388566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.73:6807","nonce":3607388566}]},"public_addr":"10.20.193.73:6805/3607388566","cluster_addr":"10.20.193.73:6806/3607388566","heartbeat_back_addr":"10.20.193.73:6808/3607388566","heartbeat_front_addr":"10.20.193.73:6807/3607388566","state":["exists","up"]},{"osd":4,"uuid":"311ec782-d282-48e9-9545-41ac3acb1ac8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.73:6801","nonce":3756325394}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.73:6802","nonce":3756325394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.73:6804","nonce":3756325394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.73:6803","nonce":3756325394}]},"public_addr":"10.20.193.73:6801/3756325394","cluster_addr":"10.20.193.73:6802/3756325394","heartbeat_back_addr":"10.20.193.73:6804/3756325394","heartbeat_front_addr":"10.20.193.73:6803/3756325394","state":["exists","up"]},{"osd":5,"uuid":"4569df35-5988-4308-9e5d-a6b26171c346","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.73:6809","nonce":1794330816}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.73:6810","nonce":1794330816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.73:6812","nonce":1794330816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.73:6811","nonce":1794330816}]},"public_addr":"10.20.193.73:6809/1794330816","cluster_addr":"10.20.193.73:6810/1794330816","heartbeat_back_addr":"10.20.193.73:6812/1794330816","heartbeat_front_addr":"10.20.193.73:6811/1794330816","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-22T23:25:32.907422+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-22T23:25:33.439017+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-22T23:25:32.880978+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-22T23:25:32.610909+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-22T23:25:32.663485+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-22T23:25:33.016218+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-22T23:25:45.298 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.295+0000 7f521a95c640 1 -- 10.20.193.45:0/2547881925 >> v1:10.20.193.73:6800/2222410180 conn(0x7f51e403f790 legacy=0x7f51e4041c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:45.298 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.295+0000 7f521a95c640 10 monclient: shutdown 2026-02-22T23:25:45.298 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.295+0000 7f521a95c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T23:25:45.298 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.295+0000 7f521a95c640 1 -- 10.20.193.45:0/2547881925 >> v1:10.20.193.73:6791/0 conn(0x7f52140a68f0 legacy=0x7f5214125980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:45.298 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.295+0000 7f521a95c640 1 -- 10.20.193.45:0/2547881925 shutdown_connections 2026-02-22T23:25:45.299 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.295+0000 7f521a95c640 1 -- 10.20.193.45:0/2547881925 >> 10.20.193.45:0/2547881925 conn(0x7f52140abb50 msgr2=0x7f5214142610 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:25:45.299 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.295+0000 7f521a95c640 1 -- 10.20.193.45:0/2547881925 shutdown_connections 2026-02-22T23:25:45.299 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.295+0000 7f521a95c640 1 -- 10.20.193.45:0/2547881925 wait complete. 2026-02-22T23:25:45.306 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2026-02-22T23:25:45.307 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2026-02-22T23:25:45.307 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2026-02-22T23:25:45.308 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2026-02-22T23:25:45.308 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2026-02-22T23:25:45.309 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2026-02-22T23:25:45.378 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.377+0000 7fba35fce640 10 monclient: get_monmap_and_config 2026-02-22T23:25:45.378 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.377+0000 7fba35fce640 10 monclient: build_initial_monmap 2026-02-22T23:25:45.379 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.377+0000 7fba35fce640 10 monclient: monmap: 2026-02-22T23:25:45.379 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-22T23:25:45.379 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:45.379 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:25:45.378934+0000 2026-02-22T23:25:45.379 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:25:45.378934+0000 2026-02-22T23:25:45.379 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-22T23:25:45.379 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:45.379 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-22T23:25:45.379 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.noname-f 2026-02-22T23:25:45.379 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.noname-b 2026-02-22T23:25:45.379 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.noname-g 2026-02-22T23:25:45.379 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.noname-c 2026-02-22T23:25:45.379 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.noname-h 2026-02-22T23:25:45.379 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.noname-d 2026-02-22T23:25:45.379 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.noname-i 2026-02-22T23:25:45.379 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.noname-e 2026-02-22T23:25:45.379 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:45.380 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.379+0000 7f88996a3640 10 monclient: get_monmap_and_config 2026-02-22T23:25:45.380 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.379+0000 7f88996a3640 10 monclient: build_initial_monmap 2026-02-22T23:25:45.380 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.379+0000 7f88996a3640 10 monclient: monmap: 2026-02-22T23:25:45.380 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-22T23:25:45.380 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:45.380 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:25:45.379289+0000 2026-02-22T23:25:45.380 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:25:45.379289+0000 2026-02-22T23:25:45.380 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-22T23:25:45.380 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:45.380 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-22T23:25:45.380 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.noname-f 2026-02-22T23:25:45.380 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.noname-b 2026-02-22T23:25:45.380 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.noname-g 2026-02-22T23:25:45.380 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.noname-c 2026-02-22T23:25:45.380 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.noname-h 2026-02-22T23:25:45.380 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.noname-d 2026-02-22T23:25:45.381 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.noname-i 2026-02-22T23:25:45.381 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.noname-e 2026-02-22T23:25:45.381 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:45.381 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.379+0000 7fba35fce640 1 Processor -- start 2026-02-22T23:25:45.381 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.379+0000 7fba35fce640 1 -- start start 2026-02-22T23:25:45.381 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.379+0000 7fba35fce640 10 monclient: init 2026-02-22T23:25:45.381 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.379+0000 7f88996a3640 1 Processor -- start 2026-02-22T23:25:45.381 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.379+0000 7f88996a3640 1 -- start start 2026-02-22T23:25:45.381 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.379+0000 7f88996a3640 10 monclient: init 2026-02-22T23:25:45.382 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.379+0000 7fba35fce640 10 monclient: _reopen_session rank -1 2026-02-22T23:25:45.382 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.379+0000 7fba35fce640 10 monclient: _add_conns ranks=[6,4,1,0,8,5,3,2,7] 2026-02-22T23:25:45.382 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.379+0000 7fba35fce640 10 monclient(hunting): picked mon.noname-d con 0x7fba300a4b30 addr v1:10.20.193.45:6792/0 2026-02-22T23:25:45.382 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.379+0000 7fba35fce640 10 monclient(hunting): picked mon.noname-c con 0x7fba300a0f60 addr v1:10.20.193.45:6791/0 2026-02-22T23:25:45.382 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.379+0000 7fba35fce640 10 monclient(hunting): picked mon.noname-f con 0x7fba300a5620 addr v1:10.20.193.73:6789/0 2026-02-22T23:25:45.382 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.379+0000 7f0c492c4640 10 monclient: get_monmap_and_config 2026-02-22T23:25:45.382 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.379+0000 7f0c492c4640 10 monclient: build_initial_monmap 2026-02-22T23:25:45.382 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.379+0000 7f0c492c4640 10 monclient: monmap: 2026-02-22T23:25:45.382 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-22T23:25:45.383 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:45.383 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:25:45.379911+0000 2026-02-22T23:25:45.383 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:25:45.379911+0000 2026-02-22T23:25:45.383 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-22T23:25:45.383 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:45.383 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-22T23:25:45.383 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.noname-f 2026-02-22T23:25:45.383 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.noname-b 2026-02-22T23:25:45.383 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.noname-g 2026-02-22T23:25:45.383 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.noname-c 2026-02-22T23:25:45.383 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.noname-h 2026-02-22T23:25:45.383 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.noname-d 2026-02-22T23:25:45.383 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.noname-i 2026-02-22T23:25:45.383 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.noname-e 2026-02-22T23:25:45.383 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:45.384 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.379+0000 7fba35fce640 1 -- --> v1:10.20.193.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba300a13b0 con 0x7fba300a5620 2026-02-22T23:25:45.384 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.379+0000 7fba35fce640 1 -- --> v1:10.20.193.45:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba300a2cf0 con 0x7fba300a0f60 2026-02-22T23:25:45.384 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.379+0000 7fba35fce640 1 -- --> v1:10.20.193.45:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba300a3480 con 0x7fba300a4b30 2026-02-22T23:25:45.384 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.379+0000 7fba35fce640 10 monclient(hunting): _renew_subs 2026-02-22T23:25:45.384 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.379+0000 7fba35fce640 10 monclient(hunting): authenticate will time out at 676.995760s 2026-02-22T23:25:45.384 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.379+0000 7fba2f7fe640 1 --1- >> v1:10.20.193.45:6792/0 conn(0x7fba300a4b30 0x7fba300a4f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.45:6792/0 says I am v1:10.20.193.45:56808/0 (socket says 10.20.193.45:56808) 2026-02-22T23:25:45.384 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.379+0000 7fba2effd640 1 --1- >> v1:10.20.193.45:6791/0 conn(0x7fba300a0f60 0x7fba3013bd30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.45:6791/0 says I am v1:10.20.193.45:37864/0 (socket says 10.20.193.45:37864) 2026-02-22T23:25:45.384 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.379+0000 7fba2f7fe640 1 -- 10.20.193.45:0/1487331920 learned_addr learned my addr 10.20.193.45:0/1487331920 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-22T23:25:45.384 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.379+0000 7f88996a3640 10 monclient: _reopen_session rank -1 2026-02-22T23:25:45.384 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.379+0000 7f88996a3640 10 monclient: _add_conns ranks=[8,5,1,6,0,2,3,4,7] 2026-02-22T23:25:45.384 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.379+0000 7f88996a3640 10 monclient(hunting): picked mon.noname-e con 0x7f8894138d30 addr v1:10.20.193.45:6793/0 2026-02-22T23:25:45.384 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.379+0000 7f88996a3640 10 monclient(hunting): picked mon.noname-h con 0x7f889413bc10 addr v1:10.20.193.73:6791/0 2026-02-22T23:25:45.384 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.379+0000 7f88996a3640 10 monclient(hunting): picked mon.noname-f con 0x7f889413f720 addr v1:10.20.193.73:6789/0 2026-02-22T23:25:45.385 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.379+0000 7fba2e7fc640 1 -- 10.20.193.45:0/1487331920 <== mon.4 v1:10.20.193.45:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3807846839 0 0) 0x7fba300a2cf0 con 0x7fba300a0f60 2026-02-22T23:25:45.385 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.379+0000 7fba2e7fc640 10 monclient(hunting): _negotiate 2026-02-22T23:25:45.385 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.379+0000 7f88996a3640 1 -- --> v1:10.20.193.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8894139820 con 0x7f889413f720 2026-02-22T23:25:45.385 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.379+0000 7fba2e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:45.385 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.379+0000 7fba2e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:45.385 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.379+0000 7fba2e7fc640 10 monclient(hunting): my global_id is 4270 2026-02-22T23:25:45.385 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.379+0000 7fba2e7fc640 1 -- 10.20.193.45:0/1487331920 --> v1:10.20.193.45:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fba14003620 con 0x7fba300a0f60 2026-02-22T23:25:45.385 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.379+0000 7f88996a3640 1 -- --> v1:10.20.193.73:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f889406f210 con 0x7f889413bc10 2026-02-22T23:25:45.386 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.379+0000 7fba2e7fc640 1 -- 10.20.193.45:0/1487331920 <== mon.6 v1:10.20.193.45:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2846424533 0 0) 0x7fba300a3480 con 0x7fba300a4b30 2026-02-22T23:25:45.386 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.379+0000 7fba2e7fc640 10 monclient(hunting): _negotiate 2026-02-22T23:25:45.386 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.379+0000 7fba2e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:45.386 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.379+0000 7fba2e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:45.386 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.379+0000 7fba2e7fc640 10 monclient(hunting): my global_id is 4272 2026-02-22T23:25:45.386 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.379+0000 7fba2e7fc640 1 -- 10.20.193.45:0/1487331920 --> v1:10.20.193.45:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fba300a2cf0 con 0x7fba300a4b30 2026-02-22T23:25:45.386 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.379+0000 7f88996a3640 1 -- --> v1:10.20.193.45:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f88940a3400 con 0x7f8894138d30 2026-02-22T23:25:45.386 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.379+0000 7f88996a3640 10 monclient(hunting): _renew_subs 2026-02-22T23:25:45.386 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.379+0000 7f88996a3640 10 monclient(hunting): authenticate will time out at 676.996081s 2026-02-22T23:25:45.386 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.379+0000 7f8893fff640 1 --1- >> v1:10.20.193.45:6793/0 conn(0x7f8894138d30 0x7f8894139110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.45:6793/0 says I am v1:10.20.193.45:36670/0 (socket says 10.20.193.45:36670) 2026-02-22T23:25:45.386 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.379+0000 7f8893fff640 1 -- 10.20.193.45:0/3441057875 learned_addr learned my addr 10.20.193.45:0/3441057875 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-22T23:25:45.386 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.379+0000 7f0c492c4640 1 Processor -- start 2026-02-22T23:25:45.387 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.379+0000 7fba2e7fc640 1 -- 10.20.193.45:0/1487331920 <== mon.1 v1:10.20.193.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3563866157 0 0) 0x7fba24002ca0 con 0x7fba300a5620 2026-02-22T23:25:45.387 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.379+0000 7fba2e7fc640 10 monclient(hunting): _negotiate 2026-02-22T23:25:45.387 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.379+0000 7fba2e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:45.387 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.379+0000 7fba2e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:45.387 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.379+0000 7fba2e7fc640 10 monclient(hunting): my global_id is 4303 2026-02-22T23:25:45.387 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.379+0000 7fba2e7fc640 1 -- 10.20.193.45:0/1487331920 --> v1:10.20.193.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fba300a3480 con 0x7fba300a5620 2026-02-22T23:25:45.387 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.379+0000 7f0c492c4640 1 -- start start 2026-02-22T23:25:45.387 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.379+0000 7f0c492c4640 10 monclient: init 2026-02-22T23:25:45.387 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.379+0000 7fba2e7fc640 1 -- 10.20.193.45:0/1487331920 <== mon.4 v1:10.20.193.45:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1395923064 0 0) 0x7fba14003620 con 0x7fba300a0f60 2026-02-22T23:25:45.387 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.379+0000 7fba2e7fc640 1 -- 10.20.193.45:0/1487331920 >> v1:10.20.193.45:6792/0 conn(0x7fba300a4b30 legacy=0x7fba300a4f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:45.387 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.379+0000 7fba2e7fc640 1 -- 10.20.193.45:0/1487331920 >> v1:10.20.193.73:6789/0 conn(0x7fba300a5620 legacy=0x7fba3013f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:45.388 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.379+0000 7fba2e7fc640 10 monclient: _finish_hunting 0 2026-02-22T23:25:45.388 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.379+0000 7fba2e7fc640 1 monclient: found mon.noname-c 2026-02-22T23:25:45.388 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.379+0000 7fba2e7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T23:25:45.388 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.379+0000 7fba2e7fc640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.45:6791/0 2026-02-22T23:25:45.388 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.379+0000 7fba2e7fc640 1 -- 10.20.193.45:0/1487331920 --> v1:10.20.193.45:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba300a6360 con 0x7fba300a0f60 2026-02-22T23:25:45.388 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.379+0000 7fba2e7fc640 10 monclient: _finish_auth 0 2026-02-22T23:25:45.388 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.379+0000 7fba2e7fc640 10 monclient: _check_auth_tickets 2026-02-22T23:25:45.388 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.379+0000 7fba2e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T23:25:45.388 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.379+0000 7fba2e7fc640 1 -- 10.20.193.45:0/1487331920 <== mon.4 v1:10.20.193.45:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7fba20003040 con 0x7fba300a0f60 2026-02-22T23:25:45.388 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.379+0000 7fba2e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:25:45.388 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.379+0000 7fba2e7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-22T23:25:45.388 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.379+0000 7fba2e7fc640 10 monclient: dump: 2026-02-22T23:25:45.388 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:45.388 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:45.388 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:45.388 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:45.388 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:45.388 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:45.388 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:45.388 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:45.388 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:45.388 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:45.388 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:45.388 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:45.388 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:45.388 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:45.388 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:45.389 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:45.389 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.379+0000 7fba35fce640 5 monclient: authenticate success, global_id 4270 2026-02-22T23:25:45.389 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.379+0000 7fba35fce640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-22T23:25:45.389 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.379+0000 7f8892ffd640 1 -- 10.20.193.45:0/3441057875 <== mon.8 v1:10.20.193.45:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1826140909 0 0) 0x7f88940a3400 con 0x7f8894138d30 2026-02-22T23:25:45.389 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.379+0000 7f8892ffd640 10 monclient(hunting): _negotiate 2026-02-22T23:25:45.389 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.379+0000 7f8892ffd640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:45.389 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.379+0000 7f8892ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:45.389 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.379+0000 7f8892ffd640 10 monclient(hunting): my global_id is 4247 2026-02-22T23:25:45.389 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.379+0000 7fa09e816640 10 monclient: get_monmap_and_config 2026-02-22T23:25:45.389 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.379+0000 7fa09e816640 10 monclient: build_initial_monmap 2026-02-22T23:25:45.389 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.379+0000 7f8892ffd640 1 -- 10.20.193.45:0/3441057875 --> v1:10.20.193.45:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8878003620 con 0x7f8894138d30 2026-02-22T23:25:45.389 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.379+0000 7fa09e816640 10 monclient: monmap: 2026-02-22T23:25:45.389 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-22T23:25:45.390 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:45.390 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:25:45.380604+0000 2026-02-22T23:25:45.390 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:25:45.380604+0000 2026-02-22T23:25:45.390 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-22T23:25:45.390 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:45.390 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-22T23:25:45.390 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.noname-f 2026-02-22T23:25:45.390 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.noname-b 2026-02-22T23:25:45.390 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.noname-g 2026-02-22T23:25:45.390 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.noname-c 2026-02-22T23:25:45.390 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.noname-h 2026-02-22T23:25:45.390 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.noname-d 2026-02-22T23:25:45.390 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.noname-i 2026-02-22T23:25:45.390 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.noname-e 2026-02-22T23:25:45.390 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:45.390 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.379+0000 7fba2e7fc640 1 -- 10.20.193.45:0/1487331920 <== mon.4 v1:10.20.193.45:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fba20003260 con 0x7fba300a0f60 2026-02-22T23:25:45.390 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.379+0000 7fba2e7fc640 10 monclient: handle_config config(0 keys) 2026-02-22T23:25:45.390 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.379+0000 7fba2e7fc640 1 -- 10.20.193.45:0/1487331920 <== mon.4 v1:10.20.193.45:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7fba20003550 con 0x7fba300a0f60 2026-02-22T23:25:45.390 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.379+0000 7fba2e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:25:45.390 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.379+0000 7f8892ffd640 1 -- 10.20.193.45:0/3441057875 <== mon.1 v1:10.20.193.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 625790078 0 0) 0x7f8894139820 con 0x7f889413f720 2026-02-22T23:25:45.391 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.379+0000 7f8892ffd640 10 monclient(hunting): _negotiate 2026-02-22T23:25:45.391 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.379+0000 7f8892ffd640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:45.391 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.379+0000 7f8892ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:45.391 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.379+0000 7fba2e7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T23:25:45.391 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.379+0000 7fba2e7fc640 10 monclient: dump: 2026-02-22T23:25:45.391 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:45.391 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:45.391 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:45.391 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:45.391 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:45.391 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:45.391 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:45.391 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:45.391 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:45.391 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:45.391 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:45.391 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:45.391 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:45.391 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:45.392 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:45.392 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:45.392 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.379+0000 7fba35fce640 10 monclient: get_monmap_and_config success 2026-02-22T23:25:45.392 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.379+0000 7fba35fce640 4 set_mon_vals no callback set 2026-02-22T23:25:45.392 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.379+0000 7f8892ffd640 10 monclient(hunting): my global_id is 4312 2026-02-22T23:25:45.392 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.379+0000 7f8892ffd640 1 -- 10.20.193.45:0/3441057875 --> v1:10.20.193.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f88940a3400 con 0x7f889413f720 2026-02-22T23:25:45.392 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.379+0000 7f8892ffd640 1 -- 10.20.193.45:0/3441057875 <== mon.8 v1:10.20.193.45:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1518979202 0 0) 0x7f8878003620 con 0x7f8894138d30 2026-02-22T23:25:45.392 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.379+0000 7f8892ffd640 1 -- 10.20.193.45:0/3441057875 >> v1:10.20.193.73:6791/0 conn(0x7f889413bc10 legacy=0x7f889413e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:45.392 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.379+0000 7f8892ffd640 1 -- 10.20.193.45:0/3441057875 >> v1:10.20.193.73:6789/0 conn(0x7f889413f720 legacy=0x7f8894141b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:45.392 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.379+0000 7f8892ffd640 10 monclient: _finish_hunting 0 2026-02-22T23:25:45.392 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.379+0000 7f8892ffd640 1 monclient: found mon.noname-e 2026-02-22T23:25:45.392 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.379+0000 7f8892ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T23:25:45.393 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.379+0000 7f8892ffd640 10 monclient: _send_mon_message to mon.noname-e at v1:10.20.193.45:6793/0 2026-02-22T23:25:45.393 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.379+0000 7f8892ffd640 1 -- 10.20.193.45:0/3441057875 --> v1:10.20.193.45:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88940a6d80 con 0x7f8894138d30 2026-02-22T23:25:45.393 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.379+0000 7f8892ffd640 10 monclient: _finish_auth 0 2026-02-22T23:25:45.393 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.379+0000 7f8892ffd640 10 monclient: _check_auth_tickets 2026-02-22T23:25:45.393 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.379+0000 7f8892ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T23:25:45.393 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.379+0000 7f8892ffd640 1 -- 10.20.193.45:0/3441057875 <== mon.8 v1:10.20.193.45:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f8880003040 con 0x7f8894138d30 2026-02-22T23:25:45.393 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.379+0000 7f88996a3640 5 monclient: authenticate success, global_id 4247 2026-02-22T23:25:45.393 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.379+0000 7f88996a3640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-22T23:25:45.393 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.379+0000 7f8892ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:25:45.393 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.379+0000 7f8892ffd640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2026-02-22T23:25:45.393 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.379+0000 7f8892ffd640 10 monclient: dump: 2026-02-22T23:25:45.393 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:45.393 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:45.393 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:45.393 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:45.393 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:45.393 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:45.393 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:45.393 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:45.393 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:45.393 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:45.393 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:45.393 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:45.393 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:45.393 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:45.394 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:45.394 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:45.394 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.379+0000 7f88996a3640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-22T23:25:45.394 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.379+0000 7f0c492c4640 10 monclient: _reopen_session rank -1 2026-02-22T23:25:45.394 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.379+0000 7f0c492c4640 10 monclient: _add_conns ranks=[5,4,8,1,0,3,6,2,7] 2026-02-22T23:25:45.394 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.379+0000 7f8892ffd640 1 -- 10.20.193.45:0/3441057875 <== mon.8 v1:10.20.193.45:6793/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f8880003260 con 0x7f8894138d30 2026-02-22T23:25:45.394 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.379+0000 7f8892ffd640 10 monclient: handle_config config(0 keys) 2026-02-22T23:25:45.394 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.379+0000 7f8892ffd640 1 -- 10.20.193.45:0/3441057875 <== mon.8 v1:10.20.193.45:6793/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f8880004ce0 con 0x7f8894138d30 2026-02-22T23:25:45.394 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.379+0000 7f8892ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:25:45.394 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.379+0000 7f8892ffd640 10 monclient: got monmap 1 from mon.e (according to old e1) 2026-02-22T23:25:45.394 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.379+0000 7f0c492c4640 10 monclient(hunting): picked mon.noname-h con 0x7f0c440a5e00 addr v1:10.20.193.73:6791/0 2026-02-22T23:25:45.395 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.379+0000 7f8892ffd640 10 monclient: dump: 2026-02-22T23:25:45.395 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:45.395 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:45.395 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:45.395 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:45.395 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:45.395 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:45.395 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:45.395 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:45.395 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:45.395 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:45.395 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:45.395 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:45.395 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:45.395 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:45.395 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:45.395 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:45.395 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.379+0000 7f88996a3640 10 monclient: get_monmap_and_config success 2026-02-22T23:25:45.395 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.379+0000 7f88996a3640 4 set_mon_vals no callback set 2026-02-22T23:25:45.396 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.379+0000 7f0c492c4640 10 monclient(hunting): picked mon.noname-c con 0x7f0c440a68f0 addr v1:10.20.193.45:6791/0 2026-02-22T23:25:45.396 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.379+0000 7f0c492c4640 10 monclient(hunting): picked mon.noname-e con 0x7f0c440a6d00 addr v1:10.20.193.45:6793/0 2026-02-22T23:25:45.396 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.379+0000 7f0c492c4640 1 -- --> v1:10.20.193.45:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0c440a2d00 con 0x7f0c440a68f0 2026-02-22T23:25:45.396 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.379+0000 7f0c492c4640 1 -- --> v1:10.20.193.73:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0c440a2fe0 con 0x7f0c440a5e00 2026-02-22T23:25:45.396 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.379+0000 7f0c492c4640 1 -- --> v1:10.20.193.45:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0c440a32c0 con 0x7f0c440a6d00 2026-02-22T23:25:45.396 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.379+0000 7f0c492c4640 10 monclient(hunting): _renew_subs 2026-02-22T23:25:45.396 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.379+0000 7f0c492c4640 10 monclient(hunting): authenticate will time out at 676.996679s 2026-02-22T23:25:45.396 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.379+0000 7faf9873e640 10 monclient: get_monmap_and_config 2026-02-22T23:25:45.396 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.379+0000 7faf9873e640 10 monclient: build_initial_monmap 2026-02-22T23:25:45.396 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.379+0000 7faf9873e640 10 monclient: monmap: 2026-02-22T23:25:45.396 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-22T23:25:45.396 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:45.396 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:25:45.380903+0000 2026-02-22T23:25:45.396 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:25:45.380903+0000 2026-02-22T23:25:45.397 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-22T23:25:45.397 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:45.397 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-22T23:25:45.397 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.noname-f 2026-02-22T23:25:45.397 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.noname-b 2026-02-22T23:25:45.397 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.noname-g 2026-02-22T23:25:45.397 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.noname-c 2026-02-22T23:25:45.397 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.noname-h 2026-02-22T23:25:45.397 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.noname-d 2026-02-22T23:25:45.397 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.noname-i 2026-02-22T23:25:45.397 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.noname-e 2026-02-22T23:25:45.397 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:45.397 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.379+0000 7f0c427fc640 1 --1- >> v1:10.20.193.45:6791/0 conn(0x7f0c440a68f0 0x7f0c4413e080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.45:6791/0 says I am v1:10.20.193.45:37868/0 (socket says 10.20.193.45:37868) 2026-02-22T23:25:45.397 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.379+0000 7f0c427fc640 1 -- 10.20.193.45:0/691118476 learned_addr learned my addr 10.20.193.45:0/691118476 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-22T23:25:45.397 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.379+0000 7f88996a3640 10 monclient: shutdown 2026-02-22T23:25:45.397 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.379+0000 7f88996a3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T23:25:45.397 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.379+0000 7f88996a3640 1 -- 10.20.193.45:0/3441057875 >> v1:10.20.193.45:6793/0 conn(0x7f8894138d30 legacy=0x7f8894139110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:45.398 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.379+0000 7f0c41ffb640 1 -- 10.20.193.45:0/691118476 <== mon.4 v1:10.20.193.45:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4040407831 0 0) 0x7f0c440a2d00 con 0x7f0c440a68f0 2026-02-22T23:25:45.398 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.379+0000 7f0c41ffb640 10 monclient(hunting): _negotiate 2026-02-22T23:25:45.398 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.379+0000 7f0c41ffb640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:45.398 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.379+0000 7f0c41ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:45.398 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.379+0000 7f0c41ffb640 10 monclient(hunting): my global_id is 4279 2026-02-22T23:25:45.398 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.379+0000 7f0c41ffb640 1 -- 10.20.193.45:0/691118476 --> v1:10.20.193.45:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0c30003620 con 0x7f0c440a68f0 2026-02-22T23:25:45.398 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.379+0000 7f0c41ffb640 1 -- 10.20.193.45:0/691118476 <== mon.8 v1:10.20.193.45:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2719603567 0 0) 0x7f0c440a32c0 con 0x7f0c440a6d00 2026-02-22T23:25:45.398 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.379+0000 7f88996a3640 1 -- 10.20.193.45:0/3441057875 shutdown_connections 2026-02-22T23:25:45.398 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.379+0000 7f88996a3640 1 -- 10.20.193.45:0/3441057875 >> 10.20.193.45:0/3441057875 conn(0x7f88940abad0 msgr2=0x7f88940a7cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:25:45.398 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.379+0000 7f0c41ffb640 10 monclient(hunting): _negotiate 2026-02-22T23:25:45.398 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.379+0000 7f0c41ffb640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:45.398 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.379+0000 7f0c41ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:45.398 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.379+0000 7f0c41ffb640 10 monclient(hunting): my global_id is 4256 2026-02-22T23:25:45.398 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.379+0000 7fa09e816640 1 Processor -- start 2026-02-22T23:25:45.399 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.379+0000 7f0c41ffb640 1 -- 10.20.193.45:0/691118476 --> v1:10.20.193.45:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0c440a2d00 con 0x7f0c440a6d00 2026-02-22T23:25:45.399 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.379+0000 7f88996a3640 1 -- 10.20.193.45:0/3441057875 shutdown_connections 2026-02-22T23:25:45.399 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.379+0000 7fba35fce640 10 monclient: shutdown 2026-02-22T23:25:45.399 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.379+0000 7f88996a3640 1 -- 10.20.193.45:0/3441057875 wait complete. 2026-02-22T23:25:45.399 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.379+0000 7fba35fce640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T23:25:45.399 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.379+0000 7fba35fce640 1 -- 10.20.193.45:0/1487331920 >> v1:10.20.193.45:6791/0 conn(0x7fba300a0f60 legacy=0x7fba3013bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:45.399 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.379+0000 7fa09e816640 1 -- start start 2026-02-22T23:25:45.399 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.379+0000 7fa09e816640 10 monclient: init 2026-02-22T23:25:45.400 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.379+0000 7fba35fce640 1 -- 10.20.193.45:0/1487331920 shutdown_connections 2026-02-22T23:25:45.400 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.379+0000 7fba35fce640 1 -- 10.20.193.45:0/1487331920 >> 10.20.193.45:0/1487331920 conn(0x7fba300a9750 msgr2=0x7fba300a5c20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:25:45.400 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.380+0000 7fba35fce640 1 -- 10.20.193.45:0/1487331920 shutdown_connections 2026-02-22T23:25:45.400 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.380+0000 7f0c41ffb640 1 -- 10.20.193.45:0/691118476 <== mon.8 v1:10.20.193.45:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 506687984 0 0) 0x7f0c440a2d00 con 0x7f0c440a6d00 2026-02-22T23:25:45.400 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.380+0000 7f0c41ffb640 1 -- 10.20.193.45:0/691118476 >> v1:10.20.193.73:6791/0 conn(0x7f0c440a5e00 legacy=0x7f0c440a61e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:45.400 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.380+0000 7f0c41ffb640 1 -- 10.20.193.45:0/691118476 >> v1:10.20.193.45:6791/0 conn(0x7f0c440a68f0 legacy=0x7f0c4413e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:45.400 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.380+0000 7fba35fce640 1 -- 10.20.193.45:0/1487331920 wait complete. 2026-02-22T23:25:45.401 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.380+0000 7f0c41ffb640 10 monclient: _finish_hunting 0 2026-02-22T23:25:45.401 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.380+0000 7f0c41ffb640 1 monclient: found mon.noname-e 2026-02-22T23:25:45.401 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.380+0000 7f0c41ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T23:25:45.401 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.380+0000 7f0c41ffb640 10 monclient: _send_mon_message to mon.noname-e at v1:10.20.193.45:6793/0 2026-02-22T23:25:45.401 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.380+0000 7f0c41ffb640 1 -- 10.20.193.45:0/691118476 --> v1:10.20.193.45:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c440a35a0 con 0x7f0c440a6d00 2026-02-22T23:25:45.401 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.380+0000 7f0c41ffb640 10 monclient: _finish_auth 0 2026-02-22T23:25:45.401 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.380+0000 7f0c41ffb640 10 monclient: _check_auth_tickets 2026-02-22T23:25:45.401 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.380+0000 7f0c41ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T23:25:45.401 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.380+0000 7f0c41ffb640 1 -- 10.20.193.45:0/691118476 <== mon.8 v1:10.20.193.45:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f0c34002f50 con 0x7f0c440a6d00 2026-02-22T23:25:45.401 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.380+0000 7f0c492c4640 5 monclient: authenticate success, global_id 4256 2026-02-22T23:25:45.401 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.380+0000 7f0c492c4640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-22T23:25:45.401 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.380+0000 7f0c41ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:25:45.401 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.380+0000 7f0c41ffb640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2026-02-22T23:25:45.401 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.380+0000 7f0c41ffb640 10 monclient: dump: 2026-02-22T23:25:45.401 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:45.401 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:45.401 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:45.401 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:45.401 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:45.401 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:45.401 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:45.401 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:45.401 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:45.401 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:45.401 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:45.402 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:45.402 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:45.402 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:45.402 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:45.402 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:45.402 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.380+0000 7f0c492c4640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-22T23:25:45.402 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.380+0000 7f0c41ffb640 1 -- 10.20.193.45:0/691118476 <== mon.8 v1:10.20.193.45:6793/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0c340030f0 con 0x7f0c440a6d00 2026-02-22T23:25:45.402 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.380+0000 7f0c41ffb640 10 monclient: handle_config config(0 keys) 2026-02-22T23:25:45.402 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.380+0000 7f0c492c4640 10 monclient: get_monmap_and_config success 2026-02-22T23:25:45.402 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.380+0000 7faf9873e640 1 Processor -- start 2026-02-22T23:25:45.402 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.380+0000 7f0c492c4640 4 set_mon_vals no callback set 2026-02-22T23:25:45.402 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.380+0000 7f0c41ffb640 1 -- 10.20.193.45:0/691118476 <== mon.8 v1:10.20.193.45:6793/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f0c34003710 con 0x7f0c440a6d00 2026-02-22T23:25:45.402 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.380+0000 7f0c41ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:25:45.402 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.380+0000 7f0c41ffb640 10 monclient: got monmap 1 from mon.e (according to old e1) 2026-02-22T23:25:45.402 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.380+0000 7f0c41ffb640 10 monclient: dump: 2026-02-22T23:25:45.402 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:45.402 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:45.402 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:45.403 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:45.403 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:45.403 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:45.403 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:45.403 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:45.403 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:45.403 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:45.403 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:45.403 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:45.403 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:45.403 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:45.403 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:45.403 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:45.403 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.380+0000 7faf9873e640 1 -- start start 2026-02-22T23:25:45.403 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.380+0000 7faf9873e640 10 monclient: init 2026-02-22T23:25:45.403 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.380+0000 7f88996a3640 10 monclient: build_initial_monmap 2026-02-22T23:25:45.403 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.380+0000 7f268b51b640 10 monclient: get_monmap_and_config 2026-02-22T23:25:45.403 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.380+0000 7f268b51b640 10 monclient: build_initial_monmap 2026-02-22T23:25:45.404 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.380+0000 7f268b51b640 10 monclient: monmap: 2026-02-22T23:25:45.404 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-22T23:25:45.404 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:45.404 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:25:45.381512+0000 2026-02-22T23:25:45.404 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:25:45.381512+0000 2026-02-22T23:25:45.404 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-22T23:25:45.404 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:45.404 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-22T23:25:45.404 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.noname-f 2026-02-22T23:25:45.404 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.noname-b 2026-02-22T23:25:45.404 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.noname-g 2026-02-22T23:25:45.404 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.noname-c 2026-02-22T23:25:45.404 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.noname-h 2026-02-22T23:25:45.404 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.noname-d 2026-02-22T23:25:45.404 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.noname-i 2026-02-22T23:25:45.404 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.noname-e 2026-02-22T23:25:45.404 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:45.404 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.380+0000 7fa09e816640 10 monclient: _reopen_session rank -1 2026-02-22T23:25:45.404 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.380+0000 7f88996a3640 10 monclient: monmap: 2026-02-22T23:25:45.404 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-22T23:25:45.404 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T23:25:45.405 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-22T23:25:45.405 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-22T23:25:45.405 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-22T23:25:45.405 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-22T23:25:45.405 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-22T23:25:45.405 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.noname-f 2026-02-22T23:25:45.405 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.noname-b 2026-02-22T23:25:45.405 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.noname-g 2026-02-22T23:25:45.405 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.noname-c 2026-02-22T23:25:45.405 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.noname-h 2026-02-22T23:25:45.405 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.noname-d 2026-02-22T23:25:45.405 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.noname-i 2026-02-22T23:25:45.405 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.noname-e 2026-02-22T23:25:45.405 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:45.405 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.380+0000 7fa09e816640 10 monclient: _add_conns ranks=[5,7,8,3,1,4,6,2,0] 2026-02-22T23:25:45.405 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.380+0000 7fa09e816640 10 monclient(hunting): picked mon.noname-h con 0x7fa0980a4610 addr v1:10.20.193.73:6791/0 2026-02-22T23:25:45.406 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.380+0000 7fa09e816640 10 monclient(hunting): picked mon.noname-i con 0x7fa0980a5100 addr v1:10.20.193.73:6792/0 2026-02-22T23:25:45.406 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.380+0000 7fa09e816640 10 monclient(hunting): picked mon.noname-e con 0x7fa0980a3f10 addr v1:10.20.193.45:6793/0 2026-02-22T23:25:45.406 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.380+0000 7fa09e816640 1 -- --> v1:10.20.193.73:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa09806f720 con 0x7fa0980a4610 2026-02-22T23:25:45.406 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.380+0000 7fa09e816640 1 -- --> v1:10.20.193.73:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa0980a7250 con 0x7fa0980a5100 2026-02-22T23:25:45.406 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.380+0000 7fa09e816640 1 -- --> v1:10.20.193.45:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa0980a2c90 con 0x7fa0980a3f10 2026-02-22T23:25:45.406 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.380+0000 7fa09e816640 10 monclient(hunting): _renew_subs 2026-02-22T23:25:45.406 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.380+0000 7fa09e816640 10 monclient(hunting): authenticate will time out at 676.997419s 2026-02-22T23:25:45.406 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.380+0000 7fba35fce640 10 monclient: build_initial_monmap 2026-02-22T23:25:45.406 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.380+0000 7f0c492c4640 10 monclient: shutdown 2026-02-22T23:25:45.406 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.380+0000 7f0c492c4640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T23:25:45.406 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.380+0000 7fba35fce640 10 monclient: monmap: 2026-02-22T23:25:45.406 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-22T23:25:45.406 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T23:25:45.406 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-22T23:25:45.406 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-22T23:25:45.406 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-22T23:25:45.406 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-22T23:25:45.406 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-22T23:25:45.407 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.noname-f 2026-02-22T23:25:45.407 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.noname-b 2026-02-22T23:25:45.407 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.noname-g 2026-02-22T23:25:45.407 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.noname-c 2026-02-22T23:25:45.407 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.noname-h 2026-02-22T23:25:45.407 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.noname-d 2026-02-22T23:25:45.407 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.noname-i 2026-02-22T23:25:45.407 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.noname-e 2026-02-22T23:25:45.407 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:45.407 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.380+0000 7f0c492c4640 1 -- 10.20.193.45:0/691118476 >> v1:10.20.193.45:6793/0 conn(0x7f0c440a6d00 legacy=0x7f0c441417b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:45.407 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.380+0000 7fa09cd8c640 1 --1- >> v1:10.20.193.45:6793/0 conn(0x7fa0980a3f10 0x7fa0981415a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.45:6793/0 says I am v1:10.20.193.45:36686/0 (socket says 10.20.193.45:36686) 2026-02-22T23:25:45.407 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.380+0000 7fa09cd8c640 1 -- 10.20.193.45:0/3021024746 learned_addr learned my addr 10.20.193.45:0/3021024746 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-22T23:25:45.407 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.380+0000 7f0c492c4640 1 -- 10.20.193.45:0/691118476 shutdown_connections 2026-02-22T23:25:45.407 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.380+0000 7f0c492c4640 1 -- 10.20.193.45:0/691118476 >> 10.20.193.45:0/691118476 conn(0x7f0c440abb50 msgr2=0x7f0c440a7f00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:25:45.407 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.380+0000 7f88996a3640 1 Processor -- start 2026-02-22T23:25:45.408 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.380+0000 7f0c492c4640 1 -- 10.20.193.45:0/691118476 shutdown_connections 2026-02-22T23:25:45.408 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.380+0000 7f0c492c4640 1 -- 10.20.193.45:0/691118476 wait complete. 2026-02-22T23:25:45.408 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.380+0000 7f88996a3640 1 -- start start 2026-02-22T23:25:45.408 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.380+0000 7f88996a3640 10 monclient: init 2026-02-22T23:25:45.408 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.380+0000 7faf9873e640 10 monclient: _reopen_session rank -1 2026-02-22T23:25:45.408 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.380+0000 7faf9873e640 10 monclient: _add_conns ranks=[1,7,2,3,5,4,0,8,6] 2026-02-22T23:25:45.408 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.380+0000 7fba35fce640 1 Processor -- start 2026-02-22T23:25:45.408 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.380+0000 7fa096ffd640 1 -- 10.20.193.45:0/3021024746 <== mon.8 v1:10.20.193.45:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4018223146 0 0) 0x7fa0980a2c90 con 0x7fa0980a3f10 2026-02-22T23:25:45.408 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.380+0000 7fa096ffd640 10 monclient(hunting): _negotiate 2026-02-22T23:25:45.408 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.380+0000 7fa096ffd640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:45.408 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.380+0000 7fa096ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:45.409 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.380+0000 7fa096ffd640 10 monclient(hunting): my global_id is 4265 2026-02-22T23:25:45.409 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.380+0000 7faf9873e640 10 monclient(hunting): picked mon.noname-f con 0x7faf900733c0 addr v1:10.20.193.73:6789/0 2026-02-22T23:25:45.409 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.380+0000 7fa096ffd640 1 -- 10.20.193.45:0/3021024746 --> v1:10.20.193.45:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa07c003620 con 0x7fa0980a3f10 2026-02-22T23:25:45.409 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.380+0000 7faf9873e640 10 monclient(hunting): picked mon.noname-i con 0x7faf900a32c0 addr v1:10.20.193.73:6792/0 2026-02-22T23:25:45.409 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.380+0000 7faf9873e640 10 monclient(hunting): picked mon.noname-b con 0x7faf9013d2b0 addr v1:10.20.193.45:6790/0 2026-02-22T23:25:45.409 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.380+0000 7faf9873e640 1 -- --> v1:10.20.193.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf900a2600 con 0x7faf900733c0 2026-02-22T23:25:45.409 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.380+0000 7fba35fce640 1 -- start start 2026-02-22T23:25:45.409 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.380+0000 7fba35fce640 10 monclient: init 2026-02-22T23:25:45.409 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.380+0000 7faf9873e640 1 -- --> v1:10.20.193.45:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf900a1c50 con 0x7faf9013d2b0 2026-02-22T23:25:45.409 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.380+0000 7faf9873e640 1 -- --> v1:10.20.193.73:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf900a28e0 con 0x7faf900a32c0 2026-02-22T23:25:45.409 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.380+0000 7faf9873e640 10 monclient(hunting): _renew_subs 2026-02-22T23:25:45.410 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.380+0000 7faf9873e640 10 monclient(hunting): authenticate will time out at 676.997760s 2026-02-22T23:25:45.410 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.380+0000 7fa096ffd640 1 -- 10.20.193.45:0/3021024746 <== mon.7 v1:10.20.193.73:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1352762932 0 0) 0x7fa0980a7250 con 0x7fa0980a5100 2026-02-22T23:25:45.410 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.380+0000 7fa096ffd640 10 monclient(hunting): _negotiate 2026-02-22T23:25:45.410 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.380+0000 7fa096ffd640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:45.410 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.380+0000 7fa096ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:45.410 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.380+0000 7fa096ffd640 10 monclient(hunting): my global_id is 4237 2026-02-22T23:25:45.410 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.380+0000 7fa096ffd640 1 -- 10.20.193.45:0/3021024746 --> v1:10.20.193.73:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa0980a2c90 con 0x7fa0980a5100 2026-02-22T23:25:45.410 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.380+0000 7f268b51b640 1 Processor -- start 2026-02-22T23:25:45.410 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.380+0000 7fa096ffd640 1 -- 10.20.193.45:0/3021024746 <== mon.8 v1:10.20.193.45:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 771132556 0 0) 0x7fa07c003620 con 0x7fa0980a3f10 2026-02-22T23:25:45.410 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.380+0000 7fa096ffd640 1 -- 10.20.193.45:0/3021024746 >> v1:10.20.193.73:6792/0 conn(0x7fa0980a5100 legacy=0x7fa09813de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:45.410 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.380+0000 7fa096ffd640 1 -- 10.20.193.45:0/3021024746 >> v1:10.20.193.73:6791/0 conn(0x7fa0980a4610 legacy=0x7fa0980a49f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:45.410 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.380+0000 7fa096ffd640 10 monclient: _finish_hunting 0 2026-02-22T23:25:45.410 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.380+0000 7fa096ffd640 1 monclient: found mon.noname-e 2026-02-22T23:25:45.410 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.380+0000 7fa096ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T23:25:45.411 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.380+0000 7faf96cb4640 1 --1- >> v1:10.20.193.45:6790/0 conn(0x7faf9013d2b0 0x7faf9013f6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.45:6790/0 says I am v1:10.20.193.45:50824/0 (socket says 10.20.193.45:50824) 2026-02-22T23:25:45.411 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.380+0000 7fa096ffd640 10 monclient: _send_mon_message to mon.noname-e at v1:10.20.193.45:6793/0 2026-02-22T23:25:45.411 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.380+0000 7fa096ffd640 1 -- 10.20.193.45:0/3021024746 --> v1:10.20.193.45:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0980a3250 con 0x7fa0980a3f10 2026-02-22T23:25:45.411 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.380+0000 7faf96cb4640 1 -- 10.20.193.45:0/1955014490 learned_addr learned my addr 10.20.193.45:0/1955014490 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-22T23:25:45.411 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.380+0000 7faf964b3640 1 --1- >> v1:10.20.193.73:6789/0 conn(0x7faf900733c0 0x7faf900737a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.73:6789/0 says I am v1:10.20.193.45:44270/0 (socket says 10.20.193.45:44270) 2026-02-22T23:25:45.411 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.380+0000 7fa096ffd640 10 monclient: _finish_auth 0 2026-02-22T23:25:45.411 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.380+0000 7fa096ffd640 10 monclient: _check_auth_tickets 2026-02-22T23:25:45.411 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.380+0000 7fa096ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T23:25:45.411 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.380+0000 7fa096ffd640 1 -- 10.20.193.45:0/3021024746 <== mon.8 v1:10.20.193.45:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7fa08c0033c0 con 0x7fa0980a3f10 2026-02-22T23:25:45.411 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.380+0000 7fa096ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:25:45.411 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.380+0000 7fa096ffd640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2026-02-22T23:25:45.411 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.380+0000 7fa096ffd640 10 monclient: dump: 2026-02-22T23:25:45.411 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:45.411 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:45.412 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:45.412 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:45.412 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:45.412 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:45.412 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:45.412 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:45.412 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:45.412 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:45.412 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:45.412 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:45.412 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:45.412 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:45.412 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:45.412 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:45.412 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.380+0000 7fa09e816640 5 monclient: authenticate success, global_id 4265 2026-02-22T23:25:45.412 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.380+0000 7fa09e816640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-22T23:25:45.412 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.380+0000 7f268b51b640 1 -- start start 2026-02-22T23:25:45.412 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.380+0000 7f268b51b640 10 monclient: init 2026-02-22T23:25:45.412 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.380+0000 7f88996a3640 10 monclient: _reopen_session rank -1 2026-02-22T23:25:45.412 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.380+0000 7f88996a3640 10 monclient: _add_conns ranks=[1,5,3,8,7,4,6,0,2] 2026-02-22T23:25:45.412 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.380+0000 7f88996a3640 10 monclient(hunting): picked mon.noname-f con 0x7f8894138d30 addr v1:10.20.193.73:6789/0 2026-02-22T23:25:45.412 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.380+0000 7f88996a3640 10 monclient(hunting): picked mon.noname-h con 0x7f889413bc10 addr v1:10.20.193.73:6791/0 2026-02-22T23:25:45.412 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.380+0000 7f88996a3640 10 monclient(hunting): picked mon.noname-g con 0x7f889413f720 addr v1:10.20.193.73:6790/0 2026-02-22T23:25:45.412 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.380+0000 7f88996a3640 1 -- --> v1:10.20.193.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f889413ce10 con 0x7f8894138d30 2026-02-22T23:25:45.412 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.380+0000 7f88996a3640 1 -- --> v1:10.20.193.73:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f889413de50 con 0x7f889413f720 2026-02-22T23:25:45.413 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.380+0000 7fa096ffd640 1 -- 10.20.193.45:0/3021024746 <== mon.8 v1:10.20.193.45:6793/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa08c0035e0 con 0x7fa0980a3f10 2026-02-22T23:25:45.413 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.380+0000 7fa096ffd640 10 monclient: handle_config config(0 keys) 2026-02-22T23:25:45.413 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.380+0000 7fa09e816640 10 monclient: get_monmap_and_config success 2026-02-22T23:25:45.413 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.380+0000 7fa09e816640 4 set_mon_vals no callback set 2026-02-22T23:25:45.413 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.380+0000 7f88996a3640 1 -- --> v1:10.20.193.73:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f889413e410 con 0x7f889413bc10 2026-02-22T23:25:45.413 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.380+0000 7f88996a3640 10 monclient(hunting): _renew_subs 2026-02-22T23:25:45.413 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.380+0000 7f88996a3640 10 monclient(hunting): authenticate will time out at 676.997920s 2026-02-22T23:25:45.413 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.380+0000 7fa096ffd640 1 -- 10.20.193.45:0/3021024746 <== mon.8 v1:10.20.193.45:6793/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7fa08c005060 con 0x7fa0980a3f10 2026-02-22T23:25:45.413 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.380+0000 7fa096ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:25:45.413 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.380+0000 7fa096ffd640 10 monclient: got monmap 1 from mon.e (according to old e1) 2026-02-22T23:25:45.413 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.380+0000 7fa096ffd640 10 monclient: dump: 2026-02-22T23:25:45.413 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:45.413 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:45.413 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:45.413 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:45.413 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:45.413 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:45.413 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:45.414 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:45.414 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:45.414 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:45.414 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:45.414 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:45.414 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:45.414 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:45.414 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:45.414 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:45.414 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.380+0000 7f0c492c4640 10 monclient: build_initial_monmap 2026-02-22T23:25:45.414 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.380+0000 7f0c492c4640 10 monclient: monmap: 2026-02-22T23:25:45.414 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-22T23:25:45.414 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T23:25:45.414 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-22T23:25:45.414 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-22T23:25:45.414 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-22T23:25:45.414 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-22T23:25:45.414 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-22T23:25:45.414 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.noname-f 2026-02-22T23:25:45.414 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.noname-b 2026-02-22T23:25:45.414 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.noname-g 2026-02-22T23:25:45.414 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.noname-c 2026-02-22T23:25:45.414 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.noname-h 2026-02-22T23:25:45.414 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.noname-d 2026-02-22T23:25:45.414 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.noname-i 2026-02-22T23:25:45.414 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.noname-e 2026-02-22T23:25:45.414 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:45.415 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.380+0000 7faf954b1640 1 -- 10.20.193.45:0/1955014490 <== mon.2 v1:10.20.193.45:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3288972352 0 0) 0x7faf900a1c50 con 0x7faf9013d2b0 2026-02-22T23:25:45.415 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.380+0000 7faf954b1640 10 monclient(hunting): _negotiate 2026-02-22T23:25:45.415 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.380+0000 7faf954b1640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:45.415 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.380+0000 7faf954b1640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:45.415 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.380+0000 7faf954b1640 10 monclient(hunting): my global_id is 4259 2026-02-22T23:25:45.415 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.380+0000 7fba35fce640 10 monclient: _reopen_session rank -1 2026-02-22T23:25:45.415 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.380+0000 7faf954b1640 1 -- 10.20.193.45:0/1955014490 --> v1:10.20.193.45:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faf78003620 con 0x7faf9013d2b0 2026-02-22T23:25:45.415 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7fba35fce640 10 monclient: _add_conns ranks=[2,0,3,1,7,6,4,8,5] 2026-02-22T23:25:45.415 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7fba35fce640 10 monclient(hunting): picked mon.noname-b con 0x7fba300a0f60 addr v1:10.20.193.45:6790/0 2026-02-22T23:25:45.415 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7fba35fce640 10 monclient(hunting): picked mon.noname-a con 0x7fba300a4b30 addr v1:10.20.193.45:6789/0 2026-02-22T23:25:45.415 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7faf954b1640 1 -- 10.20.193.45:0/1955014490 <== mon.1 v1:10.20.193.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 335647537 0 0) 0x7faf80002920 con 0x7faf900733c0 2026-02-22T23:25:45.415 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7faf954b1640 10 monclient(hunting): _negotiate 2026-02-22T23:25:45.415 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7faf954b1640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:45.416 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7f88937fe640 1 --1- >> v1:10.20.193.73:6791/0 conn(0x7f889413bc10 0x7f889413c700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.73:6791/0 says I am v1:10.20.193.45:36342/0 (socket says 10.20.193.45:36342) 2026-02-22T23:25:45.416 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7f88937fe640 1 -- 10.20.193.45:0/41817586 learned_addr learned my addr 10.20.193.45:0/41817586 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-22T23:25:45.416 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7fba35fce640 10 monclient(hunting): picked mon.noname-g con 0x7fba300a5620 addr v1:10.20.193.73:6790/0 2026-02-22T23:25:45.416 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7fba35fce640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba30135650 con 0x7fba300a4b30 2026-02-22T23:25:45.416 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7faf954b1640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:45.416 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7faf954b1640 10 monclient(hunting): my global_id is 4321 2026-02-22T23:25:45.416 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7faf954b1640 1 -- 10.20.193.45:0/1955014490 --> v1:10.20.193.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faf900a1c50 con 0x7faf900733c0 2026-02-22T23:25:45.416 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7fba35fce640 1 -- --> v1:10.20.193.45:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba30140730 con 0x7fba300a0f60 2026-02-22T23:25:45.416 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7fba35fce640 1 -- --> v1:10.20.193.73:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba3009fbe0 con 0x7fba300a5620 2026-02-22T23:25:45.416 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7fba35fce640 10 monclient(hunting): _renew_subs 2026-02-22T23:25:45.416 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7fba35fce640 10 monclient(hunting): authenticate will time out at 676.998059s 2026-02-22T23:25:45.416 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7fba2f7fe640 1 --1- >> v1:10.20.193.45:6790/0 conn(0x7fba300a0f60 0x7fba3009df60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.45:6790/0 says I am v1:10.20.193.45:50838/0 (socket says 10.20.193.45:50838) 2026-02-22T23:25:45.416 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7fba2f7fe640 1 -- 10.20.193.45:0/145605847 learned_addr learned my addr 10.20.193.45:0/145605847 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-22T23:25:45.416 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7faf954b1640 1 -- 10.20.193.45:0/1955014490 <== mon.2 v1:10.20.193.45:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2404637047 0 0) 0x7faf78003620 con 0x7faf9013d2b0 2026-02-22T23:25:45.416 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7faf954b1640 1 -- 10.20.193.45:0/1955014490 >> v1:10.20.193.73:6792/0 conn(0x7faf900a32c0 legacy=0x7faf9013bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:45.417 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7f0c492c4640 1 Processor -- start 2026-02-22T23:25:45.417 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7faf954b1640 1 -- 10.20.193.45:0/1955014490 >> v1:10.20.193.73:6789/0 conn(0x7faf900733c0 legacy=0x7faf900737a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:45.417 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7faf954b1640 10 monclient: _finish_hunting 0 2026-02-22T23:25:45.417 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7faf954b1640 1 monclient: found mon.noname-b 2026-02-22T23:25:45.417 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7faf954b1640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T23:25:45.417 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7faf954b1640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.45:6790/0 2026-02-22T23:25:45.417 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7faf954b1640 1 -- 10.20.193.45:0/1955014490 --> v1:10.20.193.45:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf90073eb0 con 0x7faf9013d2b0 2026-02-22T23:25:45.417 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7faf954b1640 10 monclient: _finish_auth 0 2026-02-22T23:25:45.417 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7faf954b1640 10 monclient: _check_auth_tickets 2026-02-22T23:25:45.417 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7faf954b1640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T23:25:45.417 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7faf954b1640 1 -- 10.20.193.45:0/1955014490 <== mon.2 v1:10.20.193.45:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7faf8c0033c0 con 0x7faf9013d2b0 2026-02-22T23:25:45.417 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7faf9873e640 5 monclient: authenticate success, global_id 4259 2026-02-22T23:25:45.417 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7faf9873e640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-22T23:25:45.417 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7faf954b1640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:25:45.417 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7f268b51b640 10 monclient: _reopen_session rank -1 2026-02-22T23:25:45.417 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7faf954b1640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-22T23:25:45.418 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7faf954b1640 10 monclient: dump: 2026-02-22T23:25:45.418 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:45.418 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:45.418 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:45.418 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:45.418 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:45.418 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:45.418 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:45.418 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:45.418 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:45.418 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:45.418 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:45.418 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:45.418 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:45.418 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:45.418 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:45.418 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:45.418 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7f268b51b640 10 monclient: _add_conns ranks=[8,2,1,3,4,5,6,7,0] 2026-02-22T23:25:45.418 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7faf9873e640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-22T23:25:45.418 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7f268b51b640 10 monclient(hunting): picked mon.noname-e con 0x7f2684137ba0 addr v1:10.20.193.45:6793/0 2026-02-22T23:25:45.418 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7fba0bfff640 1 -- 10.20.193.45:0/145605847 <== mon.2 v1:10.20.193.45:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3029914443 0 0) 0x7fba30140730 con 0x7fba300a0f60 2026-02-22T23:25:45.418 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7fba0bfff640 10 monclient(hunting): _negotiate 2026-02-22T23:25:45.419 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7f268b51b640 10 monclient(hunting): picked mon.noname-b con 0x7f268409e120 addr v1:10.20.193.45:6790/0 2026-02-22T23:25:45.419 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7fba0bfff640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:45.419 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7fba0bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:45.419 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7fba0bfff640 10 monclient(hunting): my global_id is 4268 2026-02-22T23:25:45.419 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7fba0bfff640 1 -- 10.20.193.45:0/145605847 --> v1:10.20.193.45:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fba00003620 con 0x7fba300a0f60 2026-02-22T23:25:45.419 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7faf954b1640 1 -- 10.20.193.45:0/1955014490 <== mon.2 v1:10.20.193.45:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7faf8c0035e0 con 0x7faf9013d2b0 2026-02-22T23:25:45.419 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7faf954b1640 10 monclient: handle_config config(0 keys) 2026-02-22T23:25:45.419 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7f268b51b640 10 monclient(hunting): picked mon.noname-f con 0x7f268413f380 addr v1:10.20.193.73:6789/0 2026-02-22T23:25:45.419 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7f268b51b640 1 -- --> v1:10.20.193.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f268409ced0 con 0x7f268413f380 2026-02-22T23:25:45.419 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7f268b51b640 1 -- --> v1:10.20.193.45:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f268409d3d0 con 0x7f268409e120 2026-02-22T23:25:45.419 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7faf954b1640 1 -- 10.20.193.45:0/1955014490 <== mon.2 v1:10.20.193.45:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7faf8c005060 con 0x7faf9013d2b0 2026-02-22T23:25:45.419 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7faf954b1640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:25:45.419 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7faf954b1640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-22T23:25:45.419 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7faf954b1640 10 monclient: dump: 2026-02-22T23:25:45.419 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:45.419 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:45.419 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:45.420 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:45.420 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:45.420 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:45.420 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:45.420 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:45.420 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:45.420 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:45.420 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:45.420 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:45.420 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:45.420 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:45.420 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:45.420 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:45.420 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7f268b51b640 1 -- --> v1:10.20.193.45:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f268409d6b0 con 0x7f2684137ba0 2026-02-22T23:25:45.420 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7f268b51b640 10 monclient(hunting): _renew_subs 2026-02-22T23:25:45.420 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7f268b51b640 10 monclient(hunting): authenticate will time out at 676.998300s 2026-02-22T23:25:45.420 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7fba0bfff640 1 -- 10.20.193.45:0/145605847 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1869345939 0 0) 0x7fba300a6360 con 0x7fba300a4b30 2026-02-22T23:25:45.420 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7fba0bfff640 10 monclient(hunting): _negotiate 2026-02-22T23:25:45.420 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7fba0bfff640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:45.420 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7fba0bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:45.420 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7fba0bfff640 10 monclient(hunting): my global_id is 4239 2026-02-22T23:25:45.421 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7fba0bfff640 1 -- 10.20.193.45:0/145605847 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fba30140730 con 0x7fba300a4b30 2026-02-22T23:25:45.421 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7f0c492c4640 1 -- start start 2026-02-22T23:25:45.421 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7f0c492c4640 10 monclient: init 2026-02-22T23:25:45.421 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7fa09e816640 10 monclient: shutdown 2026-02-22T23:25:45.421 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7fa09e816640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T23:25:45.421 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7fa09e816640 1 -- 10.20.193.45:0/3021024746 >> v1:10.20.193.45:6793/0 conn(0x7fa0980a3f10 legacy=0x7fa0981415a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:45.421 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7f2689290640 1 --1- >> v1:10.20.193.45:6793/0 conn(0x7f2684137ba0 0x7f2684137f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.45:6793/0 says I am v1:10.20.193.45:36696/0 (socket says 10.20.193.45:36696) 2026-02-22T23:25:45.421 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7f2689290640 1 -- 10.20.193.45:0/921591014 learned_addr learned my addr 10.20.193.45:0/921591014 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-22T23:25:45.421 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7fba0bfff640 1 -- 10.20.193.45:0/145605847 <== mon.2 v1:10.20.193.45:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1681075563 0 0) 0x7fba00003620 con 0x7fba300a0f60 2026-02-22T23:25:45.421 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7fa09e816640 1 -- 10.20.193.45:0/3021024746 shutdown_connections 2026-02-22T23:25:45.421 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7fa09e816640 1 -- 10.20.193.45:0/3021024746 >> 10.20.193.45:0/3021024746 conn(0x7fa0980a7f70 msgr2=0x7fa0980a8380 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:25:45.421 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7fba0bfff640 1 -- 10.20.193.45:0/145605847 --> v1:10.20.193.45:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fba300a6360 con 0x7fba300a0f60 2026-02-22T23:25:45.421 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7fba0bfff640 1 -- 10.20.193.45:0/145605847 <== mon.2 v1:10.20.193.45:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7fba1c003440 con 0x7fba300a0f60 2026-02-22T23:25:45.421 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7fba0bfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-22T23:25:45.421 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7fba0bfff640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-22T23:25:45.422 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7fba0bfff640 10 monclient(hunting): dump: 2026-02-22T23:25:45.422 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:45.422 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:45.422 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:45.422 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:45.422 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:45.422 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:45.422 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:45.422 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:45.422 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:45.422 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:45.422 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:45.422 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:45.422 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:45.422 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:45.422 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:45.422 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:45.422 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7fa09e816640 1 -- 10.20.193.45:0/3021024746 shutdown_connections 2026-02-22T23:25:45.422 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7f8890ff9640 1 -- 10.20.193.45:0/41817586 <== mon.3 v1:10.20.193.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 598216373 0 0) 0x7f889413de50 con 0x7f889413f720 2026-02-22T23:25:45.422 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7f8890ff9640 10 monclient(hunting): _negotiate 2026-02-22T23:25:45.422 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7fba0bfff640 10 monclient(hunting): _finish_auth 0 2026-02-22T23:25:45.423 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7f8890ff9640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:45.423 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7f8890ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:45.423 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7f8890ff9640 10 monclient(hunting): my global_id is 4260 2026-02-22T23:25:45.423 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7f8890ff9640 1 -- 10.20.193.45:0/41817586 --> v1:10.20.193.73:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8864003620 con 0x7f889413f720 2026-02-22T23:25:45.423 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7f2673fff640 1 -- 10.20.193.45:0/921591014 <== mon.2 v1:10.20.193.45:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1276284378 0 0) 0x7f268409d3d0 con 0x7f268409e120 2026-02-22T23:25:45.423 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7f2673fff640 10 monclient(hunting): _negotiate 2026-02-22T23:25:45.423 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7f2673fff640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:45.423 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7f2673fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:45.423 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7f2673fff640 10 monclient(hunting): my global_id is 4277 2026-02-22T23:25:45.423 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7f2673fff640 1 -- 10.20.193.45:0/921591014 --> v1:10.20.193.45:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f266c003620 con 0x7f268409e120 2026-02-22T23:25:45.423 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7fba0bfff640 1 -- 10.20.193.45:0/145605847 <== mon.3 v1:10.20.193.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 235897708 0 0) 0x7fba3009fbe0 con 0x7fba300a5620 2026-02-22T23:25:45.423 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7fba0bfff640 10 monclient(hunting): _negotiate 2026-02-22T23:25:45.423 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7f2673fff640 1 -- 10.20.193.45:0/921591014 <== mon.8 v1:10.20.193.45:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3259316084 0 0) 0x7f268409d6b0 con 0x7f2684137ba0 2026-02-22T23:25:45.423 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7f2673fff640 10 monclient(hunting): _negotiate 2026-02-22T23:25:45.423 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7f2673fff640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:45.423 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7f2673fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:45.423 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7fba0bfff640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:45.423 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7fba0bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:45.423 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7fba0bfff640 10 monclient(hunting): my global_id is 4269 2026-02-22T23:25:45.424 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7fba0bfff640 1 -- 10.20.193.45:0/145605847 --> v1:10.20.193.73:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fba00003620 con 0x7fba300a5620 2026-02-22T23:25:45.424 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7fba0bfff640 1 -- 10.20.193.45:0/145605847 <== mon.0 v1:10.20.193.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4268419420 0 0) 0x7fba30140730 con 0x7fba300a4b30 2026-02-22T23:25:45.424 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7f2673fff640 10 monclient(hunting): my global_id is 4274 2026-02-22T23:25:45.424 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7f2673fff640 1 -- 10.20.193.45:0/921591014 --> v1:10.20.193.45:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f268409d3d0 con 0x7f2684137ba0 2026-02-22T23:25:45.424 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7fba0bfff640 1 -- 10.20.193.45:0/145605847 --> v1:10.20.193.45:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fba3009fbe0 con 0x7fba300a4b30 2026-02-22T23:25:45.424 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7fba0bfff640 1 -- 10.20.193.45:0/145605847 <== mon.0 v1:10.20.193.45:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7fba20003000 con 0x7fba300a4b30 2026-02-22T23:25:45.424 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7fba0bfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-22T23:25:45.424 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7fba0bfff640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-22T23:25:45.424 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7fba0bfff640 10 monclient(hunting): dump: 2026-02-22T23:25:45.424 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:45.424 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:45.424 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:45.424 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:45.424 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:45.424 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:45.424 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:45.424 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:45.424 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:45.424 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:45.424 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:45.424 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:45.424 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:45.424 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:45.425 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:45.425 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:45.425 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7fba0bfff640 1 -- 10.20.193.45:0/145605847 <== mon.2 v1:10.20.193.45:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1419260343 0 0) 0x7fba300a6360 con 0x7fba300a0f60 2026-02-22T23:25:45.425 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7fba0bfff640 1 -- 10.20.193.45:0/145605847 >> v1:10.20.193.73:6790/0 conn(0x7fba300a5620 legacy=0x7fba301d74f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:45.425 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7fba0bfff640 1 -- 10.20.193.45:0/145605847 >> v1:10.20.193.45:6789/0 conn(0x7fba300a4b30 legacy=0x7fba3009e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:45.425 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7fba0bfff640 10 monclient: _finish_hunting 0 2026-02-22T23:25:45.425 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7fba0bfff640 1 monclient: found mon.b 2026-02-22T23:25:45.425 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7fba0bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T23:25:45.425 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7fba0bfff640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.45:6790/0 2026-02-22T23:25:45.425 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7fba0bfff640 1 -- 10.20.193.45:0/145605847 --> v1:10.20.193.45:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba3009ed80 con 0x7fba300a0f60 2026-02-22T23:25:45.425 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7f8890ff9640 1 -- 10.20.193.45:0/41817586 <== mon.5 v1:10.20.193.73:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1931034248 0 0) 0x7f889413e410 con 0x7f889413bc10 2026-02-22T23:25:45.425 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7f8890ff9640 10 monclient(hunting): _negotiate 2026-02-22T23:25:45.425 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7f8890ff9640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:45.425 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7f8890ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:45.425 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7fba0bfff640 10 monclient: _finish_auth 0 2026-02-22T23:25:45.425 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7fba0bfff640 10 monclient: _check_auth_tickets 2026-02-22T23:25:45.425 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7fba0bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T23:25:45.425 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7fba35fce640 5 monclient: authenticate success, global_id 4268 2026-02-22T23:25:45.425 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7f8890ff9640 10 monclient(hunting): my global_id is 4280 2026-02-22T23:25:45.425 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7f8890ff9640 1 -- 10.20.193.45:0/41817586 --> v1:10.20.193.73:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f889413de50 con 0x7f889413bc10 2026-02-22T23:25:45.425 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7fba35fce640 10 monclient: _renew_subs 2026-02-22T23:25:45.425 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7fba35fce640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.45:6790/0 2026-02-22T23:25:45.425 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7fba35fce640 1 -- 10.20.193.45:0/145605847 --> v1:10.20.193.45:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fba30135ef0 con 0x7fba300a0f60 2026-02-22T23:25:45.426 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7f2673fff640 1 -- 10.20.193.45:0/921591014 <== mon.1 v1:10.20.193.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3738146346 0 0) 0x7f268409ced0 con 0x7f268413f380 2026-02-22T23:25:45.426 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7f2673fff640 10 monclient(hunting): _negotiate 2026-02-22T23:25:45.426 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7f2673fff640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:45.426 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7f2673fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:45.426 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7f2673fff640 10 monclient(hunting): my global_id is 4330 2026-02-22T23:25:45.426 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7f2673fff640 1 -- 10.20.193.45:0/921591014 --> v1:10.20.193.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f268409d6b0 con 0x7f268413f380 2026-02-22T23:25:45.426 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7fba35fce640 10 monclient: _renew_subs 2026-02-22T23:25:45.426 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7fba35fce640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.45:6790/0 2026-02-22T23:25:45.426 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7fba35fce640 1 -- 10.20.193.45:0/145605847 --> v1:10.20.193.45:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fba30134940 con 0x7fba300a0f60 2026-02-22T23:25:45.426 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7f2673fff640 1 -- 10.20.193.45:0/921591014 <== mon.8 v1:10.20.193.45:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3333450040 0 0) 0x7f268409d3d0 con 0x7f2684137ba0 2026-02-22T23:25:45.426 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7f2673fff640 1 -- 10.20.193.45:0/921591014 >> v1:10.20.193.45:6790/0 conn(0x7f268409e120 legacy=0x7f268413dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:45.426 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7f8890ff9640 1 -- 10.20.193.45:0/41817586 <== mon.1 v1:10.20.193.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1326578571 0 0) 0x7f889413ce10 con 0x7f8894138d30 2026-02-22T23:25:45.426 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7f8890ff9640 10 monclient(hunting): _negotiate 2026-02-22T23:25:45.426 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7f8890ff9640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:45.426 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7f8890ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:45.426 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7f8890ff9640 10 monclient(hunting): my global_id is 4339 2026-02-22T23:25:45.426 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7f8890ff9640 1 -- 10.20.193.45:0/41817586 --> v1:10.20.193.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f889413e410 con 0x7f8894138d30 2026-02-22T23:25:45.426 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7f8890ff9640 1 -- 10.20.193.45:0/41817586 <== mon.3 v1:10.20.193.73:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3159423345 0 0) 0x7f8864003620 con 0x7f889413f720 2026-02-22T23:25:45.427 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7fba0bfff640 1 -- 10.20.193.45:0/145605847 <== mon.2 v1:10.20.193.45:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fba1c004b90 con 0x7fba300a0f60 2026-02-22T23:25:45.427 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7fba0bfff640 10 monclient: handle_config config(0 keys) 2026-02-22T23:25:45.427 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7fba0bfff640 1 -- 10.20.193.45:0/145605847 <== mon.2 v1:10.20.193.45:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7fba1c005080 con 0x7fba300a0f60 2026-02-22T23:25:45.427 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7fba0bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:25:45.427 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7fba2dffb640 4 set_mon_vals no callback set 2026-02-22T23:25:45.427 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7fba0bfff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-22T23:25:45.427 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7f2673fff640 1 -- 10.20.193.45:0/921591014 >> v1:10.20.193.73:6789/0 conn(0x7f268413f380 legacy=0x7f2684141770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:45.427 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7f2673fff640 10 monclient: _finish_hunting 0 2026-02-22T23:25:45.427 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7f2673fff640 1 monclient: found mon.noname-e 2026-02-22T23:25:45.427 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7f2673fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T23:25:45.427 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7f2673fff640 10 monclient: _send_mon_message to mon.noname-e at v1:10.20.193.45:6793/0 2026-02-22T23:25:45.427 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7f2673fff640 1 -- 10.20.193.45:0/921591014 --> v1:10.20.193.45:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f268409d990 con 0x7f2684137ba0 2026-02-22T23:25:45.427 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7fba0bfff640 10 monclient: dump: 2026-02-22T23:25:45.427 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:45.427 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:45.427 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:45.427 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:45.427 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:45.427 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:45.427 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:45.427 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:45.427 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:45.427 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:45.427 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:45.427 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:45.427 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:45.427 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:45.427 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:45.427 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:45.427 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7f2673fff640 10 monclient: _finish_auth 0 2026-02-22T23:25:45.428 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7f2673fff640 10 monclient: _check_auth_tickets 2026-02-22T23:25:45.428 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7f2673fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T23:25:45.428 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7f2673fff640 1 -- 10.20.193.45:0/921591014 <== mon.8 v1:10.20.193.45:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f2674003020 con 0x7f2684137ba0 2026-02-22T23:25:45.428 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7f2673fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:25:45.428 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7f8890ff9640 1 -- 10.20.193.45:0/41817586 --> v1:10.20.193.73:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f889413ce10 con 0x7f889413f720 2026-02-22T23:25:45.428 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7f2673fff640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2026-02-22T23:25:45.428 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7f0c492c4640 10 monclient: _reopen_session rank -1 2026-02-22T23:25:45.428 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7f8890ff9640 1 -- 10.20.193.45:0/41817586 <== mon.3 v1:10.20.193.73:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f88880034c0 con 0x7f889413f720 2026-02-22T23:25:45.428 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7f8890ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-22T23:25:45.428 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7f2673fff640 10 monclient: dump: 2026-02-22T23:25:45.428 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:45.428 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:45.428 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:45.428 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:45.428 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:45.428 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:45.428 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:45.428 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:45.428 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:45.428 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:45.428 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:45.428 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:45.428 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:45.428 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:45.428 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:45.428 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:45.429 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7f268b51b640 5 monclient: authenticate success, global_id 4274 2026-02-22T23:25:45.429 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7f268b51b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-22T23:25:45.429 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7f0c492c4640 10 monclient: _add_conns ranks=[2,8,3,4,6,5,0,1,7] 2026-02-22T23:25:45.429 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7f8890ff9640 10 monclient(hunting): got monmap 1 from mon.noname-g (according to old e1) 2026-02-22T23:25:45.429 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7f8890ff9640 10 monclient(hunting): dump: 2026-02-22T23:25:45.429 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:45.429 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:45.429 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:45.429 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:45.429 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:45.429 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:45.429 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:45.429 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:45.429 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:45.429 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:45.429 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:45.429 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:45.429 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:45.429 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:45.429 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:45.429 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:45.429 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7f0c492c4640 10 monclient(hunting): picked mon.noname-b con 0x7f0c440a5e00 addr v1:10.20.193.45:6790/0 2026-02-22T23:25:45.429 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7f8890ff9640 10 monclient(hunting): _finish_auth 0 2026-02-22T23:25:45.430 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7f0c492c4640 10 monclient(hunting): picked mon.noname-e con 0x7f0c440a68f0 addr v1:10.20.193.45:6793/0 2026-02-22T23:25:45.430 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7f0c492c4640 10 monclient(hunting): picked mon.noname-g con 0x7f0c440a6d00 addr v1:10.20.193.73:6790/0 2026-02-22T23:25:45.430 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7f0c492c4640 1 -- --> v1:10.20.193.45:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0c44129090 con 0x7f0c440a5e00 2026-02-22T23:25:45.430 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7f0c492c4640 1 -- --> v1:10.20.193.73:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0c440a9920 con 0x7f0c440a6d00 2026-02-22T23:25:45.430 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7f0c492c4640 1 -- --> v1:10.20.193.45:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0c44128db0 con 0x7f0c440a68f0 2026-02-22T23:25:45.430 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7f0c492c4640 10 monclient(hunting): _renew_subs 2026-02-22T23:25:45.430 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7f2673fff640 1 -- 10.20.193.45:0/921591014 <== mon.8 v1:10.20.193.45:6793/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2674003240 con 0x7f2684137ba0 2026-02-22T23:25:45.430 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7f2673fff640 10 monclient: handle_config config(0 keys) 2026-02-22T23:25:45.430 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7f0c492c4640 10 monclient(hunting): authenticate will time out at 676.998728s 2026-02-22T23:25:45.430 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7f8890ff9640 1 -- 10.20.193.45:0/41817586 <== mon.5 v1:10.20.193.73:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2295683816 0 0) 0x7f889413de50 con 0x7f889413bc10 2026-02-22T23:25:45.430 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7f2673fff640 1 -- 10.20.193.45:0/921591014 <== mon.8 v1:10.20.193.45:6793/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f2674004ce0 con 0x7f2684137ba0 2026-02-22T23:25:45.430 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7f268b51b640 10 monclient: get_monmap_and_config success 2026-02-22T23:25:45.430 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7f268b51b640 4 set_mon_vals no callback set 2026-02-22T23:25:45.430 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7f2673fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:25:45.430 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7f8890ff9640 1 -- 10.20.193.45:0/41817586 --> v1:10.20.193.73:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f8864003620 con 0x7f889413bc10 2026-02-22T23:25:45.430 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7f8890ff9640 1 -- 10.20.193.45:0/41817586 <== mon.5 v1:10.20.193.73:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f8884003360 con 0x7f889413bc10 2026-02-22T23:25:45.430 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7f8890ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-22T23:25:45.430 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7f2673fff640 10 monclient: got monmap 1 from mon.e (according to old e1) 2026-02-22T23:25:45.430 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7f2673fff640 10 monclient: dump: 2026-02-22T23:25:45.431 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:45.431 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:45.431 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:45.431 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:45.431 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:45.431 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:45.431 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:45.431 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:45.431 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:45.431 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:45.431 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:45.431 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:45.431 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:45.431 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:45.431 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:45.431 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:45.431 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7f8890ff9640 10 monclient(hunting): got monmap 1 from mon.h (according to old e1) 2026-02-22T23:25:45.431 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7f8890ff9640 10 monclient(hunting): dump: 2026-02-22T23:25:45.431 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:45.431 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:45.431 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:45.431 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:45.431 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:45.431 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:45.431 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:45.431 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:45.431 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:45.431 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:45.431 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:45.431 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:45.431 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:45.431 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:45.431 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:45.431 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:45.431 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7faf9873e640 10 monclient: get_monmap_and_config success 2026-02-22T23:25:45.431 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7faf9873e640 4 set_mon_vals no callback set 2026-02-22T23:25:45.432 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7f0c42ffd640 1 --1- >> v1:10.20.193.45:6790/0 conn(0x7f0c440a5e00 0x7f0c44141730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.45:6790/0 says I am v1:10.20.193.45:50856/0 (socket says 10.20.193.45:50856) 2026-02-22T23:25:45.432 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7f0c427fc640 1 --1- >> v1:10.20.193.45:6793/0 conn(0x7f0c440a68f0 0x7f0c441d45f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.45:6793/0 says I am v1:10.20.193.45:36706/0 (socket says 10.20.193.45:36706) 2026-02-22T23:25:45.432 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7f8890ff9640 1 -- 10.20.193.45:0/41817586 <== mon.3 v1:10.20.193.73:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2928462555 0 0) 0x7f889413ce10 con 0x7f889413f720 2026-02-22T23:25:45.432 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7f0c42ffd640 1 -- 10.20.193.45:0/4265815544 learned_addr learned my addr 10.20.193.45:0/4265815544 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-22T23:25:45.432 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7f8890ff9640 1 -- 10.20.193.45:0/41817586 >> v1:10.20.193.73:6791/0 conn(0x7f889413bc10 legacy=0x7f889413c700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:45.432 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7f8890ff9640 1 -- 10.20.193.45:0/41817586 >> v1:10.20.193.73:6789/0 conn(0x7f8894138d30 legacy=0x7f889413bff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:45.432 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7f8890ff9640 10 monclient: _finish_hunting 0 2026-02-22T23:25:45.432 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7f8890ff9640 1 monclient: found mon.g 2026-02-22T23:25:45.432 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7f8890ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T23:25:45.432 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7f8890ff9640 10 monclient: _send_mon_message to mon.g at v1:10.20.193.73:6790/0 2026-02-22T23:25:45.432 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7f8890ff9640 1 -- 10.20.193.45:0/41817586 --> v1:10.20.193.73:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f889413e130 con 0x7f889413f720 2026-02-22T23:25:45.432 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7f8890ff9640 10 monclient: _finish_auth 0 2026-02-22T23:25:45.432 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7f8890ff9640 10 monclient: _check_auth_tickets 2026-02-22T23:25:45.432 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7f8890ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T23:25:45.432 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7f88996a3640 5 monclient: authenticate success, global_id 4260 2026-02-22T23:25:45.432 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7f88996a3640 10 monclient: _renew_subs 2026-02-22T23:25:45.432 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7f88996a3640 10 monclient: _send_mon_message to mon.g at v1:10.20.193.73:6790/0 2026-02-22T23:25:45.432 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7f88996a3640 1 -- 10.20.193.45:0/41817586 --> v1:10.20.193.73:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f88941379c0 con 0x7f889413f720 2026-02-22T23:25:45.433 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7f88996a3640 10 monclient: _renew_subs 2026-02-22T23:25:45.433 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7f88996a3640 10 monclient: _send_mon_message to mon.g at v1:10.20.193.73:6790/0 2026-02-22T23:25:45.433 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7f88996a3640 1 -- 10.20.193.45:0/41817586 --> v1:10.20.193.73:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f889413edf0 con 0x7f889413f720 2026-02-22T23:25:45.433 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7f8890ff9640 1 -- 10.20.193.45:0/41817586 <== mon.3 v1:10.20.193.73:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f8888003a90 con 0x7f889413f720 2026-02-22T23:25:45.433 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7f8890ff9640 10 monclient: handle_config config(0 keys) 2026-02-22T23:25:45.433 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7f8890ff9640 1 -- 10.20.193.45:0/41817586 <== mon.3 v1:10.20.193.73:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f8888003f80 con 0x7f889413f720 2026-02-22T23:25:45.433 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7f8890ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:25:45.433 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7f88927fc640 4 set_mon_vals no callback set 2026-02-22T23:25:45.433 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7f8890ff9640 10 monclient: got monmap 1 from mon.g (according to old e1) 2026-02-22T23:25:45.433 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7f8890ff9640 10 monclient: dump: 2026-02-22T23:25:45.433 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:45.433 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:45.433 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:45.433 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:45.433 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:45.433 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:45.433 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:45.433 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:45.433 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:45.433 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:45.433 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:45.433 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:45.433 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:45.433 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:45.433 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:45.433 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:45.433 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7f0c1f7fe640 1 -- 10.20.193.45:0/4265815544 <== mon.8 v1:10.20.193.45:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1850569449 0 0) 0x7f0c44128db0 con 0x7f0c440a68f0 2026-02-22T23:25:45.433 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7f0c1f7fe640 10 monclient(hunting): _negotiate 2026-02-22T23:25:45.433 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7f0c1f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:45.433 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7f0c1f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:45.433 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7f0c1f7fe640 10 monclient(hunting): my global_id is 4283 2026-02-22T23:25:45.433 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7f0c1f7fe640 1 -- 10.20.193.45:0/4265815544 --> v1:10.20.193.45:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0c10003620 con 0x7f0c440a68f0 2026-02-22T23:25:45.433 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7f0c1f7fe640 1 -- 10.20.193.45:0/4265815544 <== mon.2 v1:10.20.193.45:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 959318769 0 0) 0x7f0c44129090 con 0x7f0c440a5e00 2026-02-22T23:25:45.433 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7f0c1f7fe640 10 monclient(hunting): _negotiate 2026-02-22T23:25:45.433 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7f0c1f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:45.433 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7f0c1f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:45.433 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7f0c1f7fe640 10 monclient(hunting): my global_id is 4286 2026-02-22T23:25:45.433 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7f0c1f7fe640 1 -- 10.20.193.45:0/4265815544 --> v1:10.20.193.45:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0c44128db0 con 0x7f0c440a5e00 2026-02-22T23:25:45.434 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7fa09e816640 1 -- 10.20.193.45:0/3021024746 wait complete. 2026-02-22T23:25:45.434 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7fa09e816640 10 monclient: build_initial_monmap 2026-02-22T23:25:45.434 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7fa09e816640 10 monclient: monmap: 2026-02-22T23:25:45.434 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-22T23:25:45.434 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T23:25:45.434 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-22T23:25:45.434 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-22T23:25:45.434 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-22T23:25:45.434 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-22T23:25:45.434 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-22T23:25:45.434 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.noname-f 2026-02-22T23:25:45.434 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.noname-b 2026-02-22T23:25:45.434 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.noname-g 2026-02-22T23:25:45.434 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.noname-c 2026-02-22T23:25:45.434 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.noname-h 2026-02-22T23:25:45.434 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.noname-d 2026-02-22T23:25:45.434 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.noname-i 2026-02-22T23:25:45.434 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.noname-e 2026-02-22T23:25:45.434 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:45.434 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.381+0000 7fa09e816640 1 Processor -- start 2026-02-22T23:25:45.434 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.382+0000 7f0c1f7fe640 1 -- 10.20.193.45:0/4265815544 <== mon.8 v1:10.20.193.45:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1332593855 0 0) 0x7f0c10003620 con 0x7f0c440a68f0 2026-02-22T23:25:45.434 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.382+0000 7f0c1f7fe640 1 -- 10.20.193.45:0/4265815544 --> v1:10.20.193.45:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0c44129090 con 0x7f0c440a68f0 2026-02-22T23:25:45.434 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.382+0000 7f0c1f7fe640 1 -- 10.20.193.45:0/4265815544 <== mon.8 v1:10.20.193.45:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f0c2c002cf0 con 0x7f0c440a68f0 2026-02-22T23:25:45.434 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.382+0000 7f0c1f7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-22T23:25:45.434 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.382+0000 7fba35fce640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.45:6790/0 2026-02-22T23:25:45.434 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.382+0000 7fba35fce640 1 -- 10.20.193.45:0/145605847 --> v1:10.20.193.45:6790/0 -- mon_get_version(what=osdmap handle=1) -- 0x7fba30140b80 con 0x7fba300a0f60 2026-02-22T23:25:45.434 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.382+0000 7f0c1f7fe640 10 monclient(hunting): got monmap 1 from mon.noname-e (according to old e1) 2026-02-22T23:25:45.434 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.382+0000 7f0c1f7fe640 10 monclient(hunting): dump: 2026-02-22T23:25:45.435 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:45.435 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:45.435 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:45.435 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:45.435 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:45.435 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:45.435 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:45.435 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:45.435 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:45.435 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:45.435 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:45.435 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:45.435 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:45.435 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:45.435 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:45.435 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:45.435 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.382+0000 7f0c1f7fe640 10 monclient(hunting): _finish_auth 0 2026-02-22T23:25:45.435 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.382+0000 7f0c1f7fe640 1 -- 10.20.193.45:0/4265815544 <== mon.2 v1:10.20.193.45:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1596286799 0 0) 0x7f0c44128db0 con 0x7f0c440a5e00 2026-02-22T23:25:45.435 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.382+0000 7f0c1f7fe640 1 -- 10.20.193.45:0/4265815544 --> v1:10.20.193.45:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0c10003620 con 0x7f0c440a5e00 2026-02-22T23:25:45.435 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.382+0000 7f0c1f7fe640 1 -- 10.20.193.45:0/4265815544 <== mon.2 v1:10.20.193.45:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f0c38003660 con 0x7f0c440a5e00 2026-02-22T23:25:45.435 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.382+0000 7f0c1f7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-22T23:25:45.435 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.382+0000 7faf9873e640 10 monclient: shutdown 2026-02-22T23:25:45.435 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.382+0000 7faf9873e640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T23:25:45.435 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.382+0000 7faf9873e640 1 -- 10.20.193.45:0/1955014490 >> v1:10.20.193.45:6790/0 conn(0x7faf9013d2b0 legacy=0x7faf9013f6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:45.435 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.382+0000 7f0c1f7fe640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-22T23:25:45.435 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.382+0000 7f0c1f7fe640 10 monclient(hunting): dump: 2026-02-22T23:25:45.435 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:45.435 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:45.435 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:45.435 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:45.435 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:45.435 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:45.435 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:45.435 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:45.435 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:45.435 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:45.435 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:45.436 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:45.436 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:45.436 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:45.436 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:45.436 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:45.436 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.382+0000 7f268b51b640 10 monclient: shutdown 2026-02-22T23:25:45.436 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.382+0000 7f268b51b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T23:25:45.436 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.382+0000 7f0c1f7fe640 1 -- 10.20.193.45:0/4265815544 <== mon.8 v1:10.20.193.45:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3990086396 0 0) 0x7f0c44129090 con 0x7f0c440a68f0 2026-02-22T23:25:45.436 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.382+0000 7f268b51b640 1 -- 10.20.193.45:0/921591014 >> v1:10.20.193.45:6793/0 conn(0x7f2684137ba0 legacy=0x7f2684137f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:45.436 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.382+0000 7f0c1f7fe640 1 -- 10.20.193.45:0/4265815544 >> v1:10.20.193.73:6790/0 conn(0x7f0c440a6d00 legacy=0x7f0c441d7d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:45.436 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.382+0000 7f268b51b640 1 -- 10.20.193.45:0/921591014 shutdown_connections 2026-02-22T23:25:45.436 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.382+0000 7f268b51b640 1 -- 10.20.193.45:0/921591014 >> 10.20.193.45:0/921591014 conn(0x7f26840a4b70 msgr2=0x7f26840a4f80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:25:45.436 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.382+0000 7f0c1f7fe640 1 -- 10.20.193.45:0/4265815544 >> v1:10.20.193.45:6790/0 conn(0x7f0c440a5e00 legacy=0x7f0c44141730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:45.436 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.382+0000 7f268b51b640 1 -- 10.20.193.45:0/921591014 shutdown_connections 2026-02-22T23:25:45.436 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.382+0000 7f268b51b640 1 -- 10.20.193.45:0/921591014 wait complete. 2026-02-22T23:25:45.436 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.382+0000 7f88996a3640 10 monclient: _send_mon_message to mon.g at v1:10.20.193.73:6790/0 2026-02-22T23:25:45.436 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.382+0000 7f88996a3640 1 -- 10.20.193.45:0/41817586 --> v1:10.20.193.73:6790/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f88940a1660 con 0x7f889413f720 2026-02-22T23:25:45.437 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.382+0000 7fba0bfff640 1 -- 10.20.193.45:0/145605847 <== mon.2 v1:10.20.193.45:6790/0 7 ==== mgrmap(e 5) ==== 50225+0+0 (unknown 2330357642 0 0) 0x7fba1c011660 con 0x7fba300a0f60 2026-02-22T23:25:45.437 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.382+0000 7fa09e816640 1 -- start start 2026-02-22T23:25:45.437 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.382+0000 7fa09e816640 10 monclient: init 2026-02-22T23:25:45.437 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.382+0000 7fa09e816640 10 monclient: _reopen_session rank -1 2026-02-22T23:25:45.437 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.382+0000 7fa09e816640 10 monclient: _add_conns ranks=[5,4,1,3,2,7,6,8,0] 2026-02-22T23:25:45.437 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.382+0000 7fa09e816640 10 monclient(hunting): picked mon.noname-h con 0x7fa0980a3f10 addr v1:10.20.193.73:6791/0 2026-02-22T23:25:45.437 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.382+0000 7f0c1f7fe640 10 monclient: _finish_hunting 0 2026-02-22T23:25:45.437 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.382+0000 7f0c1f7fe640 1 monclient: found mon.e 2026-02-22T23:25:45.437 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.382+0000 7f0c1f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T23:25:45.437 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.382+0000 7f0c1f7fe640 10 monclient: _send_mon_message to mon.e at v1:10.20.193.45:6793/0 2026-02-22T23:25:45.437 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.382+0000 7f0c1f7fe640 1 -- 10.20.193.45:0/4265815544 --> v1:10.20.193.45:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c44141e40 con 0x7f0c440a68f0 2026-02-22T23:25:45.437 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.382+0000 7f0c1f7fe640 10 monclient: _finish_auth 0 2026-02-22T23:25:45.437 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.382+0000 7f0c1f7fe640 10 monclient: _check_auth_tickets 2026-02-22T23:25:45.437 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.382+0000 7f0c1f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T23:25:45.437 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.382+0000 7f0c492c4640 5 monclient: authenticate success, global_id 4283 2026-02-22T23:25:45.437 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.382+0000 7fa09e816640 10 monclient(hunting): picked mon.noname-c con 0x7fa0980a4610 addr v1:10.20.193.45:6791/0 2026-02-22T23:25:45.437 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.382+0000 7fa09e816640 10 monclient(hunting): picked mon.noname-f con 0x7fa0980a5100 addr v1:10.20.193.73:6789/0 2026-02-22T23:25:45.437 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.382+0000 7fa09e816640 1 -- --> v1:10.20.193.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa09806fcd0 con 0x7fa0980a5100 2026-02-22T23:25:45.437 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.382+0000 7fa09e816640 1 -- --> v1:10.20.193.45:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa098141470 con 0x7fa0980a4610 2026-02-22T23:25:45.437 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.382+0000 7fa09e816640 1 -- --> v1:10.20.193.73:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa09813bbc0 con 0x7fa0980a3f10 2026-02-22T23:25:45.437 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.382+0000 7fa09e816640 10 monclient(hunting): _renew_subs 2026-02-22T23:25:45.438 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.382+0000 7f8890ff9640 1 -- 10.20.193.45:0/41817586 <== mon.3 v1:10.20.193.73:6790/0 7 ==== mgrmap(e 5) ==== 50225+0+0 (unknown 2330357642 0 0) 0x7f8888004120 con 0x7f889413f720 2026-02-22T23:25:45.438 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.382+0000 7f0c492c4640 10 monclient: _renew_subs 2026-02-22T23:25:45.438 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.382+0000 7f0c492c4640 10 monclient: _send_mon_message to mon.e at v1:10.20.193.45:6793/0 2026-02-22T23:25:45.438 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.382+0000 7f0c492c4640 1 -- 10.20.193.45:0/4265815544 --> v1:10.20.193.45:6793/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f0c44127b20 con 0x7f0c440a68f0 2026-02-22T23:25:45.438 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.382+0000 7f0c492c4640 10 monclient: _renew_subs 2026-02-22T23:25:45.438 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.382+0000 7fa0977fe640 1 --1- >> v1:10.20.193.45:6791/0 conn(0x7fa0980a4610 0x7fa09813feb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.45:6791/0 says I am v1:10.20.193.45:37880/0 (socket says 10.20.193.45:37880) 2026-02-22T23:25:45.438 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.382+0000 7fa0977fe640 1 -- 10.20.193.45:0/2242759319 learned_addr learned my addr 10.20.193.45:0/2242759319 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-22T23:25:45.438 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.382+0000 7f0c492c4640 10 monclient: _send_mon_message to mon.e at v1:10.20.193.45:6793/0 2026-02-22T23:25:45.438 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.382+0000 7f0c492c4640 1 -- 10.20.193.45:0/4265815544 --> v1:10.20.193.45:6793/0 -- mon_subscribe({osdmap=0}) -- 0x7f0c441cbf10 con 0x7f0c440a68f0 2026-02-22T23:25:45.438 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.382+0000 7fa09e816640 10 monclient(hunting): authenticate will time out at 676.999456s 2026-02-22T23:25:45.438 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.382+0000 7fa094ff9640 1 -- 10.20.193.45:0/2242759319 <== mon.4 v1:10.20.193.45:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2738368188 0 0) 0x7fa098141470 con 0x7fa0980a4610 2026-02-22T23:25:45.438 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.382+0000 7fa094ff9640 10 monclient(hunting): _negotiate 2026-02-22T23:25:45.438 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.382+0000 7fa094ff9640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:45.438 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.382+0000 7fa094ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:45.438 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.382+0000 7fa094ff9640 10 monclient(hunting): my global_id is 4288 2026-02-22T23:25:45.438 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.382+0000 7fa094ff9640 1 -- 10.20.193.45:0/2242759319 --> v1:10.20.193.45:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa068003620 con 0x7fa0980a4610 2026-02-22T23:25:45.438 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.382+0000 7fba0bfff640 1 -- 10.20.193.45:0/145605847 <== mon.2 v1:10.20.193.45:6790/0 8 ==== osd_map(19..19 src has 1..19) ==== 3558+0+0 (unknown 1288710973 0 0) 0x7fba1c04dc70 con 0x7fba300a0f60 2026-02-22T23:25:45.438 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.382+0000 7f8890ff9640 1 -- 10.20.193.45:0/41817586 <== mon.3 v1:10.20.193.73:6790/0 8 ==== osd_map(19..19 src has 1..19) ==== 3558+0+0 (unknown 1288710973 0 0) 0x7f888804cd30 con 0x7f889413f720 2026-02-22T23:25:45.439 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.382+0000 7f0c492c4640 10 monclient: _send_mon_message to mon.e at v1:10.20.193.45:6793/0 2026-02-22T23:25:45.439 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.382+0000 7f0c492c4640 1 -- 10.20.193.45:0/4265815544 --> v1:10.20.193.45:6793/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f0c440a5770 con 0x7f0c440a68f0 2026-02-22T23:25:45.439 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.382+0000 7fa094ff9640 1 -- 10.20.193.45:0/2242759319 <== mon.5 v1:10.20.193.73:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 254107509 0 0) 0x7fa09813bbc0 con 0x7fa0980a3f10 2026-02-22T23:25:45.439 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.382+0000 7fa094ff9640 10 monclient(hunting): _negotiate 2026-02-22T23:25:45.439 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.382+0000 7fa094ff9640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:45.439 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.382+0000 7fa094ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:45.439 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.382+0000 7fa094ff9640 10 monclient(hunting): my global_id is 4289 2026-02-22T23:25:45.439 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.382+0000 7fa094ff9640 1 -- 10.20.193.45:0/2242759319 --> v1:10.20.193.73:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa098141470 con 0x7fa0980a3f10 2026-02-22T23:25:45.439 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.382+0000 7fa094ff9640 1 -- 10.20.193.45:0/2242759319 <== mon.4 v1:10.20.193.45:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2383059007 0 0) 0x7fa068003620 con 0x7fa0980a4610 2026-02-22T23:25:45.439 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.382+0000 7fa094ff9640 1 -- 10.20.193.45:0/2242759319 --> v1:10.20.193.45:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa09813bbc0 con 0x7fa0980a4610 2026-02-22T23:25:45.439 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.382+0000 7fa094ff9640 1 -- 10.20.193.45:0/2242759319 <== mon.4 v1:10.20.193.45:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7fa088003340 con 0x7fa0980a4610 2026-02-22T23:25:45.439 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.382+0000 7fa094ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-22T23:25:45.439 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.382+0000 7f8890ff9640 1 -- 10.20.193.45:0/41817586 --> v1:10.20.193.73:6805/3607388566 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f886404a7c0 con 0x7f8864046b10 2026-02-22T23:25:45.439 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.382+0000 7f8890ff9640 1 -- 10.20.193.45:0/41817586 <== mon.3 v1:10.20.193.73:6790/0 9 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (unknown 4138596325 0 0) 0x7f888804d0c0 con 0x7f889413f720 2026-02-22T23:25:45.439 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.382+0000 7f8890ff9640 10 monclient: handle_get_version_reply finishing 1 version 19 2026-02-22T23:25:45.439 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.382+0000 7fa094ff9640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-22T23:25:45.439 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.382+0000 7fa094ff9640 10 monclient(hunting): dump: 2026-02-22T23:25:45.439 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:45.439 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:45.439 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:45.439 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:45.440 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:45.440 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:45.440 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:45.440 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:45.440 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:45.440 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:45.440 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:45.440 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:45.440 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:45.440 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:45.440 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:45.440 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:45.440 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.382+0000 7fa094ff9640 10 monclient(hunting): _finish_auth 0 2026-02-22T23:25:45.440 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.382+0000 7fa094ff9640 1 -- 10.20.193.45:0/2242759319 <== mon.1 v1:10.20.193.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2256612767 0 0) 0x7fa09806fcd0 con 0x7fa0980a5100 2026-02-22T23:25:45.440 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.382+0000 7fa094ff9640 10 monclient(hunting): _negotiate 2026-02-22T23:25:45.440 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.382+0000 7fa094ff9640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:45.440 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.382+0000 7fa094ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:45.440 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.382+0000 7fa094ff9640 10 monclient(hunting): my global_id is 4348 2026-02-22T23:25:45.440 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.382+0000 7f8893fff640 10 monclient: get_auth_request con 0x7f886403ff80 auth_method 0 2026-02-22T23:25:45.440 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.382+0000 7fa094ff9640 1 -- 10.20.193.45:0/2242759319 --> v1:10.20.193.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa068003620 con 0x7fa0980a5100 2026-02-22T23:25:45.440 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.382+0000 7fba0bfff640 1 -- 10.20.193.45:0/145605847 --> v1:10.20.193.73:6801/3756325394 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fba0004a7f0 con 0x7fba00046b40 2026-02-22T23:25:45.440 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.382+0000 7fba2effd640 10 monclient: get_auth_request con 0x7fba0003ffe0 auth_method 0 2026-02-22T23:25:45.440 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.382+0000 7fba0bfff640 1 -- 10.20.193.45:0/145605847 <== mon.2 v1:10.20.193.45:6790/0 9 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (unknown 4138596325 0 0) 0x7fba1c04dff0 con 0x7fba300a0f60 2026-02-22T23:25:45.440 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.382+0000 7fba0bfff640 10 monclient: handle_get_version_reply finishing 1 version 19 2026-02-22T23:25:45.440 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.382+0000 7f0c1f7fe640 1 -- 10.20.193.45:0/4265815544 <== mon.8 v1:10.20.193.45:6793/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0c440a5770 con 0x7f0c440a68f0 2026-02-22T23:25:45.440 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.382+0000 7f0c1f7fe640 10 monclient: handle_config config(0 keys) 2026-02-22T23:25:45.440 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.382+0000 7f0c1f7fe640 1 -- 10.20.193.45:0/4265815544 <== mon.8 v1:10.20.193.45:6793/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f0c2c002fd0 con 0x7f0c440a68f0 2026-02-22T23:25:45.440 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.382+0000 7f0c1f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:25:45.441 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.382+0000 7fa094ff9640 1 -- 10.20.193.45:0/2242759319 <== mon.5 v1:10.20.193.73:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3029069280 0 0) 0x7fa098141470 con 0x7fa0980a3f10 2026-02-22T23:25:45.441 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.382+0000 7f0c417fa640 4 set_mon_vals no callback set 2026-02-22T23:25:45.441 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.382+0000 7f0c1f7fe640 10 monclient: got monmap 1 from mon.e (according to old e1) 2026-02-22T23:25:45.441 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.382+0000 7fa094ff9640 1 -- 10.20.193.45:0/2242759319 --> v1:10.20.193.73:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa09806fcd0 con 0x7fa0980a3f10 2026-02-22T23:25:45.441 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.382+0000 7f0c1f7fe640 10 monclient: dump: 2026-02-22T23:25:45.441 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:45.441 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:45.441 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:45.441 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:45.441 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:45.441 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:45.441 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:45.441 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:45.441 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:45.441 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:45.441 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:45.441 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:45.441 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:45.441 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:45.441 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:45.441 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:45.441 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.382+0000 7fa094ff9640 1 -- 10.20.193.45:0/2242759319 <== mon.5 v1:10.20.193.73:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7fa084003250 con 0x7fa0980a3f10 2026-02-22T23:25:45.441 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.382+0000 7fa094ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-22T23:25:45.441 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.382+0000 7fa094ff9640 10 monclient(hunting): got monmap 1 from mon.h (according to old e1) 2026-02-22T23:25:45.441 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.382+0000 7fa094ff9640 10 monclient(hunting): dump: 2026-02-22T23:25:45.442 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:45.442 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:45.442 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:45.442 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:45.442 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:45.442 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:45.442 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:45.442 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:45.442 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:45.442 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:45.442 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:45.442 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:45.442 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:45.442 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:45.442 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:45.442 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:45.442 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.382+0000 7faf9873e640 1 -- 10.20.193.45:0/1955014490 shutdown_connections 2026-02-22T23:25:45.442 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.382+0000 7faf9873e640 1 -- 10.20.193.45:0/1955014490 >> 10.20.193.45:0/1955014490 conn(0x7faf900a9970 msgr2=0x7faf900a5c90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:25:45.442 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.382+0000 7f268b51b640 10 monclient: build_initial_monmap 2026-02-22T23:25:45.442 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.382+0000 7f268b51b640 10 monclient: monmap: 2026-02-22T23:25:45.442 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-22T23:25:45.442 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T23:25:45.442 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-22T23:25:45.442 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-22T23:25:45.442 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-22T23:25:45.442 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-22T23:25:45.442 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-22T23:25:45.442 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.noname-f 2026-02-22T23:25:45.442 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.noname-b 2026-02-22T23:25:45.442 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.noname-g 2026-02-22T23:25:45.442 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.noname-c 2026-02-22T23:25:45.442 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.noname-h 2026-02-22T23:25:45.442 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.noname-d 2026-02-22T23:25:45.442 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.noname-i 2026-02-22T23:25:45.442 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.noname-e 2026-02-22T23:25:45.442 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:45.443 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.382+0000 7f268b51b640 1 Processor -- start 2026-02-22T23:25:45.443 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.382+0000 7fba2ffff640 10 monclient: get_auth_request con 0x7fba00046b40 auth_method 0 2026-02-22T23:25:45.443 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.382+0000 7faf9873e640 1 -- 10.20.193.45:0/1955014490 shutdown_connections 2026-02-22T23:25:45.443 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.382+0000 7faf9873e640 1 -- 10.20.193.45:0/1955014490 wait complete. 2026-02-22T23:25:45.443 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.382+0000 7fa094ff9640 1 -- 10.20.193.45:0/2242759319 <== mon.1 v1:10.20.193.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1105684429 0 0) 0x7fa068003620 con 0x7fa0980a5100 2026-02-22T23:25:45.443 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.382+0000 7f268b51b640 1 -- start start 2026-02-22T23:25:45.443 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.382+0000 7f268b51b640 10 monclient: init 2026-02-22T23:25:45.443 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.382+0000 7fa094ff9640 1 -- 10.20.193.45:0/2242759319 --> v1:10.20.193.73:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa098141470 con 0x7fa0980a5100 2026-02-22T23:25:45.443 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.382+0000 7fa094ff9640 1 -- 10.20.193.45:0/2242759319 <== mon.1 v1:10.20.193.73:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7fa08c004fa0 con 0x7fa0980a5100 2026-02-22T23:25:45.443 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.382+0000 7f88937fe640 10 monclient: get_auth_request con 0x7f8864046b10 auth_method 0 2026-02-22T23:25:45.443 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.382+0000 7fa094ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-22T23:25:45.444 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.382+0000 7fa094ff9640 10 monclient(hunting): got monmap 1 from mon.f (according to old e1) 2026-02-22T23:25:45.444 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.382+0000 7fa094ff9640 10 monclient(hunting): dump: 2026-02-22T23:25:45.444 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:45.444 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:45.444 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:45.444 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:45.444 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:45.444 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:45.444 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:45.444 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:45.444 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:45.444 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:45.444 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:45.444 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:45.444 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:45.444 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:45.444 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:45.444 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:45.444 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.384+0000 7fa094ff9640 1 -- 10.20.193.45:0/2242759319 <== mon.5 v1:10.20.193.73:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 238935636 0 0) 0x7fa09806fcd0 con 0x7fa0980a3f10 2026-02-22T23:25:45.444 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.384+0000 7fa094ff9640 1 -- 10.20.193.45:0/2242759319 >> v1:10.20.193.45:6791/0 conn(0x7fa0980a4610 legacy=0x7fa09813feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:45.444 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.384+0000 7fa094ff9640 1 -- 10.20.193.45:0/2242759319 >> v1:10.20.193.73:6789/0 conn(0x7fa0980a5100 legacy=0x7fa0981dcb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:45.444 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.384+0000 7fa094ff9640 10 monclient: _finish_hunting 0 2026-02-22T23:25:45.444 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.384+0000 7fa094ff9640 1 monclient: found mon.h 2026-02-22T23:25:45.444 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.384+0000 7fa094ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T23:25:45.444 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.384+0000 7fa094ff9640 10 monclient: _send_mon_message to mon.h at v1:10.20.193.73:6791/0 2026-02-22T23:25:45.444 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.384+0000 7fa094ff9640 1 -- 10.20.193.45:0/2242759319 --> v1:10.20.193.73:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa098070ba0 con 0x7fa0980a3f10 2026-02-22T23:25:45.444 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.384+0000 7fa094ff9640 10 monclient: _finish_auth 0 2026-02-22T23:25:45.444 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.384+0000 7fa094ff9640 10 monclient: _check_auth_tickets 2026-02-22T23:25:45.444 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.384+0000 7fa094ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T23:25:45.444 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.384+0000 7fa09e816640 5 monclient: authenticate success, global_id 4289 2026-02-22T23:25:45.444 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.384+0000 7fa09e816640 10 monclient: _renew_subs 2026-02-22T23:25:45.444 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.384+0000 7fa09e816640 10 monclient: _send_mon_message to mon.h at v1:10.20.193.73:6791/0 2026-02-22T23:25:45.444 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.384+0000 7fa09e816640 1 -- 10.20.193.45:0/2242759319 --> v1:10.20.193.73:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fa098070e80 con 0x7fa0980a3f10 2026-02-22T23:25:45.444 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.384+0000 7fa09e816640 10 monclient: _renew_subs 2026-02-22T23:25:45.444 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.384+0000 7fa09e816640 10 monclient: _send_mon_message to mon.h at v1:10.20.193.73:6791/0 2026-02-22T23:25:45.444 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.384+0000 7fa09e816640 1 -- 10.20.193.45:0/2242759319 --> v1:10.20.193.73:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7fa098073610 con 0x7fa0980a3f10 2026-02-22T23:25:45.444 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.384+0000 7fa094ff9640 1 -- 10.20.193.45:0/2242759319 <== mon.5 v1:10.20.193.73:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa0840044c0 con 0x7fa0980a3f10 2026-02-22T23:25:45.444 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.384+0000 7fa094ff9640 10 monclient: handle_config config(0 keys) 2026-02-22T23:25:45.444 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.384+0000 7fa094ff9640 1 -- 10.20.193.45:0/2242759319 <== mon.5 v1:10.20.193.73:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7fa0840039e0 con 0x7fa0980a3f10 2026-02-22T23:25:45.444 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.384+0000 7fa094ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:25:45.444 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.384+0000 7fa0967fc640 4 set_mon_vals no callback set 2026-02-22T23:25:45.444 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.384+0000 7fa094ff9640 10 monclient: got monmap 1 from mon.h (according to old e1) 2026-02-22T23:25:45.444 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.384+0000 7fa094ff9640 10 monclient: dump: 2026-02-22T23:25:45.444 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:45.444 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:45.445 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:45.445 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:45.445 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:45.445 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:45.445 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:45.445 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:45.445 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:45.445 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:45.445 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:45.445 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:45.445 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:45.445 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:45.445 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:45.445 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:45.445 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.384+0000 7f0c1f7fe640 1 -- 10.20.193.45:0/4265815544 <== mon.8 v1:10.20.193.45:6793/0 7 ==== mgrmap(e 5) ==== 50225+0+0 (unknown 2330357642 0 0) 0x7f0c2c011310 con 0x7f0c440a68f0 2026-02-22T23:25:45.445 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.384+0000 7f268b51b640 10 monclient: _reopen_session rank -1 2026-02-22T23:25:45.445 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.384+0000 7f268b51b640 10 monclient: _add_conns ranks=[3,6,2,1,4,7,8,0,5] 2026-02-22T23:25:45.445 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.384+0000 7f268b51b640 10 monclient(hunting): picked mon.noname-g con 0x7f268409e120 addr v1:10.20.193.73:6790/0 2026-02-22T23:25:45.445 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.384+0000 7faf9873e640 10 monclient: build_initial_monmap 2026-02-22T23:25:45.445 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.384+0000 7f268b51b640 10 monclient(hunting): picked mon.noname-d con 0x7f2684137ba0 addr v1:10.20.193.45:6792/0 2026-02-22T23:25:45.445 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.384+0000 7f268b51b640 10 monclient(hunting): picked mon.noname-b con 0x7f268413f380 addr v1:10.20.193.45:6790/0 2026-02-22T23:25:45.445 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.384+0000 7faf9873e640 10 monclient: monmap: 2026-02-22T23:25:45.445 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-22T23:25:45.445 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T23:25:45.445 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-22T23:25:45.446 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-22T23:25:45.446 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-22T23:25:45.446 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-22T23:25:45.446 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-22T23:25:45.446 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.noname-f 2026-02-22T23:25:45.446 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.noname-b 2026-02-22T23:25:45.446 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.noname-g 2026-02-22T23:25:45.446 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.noname-c 2026-02-22T23:25:45.446 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.noname-h 2026-02-22T23:25:45.446 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.noname-d 2026-02-22T23:25:45.446 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.noname-i 2026-02-22T23:25:45.446 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.noname-e 2026-02-22T23:25:45.446 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:45.446 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.384+0000 7f268b51b640 1 -- --> v1:10.20.193.45:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f268411ea40 con 0x7f268413f380 2026-02-22T23:25:45.446 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.384+0000 7f268b51b640 1 -- --> v1:10.20.193.73:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f268413e7f0 con 0x7f268409e120 2026-02-22T23:25:45.446 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.384+0000 7f268b51b640 1 -- --> v1:10.20.193.45:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f26840a7c20 con 0x7f2684137ba0 2026-02-22T23:25:45.446 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.384+0000 7f268b51b640 10 monclient(hunting): _renew_subs 2026-02-22T23:25:45.446 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.384+0000 7f0c1f7fe640 1 -- 10.20.193.45:0/4265815544 <== mon.8 v1:10.20.193.45:6793/0 8 ==== osd_map(19..19 src has 1..19) ==== 3558+0+0 (unknown 1288710973 0 0) 0x7f0c2c04da10 con 0x7f0c440a68f0 2026-02-22T23:25:45.446 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.384+0000 7f268b51b640 10 monclient(hunting): authenticate will time out at 677.000308s 2026-02-22T23:25:45.446 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.384+0000 7f2688a8f640 1 --1- >> v1:10.20.193.45:6792/0 conn(0x7f2684137ba0 0x7f268413b500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.45:6792/0 says I am v1:10.20.193.45:56814/0 (socket says 10.20.193.45:56814) 2026-02-22T23:25:45.446 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.384+0000 7f2688a8f640 1 -- 10.20.193.45:0/2668566672 learned_addr learned my addr 10.20.193.45:0/2668566672 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-22T23:25:45.446 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.384+0000 7fa09e816640 10 monclient: _send_mon_message to mon.h at v1:10.20.193.73:6791/0 2026-02-22T23:25:45.446 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.384+0000 7fa09e816640 1 -- 10.20.193.45:0/2242759319 --> v1:10.20.193.73:6791/0 -- mon_get_version(what=osdmap handle=1) -- 0x7fa0980aa380 con 0x7fa0980a3f10 2026-02-22T23:25:45.446 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.384+0000 7faf9873e640 1 Processor -- start 2026-02-22T23:25:45.447 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.384+0000 7f0c1f7fe640 1 -- 10.20.193.45:0/4265815544 --> v1:10.20.193.45:6801/1146005631 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0c1004a600 con 0x7f0c10046970 2026-02-22T23:25:45.447 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.384+0000 7f0c1f7fe640 1 -- 10.20.193.45:0/4265815544 <== mon.8 v1:10.20.193.45:6793/0 9 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (unknown 4138596325 0 0) 0x7f0c2c04de50 con 0x7f0c440a68f0 2026-02-22T23:25:45.447 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.384+0000 7f0c1f7fe640 10 monclient: handle_get_version_reply finishing 1 version 19 2026-02-22T23:25:45.447 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.384+0000 7f2671ffb640 1 -- 10.20.193.45:0/2668566672 <== mon.2 v1:10.20.193.45:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 243708418 0 0) 0x7f268411ea40 con 0x7f268413f380 2026-02-22T23:25:45.447 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.384+0000 7f0c42ffd640 10 monclient: get_auth_request con 0x7f0c1003fda0 auth_method 0 2026-02-22T23:25:45.447 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.384+0000 7faf9873e640 1 -- start start 2026-02-22T23:25:45.447 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.384+0000 7faf9873e640 10 monclient: init 2026-02-22T23:25:45.447 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.384+0000 7f2671ffb640 10 monclient(hunting): _negotiate 2026-02-22T23:25:45.447 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.384+0000 7f2671ffb640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:45.447 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.384+0000 7f2671ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:45.447 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.384+0000 7f2671ffb640 10 monclient(hunting): my global_id is 4295 2026-02-22T23:25:45.447 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.384+0000 7f0c437fe640 10 monclient: get_auth_request con 0x7f0c10046970 auth_method 0 2026-02-22T23:25:45.447 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.384+0000 7f2671ffb640 1 -- 10.20.193.45:0/2668566672 --> v1:10.20.193.45:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2654003620 con 0x7f268413f380 2026-02-22T23:25:45.448 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.384+0000 7f2671ffb640 1 -- 10.20.193.45:0/2668566672 <== mon.6 v1:10.20.193.45:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1285321782 0 0) 0x7f26840a7c20 con 0x7f2684137ba0 2026-02-22T23:25:45.448 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.384+0000 7f2671ffb640 10 monclient(hunting): _negotiate 2026-02-22T23:25:45.448 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.384+0000 7f2671ffb640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:45.448 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.384+0000 7fa094ff9640 1 -- 10.20.193.45:0/2242759319 <== mon.5 v1:10.20.193.73:6791/0 7 ==== mgrmap(e 5) ==== 50225+0+0 (unknown 2330357642 0 0) 0x7fa084003ba0 con 0x7fa0980a3f10 2026-02-22T23:25:45.448 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.384+0000 7f2671ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:45.448 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.384+0000 7f2671ffb640 10 monclient(hunting): my global_id is 4281 2026-02-22T23:25:45.448 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.384+0000 7f2671ffb640 1 -- 10.20.193.45:0/2668566672 --> v1:10.20.193.45:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f268411ea40 con 0x7f2684137ba0 2026-02-22T23:25:45.448 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.384+0000 7f2671ffb640 1 -- 10.20.193.45:0/2668566672 <== mon.2 v1:10.20.193.45:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 760671936 0 0) 0x7f2654003620 con 0x7f268413f380 2026-02-22T23:25:45.448 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.384+0000 7f2671ffb640 1 -- 10.20.193.45:0/2668566672 --> v1:10.20.193.45:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f26840a7c20 con 0x7f268413f380 2026-02-22T23:25:45.448 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.384+0000 7f2671ffb640 1 -- 10.20.193.45:0/2668566672 <== mon.3 v1:10.20.193.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1186113618 0 0) 0x7f268413e7f0 con 0x7f268409e120 2026-02-22T23:25:45.448 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.384+0000 7f2671ffb640 10 monclient(hunting): _negotiate 2026-02-22T23:25:45.448 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.384+0000 7fba0bfff640 1 -- 10.20.193.45:0/145605847 <== osd.4 v1:10.20.193.73:6801/3756325394 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (unknown 0 0 3365489958) 0x7fba0004a7f0 con 0x7fba00046b40 2026-02-22T23:25:45.449 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.384+0000 7f2671ffb640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:45.449 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.384+0000 7f2671ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:45.449 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.384+0000 7f2671ffb640 10 monclient(hunting): my global_id is 4287 2026-02-22T23:25:45.449 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.384+0000 7f2671ffb640 1 -- 10.20.193.45:0/2668566672 --> v1:10.20.193.73:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2654003620 con 0x7f268409e120 2026-02-22T23:25:45.449 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.384+0000 7f2671ffb640 1 -- 10.20.193.45:0/2668566672 <== mon.6 v1:10.20.193.45:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1035092307 0 0) 0x7f268411ea40 con 0x7f2684137ba0 2026-02-22T23:25:45.449 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.384+0000 7f2671ffb640 1 -- 10.20.193.45:0/2668566672 --> v1:10.20.193.45:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f268413e7f0 con 0x7f2684137ba0 2026-02-22T23:25:45.449 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.384+0000 7f2671ffb640 1 -- 10.20.193.45:0/2668566672 <== mon.2 v1:10.20.193.45:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f2680003580 con 0x7f268413f380 2026-02-22T23:25:45.449 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.384+0000 7f2671ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-22T23:25:45.449 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.384+0000 7f2671ffb640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-22T23:25:45.449 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.384+0000 7f2671ffb640 10 monclient(hunting): dump: 2026-02-22T23:25:45.449 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:45.449 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:45.449 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:45.449 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:45.449 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:45.449 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:45.449 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:45.449 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:45.449 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:45.449 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:45.449 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:45.449 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:45.449 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:45.449 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:45.449 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:45.449 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:45.449 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.384+0000 7f2671ffb640 10 monclient(hunting): _finish_auth 0 2026-02-22T23:25:45.449 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.384+0000 7f2671ffb640 1 -- 10.20.193.45:0/2668566672 <== mon.6 v1:10.20.193.45:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f26780032c0 con 0x7f2684137ba0 2026-02-22T23:25:45.449 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.384+0000 7f2671ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-22T23:25:45.449 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.384+0000 7f2671ffb640 10 monclient(hunting): got monmap 1 from mon.d (according to old e1) 2026-02-22T23:25:45.449 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.384+0000 7f2671ffb640 10 monclient(hunting): dump: 2026-02-22T23:25:45.449 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:45.449 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:45.449 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:45.449 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:45.449 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:45.449 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:45.449 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:45.449 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:45.450 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:45.450 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:45.450 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:45.450 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:45.450 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:45.450 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:45.450 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:45.450 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:45.450 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.384+0000 7f2671ffb640 1 -- 10.20.193.45:0/2668566672 <== mon.6 v1:10.20.193.45:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1194318827 0 0) 0x7f268413e7f0 con 0x7f2684137ba0 2026-02-22T23:25:45.450 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.384+0000 7f2671ffb640 1 -- 10.20.193.45:0/2668566672 >> v1:10.20.193.73:6790/0 conn(0x7f268409e120 legacy=0x7f268413adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:45.450 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.384+0000 7fa094ff9640 1 -- 10.20.193.45:0/2242759319 <== mon.5 v1:10.20.193.73:6791/0 8 ==== osd_map(19..19 src has 1..19) ==== 3558+0+0 (unknown 1288710973 0 0) 0x7fa08404ca30 con 0x7fa0980a3f10 2026-02-22T23:25:45.450 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.384+0000 7f2671ffb640 1 -- 10.20.193.45:0/2668566672 >> v1:10.20.193.45:6790/0 conn(0x7f268413f380 legacy=0x7f26841d7d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:45.450 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.384+0000 7f2671ffb640 10 monclient: _finish_hunting 0 2026-02-22T23:25:45.450 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.384+0000 7f2671ffb640 1 monclient: found mon.d 2026-02-22T23:25:45.450 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.384+0000 7f2671ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T23:25:45.450 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.384+0000 7f2671ffb640 10 monclient: _send_mon_message to mon.d at v1:10.20.193.45:6792/0 2026-02-22T23:25:45.450 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.384+0000 7f2671ffb640 1 -- 10.20.193.45:0/2668566672 --> v1:10.20.193.45:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26840a77f0 con 0x7f2684137ba0 2026-02-22T23:25:45.450 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.384+0000 7f8890ff9640 1 -- 10.20.193.45:0/41817586 <== osd.3 v1:10.20.193.73:6805/3607388566 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (unknown 0 0 3365489958) 0x7f886404a7c0 con 0x7f8864046b10 2026-02-22T23:25:45.450 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.384+0000 7f2671ffb640 10 monclient: _finish_auth 0 2026-02-22T23:25:45.450 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.384+0000 7f2671ffb640 10 monclient: _check_auth_tickets 2026-02-22T23:25:45.450 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.384+0000 7f2671ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T23:25:45.450 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.384+0000 7f268b51b640 5 monclient: authenticate success, global_id 4281 2026-02-22T23:25:45.450 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.384+0000 7f268b51b640 10 monclient: _renew_subs 2026-02-22T23:25:45.450 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.384+0000 7f268b51b640 10 monclient: _send_mon_message to mon.d at v1:10.20.193.45:6792/0 2026-02-22T23:25:45.450 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.384+0000 7f268b51b640 1 -- 10.20.193.45:0/2668566672 --> v1:10.20.193.45:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f268413d370 con 0x7f2684137ba0 2026-02-22T23:25:45.450 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.384+0000 7f2671ffb640 1 -- 10.20.193.45:0/2668566672 <== mon.6 v1:10.20.193.45:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f26780038b0 con 0x7f2684137ba0 2026-02-22T23:25:45.450 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.384+0000 7f268b51b640 10 monclient: _renew_subs 2026-02-22T23:25:45.451 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.384+0000 7f268b51b640 10 monclient: _send_mon_message to mon.d at v1:10.20.193.45:6792/0 2026-02-22T23:25:45.451 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.384+0000 7f268b51b640 1 -- 10.20.193.45:0/2668566672 --> v1:10.20.193.45:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7f268411e760 con 0x7f2684137ba0 2026-02-22T23:25:45.451 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.384+0000 7f2671ffb640 10 monclient: handle_config config(0 keys) 2026-02-22T23:25:45.451 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.384+0000 7f2671ffb640 1 -- 10.20.193.45:0/2668566672 <== mon.6 v1:10.20.193.45:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f2678003ea0 con 0x7f2684137ba0 2026-02-22T23:25:45.451 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.384+0000 7f2671ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:25:45.451 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.384+0000 7f26737fe640 4 set_mon_vals no callback set 2026-02-22T23:25:45.451 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.384+0000 7faf9873e640 10 monclient: _reopen_session rank -1 2026-02-22T23:25:45.451 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.384+0000 7faf9873e640 10 monclient: _add_conns ranks=[1,5,4,7,3,6,2,8,0] 2026-02-22T23:25:45.451 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.384+0000 7faf9873e640 10 monclient(hunting): picked mon.noname-f con 0x7faf900733c0 addr v1:10.20.193.73:6789/0 2026-02-22T23:25:45.451 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.384+0000 7fa0977fe640 10 monclient: get_auth_request con 0x7fa068040240 auth_method 0 2026-02-22T23:25:45.451 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.384+0000 7faf9873e640 10 monclient(hunting): picked mon.noname-h con 0x7faf900a32c0 addr v1:10.20.193.73:6791/0 2026-02-22T23:25:45.451 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.384+0000 7faf9873e640 10 monclient(hunting): picked mon.noname-c con 0x7faf9013d2b0 addr v1:10.20.193.45:6791/0 2026-02-22T23:25:45.451 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.384+0000 7faf9873e640 1 -- --> v1:10.20.193.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf90123e60 con 0x7faf900733c0 2026-02-22T23:25:45.451 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.384+0000 7faf9873e640 1 -- --> v1:10.20.193.45:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf900a8790 con 0x7faf9013d2b0 2026-02-22T23:25:45.451 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.384+0000 7faf9873e640 1 -- --> v1:10.20.193.73:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf90124420 con 0x7faf900a32c0 2026-02-22T23:25:45.451 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.384+0000 7f2671ffb640 10 monclient: got monmap 1 from mon.d (according to old e1) 2026-02-22T23:25:45.451 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.384+0000 7f2671ffb640 10 monclient: dump: 2026-02-22T23:25:45.451 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:45.451 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:45.451 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:45.451 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:45.451 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:45.451 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:45.451 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:45.451 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:45.451 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:45.451 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:45.451 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:45.451 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:45.451 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:45.451 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:45.452 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:45.452 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:45.452 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.384+0000 7faf9873e640 10 monclient(hunting): _renew_subs 2026-02-22T23:25:45.452 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.384+0000 7faf9873e640 10 monclient(hunting): authenticate will time out at 677.001047s 2026-02-22T23:25:45.452 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.384+0000 7faf96cb4640 1 --1- >> v1:10.20.193.45:6791/0 conn(0x7faf9013d2b0 0x7faf901d5e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.45:6791/0 says I am v1:10.20.193.45:37886/0 (socket says 10.20.193.45:37886) 2026-02-22T23:25:45.452 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.384+0000 7faf96cb4640 1 -- 10.20.193.45:0/2220356480 learned_addr learned my addr 10.20.193.45:0/2220356480 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-22T23:25:45.452 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.384+0000 7fa094ff9640 1 -- 10.20.193.45:0/2242759319 --> v1:10.20.193.45:6808/2128209266 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa06804aaa0 con 0x7fa068046e10 2026-02-22T23:25:45.452 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.384+0000 7fa094ff9640 1 -- 10.20.193.45:0/2242759319 <== mon.5 v1:10.20.193.73:6791/0 9 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (unknown 4138596325 0 0) 0x7fa08404ce30 con 0x7fa0980a3f10 2026-02-22T23:25:45.452 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.384+0000 7fa094ff9640 10 monclient: handle_get_version_reply finishing 1 version 19 2026-02-22T23:25:45.452 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.384+0000 7fa09cd8c640 10 monclient: get_auth_request con 0x7fa068046e10 auth_method 0 2026-02-22T23:25:45.452 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.384+0000 7f0c1f7fe640 1 -- 10.20.193.45:0/4265815544 <== osd.0 v1:10.20.193.45:6801/1146005631 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (unknown 0 0 3365489958) 0x7f0c1004a600 con 0x7f0c10046970 2026-02-22T23:25:45.452 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.384+0000 7faf76ffd640 1 -- 10.20.193.45:0/2220356480 <== mon.4 v1:10.20.193.45:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 152946825 0 0) 0x7faf900a8790 con 0x7faf9013d2b0 2026-02-22T23:25:45.452 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.384+0000 7faf76ffd640 10 monclient(hunting): _negotiate 2026-02-22T23:25:45.452 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.384+0000 7faf76ffd640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:45.452 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.384+0000 7faf76ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:45.452 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.384+0000 7faf76ffd640 10 monclient(hunting): my global_id is 4297 2026-02-22T23:25:45.452 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.384+0000 7faf76ffd640 1 -- 10.20.193.45:0/2220356480 --> v1:10.20.193.45:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faf60003620 con 0x7faf9013d2b0 2026-02-22T23:25:45.452 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.384+0000 7f268b51b640 10 monclient: _send_mon_message to mon.d at v1:10.20.193.45:6792/0 2026-02-22T23:25:45.452 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.384+0000 7f268b51b640 1 -- 10.20.193.45:0/2668566672 --> v1:10.20.193.45:6792/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f268406d5f0 con 0x7f2684137ba0 2026-02-22T23:25:45.453 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.384+0000 7faf76ffd640 1 -- 10.20.193.45:0/2220356480 <== mon.5 v1:10.20.193.73:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 329946245 0 0) 0x7faf90124420 con 0x7faf900a32c0 2026-02-22T23:25:45.453 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.384+0000 7faf76ffd640 10 monclient(hunting): _negotiate 2026-02-22T23:25:45.453 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.384+0000 7faf76ffd640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:45.453 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.384+0000 7faf76ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:45.453 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.384+0000 7faf76ffd640 10 monclient(hunting): my global_id is 4298 2026-02-22T23:25:45.453 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.384+0000 7faf76ffd640 1 -- 10.20.193.45:0/2220356480 --> v1:10.20.193.73:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faf900a8790 con 0x7faf900a32c0 2026-02-22T23:25:45.453 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.384+0000 7faf76ffd640 1 -- 10.20.193.45:0/2220356480 <== mon.4 v1:10.20.193.45:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 680522071 0 0) 0x7faf60003620 con 0x7faf9013d2b0 2026-02-22T23:25:45.453 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.384+0000 7faf76ffd640 1 -- 10.20.193.45:0/2220356480 --> v1:10.20.193.45:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7faf90124420 con 0x7faf9013d2b0 2026-02-22T23:25:45.453 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.384+0000 7faf76ffd640 1 -- 10.20.193.45:0/2220356480 <== mon.4 v1:10.20.193.45:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7faf8c003790 con 0x7faf9013d2b0 2026-02-22T23:25:45.453 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.384+0000 7faf76ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-22T23:25:45.453 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.384+0000 7faf76ffd640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-22T23:25:45.453 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.384+0000 7faf76ffd640 10 monclient(hunting): dump: 2026-02-22T23:25:45.453 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:45.453 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:45.453 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:45.453 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:45.453 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:45.453 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:45.453 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:45.453 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:45.453 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:45.453 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:45.453 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:45.453 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:45.453 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:45.453 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:45.453 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:45.453 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:45.453 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.384+0000 7faf76ffd640 10 monclient(hunting): _finish_auth 0 2026-02-22T23:25:45.453 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.384+0000 7faf76ffd640 1 -- 10.20.193.45:0/2220356480 <== mon.4 v1:10.20.193.45:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 882039926 0 0) 0x7faf90124420 con 0x7faf9013d2b0 2026-02-22T23:25:45.453 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.384+0000 7faf76ffd640 1 -- 10.20.193.45:0/2220356480 >> v1:10.20.193.73:6791/0 conn(0x7faf900a32c0 legacy=0x7faf901d2740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:45.453 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.384+0000 7faf76ffd640 1 -- 10.20.193.45:0/2220356480 >> v1:10.20.193.73:6789/0 conn(0x7faf900733c0 legacy=0x7faf90138a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:45.454 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.384+0000 7faf76ffd640 10 monclient: _finish_hunting 0 2026-02-22T23:25:45.454 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.384+0000 7faf76ffd640 1 monclient: found mon.c 2026-02-22T23:25:45.454 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.384+0000 7faf76ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T23:25:45.454 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.384+0000 7faf76ffd640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.45:6791/0 2026-02-22T23:25:45.454 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.384+0000 7faf76ffd640 1 -- 10.20.193.45:0/2220356480 --> v1:10.20.193.45:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf901229e0 con 0x7faf9013d2b0 2026-02-22T23:25:45.454 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.384+0000 7faf76ffd640 10 monclient: _finish_auth 0 2026-02-22T23:25:45.454 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.384+0000 7faf76ffd640 10 monclient: _check_auth_tickets 2026-02-22T23:25:45.454 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.384+0000 7faf76ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T23:25:45.454 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.384+0000 7faf9873e640 5 monclient: authenticate success, global_id 4297 2026-02-22T23:25:45.454 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.384+0000 7faf9873e640 10 monclient: _renew_subs 2026-02-22T23:25:45.454 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.384+0000 7faf9873e640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.45:6791/0 2026-02-22T23:25:45.454 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.384+0000 7faf9873e640 1 -- 10.20.193.45:0/2220356480 --> v1:10.20.193.45:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7faf90139170 con 0x7faf9013d2b0 2026-02-22T23:25:45.454 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.384+0000 7faf9873e640 10 monclient: _renew_subs 2026-02-22T23:25:45.454 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.384+0000 7faf9873e640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.45:6791/0 2026-02-22T23:25:45.454 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.384+0000 7faf9873e640 1 -- 10.20.193.45:0/2220356480 --> v1:10.20.193.45:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7faf901cd5c0 con 0x7faf9013d2b0 2026-02-22T23:25:45.454 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.384+0000 7faf76ffd640 1 -- 10.20.193.45:0/2220356480 <== mon.4 v1:10.20.193.45:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7faf8c005250 con 0x7faf9013d2b0 2026-02-22T23:25:45.454 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.384+0000 7faf76ffd640 10 monclient: handle_config config(0 keys) 2026-02-22T23:25:45.454 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.384+0000 7faf76ffd640 1 -- 10.20.193.45:0/2220356480 <== mon.4 v1:10.20.193.45:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7faf8c005740 con 0x7faf9013d2b0 2026-02-22T23:25:45.454 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.384+0000 7faf76ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:25:45.454 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.384+0000 7faf76ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T23:25:45.454 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.384+0000 7faf94cb0640 4 set_mon_vals no callback set 2026-02-22T23:25:45.454 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.384+0000 7faf76ffd640 10 monclient: dump: 2026-02-22T23:25:45.454 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:45.454 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:45.454 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:45.454 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:45.454 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:45.454 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:45.454 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:45.454 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:45.454 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:45.454 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:45.454 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:45.454 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:45.454 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:45.454 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:45.454 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:45.454 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:45.455 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.384+0000 7fa094ff9640 1 -- 10.20.193.45:0/2242759319 <== osd.2 v1:10.20.193.45:6808/2128209266 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (unknown 0 0 3365489958) 0x7fa06804aaa0 con 0x7fa068046e10 2026-02-22T23:25:45.455 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.384+0000 7f2671ffb640 1 -- 10.20.193.45:0/2668566672 <== mon.6 v1:10.20.193.45:6792/0 7 ==== mgrmap(e 5) ==== 50225+0+0 (unknown 2330357642 0 0) 0x7f2678011890 con 0x7f2684137ba0 2026-02-22T23:25:45.455 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.384+0000 7faf9873e640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.45:6791/0 2026-02-22T23:25:45.455 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.386+0000 7faf9873e640 1 -- 10.20.193.45:0/2220356480 --> v1:10.20.193.45:6791/0 -- mon_get_version(what=osdmap handle=1) -- 0x7faf90123b80 con 0x7faf9013d2b0 2026-02-22T23:25:45.455 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.386+0000 7f2671ffb640 1 -- 10.20.193.45:0/2668566672 <== mon.6 v1:10.20.193.45:6792/0 8 ==== osd_map(19..19 src has 1..19) ==== 3558+0+0 (unknown 1288710973 0 0) 0x7f267804dc50 con 0x7f2684137ba0 2026-02-22T23:25:45.455 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.386+0000 7faf76ffd640 1 -- 10.20.193.45:0/2220356480 <== mon.4 v1:10.20.193.45:6791/0 7 ==== mgrmap(e 5) ==== 50225+0+0 (unknown 2330357642 0 0) 0x7faf8c011d20 con 0x7faf9013d2b0 2026-02-22T23:25:45.455 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.386+0000 7f2671ffb640 1 -- 10.20.193.45:0/2668566672 --> v1:10.20.193.73:6809/1794330816 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2654053060 con 0x7f265404f3b0 2026-02-22T23:25:45.455 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.386+0000 7f2671ffb640 1 -- 10.20.193.45:0/2668566672 <== mon.6 v1:10.20.193.45:6792/0 9 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (unknown 4138596325 0 0) 0x7f267804e060 con 0x7f2684137ba0 2026-02-22T23:25:45.455 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.386+0000 7f2671ffb640 10 monclient: handle_get_version_reply finishing 1 version 19 2026-02-22T23:25:45.455 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.386+0000 7faf76ffd640 1 -- 10.20.193.45:0/2220356480 <== mon.4 v1:10.20.193.45:6791/0 8 ==== osd_map(19..19 src has 1..19) ==== 3558+0+0 (unknown 1288710973 0 0) 0x7faf8c04dfa0 con 0x7faf9013d2b0 2026-02-22T23:25:45.455 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.386+0000 7f2689a91640 10 monclient: get_auth_request con 0x7f265404f3b0 auth_method 0 2026-02-22T23:25:45.455 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.386+0000 7f2689290640 10 monclient: get_auth_request con 0x7f26540488c0 auth_method 0 2026-02-22T23:25:45.456 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.386+0000 7faf76ffd640 1 -- 10.20.193.45:0/2220356480 --> v1:10.20.193.45:6800/628358795 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7faf6004e650 con 0x7faf6004a9a0 2026-02-22T23:25:45.456 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.386+0000 7faf76ffd640 1 -- 10.20.193.45:0/2220356480 <== mon.4 v1:10.20.193.45:6791/0 9 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (unknown 4138596325 0 0) 0x7faf8c04e3b0 con 0x7faf9013d2b0 2026-02-22T23:25:45.456 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.386+0000 7faf76ffd640 10 monclient: handle_get_version_reply finishing 1 version 19 2026-02-22T23:25:45.456 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.386+0000 7faf964b3640 10 monclient: get_auth_request con 0x7faf60043da0 auth_method 0 2026-02-22T23:25:45.456 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.387+0000 7f2671ffb640 1 -- 10.20.193.45:0/2668566672 <== osd.5 v1:10.20.193.73:6809/1794330816 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (unknown 0 0 3365489958) 0x7f2654053060 con 0x7f265404f3b0 2026-02-22T23:25:45.456 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.387+0000 7faf95cb2640 10 monclient: get_auth_request con 0x7faf6004a9a0 auth_method 0 2026-02-22T23:25:45.456 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.387+0000 7faf76ffd640 1 -- 10.20.193.45:0/2220356480 <== osd.1 v1:10.20.193.45:6800/628358795 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (unknown 0 0 3365489958) 0x7faf6004e650 con 0x7faf6004a9a0 2026-02-22T23:25:45.456 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.391+0000 7f88996a3640 1 -- 10.20.193.45:0/41817586 --> v1:10.20.193.73:6805/3607388566 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f8894135690 con 0x7f8864046b10 2026-02-22T23:25:45.456 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.391+0000 7fba35fce640 1 -- 10.20.193.45:0/145605847 --> v1:10.20.193.73:6801/3756325394 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fba3006e4b0 con 0x7fba00046b40 2026-02-22T23:25:45.456 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.391+0000 7f8890ff9640 1 -- 10.20.193.45:0/41817586 <== osd.3 v1:10.20.193.73:6805/3607388566 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (unknown 0 0 654699149) 0x7f8894135690 con 0x7f8864046b10 2026-02-22T23:25:45.456 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.391+0000 7f0c492c4640 1 -- 10.20.193.45:0/4265815544 --> v1:10.20.193.45:6801/1146005631 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f0c4409f880 con 0x7f0c10046970 2026-02-22T23:25:45.456 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.392+0000 7fba0bfff640 1 -- 10.20.193.45:0/145605847 <== osd.4 v1:10.20.193.73:6801/3756325394 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (unknown 0 0 839772338) 0x7fba3006e4b0 con 0x7fba00046b40 2026-02-22T23:25:45.456 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.392+0000 7f0c1f7fe640 1 -- 10.20.193.45:0/4265815544 <== osd.0 v1:10.20.193.45:6801/1146005631 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (unknown 0 0 839772338) 0x7f0c4409f880 con 0x7f0c10046970 2026-02-22T23:25:45.457 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.392+0000 7f88996a3640 1 -- 10.20.193.45:0/41817586 >> v1:10.20.193.73:6805/3607388566 conn(0x7f8864046b10 legacy=0x7f8864048f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:45.457 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.392+0000 7f88996a3640 1 -- 10.20.193.45:0/41817586 >> v1:10.20.193.73:6800/2222410180 conn(0x7f886403ff80 legacy=0x7f8864042440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:45.457 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.392+0000 7f88996a3640 10 monclient: shutdown 2026-02-22T23:25:45.457 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.392+0000 7f88996a3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T23:25:45.457 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.392+0000 7f88996a3640 1 -- 10.20.193.45:0/41817586 >> v1:10.20.193.73:6790/0 conn(0x7f889413f720 legacy=0x7f88941d7a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:45.457 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.392+0000 7f8898ea2640 1 -- 10.20.193.45:0/41817586 reap_dead start 2026-02-22T23:25:45.457 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.392+0000 7f0c492c4640 1 -- 10.20.193.45:0/4265815544 >> v1:10.20.193.45:6801/1146005631 conn(0x7f0c10046970 legacy=0x7f0c10048d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:45.457 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.392+0000 7fba35fce640 1 -- 10.20.193.45:0/145605847 >> v1:10.20.193.73:6801/3756325394 conn(0x7fba00046b40 legacy=0x7fba00048f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:45.457 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.392+0000 7fba35fce640 1 -- 10.20.193.45:0/145605847 >> v1:10.20.193.73:6800/2222410180 conn(0x7fba0003ffe0 legacy=0x7fba000424a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:45.457 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.392+0000 7fba35fce640 10 monclient: shutdown 2026-02-22T23:25:45.457 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.392+0000 7fba35fce640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T23:25:45.457 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.392+0000 7fba35fce640 1 -- 10.20.193.45:0/145605847 >> v1:10.20.193.45:6790/0 conn(0x7fba300a0f60 legacy=0x7fba3009df60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:45.457 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.392+0000 7fba2ffff640 1 -- 10.20.193.45:0/145605847 reap_dead start 2026-02-22T23:25:45.457 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.392+0000 7f0c492c4640 1 -- 10.20.193.45:0/4265815544 >> v1:10.20.193.73:6800/2222410180 conn(0x7f0c1003fda0 legacy=0x7f0c10042260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:45.457 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.392+0000 7f0c492c4640 10 monclient: shutdown 2026-02-22T23:25:45.457 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.392+0000 7f0c492c4640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T23:25:45.457 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.392+0000 7f0c492c4640 1 -- 10.20.193.45:0/4265815544 >> v1:10.20.193.45:6793/0 conn(0x7f0c440a68f0 legacy=0x7f0c441d45f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:45.458 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.392+0000 7f88996a3640 1 -- 10.20.193.45:0/41817586 shutdown_connections 2026-02-22T23:25:45.458 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.392+0000 7f88996a3640 1 -- 10.20.193.45:0/41817586 >> 10.20.193.45:0/41817586 conn(0x7f88940abad0 msgr2=0x7f8894134f80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:25:45.458 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.392+0000 7f0c437fe640 1 -- 10.20.193.45:0/4265815544 reap_dead start 2026-02-22T23:25:45.458 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.392+0000 7f88996a3640 1 -- 10.20.193.45:0/41817586 shutdown_connections 2026-02-22T23:25:45.458 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.392+0000 7f88996a3640 1 -- 10.20.193.45:0/41817586 wait complete. 2026-02-22T23:25:45.458 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.392+0000 7fba35fce640 1 -- 10.20.193.45:0/145605847 shutdown_connections 2026-02-22T23:25:45.458 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.392+0000 7fba35fce640 1 -- 10.20.193.45:0/145605847 >> 10.20.193.45:0/145605847 conn(0x7fba300a9750 msgr2=0x7fba300a79f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:25:45.458 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.392+0000 7f0c492c4640 1 -- 10.20.193.45:0/4265815544 shutdown_connections 2026-02-22T23:25:45.458 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.392+0000 7f0c492c4640 1 -- 10.20.193.45:0/4265815544 >> 10.20.193.45:0/4265815544 conn(0x7f0c440abb50 msgr2=0x7f0c441422f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:25:45.458 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.392+0000 7fba35fce640 1 -- 10.20.193.45:0/145605847 shutdown_connections 2026-02-22T23:25:45.458 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.392+0000 7fba35fce640 1 -- 10.20.193.45:0/145605847 wait complete. 2026-02-22T23:25:45.458 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.392+0000 7f0c492c4640 1 -- 10.20.193.45:0/4265815544 shutdown_connections 2026-02-22T23:25:45.458 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.392+0000 7f0c492c4640 1 -- 10.20.193.45:0/4265815544 wait complete. 2026-02-22T23:25:45.459 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.392+0000 7fa09e816640 1 -- 10.20.193.45:0/2242759319 --> v1:10.20.193.45:6808/2128209266 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fa098069720 con 0x7fa068046e10 2026-02-22T23:25:45.459 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.392+0000 7fa094ff9640 1 -- 10.20.193.45:0/2242759319 <== osd.2 v1:10.20.193.45:6808/2128209266 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (unknown 0 0 839772338) 0x7fa098069720 con 0x7fa068046e10 2026-02-22T23:25:45.459 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.392+0000 7fa09e816640 1 -- 10.20.193.45:0/2242759319 >> v1:10.20.193.45:6808/2128209266 conn(0x7fa068046e10 legacy=0x7fa068049230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:45.459 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.392+0000 7fa09e816640 1 -- 10.20.193.45:0/2242759319 >> v1:10.20.193.73:6800/2222410180 conn(0x7fa068040240 legacy=0x7fa068042700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:45.459 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.392+0000 7fa09e816640 10 monclient: shutdown 2026-02-22T23:25:45.459 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.392+0000 7fa09e816640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T23:25:45.459 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.392+0000 7fa09e816640 1 -- 10.20.193.45:0/2242759319 >> v1:10.20.193.73:6791/0 conn(0x7fa0980a3f10 legacy=0x7fa09813f7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:45.459 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.392+0000 7fa09cd8c640 1 -- 10.20.193.45:0/2242759319 reap_dead start 2026-02-22T23:25:45.459 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.392+0000 7fa09e816640 1 -- 10.20.193.45:0/2242759319 shutdown_connections 2026-02-22T23:25:45.459 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.392+0000 7fa09e816640 1 -- 10.20.193.45:0/2242759319 >> 10.20.193.45:0/2242759319 conn(0x7fa0980a7f70 msgr2=0x7fa098142150 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:25:45.459 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.392+0000 7fa09e816640 1 -- 10.20.193.45:0/2242759319 shutdown_connections 2026-02-22T23:25:45.459 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.393+0000 7fa09e816640 1 -- 10.20.193.45:0/2242759319 wait complete. 2026-02-22T23:25:45.459 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.394+0000 7f268b51b640 1 -- 10.20.193.45:0/2668566672 --> v1:10.20.193.73:6809/1794330816 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f26841375f0 con 0x7f265404f3b0 2026-02-22T23:25:45.459 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.394+0000 7f2671ffb640 1 -- 10.20.193.45:0/2668566672 <== osd.5 v1:10.20.193.73:6809/1794330816 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (unknown 0 0 559749958) 0x7f26841375f0 con 0x7f265404f3b0 2026-02-22T23:25:45.460 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.394+0000 7f268b51b640 1 -- 10.20.193.45:0/2668566672 >> v1:10.20.193.73:6809/1794330816 conn(0x7f265404f3b0 legacy=0x7f26540517f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:45.460 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.394+0000 7f268b51b640 1 -- 10.20.193.45:0/2668566672 >> v1:10.20.193.73:6800/2222410180 conn(0x7f26540488c0 legacy=0x7f265404ad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:45.460 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.394+0000 7f268b51b640 10 monclient: shutdown 2026-02-22T23:25:45.460 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.394+0000 7f268b51b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T23:25:45.460 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.394+0000 7f268b51b640 1 -- 10.20.193.45:0/2668566672 >> v1:10.20.193.45:6792/0 conn(0x7f2684137ba0 legacy=0x7f268413b500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:45.460 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.394+0000 7f2689a91640 1 -- 10.20.193.45:0/2668566672 reap_dead start 2026-02-22T23:25:45.460 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.394+0000 7f268b51b640 1 -- 10.20.193.45:0/2668566672 shutdown_connections 2026-02-22T23:25:45.460 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.394+0000 7f268b51b640 1 -- 10.20.193.45:0/2668566672 >> 10.20.193.45:0/2668566672 conn(0x7f26840a4b70 msgr2=0x7f2684141c50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:25:45.460 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.394+0000 7f268b51b640 1 -- 10.20.193.45:0/2668566672 shutdown_connections 2026-02-22T23:25:45.460 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.394+0000 7f268b51b640 1 -- 10.20.193.45:0/2668566672 wait complete. 2026-02-22T23:25:45.460 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.394+0000 7faf9873e640 1 -- 10.20.193.45:0/2220356480 --> v1:10.20.193.45:6800/628358795 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7faf900a11a0 con 0x7faf6004a9a0 2026-02-22T23:25:45.460 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.394+0000 7faf76ffd640 1 -- 10.20.193.45:0/2220356480 <== osd.1 v1:10.20.193.45:6800/628358795 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (unknown 0 0 839772338) 0x7faf900a11a0 con 0x7faf6004a9a0 2026-02-22T23:25:45.460 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.396+0000 7faf9873e640 1 -- 10.20.193.45:0/2220356480 >> v1:10.20.193.45:6800/628358795 conn(0x7faf6004a9a0 legacy=0x7faf6004cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:45.461 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.396+0000 7faf9873e640 1 -- 10.20.193.45:0/2220356480 >> v1:10.20.193.73:6800/2222410180 conn(0x7faf60043da0 legacy=0x7faf60046260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:45.461 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.396+0000 7faf9873e640 10 monclient: shutdown 2026-02-22T23:25:45.461 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.396+0000 7faf9873e640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T23:25:45.461 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.396+0000 7faf9873e640 1 -- 10.20.193.45:0/2220356480 >> v1:10.20.193.45:6791/0 conn(0x7faf9013d2b0 legacy=0x7faf901d5e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:45.461 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.396+0000 7faf96cb4640 1 -- 10.20.193.45:0/2220356480 reap_dead start 2026-02-22T23:25:45.461 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.396+0000 7faf9873e640 1 -- 10.20.193.45:0/2220356480 shutdown_connections 2026-02-22T23:25:45.461 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.396+0000 7faf9873e640 1 -- 10.20.193.45:0/2220356480 >> 10.20.193.45:0/2220356480 conn(0x7faf900a9970 msgr2=0x7faf900a77b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:25:45.461 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.396+0000 7faf9873e640 1 -- 10.20.193.45:0/2220356480 shutdown_connections 2026-02-22T23:25:45.461 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.396+0000 7faf9873e640 1 -- 10.20.193.45:0/2220356480 wait complete. 2026-02-22T23:25:45.461 INFO:teuthology.orchestra.run.trial045.stdout:47244640260 2026-02-22T23:25:45.461 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-22T23:25:45.461 INFO:teuthology.orchestra.run.trial045.stdout:51539607555 2026-02-22T23:25:45.462 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-22T23:25:45.462 INFO:teuthology.orchestra.run.trial045.stdout:51539607555 2026-02-22T23:25:45.462 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2026-02-22T23:25:45.462 INFO:teuthology.orchestra.run.trial045.stdout:51539607555 2026-02-22T23:25:45.462 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-22T23:25:45.463 INFO:teuthology.orchestra.run.trial045.stdout:51539607556 2026-02-22T23:25:45.463 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2026-02-22T23:25:45.463 INFO:teuthology.orchestra.run.trial045.stdout:51539607555 2026-02-22T23:25:45.463 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-22T23:25:45.572 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.572+0000 7f630e108640 10 monclient: get_monmap_and_config 2026-02-22T23:25:45.572 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.572+0000 7f630e108640 10 monclient: build_initial_monmap 2026-02-22T23:25:45.572 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.572+0000 7f630e108640 10 monclient: monmap: 2026-02-22T23:25:45.572 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-22T23:25:45.572 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:45.572 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:25:45.572396+0000 2026-02-22T23:25:45.572 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:25:45.572396+0000 2026-02-22T23:25:45.572 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-22T23:25:45.572 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:45.572 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-22T23:25:45.572 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.noname-f 2026-02-22T23:25:45.572 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.noname-b 2026-02-22T23:25:45.572 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.noname-g 2026-02-22T23:25:45.572 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.noname-c 2026-02-22T23:25:45.572 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.noname-h 2026-02-22T23:25:45.572 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.noname-d 2026-02-22T23:25:45.572 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.noname-i 2026-02-22T23:25:45.572 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.noname-e 2026-02-22T23:25:45.572 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:45.573 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.572+0000 7f8ac7196640 10 monclient: get_monmap_and_config 2026-02-22T23:25:45.573 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.572+0000 7f8ac7196640 10 monclient: build_initial_monmap 2026-02-22T23:25:45.573 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.572+0000 7f8ac7196640 10 monclient: monmap: 2026-02-22T23:25:45.573 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-22T23:25:45.573 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:45.573 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:25:45.572622+0000 2026-02-22T23:25:45.573 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:25:45.572622+0000 2026-02-22T23:25:45.573 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-22T23:25:45.573 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:45.573 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-22T23:25:45.573 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.noname-f 2026-02-22T23:25:45.573 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.noname-b 2026-02-22T23:25:45.573 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.noname-g 2026-02-22T23:25:45.573 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.noname-c 2026-02-22T23:25:45.573 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.noname-h 2026-02-22T23:25:45.573 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.noname-d 2026-02-22T23:25:45.573 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.noname-i 2026-02-22T23:25:45.573 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.noname-e 2026-02-22T23:25:45.573 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:45.573 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.572+0000 7f630e108640 1 Processor -- start 2026-02-22T23:25:45.573 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.572+0000 7f630e108640 1 -- start start 2026-02-22T23:25:45.574 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.572+0000 7f630e108640 10 monclient: init 2026-02-22T23:25:45.574 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.572+0000 7f8ac7196640 1 Processor -- start 2026-02-22T23:25:45.574 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.572+0000 7f8ac7196640 1 -- start start 2026-02-22T23:25:45.574 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.572+0000 7f8ac7196640 10 monclient: init 2026-02-22T23:25:45.574 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.572+0000 7f630e108640 10 monclient: _reopen_session rank -1 2026-02-22T23:25:45.574 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.572+0000 7f630e108640 10 monclient: _add_conns ranks=[5,6,4,8,0,7,3,1,2] 2026-02-22T23:25:45.574 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.572+0000 7fa05786d640 10 monclient: get_monmap_and_config 2026-02-22T23:25:45.574 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.572+0000 7fa05786d640 10 monclient: build_initial_monmap 2026-02-22T23:25:45.574 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.572+0000 7fa05786d640 10 monclient: monmap: 2026-02-22T23:25:45.574 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-22T23:25:45.574 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:45.574 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:25:45.573088+0000 2026-02-22T23:25:45.574 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:25:45.573088+0000 2026-02-22T23:25:45.574 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-22T23:25:45.574 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:45.574 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-22T23:25:45.575 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.noname-f 2026-02-22T23:25:45.575 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.noname-b 2026-02-22T23:25:45.575 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.noname-g 2026-02-22T23:25:45.575 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.noname-c 2026-02-22T23:25:45.575 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.noname-h 2026-02-22T23:25:45.575 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.noname-d 2026-02-22T23:25:45.575 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.noname-i 2026-02-22T23:25:45.575 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.noname-e 2026-02-22T23:25:45.575 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:45.575 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.572+0000 7f630e108640 10 monclient(hunting): picked mon.noname-h con 0x7f63080a4490 addr v1:10.20.193.73:6791/0 2026-02-22T23:25:45.575 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.572+0000 7f630e108640 10 monclient(hunting): picked mon.noname-d con 0x7f63080a4f80 addr v1:10.20.193.45:6792/0 2026-02-22T23:25:45.575 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.572+0000 7f630e108640 10 monclient(hunting): picked mon.noname-c con 0x7f63080a5390 addr v1:10.20.193.45:6791/0 2026-02-22T23:25:45.576 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.572+0000 7f630e108640 1 -- --> v1:10.20.193.45:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f630806dcb0 con 0x7f63080a5390 2026-02-22T23:25:45.576 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.572+0000 7f630e108640 1 -- --> v1:10.20.193.73:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f630806ca80 con 0x7f63080a4490 2026-02-22T23:25:45.576 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.572+0000 7f630e108640 1 -- --> v1:10.20.193.45:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f630806e1b0 con 0x7f63080a4f80 2026-02-22T23:25:45.576 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.572+0000 7f630e108640 10 monclient(hunting): _renew_subs 2026-02-22T23:25:45.576 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.572+0000 7f630e108640 10 monclient(hunting): authenticate will time out at 677.188971s 2026-02-22T23:25:45.576 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.573+0000 7f6307fff640 1 --1- >> v1:10.20.193.45:6791/0 conn(0x7f63080a5390 0x7f6308141710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.45:6791/0 says I am v1:10.20.193.45:37898/0 (socket says 10.20.193.45:37898) 2026-02-22T23:25:45.576 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.573+0000 7f6307fff640 1 -- 10.20.193.45:0/676221253 learned_addr learned my addr 10.20.193.45:0/676221253 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-22T23:25:45.576 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.573+0000 7f63067fc640 1 -- 10.20.193.45:0/676221253 <== mon.6 v1:10.20.193.45:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2085444409 0 0) 0x7f630806e1b0 con 0x7f63080a4f80 2026-02-22T23:25:45.576 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.573+0000 7f63067fc640 10 monclient(hunting): _negotiate 2026-02-22T23:25:45.576 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.573+0000 7f63067fc640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:45.576 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.573+0000 7f63067fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:45.576 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.573+0000 7f63067fc640 10 monclient(hunting): my global_id is 4290 2026-02-22T23:25:45.576 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.573+0000 7f63067fc640 1 -- 10.20.193.45:0/676221253 --> v1:10.20.193.45:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f62ec003620 con 0x7f63080a4f80 2026-02-22T23:25:45.576 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.573+0000 7f8ac7196640 10 monclient: _reopen_session rank -1 2026-02-22T23:25:45.576 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.573+0000 7fa05786d640 1 Processor -- start 2026-02-22T23:25:45.576 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.573+0000 7f63067fc640 1 -- 10.20.193.45:0/676221253 <== mon.4 v1:10.20.193.45:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2346667099 0 0) 0x7f630806dcb0 con 0x7f63080a5390 2026-02-22T23:25:45.576 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.573+0000 7f63067fc640 10 monclient(hunting): _negotiate 2026-02-22T23:25:45.576 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.573+0000 7f63067fc640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:45.577 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.573+0000 7f63067fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:45.577 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.573+0000 7f63067fc640 10 monclient(hunting): my global_id is 4306 2026-02-22T23:25:45.577 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.573+0000 7f63067fc640 1 -- 10.20.193.45:0/676221253 --> v1:10.20.193.45:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f630806e1b0 con 0x7f63080a5390 2026-02-22T23:25:45.577 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.573+0000 7f8ac7196640 10 monclient: _add_conns ranks=[5,0,7,1,6,4,2,3,8] 2026-02-22T23:25:45.577 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.573+0000 7f8ac7196640 10 monclient(hunting): picked mon.noname-h con 0x7f8ac0139240 addr v1:10.20.193.73:6791/0 2026-02-22T23:25:45.577 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.573+0000 7f8ac7196640 10 monclient(hunting): picked mon.noname-a con 0x7f8ac00a51e0 addr v1:10.20.193.45:6789/0 2026-02-22T23:25:45.577 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.573+0000 7fa05786d640 1 -- start start 2026-02-22T23:25:45.577 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.573+0000 7f8ac7196640 10 monclient(hunting): picked mon.noname-i con 0x7f8ac013f8a0 addr v1:10.20.193.73:6792/0 2026-02-22T23:25:45.577 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.573+0000 7f8ac7196640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8ac006cde0 con 0x7f8ac00a51e0 2026-02-22T23:25:45.577 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.573+0000 7fa05786d640 10 monclient: init 2026-02-22T23:25:45.578 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.573+0000 7f8ac7196640 1 -- --> v1:10.20.193.73:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8ac00a55c0 con 0x7f8ac0139240 2026-02-22T23:25:45.578 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.573+0000 7f8ac7196640 1 -- --> v1:10.20.193.73:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8ac006e850 con 0x7f8ac013f8a0 2026-02-22T23:25:45.578 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.573+0000 7f8ac7196640 10 monclient(hunting): _renew_subs 2026-02-22T23:25:45.578 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.573+0000 7f8ac7196640 10 monclient(hunting): authenticate will time out at 677.189404s 2026-02-22T23:25:45.578 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.573+0000 7f63067fc640 1 -- 10.20.193.45:0/676221253 <== mon.5 v1:10.20.193.73:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3265918503 0 0) 0x7f630806ca80 con 0x7f63080a4490 2026-02-22T23:25:45.578 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.573+0000 7f63067fc640 10 monclient(hunting): _negotiate 2026-02-22T23:25:45.578 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.573+0000 7f63067fc640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:45.578 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.573+0000 7f63067fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:45.578 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.573+0000 7f63067fc640 10 monclient(hunting): my global_id is 4307 2026-02-22T23:25:45.578 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.573+0000 7f63067fc640 1 -- 10.20.193.45:0/676221253 --> v1:10.20.193.73:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f630806dcb0 con 0x7f63080a4490 2026-02-22T23:25:45.578 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.573+0000 7f63067fc640 1 -- 10.20.193.45:0/676221253 <== mon.6 v1:10.20.193.45:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1245250139 0 0) 0x7f62ec003620 con 0x7f63080a4f80 2026-02-22T23:25:45.578 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.573+0000 7f63067fc640 1 -- 10.20.193.45:0/676221253 >> v1:10.20.193.73:6791/0 conn(0x7f63080a4490 legacy=0x7f63080a4870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:45.578 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.573+0000 7f63067fc640 1 -- 10.20.193.45:0/676221253 >> v1:10.20.193.45:6791/0 conn(0x7f63080a5390 legacy=0x7f6308141710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:45.579 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.573+0000 7f8ab7fff640 1 --1- >> v1:10.20.193.45:6789/0 conn(0x7f8ac00a51e0 0x7f8ac013e180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.45:6789/0 says I am v1:10.20.193.45:58170/0 (socket says 10.20.193.45:58170) 2026-02-22T23:25:45.579 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.573+0000 7f63067fc640 10 monclient: _finish_hunting 0 2026-02-22T23:25:45.579 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.573+0000 7f63067fc640 1 monclient: found mon.noname-d 2026-02-22T23:25:45.579 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.573+0000 7f63067fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T23:25:45.579 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.573+0000 7f8ab7fff640 1 -- 10.20.193.45:0/3052113289 learned_addr learned my addr 10.20.193.45:0/3052113289 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-22T23:25:45.579 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.573+0000 7f63067fc640 10 monclient: _send_mon_message to mon.noname-d at v1:10.20.193.45:6792/0 2026-02-22T23:25:45.579 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.573+0000 7f63067fc640 1 -- 10.20.193.45:0/676221253 --> v1:10.20.193.45:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f630806e490 con 0x7f63080a4f80 2026-02-22T23:25:45.580 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.573+0000 7f63067fc640 10 monclient: _finish_auth 0 2026-02-22T23:25:45.580 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.573+0000 7f63067fc640 10 monclient: _check_auth_tickets 2026-02-22T23:25:45.580 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.573+0000 7f63067fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T23:25:45.580 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.573+0000 7f63067fc640 1 -- 10.20.193.45:0/676221253 <== mon.6 v1:10.20.193.45:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f62f8003040 con 0x7f63080a4f80 2026-02-22T23:25:45.580 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.573+0000 7f630e108640 5 monclient: authenticate success, global_id 4290 2026-02-22T23:25:45.580 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.573+0000 7f630e108640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-22T23:25:45.580 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.573+0000 7f63067fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:25:45.580 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.573+0000 7f63067fc640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2026-02-22T23:25:45.580 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.573+0000 7f63067fc640 10 monclient: dump: 2026-02-22T23:25:45.580 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:45.580 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:45.580 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:45.580 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:45.580 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:45.580 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:45.580 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:45.580 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:45.580 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:45.580 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:45.580 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:45.580 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:45.580 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:45.580 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:45.580 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:45.580 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:45.580 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.573+0000 7f630e108640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-22T23:25:45.580 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.573+0000 7f63067fc640 1 -- 10.20.193.45:0/676221253 <== mon.6 v1:10.20.193.45:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f62f80031e0 con 0x7f63080a4f80 2026-02-22T23:25:45.580 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.573+0000 7f63067fc640 10 monclient: handle_config config(0 keys) 2026-02-22T23:25:45.580 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.573+0000 7f63067fc640 1 -- 10.20.193.45:0/676221253 <== mon.6 v1:10.20.193.45:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f62f8003a50 con 0x7f63080a4f80 2026-02-22T23:25:45.581 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.573+0000 7f63067fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:25:45.581 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.573+0000 7f63067fc640 10 monclient: got monmap 1 from mon.d (according to old e1) 2026-02-22T23:25:45.581 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.573+0000 7f63067fc640 10 monclient: dump: 2026-02-22T23:25:45.581 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:45.581 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:45.581 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:45.581 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:45.581 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:45.581 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:45.581 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:45.581 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:45.581 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:45.581 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:45.581 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:45.581 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:45.581 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:45.581 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:45.581 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:45.581 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:45.581 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.573+0000 7f630e108640 10 monclient: get_monmap_and_config success 2026-02-22T23:25:45.581 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.573+0000 7f630e108640 4 set_mon_vals no callback set 2026-02-22T23:25:45.581 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.573+0000 7f8ab77fe640 1 -- 10.20.193.45:0/3052113289 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1385482263 0 0) 0x7f8ac006cde0 con 0x7f8ac00a51e0 2026-02-22T23:25:45.581 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.573+0000 7f8ab77fe640 10 monclient(hunting): _negotiate 2026-02-22T23:25:45.581 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.573+0000 7f8ab77fe640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:45.581 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.573+0000 7f8ab77fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:45.581 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.573+0000 7f8ab77fe640 10 monclient(hunting): my global_id is 4248 2026-02-22T23:25:45.581 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.573+0000 7f8ab77fe640 1 -- 10.20.193.45:0/3052113289 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8aac003620 con 0x7f8ac00a51e0 2026-02-22T23:25:45.582 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.573+0000 7fa05786d640 10 monclient: _reopen_session rank -1 2026-02-22T23:25:45.582 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.573+0000 7fa05786d640 10 monclient: _add_conns ranks=[8,3,6,4,0,7,1,5,2] 2026-02-22T23:25:45.582 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.573+0000 7fa05786d640 10 monclient(hunting): picked mon.noname-e con 0x7fa0500a5e00 addr v1:10.20.193.45:6793/0 2026-02-22T23:25:45.582 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.573+0000 7fa05786d640 10 monclient(hunting): picked mon.noname-g con 0x7fa0500a68f0 addr v1:10.20.193.73:6790/0 2026-02-22T23:25:45.582 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.573+0000 7fa05786d640 10 monclient(hunting): picked mon.noname-d con 0x7fa0500a6d00 addr v1:10.20.193.45:6792/0 2026-02-22T23:25:45.582 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.573+0000 7fa05786d640 1 -- --> v1:10.20.193.73:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa0500a2d00 con 0x7fa0500a68f0 2026-02-22T23:25:45.582 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.573+0000 7fa05786d640 1 -- --> v1:10.20.193.45:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa0500a2fe0 con 0x7fa0500a6d00 2026-02-22T23:25:45.582 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.573+0000 7fa05786d640 1 -- --> v1:10.20.193.45:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa0500a32c0 con 0x7fa0500a5e00 2026-02-22T23:25:45.582 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.573+0000 7fa05786d640 10 monclient(hunting): _renew_subs 2026-02-22T23:25:45.582 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.573+0000 7fa05786d640 10 monclient(hunting): authenticate will time out at 677.189746s 2026-02-22T23:25:45.583 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.573+0000 7f8ab77fe640 1 -- 10.20.193.45:0/3052113289 <== mon.7 v1:10.20.193.73:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 743502073 0 0) 0x7f8ac006e850 con 0x7f8ac013f8a0 2026-02-22T23:25:45.583 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.573+0000 7f8ab77fe640 10 monclient(hunting): _negotiate 2026-02-22T23:25:45.583 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.573+0000 7f8ab77fe640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:45.583 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.573+0000 7f8ab77fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:45.583 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.573+0000 7f8ab77fe640 10 monclient(hunting): my global_id is 4255 2026-02-22T23:25:45.583 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.573+0000 7f8ab77fe640 1 -- 10.20.193.45:0/3052113289 --> v1:10.20.193.73:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8ac006cde0 con 0x7f8ac013f8a0 2026-02-22T23:25:45.583 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.573+0000 7f8ab77fe640 1 -- 10.20.193.45:0/3052113289 <== mon.0 v1:10.20.193.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1127808392 0 0) 0x7f8aac003620 con 0x7f8ac00a51e0 2026-02-22T23:25:45.583 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.573+0000 7f8ab77fe640 1 -- 10.20.193.45:0/3052113289 >> v1:10.20.193.73:6792/0 conn(0x7f8ac013f8a0 legacy=0x7f8ac0141c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:45.583 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.573+0000 7f8ab77fe640 1 -- 10.20.193.45:0/3052113289 >> v1:10.20.193.73:6791/0 conn(0x7f8ac0139240 legacy=0x7f8ac0139620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:45.583 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.573+0000 7f8ab77fe640 10 monclient: _finish_hunting 0 2026-02-22T23:25:45.583 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.573+0000 7f8ab77fe640 1 monclient: found mon.noname-a 2026-02-22T23:25:45.583 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.573+0000 7f8ab77fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T23:25:45.583 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.573+0000 7fa055de3640 1 --1- >> v1:10.20.193.45:6792/0 conn(0x7fa0500a6d00 0x7fa0501417b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.45:6792/0 says I am v1:10.20.193.45:56830/0 (socket says 10.20.193.45:56830) 2026-02-22T23:25:45.583 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.573+0000 7f8ab77fe640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.45:6789/0 2026-02-22T23:25:45.583 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.573+0000 7f8ab77fe640 1 -- 10.20.193.45:0/3052113289 --> v1:10.20.193.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ac006cba0 con 0x7f8ac00a51e0 2026-02-22T23:25:45.583 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.573+0000 7f8ab77fe640 10 monclient: _finish_auth 0 2026-02-22T23:25:45.584 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.573+0000 7fa055de3640 1 -- 10.20.193.45:0/3663020493 learned_addr learned my addr 10.20.193.45:0/3663020493 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-22T23:25:45.584 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.573+0000 7fa0555e2640 1 --1- 10.20.193.45:0/3663020493 >> v1:10.20.193.45:6793/0 conn(0x7fa0500a5e00 0x7fa0500a61e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.45:6793/0 says I am v1:10.20.193.45:36718/0 (socket says 10.20.193.45:36718) 2026-02-22T23:25:45.584 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.573+0000 7f8ab77fe640 10 monclient: _check_auth_tickets 2026-02-22T23:25:45.584 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.573+0000 7f8ab77fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T23:25:45.584 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.573+0000 7f8ab77fe640 1 -- 10.20.193.45:0/3052113289 <== mon.0 v1:10.20.193.45:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f8aa8003040 con 0x7f8ac00a51e0 2026-02-22T23:25:45.584 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.573+0000 7f8ab77fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:25:45.584 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.573+0000 7f630e108640 10 monclient: shutdown 2026-02-22T23:25:45.584 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.573+0000 7f630e108640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T23:25:45.584 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.573+0000 7f630e108640 1 -- 10.20.193.45:0/676221253 >> v1:10.20.193.45:6792/0 conn(0x7f63080a4f80 legacy=0x7f630813dfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:45.584 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.573+0000 7f8ab77fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T23:25:45.584 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.573+0000 7f8ab77fe640 10 monclient: dump: 2026-02-22T23:25:45.584 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:45.585 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:45.585 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:45.585 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:45.585 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:45.585 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:45.585 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:45.585 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:45.585 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:45.585 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:45.585 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:45.585 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:45.585 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:45.585 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:45.585 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:45.585 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:45.585 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.573+0000 7f8ac7196640 5 monclient: authenticate success, global_id 4248 2026-02-22T23:25:45.585 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.573+0000 7f8ac7196640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-22T23:25:45.585 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.573+0000 7f8ab77fe640 1 -- 10.20.193.45:0/3052113289 <== mon.0 v1:10.20.193.45:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f8aa80031e0 con 0x7f8ac00a51e0 2026-02-22T23:25:45.585 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.573+0000 7f8ab77fe640 10 monclient: handle_config config(0 keys) 2026-02-22T23:25:45.585 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.573+0000 7f8ac7196640 10 monclient: get_monmap_and_config success 2026-02-22T23:25:45.585 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.573+0000 7f8ac7196640 4 set_mon_vals no callback set 2026-02-22T23:25:45.585 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.573+0000 7f8ab77fe640 1 -- 10.20.193.45:0/3052113289 <== mon.0 v1:10.20.193.45:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f8aa8004ce0 con 0x7f8ac00a51e0 2026-02-22T23:25:45.585 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.573+0000 7f8ab77fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:25:45.585 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.573+0000 7f8ab77fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T23:25:45.585 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.573+0000 7f8ab77fe640 10 monclient: dump: 2026-02-22T23:25:45.585 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:45.585 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:45.585 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:45.585 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:45.586 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:45.586 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:45.586 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:45.586 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:45.586 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:45.586 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:45.586 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:45.586 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:45.586 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:45.586 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:45.586 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:45.586 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:45.586 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.573+0000 7f630e108640 1 -- 10.20.193.45:0/676221253 shutdown_connections 2026-02-22T23:25:45.586 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.573+0000 7f630e108640 1 -- 10.20.193.45:0/676221253 >> 10.20.193.45:0/676221253 conn(0x7f63080a9720 msgr2=0x7f63080a9b30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:25:45.586 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.573+0000 7f654e5e4640 10 monclient: get_monmap_and_config 2026-02-22T23:25:45.586 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.573+0000 7f654e5e4640 10 monclient: build_initial_monmap 2026-02-22T23:25:45.586 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.573+0000 7f654e5e4640 10 monclient: monmap: 2026-02-22T23:25:45.586 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-22T23:25:45.586 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:45.586 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:25:45.574116+0000 2026-02-22T23:25:45.586 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:25:45.574116+0000 2026-02-22T23:25:45.586 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-22T23:25:45.586 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:45.587 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-22T23:25:45.587 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.noname-f 2026-02-22T23:25:45.587 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.noname-b 2026-02-22T23:25:45.587 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.noname-g 2026-02-22T23:25:45.587 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.noname-c 2026-02-22T23:25:45.587 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.noname-h 2026-02-22T23:25:45.587 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.noname-d 2026-02-22T23:25:45.587 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.noname-i 2026-02-22T23:25:45.587 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.noname-e 2026-02-22T23:25:45.587 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:45.587 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.573+0000 7f630e108640 1 -- 10.20.193.45:0/676221253 shutdown_connections 2026-02-22T23:25:45.587 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.573+0000 7fa03ffff640 1 -- 10.20.193.45:0/3663020493 <== mon.6 v1:10.20.193.45:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2683025040 0 0) 0x7fa0500a2fe0 con 0x7fa0500a6d00 2026-02-22T23:25:45.587 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.573+0000 7fa03ffff640 10 monclient(hunting): _negotiate 2026-02-22T23:25:45.587 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.573+0000 7fa03ffff640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:45.587 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.573+0000 7fa03ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:45.587 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.573+0000 7fa03ffff640 10 monclient(hunting): my global_id is 4299 2026-02-22T23:25:45.587 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.573+0000 7f630e108640 1 -- 10.20.193.45:0/676221253 wait complete. 2026-02-22T23:25:45.588 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.573+0000 7fa03ffff640 1 -- 10.20.193.45:0/3663020493 --> v1:10.20.193.45:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa038003620 con 0x7fa0500a6d00 2026-02-22T23:25:45.588 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.573+0000 7faf70056640 10 monclient: get_monmap_and_config 2026-02-22T23:25:45.588 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.573+0000 7faf70056640 10 monclient: build_initial_monmap 2026-02-22T23:25:45.588 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.573+0000 7faf70056640 10 monclient: monmap: 2026-02-22T23:25:45.588 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-22T23:25:45.588 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:45.588 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:25:45.574178+0000 2026-02-22T23:25:45.588 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:25:45.574178+0000 2026-02-22T23:25:45.588 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-22T23:25:45.588 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:45.588 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-22T23:25:45.588 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.noname-f 2026-02-22T23:25:45.588 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.noname-b 2026-02-22T23:25:45.588 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.noname-g 2026-02-22T23:25:45.588 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.noname-c 2026-02-22T23:25:45.588 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.noname-h 2026-02-22T23:25:45.588 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.noname-d 2026-02-22T23:25:45.588 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.noname-i 2026-02-22T23:25:45.588 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.noname-e 2026-02-22T23:25:45.588 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:45.589 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.574+0000 7f8ac7196640 10 monclient: shutdown 2026-02-22T23:25:45.589 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.574+0000 7f8ac7196640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T23:25:45.589 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.574+0000 7f8ac7196640 1 -- 10.20.193.45:0/3052113289 >> v1:10.20.193.45:6789/0 conn(0x7f8ac00a51e0 legacy=0x7f8ac013e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:45.589 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.574+0000 7f8ac7196640 1 -- 10.20.193.45:0/3052113289 shutdown_connections 2026-02-22T23:25:45.589 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.574+0000 7f8ac7196640 1 -- 10.20.193.45:0/3052113289 >> 10.20.193.45:0/3052113289 conn(0x7f8ac00a96b0 msgr2=0x7f8ac00a9ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:25:45.589 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.574+0000 7f8ac7196640 1 -- 10.20.193.45:0/3052113289 shutdown_connections 2026-02-22T23:25:45.589 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.574+0000 7f8ac7196640 1 -- 10.20.193.45:0/3052113289 wait complete. 2026-02-22T23:25:45.590 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.573+0000 7fa03ffff640 1 -- 10.20.193.45:0/3663020493 <== mon.8 v1:10.20.193.45:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1173615697 0 0) 0x7fa0500a32c0 con 0x7fa0500a5e00 2026-02-22T23:25:45.590 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.573+0000 7fa03ffff640 10 monclient(hunting): _negotiate 2026-02-22T23:25:45.590 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.573+0000 7fa03ffff640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:45.590 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.573+0000 7fa03ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:45.590 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.573+0000 7fa03ffff640 10 monclient(hunting): my global_id is 4292 2026-02-22T23:25:45.590 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.573+0000 7fa03ffff640 1 -- 10.20.193.45:0/3663020493 --> v1:10.20.193.45:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa0500a2fe0 con 0x7fa0500a5e00 2026-02-22T23:25:45.590 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.574+0000 7fa03ffff640 1 -- 10.20.193.45:0/3663020493 <== mon.6 v1:10.20.193.45:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4011154512 0 0) 0x7fa038003620 con 0x7fa0500a6d00 2026-02-22T23:25:45.590 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.574+0000 7fa03ffff640 1 -- 10.20.193.45:0/3663020493 >> v1:10.20.193.45:6793/0 conn(0x7fa0500a5e00 legacy=0x7fa0500a61e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:45.590 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.574+0000 7fa03ffff640 1 -- 10.20.193.45:0/3663020493 >> v1:10.20.193.73:6790/0 conn(0x7fa0500a68f0 legacy=0x7fa05013e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:45.590 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.574+0000 7fa03ffff640 10 monclient: _finish_hunting 0 2026-02-22T23:25:45.590 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.574+0000 7fa03ffff640 1 monclient: found mon.noname-d 2026-02-22T23:25:45.590 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.574+0000 7fa03ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T23:25:45.590 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.574+0000 7fa03ffff640 10 monclient: _send_mon_message to mon.noname-d at v1:10.20.193.45:6792/0 2026-02-22T23:25:45.590 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.574+0000 7fa03ffff640 1 -- 10.20.193.45:0/3663020493 --> v1:10.20.193.45:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0500a35a0 con 0x7fa0500a6d00 2026-02-22T23:25:45.590 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.574+0000 7fa03ffff640 10 monclient: _finish_auth 0 2026-02-22T23:25:45.590 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.574+0000 7fa03ffff640 10 monclient: _check_auth_tickets 2026-02-22T23:25:45.590 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.574+0000 7fa03ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T23:25:45.590 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.574+0000 7fa03ffff640 1 -- 10.20.193.45:0/3663020493 <== mon.6 v1:10.20.193.45:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7fa04c0033c0 con 0x7fa0500a6d00 2026-02-22T23:25:45.590 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.574+0000 7fa03ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:25:45.590 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.574+0000 7fa03ffff640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2026-02-22T23:25:45.590 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.574+0000 7fa03ffff640 10 monclient: dump: 2026-02-22T23:25:45.590 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:45.590 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:45.590 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:45.590 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:45.590 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:45.590 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:45.591 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:45.591 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:45.591 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:45.591 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:45.591 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:45.591 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:45.591 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:45.591 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:45.591 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:45.591 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:45.591 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.574+0000 7fa05786d640 5 monclient: authenticate success, global_id 4299 2026-02-22T23:25:45.591 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.574+0000 7fa05786d640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-22T23:25:45.591 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.574+0000 7fa03ffff640 1 -- 10.20.193.45:0/3663020493 <== mon.6 v1:10.20.193.45:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa04c003620 con 0x7fa0500a6d00 2026-02-22T23:25:45.591 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.574+0000 7fa03ffff640 10 monclient: handle_config config(0 keys) 2026-02-22T23:25:45.591 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.574+0000 7fa05786d640 10 monclient: get_monmap_and_config success 2026-02-22T23:25:45.591 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.574+0000 7fa03ffff640 1 -- 10.20.193.45:0/3663020493 <== mon.6 v1:10.20.193.45:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7fa04c005060 con 0x7fa0500a6d00 2026-02-22T23:25:45.591 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.574+0000 7fa03ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:25:45.591 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.574+0000 7fa05786d640 4 set_mon_vals no callback set 2026-02-22T23:25:45.591 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.574+0000 7fa03ffff640 10 monclient: got monmap 1 from mon.d (according to old e1) 2026-02-22T23:25:45.591 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.574+0000 7fa03ffff640 10 monclient: dump: 2026-02-22T23:25:45.591 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:45.591 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:45.591 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:45.591 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:45.591 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:45.591 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:45.591 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:45.591 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:45.591 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:45.591 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:45.591 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:45.591 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:45.592 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:45.592 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:45.592 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:45.592 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:45.592 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.574+0000 7fa05786d640 10 monclient: shutdown 2026-02-22T23:25:45.592 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.574+0000 7fa05786d640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T23:25:45.592 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.574+0000 7fa05786d640 1 -- 10.20.193.45:0/3663020493 >> v1:10.20.193.45:6792/0 conn(0x7fa0500a6d00 legacy=0x7fa0501417b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:45.592 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.574+0000 7fa05786d640 1 -- 10.20.193.45:0/3663020493 shutdown_connections 2026-02-22T23:25:45.592 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.574+0000 7fa05786d640 1 -- 10.20.193.45:0/3663020493 >> 10.20.193.45:0/3663020493 conn(0x7fa0500abb50 msgr2=0x7fa0500a7f00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:25:45.592 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.574+0000 7f654e5e4640 1 Processor -- start 2026-02-22T23:25:45.592 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.574+0000 7fa05786d640 1 -- 10.20.193.45:0/3663020493 shutdown_connections 2026-02-22T23:25:45.592 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.574+0000 7fa05786d640 1 -- 10.20.193.45:0/3663020493 wait complete. 2026-02-22T23:25:45.592 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.574+0000 7f630e108640 10 monclient: build_initial_monmap 2026-02-22T23:25:45.592 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.574+0000 7f630e108640 10 monclient: monmap: 2026-02-22T23:25:45.592 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-22T23:25:45.592 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T23:25:45.592 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-22T23:25:45.592 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-22T23:25:45.592 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-22T23:25:45.593 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-22T23:25:45.593 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-22T23:25:45.593 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.noname-f 2026-02-22T23:25:45.593 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.noname-b 2026-02-22T23:25:45.593 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.noname-g 2026-02-22T23:25:45.593 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.noname-c 2026-02-22T23:25:45.593 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.noname-h 2026-02-22T23:25:45.593 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.noname-d 2026-02-22T23:25:45.593 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.noname-i 2026-02-22T23:25:45.593 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.noname-e 2026-02-22T23:25:45.593 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:45.593 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.574+0000 7faf70056640 1 Processor -- start 2026-02-22T23:25:45.593 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.574+0000 7f8ac7196640 10 monclient: build_initial_monmap 2026-02-22T23:25:45.593 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.574+0000 7f654e5e4640 1 -- start start 2026-02-22T23:25:45.593 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.574+0000 7f8ac7196640 10 monclient: monmap: 2026-02-22T23:25:45.593 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-22T23:25:45.593 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T23:25:45.593 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-22T23:25:45.593 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-22T23:25:45.594 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-22T23:25:45.594 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-22T23:25:45.594 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-22T23:25:45.594 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.noname-f 2026-02-22T23:25:45.594 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.noname-b 2026-02-22T23:25:45.594 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.noname-g 2026-02-22T23:25:45.594 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.noname-c 2026-02-22T23:25:45.594 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.noname-h 2026-02-22T23:25:45.594 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.noname-d 2026-02-22T23:25:45.594 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.noname-i 2026-02-22T23:25:45.594 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.noname-e 2026-02-22T23:25:45.594 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:45.594 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.574+0000 7f654e5e4640 10 monclient: init 2026-02-22T23:25:45.594 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.574+0000 7faf70056640 1 -- start start 2026-02-22T23:25:45.594 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.574+0000 7faf70056640 10 monclient: init 2026-02-22T23:25:45.594 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.574+0000 7f630e108640 1 Processor -- start 2026-02-22T23:25:45.594 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.574+0000 7f8ac7196640 1 Processor -- start 2026-02-22T23:25:45.595 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.574+0000 7f630e108640 1 -- start start 2026-02-22T23:25:45.595 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.574+0000 7f630e108640 10 monclient: init 2026-02-22T23:25:45.595 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.574+0000 7f8ac7196640 1 -- start start 2026-02-22T23:25:45.595 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.574+0000 7f8ac7196640 10 monclient: init 2026-02-22T23:25:45.595 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.574+0000 7faf70056640 10 monclient: _reopen_session rank -1 2026-02-22T23:25:45.595 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.574+0000 7faf70056640 10 monclient: _add_conns ranks=[2,3,0,8,1,7,4,5,6] 2026-02-22T23:25:45.595 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.574+0000 7fa05786d640 10 monclient: build_initial_monmap 2026-02-22T23:25:45.595 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.574+0000 7faf70056640 10 monclient(hunting): picked mon.noname-b con 0x7faf680a4610 addr v1:10.20.193.45:6790/0 2026-02-22T23:25:45.595 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.574+0000 7f654e5e4640 10 monclient: _reopen_session rank -1 2026-02-22T23:25:45.596 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.574+0000 7fa05786d640 10 monclient: monmap: 2026-02-22T23:25:45.596 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-22T23:25:45.596 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T23:25:45.596 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-22T23:25:45.596 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-22T23:25:45.596 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-22T23:25:45.596 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-22T23:25:45.596 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-22T23:25:45.596 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.noname-f 2026-02-22T23:25:45.596 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.noname-b 2026-02-22T23:25:45.596 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.noname-g 2026-02-22T23:25:45.596 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.noname-c 2026-02-22T23:25:45.596 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.noname-h 2026-02-22T23:25:45.596 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.noname-d 2026-02-22T23:25:45.596 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.noname-i 2026-02-22T23:25:45.596 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.noname-e 2026-02-22T23:25:45.596 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:45.596 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.574+0000 7f654e5e4640 10 monclient: _add_conns ranks=[3,1,2,0,5,8,7,4,6] 2026-02-22T23:25:45.596 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.574+0000 7faf70056640 10 monclient(hunting): picked mon.noname-g con 0x7faf680a5100 addr v1:10.20.193.73:6790/0 2026-02-22T23:25:45.596 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.574+0000 7faf70056640 10 monclient(hunting): picked mon.noname-a con 0x7faf680a3f10 addr v1:10.20.193.45:6789/0 2026-02-22T23:25:45.597 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.574+0000 7faf70056640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf6806f720 con 0x7faf680a3f10 2026-02-22T23:25:45.597 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.574+0000 7f654e5e4640 10 monclient(hunting): picked mon.noname-g con 0x7f65480a5e00 addr v1:10.20.193.73:6790/0 2026-02-22T23:25:45.597 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7f654e5e4640 10 monclient(hunting): picked mon.noname-f con 0x7f65480a68f0 addr v1:10.20.193.73:6789/0 2026-02-22T23:25:45.597 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7f630e108640 10 monclient: _reopen_session rank -1 2026-02-22T23:25:45.597 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7faf70056640 1 -- --> v1:10.20.193.45:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf680a7250 con 0x7faf680a4610 2026-02-22T23:25:45.597 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7f654e5e4640 10 monclient(hunting): picked mon.noname-b con 0x7f65480a6d00 addr v1:10.20.193.45:6790/0 2026-02-22T23:25:45.597 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7faf70056640 1 -- --> v1:10.20.193.73:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf680a2c90 con 0x7faf680a5100 2026-02-22T23:25:45.597 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7faf70056640 10 monclient(hunting): _renew_subs 2026-02-22T23:25:45.597 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7f630e108640 10 monclient: _add_conns ranks=[2,7,0,6,3,1,8,4,5] 2026-02-22T23:25:45.598 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7f654e5e4640 1 -- --> v1:10.20.193.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f65480a2d00 con 0x7f65480a68f0 2026-02-22T23:25:45.598 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7faf70056640 10 monclient(hunting): authenticate will time out at 677.191033s 2026-02-22T23:25:45.598 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7f630e108640 10 monclient(hunting): picked mon.noname-b con 0x7f63080a4490 addr v1:10.20.193.45:6790/0 2026-02-22T23:25:45.598 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7f8ac7196640 10 monclient: _reopen_session rank -1 2026-02-22T23:25:45.598 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7f654e5e4640 1 -- --> v1:10.20.193.45:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f65480a2fe0 con 0x7f65480a6d00 2026-02-22T23:25:45.598 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7f654e5e4640 1 -- --> v1:10.20.193.73:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f65480a32c0 con 0x7f65480a5e00 2026-02-22T23:25:45.598 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7f8ac7196640 10 monclient: _add_conns ranks=[1,3,5,2,7,0,6,4,8] 2026-02-22T23:25:45.598 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7f654e5e4640 10 monclient(hunting): _renew_subs 2026-02-22T23:25:45.598 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7f654e5e4640 10 monclient(hunting): authenticate will time out at 677.191064s 2026-02-22T23:25:45.599 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7f630e108640 10 monclient(hunting): picked mon.noname-i con 0x7f63080a4f80 addr v1:10.20.193.73:6792/0 2026-02-22T23:25:45.599 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7faf6ddcb640 1 --1- >> v1:10.20.193.45:6790/0 conn(0x7faf680a4610 0x7faf680a49f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.45:6790/0 says I am v1:10.20.193.45:50878/0 (socket says 10.20.193.45:50878) 2026-02-22T23:25:45.599 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7faf6ddcb640 1 -- 10.20.193.45:0/2286020958 learned_addr learned my addr 10.20.193.45:0/2286020958 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-22T23:25:45.599 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7f8ac7196640 10 monclient(hunting): picked mon.noname-f con 0x7f8ac00a51e0 addr v1:10.20.193.73:6789/0 2026-02-22T23:25:45.599 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7f630e108640 10 monclient(hunting): picked mon.noname-a con 0x7f63080a5390 addr v1:10.20.193.45:6789/0 2026-02-22T23:25:45.599 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7f630e108640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63080a68a0 con 0x7f63080a5390 2026-02-22T23:25:45.599 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7f8ac7196640 10 monclient(hunting): picked mon.noname-g con 0x7f8ac0139240 addr v1:10.20.193.73:6790/0 2026-02-22T23:25:45.599 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7f8ac7196640 10 monclient(hunting): picked mon.noname-h con 0x7f8ac013f8a0 addr v1:10.20.193.73:6791/0 2026-02-22T23:25:45.599 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7f8ac7196640 1 -- --> v1:10.20.193.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8ac013e650 con 0x7f8ac00a51e0 2026-02-22T23:25:45.599 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7f630e108640 1 -- --> v1:10.20.193.45:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63081b0680 con 0x7f63080a4490 2026-02-22T23:25:45.599 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7f630e108640 1 -- --> v1:10.20.193.73:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63081b0960 con 0x7f63080a4f80 2026-02-22T23:25:45.600 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7f630e108640 10 monclient(hunting): _renew_subs 2026-02-22T23:25:45.600 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7f630e108640 10 monclient(hunting): authenticate will time out at 677.191120s 2026-02-22T23:25:45.600 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7f8ac7196640 1 -- --> v1:10.20.193.73:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8ac013e930 con 0x7f8ac0139240 2026-02-22T23:25:45.600 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7f8ac7196640 1 -- --> v1:10.20.193.73:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8ac00a6bc0 con 0x7f8ac013f8a0 2026-02-22T23:25:45.600 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7f63077fe640 1 --1- >> v1:10.20.193.45:6790/0 conn(0x7f63080a4490 0x7f63081c2fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.45:6790/0 says I am v1:10.20.193.45:50898/0 (socket says 10.20.193.45:50898) 2026-02-22T23:25:45.600 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7f8ac7196640 10 monclient(hunting): _renew_subs 2026-02-22T23:25:45.600 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7f8ac7196640 10 monclient(hunting): authenticate will time out at 677.191128s 2026-02-22T23:25:45.600 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7f654cb5a640 1 --1- >> v1:10.20.193.45:6790/0 conn(0x7f65480a6d00 0x7f65481417b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.45:6790/0 says I am v1:10.20.193.45:50892/0 (socket says 10.20.193.45:50892) 2026-02-22T23:25:45.600 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7f654cb5a640 1 -- 10.20.193.45:0/4039281391 learned_addr learned my addr 10.20.193.45:0/4039281391 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-22T23:25:45.600 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7f63077fe640 1 -- 10.20.193.45:0/2035269433 learned_addr learned my addr 10.20.193.45:0/2035269433 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-22T23:25:45.600 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7fa05786d640 1 Processor -- start 2026-02-22T23:25:45.601 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7f8ac570c640 1 --1- >> v1:10.20.193.73:6791/0 conn(0x7f8ac013f8a0 0x7f8ac01d82d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.73:6791/0 says I am v1:10.20.193.45:36378/0 (socket says 10.20.193.45:36378) 2026-02-22T23:25:45.601 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7f8ac4f0b640 1 --1- >> v1:10.20.193.73:6789/0 conn(0x7f8ac00a51e0 0x7f8ac01cfc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.73:6789/0 says I am v1:10.20.193.45:44324/0 (socket says 10.20.193.45:44324) 2026-02-22T23:25:45.601 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7f8ac570c640 1 -- 10.20.193.45:0/1763836368 learned_addr learned my addr 10.20.193.45:0/1763836368 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-22T23:25:45.601 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7faf6cdc9640 1 -- 10.20.193.45:0/2286020958 <== mon.2 v1:10.20.193.45:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3791527093 0 0) 0x7faf680a7250 con 0x7faf680a4610 2026-02-22T23:25:45.601 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7faf6cdc9640 10 monclient(hunting): _negotiate 2026-02-22T23:25:45.601 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7faf6cdc9640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:45.601 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7faf6cdc9640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:45.601 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7faf6cdc9640 10 monclient(hunting): my global_id is 4304 2026-02-22T23:25:45.601 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7fa05786d640 1 -- start start 2026-02-22T23:25:45.601 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7fa05786d640 10 monclient: init 2026-02-22T23:25:45.601 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7faf6cdc9640 1 -- 10.20.193.45:0/2286020958 --> v1:10.20.193.45:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faf50003620 con 0x7faf680a4610 2026-02-22T23:25:45.601 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7f62e3fff640 1 -- 10.20.193.45:0/2035269433 <== mon.2 v1:10.20.193.45:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1438680124 0 0) 0x7f63081b0680 con 0x7f63080a4490 2026-02-22T23:25:45.602 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7f62e3fff640 10 monclient(hunting): _negotiate 2026-02-22T23:25:45.602 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7f62e3fff640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:45.602 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7f62e3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:45.602 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7f62e3fff640 10 monclient(hunting): my global_id is 4313 2026-02-22T23:25:45.602 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7faf6cdc9640 1 -- 10.20.193.45:0/2286020958 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2288694911 0 0) 0x7faf6806f720 con 0x7faf680a3f10 2026-02-22T23:25:45.602 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7faf6cdc9640 10 monclient(hunting): _negotiate 2026-02-22T23:25:45.602 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7faf6cdc9640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:45.602 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7faf6cdc9640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:45.602 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7f62e3fff640 1 -- 10.20.193.45:0/2035269433 --> v1:10.20.193.45:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f62d8003620 con 0x7f63080a4490 2026-02-22T23:25:45.602 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7faf6cdc9640 10 monclient(hunting): my global_id is 4257 2026-02-22T23:25:45.602 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7faf6cdc9640 1 -- 10.20.193.45:0/2286020958 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faf680a7250 con 0x7faf680a3f10 2026-02-22T23:25:45.602 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7f6546ffd640 1 -- 10.20.193.45:0/4039281391 <== mon.2 v1:10.20.193.45:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 935520792 0 0) 0x7f65480a2fe0 con 0x7f65480a6d00 2026-02-22T23:25:45.602 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7f6546ffd640 10 monclient(hunting): _negotiate 2026-02-22T23:25:45.602 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7f6546ffd640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:45.602 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7f6546ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:45.602 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7f6546ffd640 10 monclient(hunting): my global_id is 4322 2026-02-22T23:25:45.603 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7faf6cdc9640 1 -- 10.20.193.45:0/2286020958 <== mon.3 v1:10.20.193.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2274266381 0 0) 0x7faf680a2c90 con 0x7faf680a5100 2026-02-22T23:25:45.603 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7faf6cdc9640 10 monclient(hunting): _negotiate 2026-02-22T23:25:45.603 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7faf6cdc9640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:45.603 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7faf6cdc9640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:45.603 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7faf6cdc9640 10 monclient(hunting): my global_id is 4314 2026-02-22T23:25:45.603 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7f6546ffd640 1 -- 10.20.193.45:0/4039281391 --> v1:10.20.193.45:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f652c003620 con 0x7f65480a6d00 2026-02-22T23:25:45.603 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7faf6cdc9640 1 -- 10.20.193.45:0/2286020958 --> v1:10.20.193.73:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faf6806f720 con 0x7faf680a5100 2026-02-22T23:25:45.603 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7f62e3fff640 1 -- 10.20.193.45:0/2035269433 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2299322998 0 0) 0x7f62fc003550 con 0x7f63080a5390 2026-02-22T23:25:45.603 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7f62e3fff640 10 monclient(hunting): _negotiate 2026-02-22T23:25:45.603 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7f62e3fff640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:45.603 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7f62e3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:45.603 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7f62e3fff640 10 monclient(hunting): my global_id is 4266 2026-02-22T23:25:45.603 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7f62e3fff640 1 -- 10.20.193.45:0/2035269433 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f63081b0680 con 0x7f63080a5390 2026-02-22T23:25:45.604 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7f6546ffd640 1 -- 10.20.193.45:0/4039281391 <== mon.3 v1:10.20.193.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1337924233 0 0) 0x7f65480a32c0 con 0x7f65480a5e00 2026-02-22T23:25:45.604 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7f6546ffd640 10 monclient(hunting): _negotiate 2026-02-22T23:25:45.604 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7f6546ffd640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:45.604 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7f6546ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:45.604 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7f6546ffd640 10 monclient(hunting): my global_id is 4305 2026-02-22T23:25:45.604 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7f6546ffd640 1 -- 10.20.193.45:0/4039281391 --> v1:10.20.193.73:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f65480a2fe0 con 0x7f65480a5e00 2026-02-22T23:25:45.604 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7faf6cdc9640 1 -- 10.20.193.45:0/2286020958 <== mon.2 v1:10.20.193.45:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4004047338 0 0) 0x7faf50003620 con 0x7faf680a4610 2026-02-22T23:25:45.604 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7faf6cdc9640 1 -- 10.20.193.45:0/2286020958 >> v1:10.20.193.73:6790/0 conn(0x7faf680a5100 legacy=0x7faf6813de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:45.604 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7faf6cdc9640 1 -- 10.20.193.45:0/2286020958 >> v1:10.20.193.45:6789/0 conn(0x7faf680a3f10 legacy=0x7faf681415a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:45.604 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7faf6cdc9640 10 monclient: _finish_hunting 0 2026-02-22T23:25:45.604 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7faf6cdc9640 1 monclient: found mon.noname-b 2026-02-22T23:25:45.604 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7faf6cdc9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T23:25:45.604 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7f6546ffd640 1 -- 10.20.193.45:0/4039281391 <== mon.1 v1:10.20.193.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1945797419 0 0) 0x7f65480a2d00 con 0x7f65480a68f0 2026-02-22T23:25:45.604 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7f6546ffd640 10 monclient(hunting): _negotiate 2026-02-22T23:25:45.604 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7f6546ffd640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:45.604 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7f6546ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:45.604 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7f6546ffd640 10 monclient(hunting): my global_id is 4357 2026-02-22T23:25:45.604 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7faf6cdc9640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.45:6790/0 2026-02-22T23:25:45.605 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7faf6cdc9640 1 -- 10.20.193.45:0/2286020958 --> v1:10.20.193.45:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf680a3250 con 0x7faf680a4610 2026-02-22T23:25:45.605 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7faf6cdc9640 10 monclient: _finish_auth 0 2026-02-22T23:25:45.605 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7faf6cdc9640 10 monclient: _check_auth_tickets 2026-02-22T23:25:45.605 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7faf6cdc9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T23:25:45.605 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7faf6cdc9640 1 -- 10.20.193.45:0/2286020958 <== mon.2 v1:10.20.193.45:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7faf58003040 con 0x7faf680a4610 2026-02-22T23:25:45.605 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7faf6cdc9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:25:45.605 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7f6546ffd640 1 -- 10.20.193.45:0/4039281391 --> v1:10.20.193.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f65480a32c0 con 0x7f65480a68f0 2026-02-22T23:25:45.605 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7faf6cdc9640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-22T23:25:45.605 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7faf6cdc9640 10 monclient: dump: 2026-02-22T23:25:45.605 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:45.605 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:45.605 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:45.605 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:45.605 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:45.605 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:45.605 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:45.605 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:45.605 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:45.605 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:45.605 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:45.606 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:45.606 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:45.606 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:45.606 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:45.606 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:45.606 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7faf70056640 5 monclient: authenticate success, global_id 4304 2026-02-22T23:25:45.606 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7faf70056640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-22T23:25:45.606 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7f9b02a0b640 10 monclient: get_monmap_and_config 2026-02-22T23:25:45.606 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7f9b02a0b640 10 monclient: build_initial_monmap 2026-02-22T23:25:45.606 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7f9b02a0b640 10 monclient: monmap: 2026-02-22T23:25:45.606 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-22T23:25:45.606 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:45.606 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:25:45.575630+0000 2026-02-22T23:25:45.606 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:25:45.575630+0000 2026-02-22T23:25:45.606 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-22T23:25:45.606 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:45.606 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-22T23:25:45.606 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.noname-f 2026-02-22T23:25:45.606 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.noname-b 2026-02-22T23:25:45.606 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.noname-g 2026-02-22T23:25:45.606 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.noname-c 2026-02-22T23:25:45.606 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.noname-h 2026-02-22T23:25:45.606 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.noname-d 2026-02-22T23:25:45.606 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.noname-i 2026-02-22T23:25:45.607 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.noname-e 2026-02-22T23:25:45.607 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:45.607 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7f62e3fff640 1 -- 10.20.193.45:0/2035269433 <== mon.2 v1:10.20.193.45:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2465138105 0 0) 0x7f62d8003620 con 0x7f63080a4490 2026-02-22T23:25:45.607 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7f6546ffd640 1 -- 10.20.193.45:0/4039281391 <== mon.2 v1:10.20.193.45:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2053574928 0 0) 0x7f652c003620 con 0x7f65480a6d00 2026-02-22T23:25:45.607 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7f6546ffd640 1 -- 10.20.193.45:0/4039281391 >> v1:10.20.193.73:6790/0 conn(0x7f65480a5e00 legacy=0x7f65480a61e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:45.607 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7f62e3fff640 1 -- 10.20.193.45:0/2035269433 --> v1:10.20.193.45:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f62fc003550 con 0x7f63080a4490 2026-02-22T23:25:45.607 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7f62e3fff640 1 -- 10.20.193.45:0/2035269433 <== mon.2 v1:10.20.193.45:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f62f4003320 con 0x7f63080a4490 2026-02-22T23:25:45.607 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7f62e3fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-22T23:25:45.607 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7f8ab57fa640 1 -- 10.20.193.45:0/1763836368 <== mon.5 v1:10.20.193.73:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3213390032 0 0) 0x7f8ac00a6bc0 con 0x7f8ac013f8a0 2026-02-22T23:25:45.607 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7f8ab57fa640 10 monclient(hunting): _negotiate 2026-02-22T23:25:45.607 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7f8ab57fa640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:45.607 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7f8ab57fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:45.608 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7f6546ffd640 1 -- 10.20.193.45:0/4039281391 >> v1:10.20.193.73:6789/0 conn(0x7f65480a68f0 legacy=0x7f654813e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:45.608 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7f6546ffd640 10 monclient: _finish_hunting 0 2026-02-22T23:25:45.608 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7f6546ffd640 1 monclient: found mon.noname-b 2026-02-22T23:25:45.608 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7faf6cdc9640 1 -- 10.20.193.45:0/2286020958 <== mon.2 v1:10.20.193.45:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7faf58003260 con 0x7faf680a4610 2026-02-22T23:25:45.608 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7faf6cdc9640 10 monclient: handle_config config(0 keys) 2026-02-22T23:25:45.608 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7faf6cdc9640 1 -- 10.20.193.45:0/2286020958 <== mon.2 v1:10.20.193.45:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7faf58004ce0 con 0x7faf680a4610 2026-02-22T23:25:45.608 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7faf6cdc9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:25:45.608 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7f8ab57fa640 10 monclient(hunting): my global_id is 4325 2026-02-22T23:25:45.608 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7f8ab57fa640 1 -- 10.20.193.45:0/1763836368 --> v1:10.20.193.73:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8a90003620 con 0x7f8ac013f8a0 2026-02-22T23:25:45.608 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7f6546ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T23:25:45.608 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7f6546ffd640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.45:6790/0 2026-02-22T23:25:45.608 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7f6546ffd640 1 -- 10.20.193.45:0/4039281391 --> v1:10.20.193.45:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65480a35a0 con 0x7f65480a6d00 2026-02-22T23:25:45.608 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7f6546ffd640 10 monclient: _finish_auth 0 2026-02-22T23:25:45.608 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7f6546ffd640 10 monclient: _check_auth_tickets 2026-02-22T23:25:45.608 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7f6546ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T23:25:45.608 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7f6546ffd640 1 -- 10.20.193.45:0/4039281391 <== mon.2 v1:10.20.193.45:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f653c0033c0 con 0x7f65480a6d00 2026-02-22T23:25:45.608 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7f6546ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:25:45.609 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7faf6cdc9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-22T23:25:45.609 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7faf6cdc9640 10 monclient: dump: 2026-02-22T23:25:45.609 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:45.609 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:45.609 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:45.609 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:45.609 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:45.609 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:45.609 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:45.609 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:45.609 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:45.609 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:45.609 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:45.609 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:45.609 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:45.609 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:45.609 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:45.609 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:45.609 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7f62e3fff640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-22T23:25:45.609 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7f62e3fff640 10 monclient(hunting): dump: 2026-02-22T23:25:45.609 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:45.609 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:45.609 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:45.609 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:45.609 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:45.609 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:45.609 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:45.610 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:45.610 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:45.610 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:45.610 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:45.610 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:45.610 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:45.610 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:45.610 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:45.610 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:45.610 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7f62e3fff640 10 monclient(hunting): _finish_auth 0 2026-02-22T23:25:45.610 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7f6546ffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-22T23:25:45.610 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7f6546ffd640 10 monclient: dump: 2026-02-22T23:25:45.610 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:45.610 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:45.610 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:45.610 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:45.610 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:45.610 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:45.610 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:45.610 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:45.610 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:45.610 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:45.610 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:45.610 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:45.610 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:45.610 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:45.610 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:45.610 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:45.610 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7f654e5e4640 5 monclient: authenticate success, global_id 4322 2026-02-22T23:25:45.611 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7f654e5e4640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-22T23:25:45.611 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7faf70056640 10 monclient: get_monmap_and_config success 2026-02-22T23:25:45.611 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7faf70056640 4 set_mon_vals no callback set 2026-02-22T23:25:45.611 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7f8ab57fa640 1 -- 10.20.193.45:0/1763836368 <== mon.3 v1:10.20.193.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3062914746 0 0) 0x7f8ac013e930 con 0x7f8ac0139240 2026-02-22T23:25:45.611 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7f8ab57fa640 10 monclient(hunting): _negotiate 2026-02-22T23:25:45.611 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7f8ab57fa640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:45.611 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7f8ab57fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:45.611 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7f8ab57fa640 10 monclient(hunting): my global_id is 4323 2026-02-22T23:25:45.611 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7f8ab57fa640 1 -- 10.20.193.45:0/1763836368 --> v1:10.20.193.73:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8ac00a6bc0 con 0x7f8ac0139240 2026-02-22T23:25:45.611 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7fa05786d640 10 monclient: _reopen_session rank -1 2026-02-22T23:25:45.611 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7f8ab57fa640 1 -- 10.20.193.45:0/1763836368 <== mon.1 v1:10.20.193.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1038427707 0 0) 0x7f8ac013e650 con 0x7f8ac00a51e0 2026-02-22T23:25:45.611 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7f8ab57fa640 10 monclient(hunting): _negotiate 2026-02-22T23:25:45.611 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7f8ab57fa640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:45.611 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7f8ab57fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:45.611 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7f8ab57fa640 10 monclient(hunting): my global_id is 4366 2026-02-22T23:25:45.611 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7f8ab57fa640 1 -- 10.20.193.45:0/1763836368 --> v1:10.20.193.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8ac013e930 con 0x7f8ac00a51e0 2026-02-22T23:25:45.612 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7fa05786d640 10 monclient: _add_conns ranks=[6,5,8,2,7,4,1,0,3] 2026-02-22T23:25:45.612 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7fa05786d640 10 monclient(hunting): picked mon.noname-d con 0x7fa0500a5e00 addr v1:10.20.193.45:6792/0 2026-02-22T23:25:45.612 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7fa05786d640 10 monclient(hunting): picked mon.noname-h con 0x7fa0500a68f0 addr v1:10.20.193.73:6791/0 2026-02-22T23:25:45.612 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7f62e3fff640 1 -- 10.20.193.45:0/2035269433 <== mon.2 v1:10.20.193.45:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2062348824 0 0) 0x7f62fc003550 con 0x7f63080a4490 2026-02-22T23:25:45.612 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7f62e3fff640 1 -- 10.20.193.45:0/2035269433 >> v1:10.20.193.73:6792/0 conn(0x7f63080a4f80 legacy=0x7f63081d4530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:45.612 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7f62e3fff640 1 -- 10.20.193.45:0/2035269433 >> v1:10.20.193.45:6789/0 conn(0x7f63080a5390 legacy=0x7f63081d7c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:45.612 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7f6546ffd640 1 -- 10.20.193.45:0/4039281391 <== mon.2 v1:10.20.193.45:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f653c003560 con 0x7f65480a6d00 2026-02-22T23:25:45.612 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7f6546ffd640 10 monclient: handle_config config(0 keys) 2026-02-22T23:25:45.612 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7f62e3fff640 10 monclient: _finish_hunting 0 2026-02-22T23:25:45.612 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7f62e3fff640 1 monclient: found mon.b 2026-02-22T23:25:45.612 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7f62e3fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T23:25:45.612 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7f62e3fff640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.45:6790/0 2026-02-22T23:25:45.612 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7f62e3fff640 1 -- 10.20.193.45:0/2035269433 --> v1:10.20.193.45:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63080a6470 con 0x7f63080a4490 2026-02-22T23:25:45.612 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7f6546ffd640 1 -- 10.20.193.45:0/4039281391 <== mon.2 v1:10.20.193.45:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f653c005060 con 0x7f65480a6d00 2026-02-22T23:25:45.612 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7f6546ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:25:45.612 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7f6546ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-22T23:25:45.613 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7f6546ffd640 10 monclient: dump: 2026-02-22T23:25:45.613 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:45.613 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:45.613 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:45.613 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:45.613 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:45.613 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:45.613 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:45.613 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:45.613 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:45.613 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:45.613 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:45.613 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:45.613 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:45.613 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:45.613 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:45.613 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:45.613 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7fa05786d640 10 monclient(hunting): picked mon.noname-e con 0x7fa0500a6d00 addr v1:10.20.193.45:6793/0 2026-02-22T23:25:45.613 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7fa05786d640 1 -- --> v1:10.20.193.73:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa050121f10 con 0x7fa0500a68f0 2026-02-22T23:25:45.613 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7fa05786d640 1 -- --> v1:10.20.193.45:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa0500a9f60 con 0x7fa0500a5e00 2026-02-22T23:25:45.613 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7f62e3fff640 10 monclient: _finish_auth 0 2026-02-22T23:25:45.613 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7f62e3fff640 10 monclient: _check_auth_tickets 2026-02-22T23:25:45.613 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7f62e3fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T23:25:45.613 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7f654e5e4640 10 monclient: get_monmap_and_config success 2026-02-22T23:25:45.614 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7f654e5e4640 4 set_mon_vals no callback set 2026-02-22T23:25:45.614 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7fa05786d640 1 -- --> v1:10.20.193.45:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa050124520 con 0x7fa0500a6d00 2026-02-22T23:25:45.614 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7fa05786d640 10 monclient(hunting): _renew_subs 2026-02-22T23:25:45.614 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7fa05786d640 10 monclient(hunting): authenticate will time out at 677.191659s 2026-02-22T23:25:45.614 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7f630e108640 5 monclient: authenticate success, global_id 4313 2026-02-22T23:25:45.614 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7f630e108640 10 monclient: _renew_subs 2026-02-22T23:25:45.614 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7f630e108640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.45:6790/0 2026-02-22T23:25:45.614 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7f630e108640 1 -- 10.20.193.45:0/2035269433 --> v1:10.20.193.45:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f63080a8ba0 con 0x7f63080a4490 2026-02-22T23:25:45.614 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7f8ab57fa640 1 -- 10.20.193.45:0/1763836368 <== mon.5 v1:10.20.193.73:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 926559149 0 0) 0x7f8a90003620 con 0x7f8ac013f8a0 2026-02-22T23:25:45.614 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7f8ab57fa640 1 -- 10.20.193.45:0/1763836368 --> v1:10.20.193.73:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f8ac013e650 con 0x7f8ac013f8a0 2026-02-22T23:25:45.614 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7f8ab57fa640 1 -- 10.20.193.45:0/1763836368 <== mon.5 v1:10.20.193.73:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f8abc0035e0 con 0x7f8ac013f8a0 2026-02-22T23:25:45.614 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7f8ab57fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-22T23:25:45.614 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7f8ab57fa640 10 monclient(hunting): got monmap 1 from mon.noname-h (according to old e1) 2026-02-22T23:25:45.614 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7f630e108640 10 monclient: _renew_subs 2026-02-22T23:25:45.614 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7f630e108640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.45:6790/0 2026-02-22T23:25:45.614 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7f630e108640 1 -- 10.20.193.45:0/2035269433 --> v1:10.20.193.45:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f63081aef20 con 0x7f63080a4490 2026-02-22T23:25:45.615 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7fa0555e2640 1 --1- >> v1:10.20.193.45:6792/0 conn(0x7fa0500a5e00 0x7fa050137e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.45:6792/0 says I am v1:10.20.193.45:56844/0 (socket says 10.20.193.45:56844) 2026-02-22T23:25:45.615 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7fa0555e2640 1 -- 10.20.193.45:0/1665227284 learned_addr learned my addr 10.20.193.45:0/1665227284 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-22T23:25:45.615 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7f8ab57fa640 10 monclient(hunting): dump: 2026-02-22T23:25:45.615 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:45.615 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:45.615 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:45.615 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:45.615 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:45.615 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:45.615 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:45.615 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:45.615 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:45.615 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:45.615 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:45.615 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:45.615 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:45.615 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:45.615 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:45.615 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:45.615 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7f8ab57fa640 10 monclient(hunting): _finish_auth 0 2026-02-22T23:25:45.615 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7f8ab57fa640 1 -- 10.20.193.45:0/1763836368 <== mon.3 v1:10.20.193.73:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1837201124 0 0) 0x7f8ac00a6bc0 con 0x7f8ac0139240 2026-02-22T23:25:45.615 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7f8ab57fa640 1 -- 10.20.193.45:0/1763836368 --> v1:10.20.193.73:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f8a90003620 con 0x7f8ac0139240 2026-02-22T23:25:45.615 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7f62e3fff640 1 -- 10.20.193.45:0/2035269433 <== mon.2 v1:10.20.193.45:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f62f40039c0 con 0x7f63080a4490 2026-02-22T23:25:45.615 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7f62e3fff640 10 monclient: handle_config config(0 keys) 2026-02-22T23:25:45.616 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7f62e3fff640 1 -- 10.20.193.45:0/2035269433 <== mon.2 v1:10.20.193.45:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f62f4003fb0 con 0x7f63080a4490 2026-02-22T23:25:45.616 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7f62e3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:25:45.616 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7f62e3fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-22T23:25:45.616 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7faf70056640 10 monclient: shutdown 2026-02-22T23:25:45.616 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7f6305ffb640 4 set_mon_vals no callback set 2026-02-22T23:25:45.616 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7f62e3fff640 10 monclient: dump: 2026-02-22T23:25:45.616 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:45.616 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:45.616 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:45.616 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:45.616 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:45.616 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:45.616 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:45.616 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:45.616 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:45.616 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:45.616 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:45.616 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:45.616 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:45.616 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:45.616 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:45.616 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:45.616 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7faf70056640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T23:25:45.616 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7faf70056640 1 -- 10.20.193.45:0/2286020958 >> v1:10.20.193.45:6790/0 conn(0x7faf680a4610 legacy=0x7faf680a49f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:45.617 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7f8ab57fa640 1 -- 10.20.193.45:0/1763836368 <== mon.5 v1:10.20.193.73:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3861941021 0 0) 0x7f8ac013e650 con 0x7f8ac013f8a0 2026-02-22T23:25:45.617 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7f8ab57fa640 1 -- 10.20.193.45:0/1763836368 >> v1:10.20.193.73:6790/0 conn(0x7f8ac0139240 legacy=0x7f8ac01d4ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:45.617 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7f8ab57fa640 1 -- 10.20.193.45:0/1763836368 >> v1:10.20.193.73:6789/0 conn(0x7f8ac00a51e0 legacy=0x7f8ac01cfc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:45.617 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7f8ab57fa640 10 monclient: _finish_hunting 0 2026-02-22T23:25:45.617 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7f8ab57fa640 1 monclient: found mon.h 2026-02-22T23:25:45.617 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7f8ab57fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T23:25:45.617 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7f8ab57fa640 10 monclient: _send_mon_message to mon.h at v1:10.20.193.73:6791/0 2026-02-22T23:25:45.617 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7f8ab57fa640 1 -- 10.20.193.45:0/1763836368 --> v1:10.20.193.73:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ac00a6670 con 0x7f8ac013f8a0 2026-02-22T23:25:45.617 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7f8ab57fa640 10 monclient: _finish_auth 0 2026-02-22T23:25:45.617 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7f8ab57fa640 10 monclient: _check_auth_tickets 2026-02-22T23:25:45.617 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7f8ab57fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T23:25:45.617 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7faf70056640 1 -- 10.20.193.45:0/2286020958 shutdown_connections 2026-02-22T23:25:45.617 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7faf70056640 1 -- 10.20.193.45:0/2286020958 >> 10.20.193.45:0/2286020958 conn(0x7faf680a7f70 msgr2=0x7faf680a8380 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:25:45.617 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7f8ac7196640 5 monclient: authenticate success, global_id 4325 2026-02-22T23:25:45.617 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7f8ac7196640 10 monclient: _renew_subs 2026-02-22T23:25:45.617 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7f8ac7196640 10 monclient: _send_mon_message to mon.h at v1:10.20.193.73:6791/0 2026-02-22T23:25:45.617 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7f8ac7196640 1 -- 10.20.193.45:0/1763836368 --> v1:10.20.193.73:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f8ac013e370 con 0x7f8ac013f8a0 2026-02-22T23:25:45.617 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7fa03dffb640 1 -- 10.20.193.45:0/1665227284 <== mon.6 v1:10.20.193.45:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1288009433 0 0) 0x7fa0500a2fe0 con 0x7fa0500a5e00 2026-02-22T23:25:45.618 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7fa03dffb640 10 monclient(hunting): _negotiate 2026-02-22T23:25:45.618 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7fa03dffb640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:45.618 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7fa03dffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:45.618 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7fa03dffb640 10 monclient(hunting): my global_id is 4308 2026-02-22T23:25:45.618 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7fa03dffb640 1 -- 10.20.193.45:0/1665227284 --> v1:10.20.193.45:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa020003620 con 0x7fa0500a5e00 2026-02-22T23:25:45.618 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7f9b02a0b640 1 Processor -- start 2026-02-22T23:25:45.618 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7fa03dffb640 1 -- 10.20.193.45:0/1665227284 <== mon.8 v1:10.20.193.45:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 922776987 0 0) 0x7fa050124520 con 0x7fa0500a6d00 2026-02-22T23:25:45.618 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7fa03dffb640 10 monclient(hunting): _negotiate 2026-02-22T23:25:45.618 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7fa03dffb640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:45.618 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7fa03dffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:45.618 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7faf70056640 1 -- 10.20.193.45:0/2286020958 shutdown_connections 2026-02-22T23:25:45.618 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7fa03dffb640 10 monclient(hunting): my global_id is 4301 2026-02-22T23:25:45.618 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7fa03dffb640 1 -- 10.20.193.45:0/1665227284 --> v1:10.20.193.45:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa0500a2fe0 con 0x7fa0500a6d00 2026-02-22T23:25:45.618 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7faf70056640 1 -- 10.20.193.45:0/2286020958 wait complete. 2026-02-22T23:25:45.618 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7f8ac7196640 10 monclient: _renew_subs 2026-02-22T23:25:45.618 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7f8ac7196640 10 monclient: _send_mon_message to mon.h at v1:10.20.193.73:6791/0 2026-02-22T23:25:45.619 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7f8ac7196640 1 -- 10.20.193.45:0/1763836368 --> v1:10.20.193.73:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7f8ac013b9c0 con 0x7f8ac013f8a0 2026-02-22T23:25:45.619 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7f9b02a0b640 1 -- start start 2026-02-22T23:25:45.619 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7f9b02a0b640 10 monclient: init 2026-02-22T23:25:45.619 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7f8ab57fa640 1 -- 10.20.193.45:0/1763836368 <== mon.5 v1:10.20.193.73:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f8abc003d40 con 0x7f8ac013f8a0 2026-02-22T23:25:45.619 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7f8ab57fa640 10 monclient: handle_config config(0 keys) 2026-02-22T23:25:45.619 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.575+0000 7f8ab6ffd640 4 set_mon_vals no callback set 2026-02-22T23:25:45.619 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.576+0000 7f8ab57fa640 1 -- 10.20.193.45:0/1763836368 <== mon.5 v1:10.20.193.73:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f8abc004270 con 0x7f8ac013f8a0 2026-02-22T23:25:45.619 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.576+0000 7f8ab57fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:25:45.619 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.576+0000 7f8ab57fa640 10 monclient: got monmap 1 from mon.h (according to old e1) 2026-02-22T23:25:45.619 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.576+0000 7fa03dffb640 1 -- 10.20.193.45:0/1665227284 <== mon.6 v1:10.20.193.45:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2030691645 0 0) 0x7fa020003620 con 0x7fa0500a5e00 2026-02-22T23:25:45.619 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.576+0000 7fa03dffb640 1 -- 10.20.193.45:0/1665227284 --> v1:10.20.193.45:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa050124520 con 0x7fa0500a5e00 2026-02-22T23:25:45.619 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.576+0000 7f8ab57fa640 10 monclient: dump: 2026-02-22T23:25:45.619 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:45.619 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:45.619 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:45.619 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:45.619 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:45.619 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:45.619 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:45.620 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:45.620 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:45.620 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:45.620 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:45.620 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:45.620 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:45.620 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:45.620 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:45.620 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:45.620 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.576+0000 7f654e5e4640 10 monclient: shutdown 2026-02-22T23:25:45.620 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.576+0000 7f654e5e4640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T23:25:45.620 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.576+0000 7f654e5e4640 1 -- 10.20.193.45:0/4039281391 >> v1:10.20.193.45:6790/0 conn(0x7f65480a6d00 legacy=0x7f65481417b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:45.620 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.576+0000 7fa03dffb640 1 -- 10.20.193.45:0/1665227284 <== mon.8 v1:10.20.193.45:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1147829066 0 0) 0x7fa0500a2fe0 con 0x7fa0500a6d00 2026-02-22T23:25:45.620 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.576+0000 7fa03dffb640 1 -- 10.20.193.45:0/1665227284 --> v1:10.20.193.45:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa020003620 con 0x7fa0500a6d00 2026-02-22T23:25:45.620 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.576+0000 7fa03dffb640 1 -- 10.20.193.45:0/1665227284 <== mon.6 v1:10.20.193.45:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7fa0400033a0 con 0x7fa0500a5e00 2026-02-22T23:25:45.620 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.576+0000 7fa03dffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-22T23:25:45.620 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.576+0000 7fa03dffb640 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2026-02-22T23:25:45.620 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.576+0000 7fa03dffb640 10 monclient(hunting): dump: 2026-02-22T23:25:45.620 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:45.620 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:45.620 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:45.620 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:45.620 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:45.620 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:45.620 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:45.620 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:45.621 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:45.621 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:45.621 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:45.621 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:45.621 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:45.621 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:45.621 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:45.621 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:45.621 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.576+0000 7fa03dffb640 10 monclient(hunting): _finish_auth 0 2026-02-22T23:25:45.621 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.576+0000 7fa03dffb640 1 -- 10.20.193.45:0/1665227284 <== mon.8 v1:10.20.193.45:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7fa04c003280 con 0x7fa0500a6d00 2026-02-22T23:25:45.621 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.576+0000 7fa03dffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-22T23:25:45.621 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.576+0000 7fa03dffb640 10 monclient(hunting): got monmap 1 from mon.e (according to old e1) 2026-02-22T23:25:45.621 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.576+0000 7fa03dffb640 10 monclient(hunting): dump: 2026-02-22T23:25:45.621 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:45.621 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:45.621 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:45.621 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:45.621 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:45.621 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:45.621 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:45.621 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:45.621 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:45.621 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:45.621 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:45.621 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:45.621 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:45.621 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:45.621 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:45.621 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:45.621 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.576+0000 7f654e5e4640 1 -- 10.20.193.45:0/4039281391 shutdown_connections 2026-02-22T23:25:45.621 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.576+0000 7f654e5e4640 1 -- 10.20.193.45:0/4039281391 >> 10.20.193.45:0/4039281391 conn(0x7f65480abb50 msgr2=0x7f65480a7f00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:25:45.621 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.576+0000 7f654e5e4640 1 -- 10.20.193.45:0/4039281391 shutdown_connections 2026-02-22T23:25:45.622 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.576+0000 7f654e5e4640 1 -- 10.20.193.45:0/4039281391 wait complete. 2026-02-22T23:25:45.622 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.576+0000 7fa03dffb640 1 -- 10.20.193.45:0/1665227284 <== mon.6 v1:10.20.193.45:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3230440903 0 0) 0x7fa050124520 con 0x7fa0500a5e00 2026-02-22T23:25:45.622 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.576+0000 7fa03dffb640 1 -- 10.20.193.45:0/1665227284 >> v1:10.20.193.45:6793/0 conn(0x7fa0500a6d00 legacy=0x7fa0501d3a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:45.622 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.576+0000 7fa03dffb640 1 -- 10.20.193.45:0/1665227284 >> v1:10.20.193.73:6791/0 conn(0x7fa0500a68f0 legacy=0x7fa0501d02f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:45.622 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.576+0000 7fa03dffb640 10 monclient: _finish_hunting 0 2026-02-22T23:25:45.622 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.576+0000 7fa03dffb640 1 monclient: found mon.d 2026-02-22T23:25:45.622 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.576+0000 7fa03dffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T23:25:45.622 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.576+0000 7fa03dffb640 10 monclient: _send_mon_message to mon.d at v1:10.20.193.45:6792/0 2026-02-22T23:25:45.622 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.576+0000 7fa03dffb640 1 -- 10.20.193.45:0/1665227284 --> v1:10.20.193.45:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0500a9a10 con 0x7fa0500a5e00 2026-02-22T23:25:45.622 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.576+0000 7fa03dffb640 10 monclient: _finish_auth 0 2026-02-22T23:25:45.622 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.576+0000 7fa03dffb640 10 monclient: _check_auth_tickets 2026-02-22T23:25:45.622 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.576+0000 7fa03dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T23:25:45.622 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.576+0000 7fa05786d640 5 monclient: authenticate success, global_id 4308 2026-02-22T23:25:45.622 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.576+0000 7fa05786d640 10 monclient: _renew_subs 2026-02-22T23:25:45.622 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.576+0000 7fa05786d640 10 monclient: _send_mon_message to mon.d at v1:10.20.193.45:6792/0 2026-02-22T23:25:45.622 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.576+0000 7fa05786d640 1 -- 10.20.193.45:0/1665227284 --> v1:10.20.193.45:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fa050072b60 con 0x7fa0500a5e00 2026-02-22T23:25:45.622 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.576+0000 7fa05786d640 10 monclient: _renew_subs 2026-02-22T23:25:45.622 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.576+0000 7fa05786d640 10 monclient: _send_mon_message to mon.d at v1:10.20.193.45:6792/0 2026-02-22T23:25:45.622 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.576+0000 7fa05786d640 1 -- 10.20.193.45:0/1665227284 --> v1:10.20.193.45:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7fa050122d60 con 0x7fa0500a5e00 2026-02-22T23:25:45.622 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.576+0000 7f9b02a0b640 10 monclient: _reopen_session rank -1 2026-02-22T23:25:45.622 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.576+0000 7f9b02a0b640 10 monclient: _add_conns ranks=[2,5,4,6,3,8,7,1,0] 2026-02-22T23:25:45.623 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.576+0000 7f9b02a0b640 10 monclient(hunting): picked mon.noname-b con 0x7f9afc0a4610 addr v1:10.20.193.45:6790/0 2026-02-22T23:25:45.623 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.576+0000 7f9b02a0b640 10 monclient(hunting): picked mon.noname-h con 0x7f9afc0a5100 addr v1:10.20.193.73:6791/0 2026-02-22T23:25:45.623 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.576+0000 7fa03dffb640 1 -- 10.20.193.45:0/1665227284 <== mon.6 v1:10.20.193.45:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa040004b90 con 0x7fa0500a5e00 2026-02-22T23:25:45.623 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.576+0000 7fa03dffb640 10 monclient: handle_config config(0 keys) 2026-02-22T23:25:45.623 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.576+0000 7f9b02a0b640 10 monclient(hunting): picked mon.noname-c con 0x7f9afc0a3f10 addr v1:10.20.193.45:6791/0 2026-02-22T23:25:45.623 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.576+0000 7fa03dffb640 1 -- 10.20.193.45:0/1665227284 <== mon.6 v1:10.20.193.45:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7fa040005080 con 0x7fa0500a5e00 2026-02-22T23:25:45.623 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.576+0000 7fa03dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:25:45.623 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.576+0000 7fa03f7fe640 4 set_mon_vals no callback set 2026-02-22T23:25:45.623 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.576+0000 7f9b02a0b640 1 -- --> v1:10.20.193.45:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9afc06f720 con 0x7f9afc0a4610 2026-02-22T23:25:45.623 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.576+0000 7f9b02a0b640 1 -- --> v1:10.20.193.45:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9afc0a7250 con 0x7f9afc0a3f10 2026-02-22T23:25:45.623 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.576+0000 7fa03dffb640 10 monclient: got monmap 1 from mon.d (according to old e1) 2026-02-22T23:25:45.623 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.576+0000 7fa03dffb640 10 monclient: dump: 2026-02-22T23:25:45.623 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:45.623 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:45.623 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:45.623 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:45.623 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:45.623 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:45.623 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:45.623 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:45.623 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:45.623 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:45.623 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:45.624 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:45.624 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:45.624 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:45.624 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:45.624 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:45.624 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.576+0000 7f9b02a0b640 1 -- --> v1:10.20.193.73:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9afc0a2c90 con 0x7f9afc0a5100 2026-02-22T23:25:45.624 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.576+0000 7f9b02a0b640 10 monclient(hunting): _renew_subs 2026-02-22T23:25:45.624 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.576+0000 7f9b02a0b640 10 monclient(hunting): authenticate will time out at 677.192287s 2026-02-22T23:25:45.624 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.576+0000 7faf70056640 10 monclient: build_initial_monmap 2026-02-22T23:25:45.624 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.576+0000 7f9afbfff640 1 --1- >> v1:10.20.193.45:6790/0 conn(0x7f9afc0a4610 0x7f9afc0a49f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.45:6790/0 says I am v1:10.20.193.45:50914/0 (socket says 10.20.193.45:50914) 2026-02-22T23:25:45.624 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.576+0000 7f9afbfff640 1 -- 10.20.193.45:0/904955590 learned_addr learned my addr 10.20.193.45:0/904955590 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-22T23:25:45.624 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.576+0000 7faf70056640 10 monclient: monmap: 2026-02-22T23:25:45.624 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-22T23:25:45.624 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T23:25:45.624 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-22T23:25:45.624 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-22T23:25:45.624 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-22T23:25:45.624 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-22T23:25:45.624 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-22T23:25:45.624 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.noname-f 2026-02-22T23:25:45.624 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.noname-b 2026-02-22T23:25:45.624 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.noname-g 2026-02-22T23:25:45.624 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.noname-c 2026-02-22T23:25:45.624 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.noname-h 2026-02-22T23:25:45.624 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.noname-d 2026-02-22T23:25:45.624 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.noname-i 2026-02-22T23:25:45.624 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.noname-e 2026-02-22T23:25:45.624 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:45.625 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.576+0000 7f630e108640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T23:25:45.625 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.576+0000 7f630e108640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T23:25:45.625 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.576+0000 7f630e108640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.45:6790/0 2026-02-22T23:25:45.625 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.576+0000 7f630e108640 1 -- 10.20.193.45:0/2035269433 --> v1:10.20.193.45:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f63080008d0 con 0x7f63080a4490 2026-02-22T23:25:45.625 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.576+0000 7f62e3fff640 1 -- 10.20.193.45:0/2035269433 <== mon.2 v1:10.20.193.45:6790/0 7 ==== mgrmap(e 5) ==== 50225+0+0 (unknown 2330357642 0 0) 0x7f62f4004150 con 0x7f63080a4490 2026-02-22T23:25:45.625 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.576+0000 7f9afaffd640 1 -- 10.20.193.45:0/904955590 <== mon.2 v1:10.20.193.45:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3958679690 0 0) 0x7f9afc06f720 con 0x7f9afc0a4610 2026-02-22T23:25:45.625 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.576+0000 7f9afaffd640 10 monclient(hunting): _negotiate 2026-02-22T23:25:45.625 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.576+0000 7f9afaffd640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:45.625 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.576+0000 7f9afaffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:45.625 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.576+0000 7f9afaffd640 10 monclient(hunting): my global_id is 4331 2026-02-22T23:25:45.625 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.576+0000 7f8ac7196640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T23:25:45.625 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.576+0000 7f8ac7196640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T23:25:45.625 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.576+0000 7f8ac7196640 10 monclient: _send_mon_message to mon.h at v1:10.20.193.73:6791/0 2026-02-22T23:25:45.625 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.576+0000 7f9afaffd640 1 -- 10.20.193.45:0/904955590 --> v1:10.20.193.45:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9ae0003620 con 0x7f9afc0a4610 2026-02-22T23:25:45.625 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.576+0000 7f8ab57fa640 1 -- 10.20.193.45:0/1763836368 <== mon.5 v1:10.20.193.73:6791/0 7 ==== mgrmap(e 5) ==== 50225+0+0 (unknown 2330357642 0 0) 0x7f8abc004410 con 0x7f8ac013f8a0 2026-02-22T23:25:45.625 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.576+0000 7f8ac7196640 1 -- 10.20.193.45:0/1763836368 --> v1:10.20.193.73:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ac006ea50 con 0x7f8ac013f8a0 2026-02-22T23:25:45.626 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.576+0000 7f9afaffd640 1 -- 10.20.193.45:0/904955590 <== mon.4 v1:10.20.193.45:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1482623597 0 0) 0x7f9afc0a7250 con 0x7f9afc0a3f10 2026-02-22T23:25:45.626 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.576+0000 7f9afaffd640 10 monclient(hunting): _negotiate 2026-02-22T23:25:45.626 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.576+0000 7f9afaffd640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:45.626 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.576+0000 7f9afaffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:45.626 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.576+0000 7f9afaffd640 10 monclient(hunting): my global_id is 4315 2026-02-22T23:25:45.626 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.576+0000 7f9afaffd640 1 -- 10.20.193.45:0/904955590 --> v1:10.20.193.45:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9afc06f720 con 0x7f9afc0a3f10 2026-02-22T23:25:45.626 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.576+0000 7f654e5e4640 10 monclient: build_initial_monmap 2026-02-22T23:25:45.626 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.576+0000 7f654e5e4640 10 monclient: monmap: 2026-02-22T23:25:45.626 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-22T23:25:45.626 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T23:25:45.626 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-22T23:25:45.626 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-22T23:25:45.626 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-22T23:25:45.626 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-22T23:25:45.626 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-22T23:25:45.626 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.noname-f 2026-02-22T23:25:45.626 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.noname-b 2026-02-22T23:25:45.626 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.noname-g 2026-02-22T23:25:45.626 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.noname-c 2026-02-22T23:25:45.626 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.noname-h 2026-02-22T23:25:45.626 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.noname-d 2026-02-22T23:25:45.626 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.noname-i 2026-02-22T23:25:45.626 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.noname-e 2026-02-22T23:25:45.626 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:45.626 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.576+0000 7f9afaffd640 1 -- 10.20.193.45:0/904955590 <== mon.4 v1:10.20.193.45:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2631893286 0 0) 0x7f9afc06f720 con 0x7f9afc0a3f10 2026-02-22T23:25:45.627 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.576+0000 7f9afaffd640 1 -- 10.20.193.45:0/904955590 >> v1:10.20.193.73:6791/0 conn(0x7f9afc0a5100 legacy=0x7f9afc13de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:45.627 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.576+0000 7f9afaffd640 1 -- 10.20.193.45:0/904955590 >> v1:10.20.193.45:6790/0 conn(0x7f9afc0a4610 legacy=0x7f9afc0a49f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:45.627 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.576+0000 7f9afaffd640 10 monclient: _finish_hunting 0 2026-02-22T23:25:45.627 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.576+0000 7f9afaffd640 1 monclient: found mon.noname-c 2026-02-22T23:25:45.627 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.576+0000 7f9afaffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T23:25:45.627 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.576+0000 7f9afaffd640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.45:6791/0 2026-02-22T23:25:45.627 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.576+0000 7f9afaffd640 1 -- 10.20.193.45:0/904955590 --> v1:10.20.193.45:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9afc0a3250 con 0x7f9afc0a3f10 2026-02-22T23:25:45.627 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.576+0000 7f9afaffd640 10 monclient: _finish_auth 0 2026-02-22T23:25:45.627 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.576+0000 7f9afaffd640 10 monclient: _check_auth_tickets 2026-02-22T23:25:45.627 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.576+0000 7f9afaffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T23:25:45.627 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.576+0000 7f9afaffd640 1 -- 10.20.193.45:0/904955590 <== mon.4 v1:10.20.193.45:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f9af00032d0 con 0x7f9afc0a3f10 2026-02-22T23:25:45.627 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.576+0000 7f9afaffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:25:45.627 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.576+0000 7f8ab57fa640 1 -- 10.20.193.45:0/1763836368 <== mon.5 v1:10.20.193.73:6791/0 8 ==== osd_map(19..19 src has 1..19) ==== 3558+0+0 (unknown 1288710973 0 0) 0x7f8abc04e060 con 0x7f8ac013f8a0 2026-02-22T23:25:45.627 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.576+0000 7f9afaffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-22T23:25:45.627 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.576+0000 7f62e3fff640 1 -- 10.20.193.45:0/2035269433 <== mon.2 v1:10.20.193.45:6790/0 8 ==== osd_map(19..19 src has 1..19) ==== 3558+0+0 (unknown 1288710973 0 0) 0x7f62f404dcc0 con 0x7f63080a4490 2026-02-22T23:25:45.627 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.576+0000 7f9afaffd640 10 monclient: dump: 2026-02-22T23:25:45.627 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:45.627 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:45.627 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:45.627 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:45.627 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:45.627 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:45.628 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:45.628 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:45.628 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:45.628 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:45.628 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:45.628 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:45.628 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:45.628 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:45.628 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:45.628 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:45.628 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.576+0000 7f9b02a0b640 5 monclient: authenticate success, global_id 4315 2026-02-22T23:25:45.628 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.576+0000 7f9b02a0b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-22T23:25:45.628 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.576+0000 7f9afaffd640 1 -- 10.20.193.45:0/904955590 <== mon.4 v1:10.20.193.45:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9af00034f0 con 0x7f9afc0a3f10 2026-02-22T23:25:45.628 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.576+0000 7f9afaffd640 10 monclient: handle_config config(0 keys) 2026-02-22T23:25:45.628 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.576+0000 7f9b02a0b640 10 monclient: get_monmap_and_config success 2026-02-22T23:25:45.628 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.576+0000 7f9b02a0b640 4 set_mon_vals no callback set 2026-02-22T23:25:45.628 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.576+0000 7f9afaffd640 1 -- 10.20.193.45:0/904955590 <== mon.4 v1:10.20.193.45:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f9af0003a90 con 0x7f9afc0a3f10 2026-02-22T23:25:45.628 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.576+0000 7f9afaffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:25:45.628 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.576+0000 7f9afaffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T23:25:45.628 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.576+0000 7f9afaffd640 10 monclient: dump: 2026-02-22T23:25:45.628 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:45.628 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:45.628 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:45.628 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:45.628 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:45.628 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:45.628 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:45.628 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:45.628 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:45.628 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:45.628 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:45.628 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:45.628 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:45.628 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:45.628 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:45.628 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:45.628 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.576+0000 7f654e5e4640 1 Processor -- start 2026-02-22T23:25:45.628 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.576+0000 7f8ac4f0b640 10 monclient: get_auth_request con 0x7f8a9003f940 auth_method 0 2026-02-22T23:25:45.629 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.576+0000 7f654e5e4640 1 -- start start 2026-02-22T23:25:45.629 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.576+0000 7f654e5e4640 10 monclient: init 2026-02-22T23:25:45.629 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.576+0000 7f6306ffd640 10 monclient: get_auth_request con 0x7f62d803f860 auth_method 0 2026-02-22T23:25:45.629 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.576+0000 7fa05786d640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T23:25:45.629 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.576+0000 7fa05786d640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T23:25:45.629 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.576+0000 7fa05786d640 10 monclient: _send_mon_message to mon.d at v1:10.20.193.45:6792/0 2026-02-22T23:25:45.629 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.576+0000 7fa03dffb640 1 -- 10.20.193.45:0/1665227284 <== mon.6 v1:10.20.193.45:6792/0 7 ==== mgrmap(e 5) ==== 50225+0+0 (unknown 2330357642 0 0) 0x7fa040011660 con 0x7fa0500a5e00 2026-02-22T23:25:45.629 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.576+0000 7fa05786d640 1 -- 10.20.193.45:0/1665227284 --> v1:10.20.193.45:6792/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa05006ea50 con 0x7fa0500a5e00 2026-02-22T23:25:45.629 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.576+0000 7f9b02a0b640 10 monclient: shutdown 2026-02-22T23:25:45.629 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.576+0000 7f9b02a0b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T23:25:45.629 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.576+0000 7f9b02a0b640 1 -- 10.20.193.45:0/904955590 >> v1:10.20.193.45:6791/0 conn(0x7f9afc0a3f10 legacy=0x7f9afc1415a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:45.629 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.576+0000 7faf70056640 1 Processor -- start 2026-02-22T23:25:45.629 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.576+0000 7faf70056640 1 -- start start 2026-02-22T23:25:45.629 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.576+0000 7faf70056640 10 monclient: init 2026-02-22T23:25:45.629 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.576+0000 7faf70056640 10 monclient: _reopen_session rank -1 2026-02-22T23:25:45.629 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.576+0000 7faf70056640 10 monclient: _add_conns ranks=[8,5,0,4,2,7,1,3,6] 2026-02-22T23:25:45.629 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.576+0000 7faf70056640 10 monclient(hunting): picked mon.noname-e con 0x7faf680a3f10 addr v1:10.20.193.45:6793/0 2026-02-22T23:25:45.629 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.576+0000 7faf70056640 10 monclient(hunting): picked mon.noname-h con 0x7faf680a4610 addr v1:10.20.193.73:6791/0 2026-02-22T23:25:45.629 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.576+0000 7faf70056640 10 monclient(hunting): picked mon.noname-a con 0x7faf680a5100 addr v1:10.20.193.45:6789/0 2026-02-22T23:25:45.630 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.576+0000 7faf70056640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf681230c0 con 0x7faf680a5100 2026-02-22T23:25:45.630 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.576+0000 7faf70056640 1 -- --> v1:10.20.193.73:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf680a18b0 con 0x7faf680a4610 2026-02-22T23:25:45.630 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.576+0000 7faf70056640 1 -- --> v1:10.20.193.45:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf68141240 con 0x7faf680a3f10 2026-02-22T23:25:45.630 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.576+0000 7faf70056640 10 monclient(hunting): _renew_subs 2026-02-22T23:25:45.630 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.576+0000 7faf70056640 10 monclient(hunting): authenticate will time out at 677.192966s 2026-02-22T23:25:45.630 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.577+0000 7f9b02a0b640 1 -- 10.20.193.45:0/904955590 shutdown_connections 2026-02-22T23:25:45.630 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.577+0000 7f9b02a0b640 1 -- 10.20.193.45:0/904955590 >> 10.20.193.45:0/904955590 conn(0x7f9afc0a7f70 msgr2=0x7f9afc0a8380 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:25:45.630 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.577+0000 7faf6ddcb640 1 --1- >> v1:10.20.193.45:6793/0 conn(0x7faf680a3f10 0x7faf6813f850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.45:6793/0 says I am v1:10.20.193.45:36730/0 (socket says 10.20.193.45:36730) 2026-02-22T23:25:45.630 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.577+0000 7faf6e5cc640 1 --1- >> v1:10.20.193.45:6789/0 conn(0x7faf680a5100 0x7faf681d7b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.45:6789/0 says I am v1:10.20.193.45:58202/0 (socket says 10.20.193.45:58202) 2026-02-22T23:25:45.630 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.577+0000 7faf6ddcb640 1 -- 10.20.193.45:0/434929822 learned_addr learned my addr 10.20.193.45:0/434929822 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-22T23:25:45.630 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.577+0000 7faf567fc640 1 -- 10.20.193.45:0/434929822 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4095807209 0 0) 0x7faf681230c0 con 0x7faf680a5100 2026-02-22T23:25:45.630 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.577+0000 7faf567fc640 10 monclient(hunting): _negotiate 2026-02-22T23:25:45.630 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.577+0000 7faf567fc640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:45.630 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.577+0000 7f654e5e4640 10 monclient: _reopen_session rank -1 2026-02-22T23:25:45.630 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.577+0000 7faf567fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:45.630 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.577+0000 7faf567fc640 10 monclient(hunting): my global_id is 4275 2026-02-22T23:25:45.630 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.577+0000 7f654e5e4640 10 monclient: _add_conns ranks=[2,0,1,8,7,5,4,3,6] 2026-02-22T23:25:45.630 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.577+0000 7fa03dffb640 1 -- 10.20.193.45:0/1665227284 <== mon.6 v1:10.20.193.45:6792/0 8 ==== osd_map(19..19 src has 1..19) ==== 3558+0+0 (unknown 1288710973 0 0) 0x7fa04004de00 con 0x7fa0500a5e00 2026-02-22T23:25:45.631 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.577+0000 7f654e5e4640 10 monclient(hunting): picked mon.noname-b con 0x7f65480a5e00 addr v1:10.20.193.45:6790/0 2026-02-22T23:25:45.631 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.577+0000 7f654e5e4640 10 monclient(hunting): picked mon.noname-a con 0x7f65480a68f0 addr v1:10.20.193.45:6789/0 2026-02-22T23:25:45.631 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.577+0000 7faf567fc640 1 -- 10.20.193.45:0/434929822 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faf38003620 con 0x7faf680a5100 2026-02-22T23:25:45.631 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.577+0000 7faf567fc640 1 -- 10.20.193.45:0/434929822 <== mon.8 v1:10.20.193.45:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2356112071 0 0) 0x7faf68141240 con 0x7faf680a3f10 2026-02-22T23:25:45.631 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.577+0000 7faf567fc640 10 monclient(hunting): _negotiate 2026-02-22T23:25:45.631 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.577+0000 7faf567fc640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:45.631 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.577+0000 7faf567fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:45.631 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.577+0000 7faf567fc640 10 monclient(hunting): my global_id is 4310 2026-02-22T23:25:45.631 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.577+0000 7f654e5e4640 10 monclient(hunting): picked mon.noname-f con 0x7f65480a6d00 addr v1:10.20.193.73:6789/0 2026-02-22T23:25:45.631 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.577+0000 7f654e5e4640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6548138710 con 0x7f65480a68f0 2026-02-22T23:25:45.631 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.577+0000 7faf567fc640 1 -- 10.20.193.45:0/434929822 --> v1:10.20.193.45:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faf681230c0 con 0x7faf680a3f10 2026-02-22T23:25:45.631 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.577+0000 7f654e5e4640 1 -- --> v1:10.20.193.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6548138150 con 0x7f65480a6d00 2026-02-22T23:25:45.631 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.577+0000 7f654e5e4640 1 -- --> v1:10.20.193.45:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6548138430 con 0x7f65480a5e00 2026-02-22T23:25:45.631 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.577+0000 7f654e5e4640 10 monclient(hunting): _renew_subs 2026-02-22T23:25:45.631 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.577+0000 7f654e5e4640 10 monclient(hunting): authenticate will time out at 677.193248s 2026-02-22T23:25:45.631 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.577+0000 7f9b02a0b640 1 -- 10.20.193.45:0/904955590 shutdown_connections 2026-02-22T23:25:45.631 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.577+0000 7f6547fff640 1 --1- >> v1:10.20.193.45:6790/0 conn(0x7f65480a5e00 0x7f65481cff70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.45:6790/0 says I am v1:10.20.193.45:50916/0 (socket says 10.20.193.45:50916) 2026-02-22T23:25:45.632 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.577+0000 7f6547fff640 1 -- 10.20.193.45:0/1799836995 learned_addr learned my addr 10.20.193.45:0/1799836995 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-22T23:25:45.632 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.577+0000 7fa054de1640 10 monclient: get_auth_request con 0x7fa02003fd20 auth_method 0 2026-02-22T23:25:45.632 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.577+0000 7f9b02a0b640 1 -- 10.20.193.45:0/904955590 wait complete. 2026-02-22T23:25:45.632 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.577+0000 7faf567fc640 1 -- 10.20.193.45:0/434929822 <== mon.8 v1:10.20.193.45:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 62037616 0 0) 0x7faf681230c0 con 0x7faf680a3f10 2026-02-22T23:25:45.632 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.577+0000 7faf567fc640 1 -- 10.20.193.45:0/434929822 --> v1:10.20.193.45:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7faf68141240 con 0x7faf680a3f10 2026-02-22T23:25:45.632 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.577+0000 7faf567fc640 1 -- 10.20.193.45:0/434929822 <== mon.8 v1:10.20.193.45:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7faf58004c20 con 0x7faf680a3f10 2026-02-22T23:25:45.632 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.577+0000 7faf567fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-22T23:25:45.632 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.577+0000 7faf567fc640 10 monclient(hunting): got monmap 1 from mon.noname-e (according to old e1) 2026-02-22T23:25:45.632 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.577+0000 7faf567fc640 10 monclient(hunting): dump: 2026-02-22T23:25:45.632 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:45.632 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:45.632 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:45.632 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:45.632 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:45.632 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:45.632 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:45.632 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:45.632 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:45.632 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:45.632 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:45.632 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:45.633 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:45.633 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:45.633 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:45.633 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:45.633 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.577+0000 7faf567fc640 10 monclient(hunting): _finish_auth 0 2026-02-22T23:25:45.633 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.577+0000 7faf567fc640 1 -- 10.20.193.45:0/434929822 <== mon.0 v1:10.20.193.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1998724603 0 0) 0x7faf38003620 con 0x7faf680a5100 2026-02-22T23:25:45.633 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.577+0000 7faf567fc640 1 -- 10.20.193.45:0/434929822 --> v1:10.20.193.45:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7faf681230c0 con 0x7faf680a5100 2026-02-22T23:25:45.633 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.577+0000 7faf567fc640 1 -- 10.20.193.45:0/434929822 <== mon.0 v1:10.20.193.45:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7faf64003660 con 0x7faf680a5100 2026-02-22T23:25:45.633 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.577+0000 7faf567fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-22T23:25:45.633 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.577+0000 7faf567fc640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-22T23:25:45.633 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.577+0000 7faf567fc640 10 monclient(hunting): dump: 2026-02-22T23:25:45.633 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:45.633 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:45.633 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:45.633 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:45.633 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:45.633 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:45.633 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:45.633 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:45.633 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:45.633 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:45.633 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:45.633 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:45.633 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:45.633 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:45.633 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:45.633 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:45.633 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.577+0000 7faf567fc640 1 -- 10.20.193.45:0/434929822 <== mon.8 v1:10.20.193.45:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4042107678 0 0) 0x7faf68141240 con 0x7faf680a3f10 2026-02-22T23:25:45.633 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.577+0000 7faf567fc640 1 -- 10.20.193.45:0/434929822 >> v1:10.20.193.73:6791/0 conn(0x7faf680a4610 legacy=0x7faf6813ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:45.633 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.577+0000 7faf567fc640 1 -- 10.20.193.45:0/434929822 >> v1:10.20.193.45:6789/0 conn(0x7faf680a5100 legacy=0x7faf681d7b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:45.633 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.577+0000 7faf567fc640 10 monclient: _finish_hunting 0 2026-02-22T23:25:45.633 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.577+0000 7faf567fc640 1 monclient: found mon.e 2026-02-22T23:25:45.633 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.577+0000 7faf567fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T23:25:45.633 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.577+0000 7faf567fc640 10 monclient: _send_mon_message to mon.e at v1:10.20.193.45:6793/0 2026-02-22T23:25:45.633 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.577+0000 7f6544ff9640 1 -- 10.20.193.45:0/1799836995 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 880640425 0 0) 0x7f6548138710 con 0x7f65480a68f0 2026-02-22T23:25:45.633 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.577+0000 7faf567fc640 1 -- 10.20.193.45:0/434929822 --> v1:10.20.193.45:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf68122de0 con 0x7faf680a3f10 2026-02-22T23:25:45.633 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.577+0000 7faf567fc640 10 monclient: _finish_auth 0 2026-02-22T23:25:45.633 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.577+0000 7faf567fc640 10 monclient: _check_auth_tickets 2026-02-22T23:25:45.634 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.577+0000 7faf567fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T23:25:45.634 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.577+0000 7f6544ff9640 10 monclient(hunting): _negotiate 2026-02-22T23:25:45.634 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.577+0000 7f6544ff9640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:45.634 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.577+0000 7f6544ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:45.634 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.577+0000 7f6544ff9640 10 monclient(hunting): my global_id is 4284 2026-02-22T23:25:45.634 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.577+0000 7faf70056640 5 monclient: authenticate success, global_id 4310 2026-02-22T23:25:45.634 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.577+0000 7faf70056640 10 monclient: _renew_subs 2026-02-22T23:25:45.634 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.577+0000 7faf70056640 10 monclient: _send_mon_message to mon.e at v1:10.20.193.45:6793/0 2026-02-22T23:25:45.634 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.577+0000 7faf70056640 1 -- 10.20.193.45:0/434929822 --> v1:10.20.193.45:6793/0 -- mon_subscribe({mgrmap=0+}) -- 0x7faf68122820 con 0x7faf680a3f10 2026-02-22T23:25:45.634 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.577+0000 7f6544ff9640 1 -- 10.20.193.45:0/1799836995 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6518003620 con 0x7f65480a68f0 2026-02-22T23:25:45.634 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.577+0000 7faf70056640 10 monclient: _renew_subs 2026-02-22T23:25:45.634 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.577+0000 7faf70056640 10 monclient: _send_mon_message to mon.e at v1:10.20.193.45:6793/0 2026-02-22T23:25:45.634 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.577+0000 7faf70056640 1 -- 10.20.193.45:0/434929822 --> v1:10.20.193.45:6793/0 -- mon_subscribe({osdmap=0}) -- 0x7faf68140670 con 0x7faf680a3f10 2026-02-22T23:25:45.634 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.577+0000 7f6544ff9640 1 -- 10.20.193.45:0/1799836995 <== mon.1 v1:10.20.193.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3655387317 0 0) 0x7f6548138150 con 0x7f65480a6d00 2026-02-22T23:25:45.634 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.577+0000 7f6544ff9640 10 monclient(hunting): _negotiate 2026-02-22T23:25:45.634 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.577+0000 7f6544ff9640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:45.634 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.577+0000 7f6544ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:45.634 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.577+0000 7f6544ff9640 10 monclient(hunting): my global_id is 4375 2026-02-22T23:25:45.634 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.577+0000 7f6544ff9640 1 -- 10.20.193.45:0/1799836995 --> v1:10.20.193.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6548138710 con 0x7f65480a6d00 2026-02-22T23:25:45.634 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.577+0000 7f9b02a0b640 10 monclient: build_initial_monmap 2026-02-22T23:25:45.635 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.577+0000 7f6544ff9640 1 -- 10.20.193.45:0/1799836995 <== mon.0 v1:10.20.193.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 782032736 0 0) 0x7f6518003620 con 0x7f65480a68f0 2026-02-22T23:25:45.635 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.577+0000 7f9b02a0b640 10 monclient: monmap: 2026-02-22T23:25:45.635 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-22T23:25:45.635 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T23:25:45.635 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-22T23:25:45.635 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-22T23:25:45.635 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-22T23:25:45.635 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-22T23:25:45.635 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-22T23:25:45.635 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.noname-f 2026-02-22T23:25:45.635 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.noname-b 2026-02-22T23:25:45.635 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.noname-g 2026-02-22T23:25:45.635 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.noname-c 2026-02-22T23:25:45.635 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.noname-h 2026-02-22T23:25:45.635 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.noname-d 2026-02-22T23:25:45.635 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.noname-i 2026-02-22T23:25:45.635 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.noname-e 2026-02-22T23:25:45.635 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:45.635 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.577+0000 7f6544ff9640 1 -- 10.20.193.45:0/1799836995 --> v1:10.20.193.45:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6548138150 con 0x7f65480a68f0 2026-02-22T23:25:45.635 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.577+0000 7f6544ff9640 1 -- 10.20.193.45:0/1799836995 <== mon.0 v1:10.20.193.45:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f65380032a0 con 0x7f65480a68f0 2026-02-22T23:25:45.635 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.577+0000 7f6544ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-22T23:25:45.635 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.577+0000 7f6544ff9640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T23:25:45.635 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.577+0000 7f6544ff9640 10 monclient(hunting): dump: 2026-02-22T23:25:45.635 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:45.635 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:45.635 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:45.635 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:45.635 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:45.636 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:45.636 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:45.636 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:45.636 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:45.636 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:45.636 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:45.636 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:45.636 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:45.636 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:45.636 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:45.636 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:45.636 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.577+0000 7f6544ff9640 10 monclient(hunting): _finish_auth 0 2026-02-22T23:25:45.636 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.577+0000 7f6544ff9640 1 -- 10.20.193.45:0/1799836995 <== mon.1 v1:10.20.193.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 647802212 0 0) 0x7f6548138710 con 0x7f65480a6d00 2026-02-22T23:25:45.636 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.577+0000 7f6544ff9640 1 -- 10.20.193.45:0/1799836995 --> v1:10.20.193.73:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6518003620 con 0x7f65480a6d00 2026-02-22T23:25:45.636 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.577+0000 7f6544ff9640 1 -- 10.20.193.45:0/1799836995 <== mon.1 v1:10.20.193.73:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f653c003280 con 0x7f65480a6d00 2026-02-22T23:25:45.636 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.577+0000 7f6544ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-22T23:25:45.636 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.577+0000 7f6544ff9640 10 monclient(hunting): got monmap 1 from mon.f (according to old e1) 2026-02-22T23:25:45.636 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.577+0000 7f6544ff9640 10 monclient(hunting): dump: 2026-02-22T23:25:45.636 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:45.636 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:45.636 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:45.636 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:45.636 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:45.636 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:45.636 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:45.636 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:45.636 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:45.636 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:45.636 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:45.636 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:45.636 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:45.636 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:45.636 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:45.636 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:45.636 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.577+0000 7f9b02a0b640 1 Processor -- start 2026-02-22T23:25:45.637 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.577+0000 7f6544ff9640 1 -- 10.20.193.45:0/1799836995 <== mon.1 v1:10.20.193.73:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2482891456 0 0) 0x7f6518003620 con 0x7f65480a6d00 2026-02-22T23:25:45.637 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.578+0000 7f6544ff9640 1 -- 10.20.193.45:0/1799836995 >> v1:10.20.193.45:6790/0 conn(0x7f65480a5e00 legacy=0x7f65481cff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:45.637 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.578+0000 7f6544ff9640 1 -- 10.20.193.45:0/1799836995 >> v1:10.20.193.45:6789/0 conn(0x7f65480a68f0 legacy=0x7f65481d4f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:45.637 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.578+0000 7f6544ff9640 10 monclient: _finish_hunting 0 2026-02-22T23:25:45.637 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.578+0000 7f6544ff9640 1 monclient: found mon.f 2026-02-22T23:25:45.637 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.578+0000 7f6544ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T23:25:45.637 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.578+0000 7f6544ff9640 10 monclient: _send_mon_message to mon.f at v1:10.20.193.73:6789/0 2026-02-22T23:25:45.637 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.578+0000 7f6544ff9640 1 -- 10.20.193.45:0/1799836995 --> v1:10.20.193.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65481364e0 con 0x7f65480a6d00 2026-02-22T23:25:45.637 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.578+0000 7f6544ff9640 10 monclient: _finish_auth 0 2026-02-22T23:25:45.637 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.578+0000 7f6544ff9640 10 monclient: _check_auth_tickets 2026-02-22T23:25:45.637 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.578+0000 7f6544ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T23:25:45.637 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.578+0000 7f654e5e4640 5 monclient: authenticate success, global_id 4375 2026-02-22T23:25:45.637 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.578+0000 7f654e5e4640 10 monclient: _renew_subs 2026-02-22T23:25:45.637 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.578+0000 7f654e5e4640 10 monclient: _send_mon_message to mon.f at v1:10.20.193.73:6789/0 2026-02-22T23:25:45.637 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.578+0000 7f654e5e4640 1 -- 10.20.193.45:0/1799836995 --> v1:10.20.193.73:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f65481368d0 con 0x7f65480a6d00 2026-02-22T23:25:45.637 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.578+0000 7f9b02a0b640 1 -- start start 2026-02-22T23:25:45.637 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.578+0000 7faf567fc640 1 -- 10.20.193.45:0/434929822 <== mon.8 v1:10.20.193.45:6793/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7faf58002980 con 0x7faf680a3f10 2026-02-22T23:25:45.637 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.578+0000 7faf567fc640 10 monclient: handle_config config(0 keys) 2026-02-22T23:25:45.637 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.578+0000 7f9b02a0b640 10 monclient: init 2026-02-22T23:25:45.637 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.578+0000 7faf567fc640 1 -- 10.20.193.45:0/434929822 <== mon.8 v1:10.20.193.45:6793/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7faf58003120 con 0x7faf680a3f10 2026-02-22T23:25:45.637 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.578+0000 7faf567fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:25:45.637 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.578+0000 7faf567fc640 10 monclient: got monmap 1 from mon.e (according to old e1) 2026-02-22T23:25:45.637 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.578+0000 7faf567fc640 10 monclient: dump: 2026-02-22T23:25:45.637 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:45.637 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:45.637 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:45.638 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:45.638 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:45.638 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:45.638 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:45.638 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:45.638 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:45.638 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:45.638 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:45.638 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:45.638 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:45.638 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:45.638 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:45.638 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:45.638 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.578+0000 7f654e5e4640 10 monclient: _renew_subs 2026-02-22T23:25:45.638 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.578+0000 7f654e5e4640 10 monclient: _send_mon_message to mon.f at v1:10.20.193.73:6789/0 2026-02-22T23:25:45.638 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.578+0000 7f654e5e4640 1 -- 10.20.193.45:0/1799836995 --> v1:10.20.193.73:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f6548135b50 con 0x7f65480a6d00 2026-02-22T23:25:45.638 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.578+0000 7faf70056640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T23:25:45.638 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.578+0000 7faf70056640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T23:25:45.638 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.578+0000 7faf70056640 10 monclient: _send_mon_message to mon.e at v1:10.20.193.45:6793/0 2026-02-22T23:25:45.638 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.578+0000 7f9b02a0b640 10 monclient: _reopen_session rank -1 2026-02-22T23:25:45.638 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.578+0000 7faf70056640 1 -- 10.20.193.45:0/434929822 --> v1:10.20.193.45:6793/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf680a5560 con 0x7faf680a3f10 2026-02-22T23:25:45.638 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.578+0000 7f9b02a0b640 10 monclient: _add_conns ranks=[0,6,8,2,7,4,3,5,1] 2026-02-22T23:25:45.638 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.578+0000 7f9b02a0b640 10 monclient(hunting): picked mon.noname-a con 0x7f9afc0a3f10 addr v1:10.20.193.45:6789/0 2026-02-22T23:25:45.638 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.578+0000 7f9b02a0b640 10 monclient(hunting): picked mon.noname-d con 0x7f9afc0a4610 addr v1:10.20.193.45:6792/0 2026-02-22T23:25:45.639 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.578+0000 7f6544ff9640 1 -- 10.20.193.45:0/1799836995 <== mon.1 v1:10.20.193.73:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f653c002d50 con 0x7f65480a6d00 2026-02-22T23:25:45.639 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.578+0000 7f6544ff9640 10 monclient: handle_config config(0 keys) 2026-02-22T23:25:45.639 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.578+0000 7f9b02a0b640 10 monclient(hunting): picked mon.noname-e con 0x7f9afc0a5100 addr v1:10.20.193.45:6793/0 2026-02-22T23:25:45.639 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.578+0000 7f9b02a0b640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9afc0a1ad0 con 0x7f9afc0a3f10 2026-02-22T23:25:45.639 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.578+0000 7f6544ff9640 1 -- 10.20.193.45:0/1799836995 <== mon.1 v1:10.20.193.73:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f653c003520 con 0x7f65480a6d00 2026-02-22T23:25:45.639 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.578+0000 7f6544ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:25:45.639 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.578+0000 7f9b02a0b640 1 -- --> v1:10.20.193.45:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9afc0a15c0 con 0x7f9afc0a4610 2026-02-22T23:25:45.639 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.578+0000 7f6544ff9640 10 monclient: got monmap 1 from mon.f (according to old e1) 2026-02-22T23:25:45.639 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.578+0000 7f6544ff9640 10 monclient: dump: 2026-02-22T23:25:45.639 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:45.639 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:45.639 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:45.639 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:45.639 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:45.639 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:45.639 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:45.639 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:45.639 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:45.639 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:45.639 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:45.639 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:45.639 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:45.639 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:45.639 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:45.639 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:45.639 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.578+0000 7f9b02a0b640 1 -- --> v1:10.20.193.45:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9afc06e780 con 0x7f9afc0a5100 2026-02-22T23:25:45.640 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.578+0000 7f9b02a0b640 10 monclient(hunting): _renew_subs 2026-02-22T23:25:45.640 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.578+0000 7f9b02a0b640 10 monclient(hunting): authenticate will time out at 677.194353s 2026-02-22T23:25:45.640 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.578+0000 7faf57fff640 4 set_mon_vals no callback set 2026-02-22T23:25:45.640 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.578+0000 7faf567fc640 1 -- 10.20.193.45:0/434929822 <== mon.8 v1:10.20.193.45:6793/0 7 ==== mgrmap(e 5) ==== 50225+0+0 (unknown 2330357642 0 0) 0x7faf58011720 con 0x7faf680a3f10 2026-02-22T23:25:45.640 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.578+0000 7f9afbfff640 1 --1- >> v1:10.20.193.45:6789/0 conn(0x7f9afc0a3f10 0x7f9afc1d3f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.45:6789/0 says I am v1:10.20.193.45:58216/0 (socket says 10.20.193.45:58216) 2026-02-22T23:25:45.640 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.578+0000 7f9afbfff640 1 -- 10.20.193.45:0/711412377 learned_addr learned my addr 10.20.193.45:0/711412377 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-22T23:25:45.640 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.578+0000 7f65467fc640 4 set_mon_vals no callback set 2026-02-22T23:25:45.640 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.578+0000 7faf567fc640 1 -- 10.20.193.45:0/434929822 <== mon.8 v1:10.20.193.45:6793/0 8 ==== osd_map(19..19 src has 1..19) ==== 3558+0+0 (unknown 1288710973 0 0) 0x7faf5804dda0 con 0x7faf680a3f10 2026-02-22T23:25:45.640 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.578+0000 7f654e5e4640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T23:25:45.640 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.578+0000 7f654e5e4640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T23:25:45.640 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.578+0000 7f654e5e4640 10 monclient: _send_mon_message to mon.f at v1:10.20.193.73:6789/0 2026-02-22T23:25:45.640 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.578+0000 7f654e5e4640 1 -- 10.20.193.45:0/1799836995 --> v1:10.20.193.73:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f65480008d0 con 0x7f65480a6d00 2026-02-22T23:25:45.640 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.578+0000 7faf6d5ca640 10 monclient: get_auth_request con 0x7faf3803fe60 auth_method 0 2026-02-22T23:25:45.640 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.578+0000 7f6544ff9640 1 -- 10.20.193.45:0/1799836995 <== mon.1 v1:10.20.193.73:6789/0 7 ==== mgrmap(e 5) ==== 50225+0+0 (unknown 2330357642 0 0) 0x7f653c011820 con 0x7f65480a6d00 2026-02-22T23:25:45.641 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.579+0000 7f8ab57fa640 1 -- 10.20.193.45:0/1763836368 <== mon.5 v1:10.20.193.73:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (unknown 1092875540 0 2568732696) 0x7f8abc017b00 con 0x7f8ac013f8a0 2026-02-22T23:25:45.641 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.579+0000 7f8ab57fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T23:25:45.641 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.579+0000 7f8ab57fa640 10 monclient: _finish_command 1 = system:0 2026-02-22T23:25:45.641 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.579+0000 7f9af8ff9640 1 -- 10.20.193.45:0/711412377 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2049128024 0 0) 0x7f9ae0003620 con 0x7f9afc0a3f10 2026-02-22T23:25:45.641 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.579+0000 7f9af8ff9640 10 monclient(hunting): _negotiate 2026-02-22T23:25:45.641 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.579+0000 7f9af8ff9640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:45.641 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.579+0000 7f9af8ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:45.641 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.579+0000 7f9af8ff9640 10 monclient(hunting): my global_id is 4293 2026-02-22T23:25:45.641 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.579+0000 7f9af8ff9640 1 -- 10.20.193.45:0/711412377 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9acc003620 con 0x7f9afc0a3f10 2026-02-22T23:25:45.641 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.579+0000 7f6544ff9640 1 -- 10.20.193.45:0/1799836995 <== mon.1 v1:10.20.193.73:6789/0 8 ==== osd_map(19..19 src has 1..19) ==== 3558+0+0 (unknown 1288710973 0 0) 0x7f653c04df30 con 0x7f65480a6d00 2026-02-22T23:25:45.641 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.579+0000 7f9af8ff9640 1 -- 10.20.193.45:0/711412377 <== mon.0 v1:10.20.193.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1958925028 0 0) 0x7f9acc003620 con 0x7f9afc0a3f10 2026-02-22T23:25:45.641 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.579+0000 7f9af8ff9640 1 -- 10.20.193.45:0/711412377 --> v1:10.20.193.45:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9ae0003620 con 0x7f9afc0a3f10 2026-02-22T23:25:45.641 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.579+0000 7f9af8ff9640 1 -- 10.20.193.45:0/711412377 <== mon.0 v1:10.20.193.45:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f9ae8003300 con 0x7f9afc0a3f10 2026-02-22T23:25:45.641 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.579+0000 7f9af8ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-22T23:25:45.641 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.579+0000 7f9af8ff9640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T23:25:45.641 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.579+0000 7f9af8ff9640 10 monclient(hunting): dump: 2026-02-22T23:25:45.641 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:45.641 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:45.641 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:45.641 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:45.641 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:45.642 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:45.642 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:45.642 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:45.642 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:45.642 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:45.642 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:45.642 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:45.642 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:45.642 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:45.642 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:45.642 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:45.642 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.579+0000 7f9af8ff9640 10 monclient(hunting): _finish_auth 0 2026-02-22T23:25:45.642 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.579+0000 7f6547fff640 10 monclient: get_auth_request con 0x7f651803fdd0 auth_method 0 2026-02-22T23:25:45.642 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.579+0000 7f9af8ff9640 1 -- 10.20.193.45:0/711412377 <== mon.0 v1:10.20.193.45:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1181085988 0 0) 0x7f9ae0003620 con 0x7f9afc0a3f10 2026-02-22T23:25:45.642 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.579+0000 7f9af8ff9640 1 -- 10.20.193.45:0/711412377 >> v1:10.20.193.45:6793/0 conn(0x7f9afc0a5100 legacy=0x7f9afc1dc660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:45.642 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.579+0000 7f9af8ff9640 1 -- 10.20.193.45:0/711412377 >> v1:10.20.193.45:6792/0 conn(0x7f9afc0a4610 legacy=0x7f9afc1d8f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:45.642 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.579+0000 7f9af8ff9640 10 monclient: _finish_hunting 0 2026-02-22T23:25:45.642 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.579+0000 7f9af8ff9640 1 monclient: found mon.a 2026-02-22T23:25:45.642 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.579+0000 7f9af8ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T23:25:45.642 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.579+0000 7f9af8ff9640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-22T23:25:45.642 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.579+0000 7f9af8ff9640 1 -- 10.20.193.45:0/711412377 --> v1:10.20.193.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9afc070c90 con 0x7f9afc0a3f10 2026-02-22T23:25:45.642 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.579+0000 7f9af8ff9640 10 monclient: _finish_auth 0 2026-02-22T23:25:45.642 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.579+0000 7f9af8ff9640 10 monclient: _check_auth_tickets 2026-02-22T23:25:45.643 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.579+0000 7f9af8ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T23:25:45.643 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.579+0000 7f9b02a0b640 5 monclient: authenticate success, global_id 4293 2026-02-22T23:25:45.643 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.579+0000 7f9b02a0b640 10 monclient: _renew_subs 2026-02-22T23:25:45.643 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.579+0000 7f9b02a0b640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-22T23:25:45.643 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.579+0000 7f9b02a0b640 1 -- 10.20.193.45:0/711412377 --> v1:10.20.193.45:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f9afc070f70 con 0x7f9afc0a3f10 2026-02-22T23:25:45.643 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.579+0000 7f9b02a0b640 10 monclient: _renew_subs 2026-02-22T23:25:45.643 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.579+0000 7f9b02a0b640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-22T23:25:45.643 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.579+0000 7f9b02a0b640 1 -- 10.20.193.45:0/711412377 --> v1:10.20.193.45:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f9afc141060 con 0x7f9afc0a3f10 2026-02-22T23:25:45.643 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.579+0000 7f9af8ff9640 1 -- 10.20.193.45:0/711412377 <== mon.0 v1:10.20.193.45:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9ae80034a0 con 0x7f9afc0a3f10 2026-02-22T23:25:45.643 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.579+0000 7f9af8ff9640 10 monclient: handle_config config(0 keys) 2026-02-22T23:25:45.643 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.579+0000 7f9af8ff9640 1 -- 10.20.193.45:0/711412377 <== mon.0 v1:10.20.193.45:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f9ae8004ed0 con 0x7f9afc0a3f10 2026-02-22T23:25:45.643 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.579+0000 7f9af8ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:25:45.643 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.579+0000 7f9afa7fc640 4 set_mon_vals no callback set 2026-02-22T23:25:45.643 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.579+0000 7f9af8ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T23:25:45.643 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.579+0000 7f9af8ff9640 10 monclient: dump: 2026-02-22T23:25:45.643 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:45.643 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:45.643 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:45.643 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:45.643 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:45.643 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:45.643 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:45.643 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:45.643 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:45.643 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:45.643 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:45.643 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:45.643 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:45.643 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:45.643 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:45.643 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:45.643 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.579+0000 7f62e3fff640 1 -- 10.20.193.45:0/2035269433 <== mon.2 v1:10.20.193.45:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (unknown 1092875540 0 2568732696) 0x7f62f40177c0 con 0x7f63080a4490 2026-02-22T23:25:45.643 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.579+0000 7f62e3fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T23:25:45.643 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.579+0000 7f62e3fff640 10 monclient: _finish_command 1 = system:0 2026-02-22T23:25:45.643 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.580+0000 7f9ad67fc640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T23:25:45.644 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.580+0000 7f9ad67fc640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T23:25:45.644 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.580+0000 7f9ad67fc640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-22T23:25:45.644 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.580+0000 7f9af8ff9640 1 -- 10.20.193.45:0/711412377 <== mon.0 v1:10.20.193.45:6789/0 7 ==== mgrmap(e 5) ==== 50225+0+0 (unknown 2330357642 0 0) 0x7f9ae8005070 con 0x7f9afc0a3f10 2026-02-22T23:25:45.644 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.580+0000 7f9ad67fc640 1 -- 10.20.193.45:0/711412377 --> v1:10.20.193.45:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9afc068a50 con 0x7f9afc0a3f10 2026-02-22T23:25:45.644 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.580+0000 7fa03dffb640 1 -- 10.20.193.45:0/1665227284 <== mon.6 v1:10.20.193.45:6792/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (unknown 1092875540 0 2568732696) 0x7fa0400809f0 con 0x7fa0500a5e00 2026-02-22T23:25:45.644 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.580+0000 7fa03dffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T23:25:45.644 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.580+0000 7fa03dffb640 10 monclient: _finish_command 1 = system:0 2026-02-22T23:25:45.644 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.580+0000 7f9af8ff9640 1 -- 10.20.193.45:0/711412377 <== mon.0 v1:10.20.193.45:6789/0 8 ==== osd_map(19..19 src has 1..19) ==== 3558+0+0 (unknown 1288710973 0 0) 0x7f9ae804dc50 con 0x7f9afc0a3f10 2026-02-22T23:25:45.644 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.580+0000 7f9afb7fe640 10 monclient: get_auth_request con 0x7f9acc03f850 auth_method 0 2026-02-22T23:25:45.644 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.581+0000 7faf567fc640 1 -- 10.20.193.45:0/434929822 <== mon.8 v1:10.20.193.45:6793/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (unknown 1092875540 0 2568732696) 0x7faf680a5560 con 0x7faf680a3f10 2026-02-22T23:25:45.644 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.581+0000 7faf567fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T23:25:45.644 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.581+0000 7faf567fc640 10 monclient: _finish_command 1 = system:0 2026-02-22T23:25:45.644 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.582+0000 7f6544ff9640 1 -- 10.20.193.45:0/1799836995 <== mon.1 v1:10.20.193.73:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (unknown 1092875540 0 2568732696) 0x7f653c017a30 con 0x7f65480a6d00 2026-02-22T23:25:45.644 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.582+0000 7f6544ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T23:25:45.644 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.582+0000 7f6544ff9640 10 monclient: _finish_command 1 = system:0 2026-02-22T23:25:45.644 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.584+0000 7f9af8ff9640 1 -- 10.20.193.45:0/711412377 <== mon.0 v1:10.20.193.45:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (unknown 1092875540 0 2568732696) 0x7f9afc0a1ad0 con 0x7f9afc0a3f10 2026-02-22T23:25:45.644 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.584+0000 7f9af8ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T23:25:45.644 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.584+0000 7f9af8ff9640 10 monclient: _finish_command 1 = system:0 2026-02-22T23:25:45.666 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.666+0000 7f8ac7196640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 3}] 2026-02-22T23:25:45.666 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.666+0000 7f8ac7196640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 3}] 2026-02-22T23:25:45.666 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.666+0000 7f8ac7196640 10 monclient: _send_mon_message to mon.h at v1:10.20.193.73:6791/0 2026-02-22T23:25:45.666 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.666+0000 7f8ac7196640 1 -- 10.20.193.45:0/1763836368 --> v1:10.20.193.73:6791/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f8ac00a9ff0 con 0x7f8ac013f8a0 2026-02-22T23:25:45.666 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.666+0000 7f8ab57fa640 1 -- 10.20.193.45:0/1763836368 <== mon.5 v1:10.20.193.73:6791/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (unknown 383520633 0 555833778) 0x7f8ac00a9ff0 con 0x7f8ac013f8a0 2026-02-22T23:25:45.666 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.666+0000 7f8ab57fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 3}] 2026-02-22T23:25:45.666 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.666+0000 7f8ab57fa640 10 monclient: _finish_command 2 = system:0 2026-02-22T23:25:45.667 INFO:teuthology.orchestra.run.trial045.stdout:47244640258 2026-02-22T23:25:45.668 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.668+0000 7f630e108640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 5}] 2026-02-22T23:25:45.668 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.668+0000 7f630e108640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 5}] 2026-02-22T23:25:45.668 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.668+0000 7f630e108640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.45:6790/0 2026-02-22T23:25:45.668 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.668+0000 7f630e108640 1 -- 10.20.193.45:0/2035269433 --> v1:10.20.193.45:6790/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f630806d180 con 0x7f63080a4490 2026-02-22T23:25:45.668 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.668+0000 7f8ac7196640 1 -- 10.20.193.45:0/1763836368 >> v1:10.20.193.73:6800/2222410180 conn(0x7f8a9003f940 legacy=0x7f8a90041e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:45.668 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.668+0000 7f8ac7196640 10 monclient: shutdown 2026-02-22T23:25:45.668 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.668+0000 7f8ac7196640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T23:25:45.668 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.668+0000 7f8ac7196640 1 -- 10.20.193.45:0/1763836368 >> v1:10.20.193.73:6791/0 conn(0x7f8ac013f8a0 legacy=0x7f8ac01d82d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:45.668 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.668+0000 7f8ac7196640 1 -- 10.20.193.45:0/1763836368 shutdown_connections 2026-02-22T23:25:45.668 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.668+0000 7f8ac7196640 1 -- 10.20.193.45:0/1763836368 >> 10.20.193.45:0/1763836368 conn(0x7f8ac00a96b0 msgr2=0x7f8ac00a2750 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:25:45.668 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.668+0000 7f8ac7196640 1 -- 10.20.193.45:0/1763836368 shutdown_connections 2026-02-22T23:25:45.668 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.668+0000 7f8ac7196640 1 -- 10.20.193.45:0/1763836368 wait complete. 2026-02-22T23:25:45.668 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.668+0000 7f62e3fff640 1 -- 10.20.193.45:0/2035269433 <== mon.2 v1:10.20.193.45:6790/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (unknown 2131975755 0 956180462) 0x7f62f40170c0 con 0x7f63080a4490 2026-02-22T23:25:45.668 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.668+0000 7f62e3fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 5}] 2026-02-22T23:25:45.669 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.668+0000 7f62e3fff640 10 monclient: _finish_command 2 = system:0 2026-02-22T23:25:45.669 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.668+0000 7faf70056640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 2}] 2026-02-22T23:25:45.669 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.668+0000 7faf70056640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 2}] 2026-02-22T23:25:45.669 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.668+0000 7faf70056640 10 monclient: _send_mon_message to mon.e at v1:10.20.193.45:6793/0 2026-02-22T23:25:45.669 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.668+0000 7faf70056640 1 -- 10.20.193.45:0/434929822 --> v1:10.20.193.45:6793/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7faf68068a50 con 0x7faf680a3f10 2026-02-22T23:25:45.669 INFO:teuthology.orchestra.run.trial045.stdout:51539607555 2026-02-22T23:25:45.669 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.668+0000 7faf567fc640 1 -- 10.20.193.45:0/434929822 <== mon.8 v1:10.20.193.45:6793/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (unknown 92182286 0 727498649) 0x7faf580178c0 con 0x7faf680a3f10 2026-02-22T23:25:45.669 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.669+0000 7faf567fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 2}] 2026-02-22T23:25:45.669 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.669+0000 7faf567fc640 10 monclient: _finish_command 2 = system:0 2026-02-22T23:25:45.669 INFO:teuthology.orchestra.run.trial045.stdout:51539607554 2026-02-22T23:25:45.669 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.670+0000 7fa05786d640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 4}] 2026-02-22T23:25:45.669 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.670+0000 7fa05786d640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 4}] 2026-02-22T23:25:45.669 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.670+0000 7fa05786d640 10 monclient: _send_mon_message to mon.d at v1:10.20.193.45:6792/0 2026-02-22T23:25:45.669 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.670+0000 7fa05786d640 1 -- 10.20.193.45:0/1665227284 --> v1:10.20.193.45:6792/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7fa05006ce10 con 0x7fa0500a5e00 2026-02-22T23:25:45.670 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.670+0000 7fa03dffb640 1 -- 10.20.193.45:0/1665227284 <== mon.6 v1:10.20.193.45:6792/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (unknown 1823589948 0 727498649) 0x7fa0500a9f60 con 0x7fa0500a5e00 2026-02-22T23:25:45.670 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.670+0000 7fa03dffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 4}] 2026-02-22T23:25:45.670 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.670+0000 7fa03dffb640 10 monclient: _finish_command 2 = system:0 2026-02-22T23:25:45.670 INFO:teuthology.orchestra.run.trial045.stdout:51539607554 2026-02-22T23:25:45.670 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.670+0000 7faf70056640 1 -- 10.20.193.45:0/434929822 >> v1:10.20.193.73:6800/2222410180 conn(0x7faf3803fe60 legacy=0x7faf38042320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:45.670 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.670+0000 7faf70056640 10 monclient: shutdown 2026-02-22T23:25:45.670 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.670+0000 7faf70056640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T23:25:45.670 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.670+0000 7faf70056640 1 -- 10.20.193.45:0/434929822 >> v1:10.20.193.45:6793/0 conn(0x7faf680a3f10 legacy=0x7faf6813f850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:45.670 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.671+0000 7f630e108640 1 -- 10.20.193.45:0/2035269433 >> v1:10.20.193.73:6800/2222410180 conn(0x7f62d803f860 legacy=0x7f62d8041d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:45.670 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.671+0000 7f630e108640 10 monclient: shutdown 2026-02-22T23:25:45.670 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.671+0000 7f630e108640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T23:25:45.670 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.671+0000 7f630e108640 1 -- 10.20.193.45:0/2035269433 >> v1:10.20.193.45:6790/0 conn(0x7f63080a4490 legacy=0x7f63081c2fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:45.671 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.671+0000 7faf70056640 1 -- 10.20.193.45:0/434929822 shutdown_connections 2026-02-22T23:25:45.671 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.671+0000 7faf70056640 1 -- 10.20.193.45:0/434929822 >> 10.20.193.45:0/434929822 conn(0x7faf680a7f70 msgr2=0x7faf68142150 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:25:45.671 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.671+0000 7f630e108640 1 -- 10.20.193.45:0/2035269433 shutdown_connections 2026-02-22T23:25:45.671 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.671+0000 7f630e108640 1 -- 10.20.193.45:0/2035269433 >> 10.20.193.45:0/2035269433 conn(0x7f63080a9720 msgr2=0x7f630809ef30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:25:45.671 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.671+0000 7faf70056640 1 -- 10.20.193.45:0/434929822 shutdown_connections 2026-02-22T23:25:45.671 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.671+0000 7faf70056640 1 -- 10.20.193.45:0/434929822 wait complete. 2026-02-22T23:25:45.671 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.671+0000 7f630e108640 1 -- 10.20.193.45:0/2035269433 shutdown_connections 2026-02-22T23:25:45.671 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.671+0000 7f630e108640 1 -- 10.20.193.45:0/2035269433 wait complete. 2026-02-22T23:25:45.671 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.671+0000 7f654e5e4640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 0}] 2026-02-22T23:25:45.671 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.671+0000 7f654e5e4640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 0}] 2026-02-22T23:25:45.671 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.671+0000 7f654e5e4640 10 monclient: _send_mon_message to mon.f at v1:10.20.193.73:6789/0 2026-02-22T23:25:45.671 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.671+0000 7f654e5e4640 1 -- 10.20.193.45:0/1799836995 --> v1:10.20.193.73:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f65480a5770 con 0x7f65480a6d00 2026-02-22T23:25:45.671 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.671+0000 7f6544ff9640 1 -- 10.20.193.45:0/1799836995 <== mon.1 v1:10.20.193.73:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (unknown 574334944 0 727498649) 0x7f653c020560 con 0x7f65480a6d00 2026-02-22T23:25:45.671 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.671+0000 7f6544ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 0}] 2026-02-22T23:25:45.671 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.671+0000 7f6544ff9640 10 monclient: _finish_command 2 = system:0 2026-02-22T23:25:45.672 INFO:teuthology.orchestra.run.trial045.stdout:51539607554 2026-02-22T23:25:45.672 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.671+0000 7f9ad67fc640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 1}] 2026-02-22T23:25:45.672 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.671+0000 7f9ad67fc640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 1}] 2026-02-22T23:25:45.672 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.671+0000 7f9ad67fc640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-22T23:25:45.672 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.671+0000 7f9ad67fc640 1 -- 10.20.193.45:0/711412377 --> v1:10.20.193.45:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f9afc0008d0 con 0x7f9afc0a3f10 2026-02-22T23:25:45.672 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.671+0000 7f9af8ff9640 1 -- 10.20.193.45:0/711412377 <== mon.0 v1:10.20.193.45:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (unknown 832126871 0 727498649) 0x7f9ae8017690 con 0x7f9afc0a3f10 2026-02-22T23:25:45.672 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.671+0000 7f9af8ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 1}] 2026-02-22T23:25:45.672 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.671+0000 7f9af8ff9640 10 monclient: _finish_command 2 = system:0 2026-02-22T23:25:45.672 INFO:teuthology.orchestra.run.trial045.stdout:51539607554 2026-02-22T23:25:45.672 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.672+0000 7fa05786d640 1 -- 10.20.193.45:0/1665227284 >> v1:10.20.193.73:6800/2222410180 conn(0x7fa02003fd20 legacy=0x7fa0200421e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:45.672 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.672+0000 7fa05786d640 10 monclient: shutdown 2026-02-22T23:25:45.672 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.672+0000 7fa05786d640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T23:25:45.672 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.672+0000 7fa05786d640 1 -- 10.20.193.45:0/1665227284 >> v1:10.20.193.45:6792/0 conn(0x7fa0500a5e00 legacy=0x7fa050137e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:45.672 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.672+0000 7fa05786d640 1 -- 10.20.193.45:0/1665227284 shutdown_connections 2026-02-22T23:25:45.672 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.672+0000 7fa05786d640 1 -- 10.20.193.45:0/1665227284 >> 10.20.193.45:0/1665227284 conn(0x7fa0500abb50 msgr2=0x7fa050071680 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:25:45.673 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.672+0000 7fa05786d640 1 -- 10.20.193.45:0/1665227284 shutdown_connections 2026-02-22T23:25:45.673 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.672+0000 7fa05786d640 1 -- 10.20.193.45:0/1665227284 wait complete. 2026-02-22T23:25:45.673 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.673+0000 7f654e5e4640 1 -- 10.20.193.45:0/1799836995 >> v1:10.20.193.73:6800/2222410180 conn(0x7f651803fdd0 legacy=0x7f6518042290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:45.673 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.673+0000 7f654e5e4640 10 monclient: shutdown 2026-02-22T23:25:45.673 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.673+0000 7f654e5e4640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T23:25:45.673 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.673+0000 7f654e5e4640 1 -- 10.20.193.45:0/1799836995 >> v1:10.20.193.73:6789/0 conn(0x7f65480a6d00 legacy=0x7f65481d8670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:45.673 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.673+0000 7f654e5e4640 1 -- 10.20.193.45:0/1799836995 shutdown_connections 2026-02-22T23:25:45.673 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.673+0000 7f654e5e4640 1 -- 10.20.193.45:0/1799836995 >> 10.20.193.45:0/1799836995 conn(0x7f65480abb50 msgr2=0x7f65480a4010 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:25:45.673 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.673+0000 7f654e5e4640 1 -- 10.20.193.45:0/1799836995 shutdown_connections 2026-02-22T23:25:45.674 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.673+0000 7f654e5e4640 1 -- 10.20.193.45:0/1799836995 wait complete. 2026-02-22T23:25:45.674 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.674+0000 7f9ad67fc640 1 -- 10.20.193.45:0/711412377 >> v1:10.20.193.73:6800/2222410180 conn(0x7f9acc03f850 legacy=0x7f9acc041d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:45.674 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.674+0000 7f9ad67fc640 10 monclient: shutdown 2026-02-22T23:25:45.674 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.674+0000 7f9ad67fc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T23:25:45.674 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.674+0000 7f9ad67fc640 1 -- 10.20.193.45:0/711412377 >> v1:10.20.193.45:6789/0 conn(0x7f9afc0a3f10 legacy=0x7f9afc1d3f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:45.674 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.674+0000 7f9ad67fc640 1 -- 10.20.193.45:0/711412377 shutdown_connections 2026-02-22T23:25:45.674 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.674+0000 7f9ad67fc640 1 -- 10.20.193.45:0/711412377 >> 10.20.193.45:0/711412377 conn(0x7f9afc0a7f70 msgr2=0x7f9afc0a9a90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:25:45.674 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.674+0000 7f9ad67fc640 1 -- 10.20.193.45:0/711412377 shutdown_connections 2026-02-22T23:25:45.674 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:45.674+0000 7f9ad67fc640 1 -- 10.20.193.45:0/711412377 wait complete. 2026-02-22T23:25:45.677 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640260 got 47244640258 for osd.3 2026-02-22T23:25:45.679 INFO:tasks.ceph.ceph_manager.ceph:need seq 51539607555 got 51539607554 for osd.2 2026-02-22T23:25:45.679 INFO:tasks.ceph.ceph_manager.ceph:need seq 51539607556 got 51539607555 for osd.5 2026-02-22T23:25:45.680 INFO:tasks.ceph.ceph_manager.ceph:need seq 51539607555 got 51539607554 for osd.4 2026-02-22T23:25:45.681 INFO:tasks.ceph.ceph_manager.ceph:need seq 51539607555 got 51539607554 for osd.1 2026-02-22T23:25:45.681 INFO:tasks.ceph.ceph_manager.ceph:need seq 51539607555 got 51539607554 for osd.0 2026-02-22T23:25:46.678 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-22T23:25:46.680 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-22T23:25:46.681 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2026-02-22T23:25:46.681 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2026-02-22T23:25:46.683 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-22T23:25:46.683 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-22T23:25:46.751 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.751+0000 7f9cbe0a9640 10 monclient: get_monmap_and_config 2026-02-22T23:25:46.752 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.751+0000 7f9cbe0a9640 10 monclient: build_initial_monmap 2026-02-22T23:25:46.752 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.751+0000 7f9cbe0a9640 10 monclient: monmap: 2026-02-22T23:25:46.752 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-22T23:25:46.752 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:46.752 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:25:46.751867+0000 2026-02-22T23:25:46.752 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:25:46.751867+0000 2026-02-22T23:25:46.752 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-22T23:25:46.752 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:46.752 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-22T23:25:46.753 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.noname-f 2026-02-22T23:25:46.753 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.noname-b 2026-02-22T23:25:46.753 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.noname-g 2026-02-22T23:25:46.753 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.noname-c 2026-02-22T23:25:46.753 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.noname-h 2026-02-22T23:25:46.753 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.noname-d 2026-02-22T23:25:46.753 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.noname-i 2026-02-22T23:25:46.753 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.noname-e 2026-02-22T23:25:46.753 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:46.754 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.751+0000 7f3eb6f55640 10 monclient: get_monmap_and_config 2026-02-22T23:25:46.754 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.751+0000 7f3eb6f55640 10 monclient: build_initial_monmap 2026-02-22T23:25:46.754 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.751+0000 7f3eb6f55640 10 monclient: monmap: 2026-02-22T23:25:46.754 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-22T23:25:46.754 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:46.754 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:25:46.752106+0000 2026-02-22T23:25:46.754 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:25:46.752106+0000 2026-02-22T23:25:46.754 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-22T23:25:46.754 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:46.754 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-22T23:25:46.755 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.noname-f 2026-02-22T23:25:46.755 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.noname-b 2026-02-22T23:25:46.755 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.noname-g 2026-02-22T23:25:46.755 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.noname-c 2026-02-22T23:25:46.755 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.noname-h 2026-02-22T23:25:46.755 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.noname-d 2026-02-22T23:25:46.755 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.noname-i 2026-02-22T23:25:46.755 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.noname-e 2026-02-22T23:25:46.755 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:46.756 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.752+0000 7f9cbe0a9640 1 Processor -- start 2026-02-22T23:25:46.756 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.752+0000 7f9cbe0a9640 1 -- start start 2026-02-22T23:25:46.756 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.752+0000 7f9cbe0a9640 10 monclient: init 2026-02-22T23:25:46.756 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.752+0000 7f3eb6f55640 1 Processor -- start 2026-02-22T23:25:46.757 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.752+0000 7f9cbe0a9640 10 monclient: _reopen_session rank -1 2026-02-22T23:25:46.757 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.752+0000 7f9cbe0a9640 10 monclient: _add_conns ranks=[2,0,8,4,6,3,7,5,1] 2026-02-22T23:25:46.757 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.752+0000 7f9cbe0a9640 10 monclient(hunting): picked mon.noname-b con 0x7f9cb80a5e00 addr v1:10.20.193.45:6790/0 2026-02-22T23:25:46.757 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.752+0000 7f3eb6f55640 1 -- start start 2026-02-22T23:25:46.758 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.752+0000 7f3eb6f55640 10 monclient: init 2026-02-22T23:25:46.758 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.752+0000 7f9cbe0a9640 10 monclient(hunting): picked mon.noname-a con 0x7f9cb80a68f0 addr v1:10.20.193.45:6789/0 2026-02-22T23:25:46.758 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.752+0000 7f9cbe0a9640 10 monclient(hunting): picked mon.noname-e con 0x7f9cb80a6d00 addr v1:10.20.193.45:6793/0 2026-02-22T23:25:46.758 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.752+0000 7f9cbe0a9640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9cb80a2d00 con 0x7f9cb80a68f0 2026-02-22T23:25:46.759 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.752+0000 7f9cbe0a9640 1 -- --> v1:10.20.193.45:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9cb80a2fe0 con 0x7f9cb80a5e00 2026-02-22T23:25:46.759 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.752+0000 7f9cbe0a9640 1 -- --> v1:10.20.193.45:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9cb80a32c0 con 0x7f9cb80a6d00 2026-02-22T23:25:46.759 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.752+0000 7f9cbe0a9640 10 monclient(hunting): _renew_subs 2026-02-22T23:25:46.759 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.752+0000 7f9cbe0a9640 10 monclient(hunting): authenticate will time out at 678.368508s 2026-02-22T23:25:46.759 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.752+0000 7fa2037ed640 10 monclient: get_monmap_and_config 2026-02-22T23:25:46.759 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.752+0000 7fa2037ed640 10 monclient: build_initial_monmap 2026-02-22T23:25:46.760 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.752+0000 7fa2037ed640 10 monclient: monmap: 2026-02-22T23:25:46.760 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-22T23:25:46.760 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:46.760 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:25:46.752718+0000 2026-02-22T23:25:46.760 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:25:46.752718+0000 2026-02-22T23:25:46.760 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-22T23:25:46.760 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:46.760 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-22T23:25:46.760 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.noname-f 2026-02-22T23:25:46.760 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.noname-b 2026-02-22T23:25:46.760 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.noname-g 2026-02-22T23:25:46.761 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.noname-c 2026-02-22T23:25:46.761 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.noname-h 2026-02-22T23:25:46.761 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.noname-d 2026-02-22T23:25:46.761 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.noname-i 2026-02-22T23:25:46.761 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.noname-e 2026-02-22T23:25:46.761 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:46.762 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.752+0000 7f9cb7fff640 1 --1- >> v1:10.20.193.45:6793/0 conn(0x7f9cb80a6d00 0x7f9cb81417b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.45:6793/0 says I am v1:10.20.193.45:36748/0 (socket says 10.20.193.45:36748) 2026-02-22T23:25:46.762 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.752+0000 7f9cb6ffd640 1 --1- >> v1:10.20.193.45:6789/0 conn(0x7f9cb80a68f0 0x7f9cb813e080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.45:6789/0 says I am v1:10.20.193.45:58222/0 (socket says 10.20.193.45:58222) 2026-02-22T23:25:46.762 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.752+0000 7f9cb77fe640 1 --1- >> v1:10.20.193.45:6790/0 conn(0x7f9cb80a5e00 0x7f9cb80a61e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.45:6790/0 says I am v1:10.20.193.45:50918/0 (socket says 10.20.193.45:50918) 2026-02-22T23:25:46.762 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.752+0000 7f9cb7fff640 1 -- 10.20.193.45:0/2709799301 learned_addr learned my addr 10.20.193.45:0/2709799301 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-22T23:25:46.762 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.752+0000 7effdca98640 10 monclient: get_monmap_and_config 2026-02-22T23:25:46.762 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.752+0000 7effdca98640 10 monclient: build_initial_monmap 2026-02-22T23:25:46.762 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.752+0000 7effdca98640 10 monclient: monmap: 2026-02-22T23:25:46.763 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-22T23:25:46.763 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:46.763 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:25:46.752798+0000 2026-02-22T23:25:46.763 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:25:46.752798+0000 2026-02-22T23:25:46.763 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-22T23:25:46.763 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:46.763 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-22T23:25:46.763 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.noname-f 2026-02-22T23:25:46.763 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.noname-b 2026-02-22T23:25:46.763 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.noname-g 2026-02-22T23:25:46.763 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.noname-c 2026-02-22T23:25:46.763 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.noname-h 2026-02-22T23:25:46.764 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.noname-d 2026-02-22T23:25:46.764 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.noname-i 2026-02-22T23:25:46.764 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.noname-e 2026-02-22T23:25:46.764 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:46.764 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.752+0000 7f9cb67fc640 1 -- 10.20.193.45:0/2709799301 <== mon.2 v1:10.20.193.45:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3752120630 0 0) 0x7f9cb80a2fe0 con 0x7f9cb80a5e00 2026-02-22T23:25:46.764 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.752+0000 7f9cb67fc640 10 monclient(hunting): _negotiate 2026-02-22T23:25:46.764 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.752+0000 7f9cb67fc640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:46.764 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.752+0000 7f9cb67fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:46.765 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.752+0000 7f9cb67fc640 10 monclient(hunting): my global_id is 4340 2026-02-22T23:25:46.765 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.752+0000 7f3eb6f55640 10 monclient: _reopen_session rank -1 2026-02-22T23:25:46.766 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.752+0000 7f9cb67fc640 1 -- 10.20.193.45:0/2709799301 --> v1:10.20.193.45:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9c9c003620 con 0x7f9cb80a5e00 2026-02-22T23:25:46.766 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.752+0000 7f9cb67fc640 1 -- 10.20.193.45:0/2709799301 <== mon.8 v1:10.20.193.45:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3298364569 0 0) 0x7f9cb80a32c0 con 0x7f9cb80a6d00 2026-02-22T23:25:46.766 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.752+0000 7f9cb67fc640 10 monclient(hunting): _negotiate 2026-02-22T23:25:46.766 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.752+0000 7f9cb67fc640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:46.766 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.752+0000 7f9cb67fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:46.767 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.752+0000 7f9cb67fc640 10 monclient(hunting): my global_id is 4319 2026-02-22T23:25:46.767 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.752+0000 7f3eb6f55640 10 monclient: _add_conns ranks=[6,3,1,2,5,7,8,0,4] 2026-02-22T23:25:46.768 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.752+0000 7f9cb67fc640 1 -- 10.20.193.45:0/2709799301 --> v1:10.20.193.45:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9cb80a2fe0 con 0x7f9cb80a6d00 2026-02-22T23:25:46.768 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.752+0000 7f9cb67fc640 1 -- 10.20.193.45:0/2709799301 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2344697547 0 0) 0x7f9cb80a2d00 con 0x7f9cb80a68f0 2026-02-22T23:25:46.768 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.752+0000 7f9cb67fc640 10 monclient(hunting): _negotiate 2026-02-22T23:25:46.768 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.752+0000 7f9cb67fc640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:46.768 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.752+0000 7f9cb67fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:46.768 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.752+0000 7f9cb67fc640 10 monclient(hunting): my global_id is 4302 2026-02-22T23:25:46.768 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.752+0000 7f9cb67fc640 1 -- 10.20.193.45:0/2709799301 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9cb80a32c0 con 0x7f9cb80a68f0 2026-02-22T23:25:46.769 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.752+0000 7f3eb6f55640 10 monclient(hunting): picked mon.noname-d con 0x7f3eb00a2f60 addr v1:10.20.193.45:6792/0 2026-02-22T23:25:46.769 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.752+0000 7f3eb6f55640 10 monclient(hunting): picked mon.noname-g con 0x7f3eb00a3a50 addr v1:10.20.193.73:6790/0 2026-02-22T23:25:46.770 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.752+0000 7f3eb6f55640 10 monclient(hunting): picked mon.noname-f con 0x7f3eb013d420 addr v1:10.20.193.73:6789/0 2026-02-22T23:25:46.770 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.752+0000 7f3eb6f55640 1 -- --> v1:10.20.193.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3eb006d640 con 0x7f3eb013d420 2026-02-22T23:25:46.770 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.752+0000 7f3eb6f55640 1 -- --> v1:10.20.193.73:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3eb006d390 con 0x7f3eb00a3a50 2026-02-22T23:25:46.770 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.752+0000 7f3eb6f55640 1 -- --> v1:10.20.193.45:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3eb00a4090 con 0x7f3eb00a2f60 2026-02-22T23:25:46.770 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.752+0000 7f3eb6f55640 10 monclient(hunting): _renew_subs 2026-02-22T23:25:46.770 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.752+0000 7f3eb6f55640 10 monclient(hunting): authenticate will time out at 678.368893s 2026-02-22T23:25:46.771 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.752+0000 7f9cb67fc640 1 -- 10.20.193.45:0/2709799301 <== mon.8 v1:10.20.193.45:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1812399264 0 0) 0x7f9cb80a2fe0 con 0x7f9cb80a6d00 2026-02-22T23:25:46.771 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.752+0000 7f9cb67fc640 1 -- 10.20.193.45:0/2709799301 >> v1:10.20.193.45:6790/0 conn(0x7f9cb80a5e00 legacy=0x7f9cb80a61e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:46.771 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.752+0000 7f9cb67fc640 1 -- 10.20.193.45:0/2709799301 >> v1:10.20.193.45:6789/0 conn(0x7f9cb80a68f0 legacy=0x7f9cb813e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:46.771 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.752+0000 7f9cb67fc640 10 monclient: _finish_hunting 0 2026-02-22T23:25:46.771 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.752+0000 7f9cb67fc640 1 monclient: found mon.noname-e 2026-02-22T23:25:46.771 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.752+0000 7f9cb67fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T23:25:46.771 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.752+0000 7f9cb67fc640 10 monclient: _send_mon_message to mon.noname-e at v1:10.20.193.45:6793/0 2026-02-22T23:25:46.771 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.752+0000 7f9cb67fc640 1 -- 10.20.193.45:0/2709799301 --> v1:10.20.193.45:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9cb80a35a0 con 0x7f9cb80a6d00 2026-02-22T23:25:46.772 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.752+0000 7f3eb4cca640 1 --1- >> v1:10.20.193.45:6792/0 conn(0x7f3eb00a2f60 0x7f3eb00a3340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.45:6792/0 says I am v1:10.20.193.45:56852/0 (socket says 10.20.193.45:56852) 2026-02-22T23:25:46.772 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.752+0000 7f3eb4cca640 1 -- 10.20.193.45:0/3387173525 learned_addr learned my addr 10.20.193.45:0/3387173525 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-22T23:25:46.773 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.752+0000 7f9cb67fc640 10 monclient: _finish_auth 0 2026-02-22T23:25:46.773 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.752+0000 7f9cb67fc640 10 monclient: _check_auth_tickets 2026-02-22T23:25:46.773 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.752+0000 7f9cb67fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T23:25:46.773 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.752+0000 7f9cb67fc640 1 -- 10.20.193.45:0/2709799301 <== mon.8 v1:10.20.193.45:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f9cac0032d0 con 0x7f9cb80a6d00 2026-02-22T23:25:46.773 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.752+0000 7f9cbe0a9640 5 monclient: authenticate success, global_id 4319 2026-02-22T23:25:46.773 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.752+0000 7f9cbe0a9640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-22T23:25:46.774 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.752+0000 7f9cb67fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:25:46.774 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.752+0000 7f9cb67fc640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2026-02-22T23:25:46.774 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.752+0000 7f9cb67fc640 10 monclient: dump: 2026-02-22T23:25:46.774 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:46.774 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:46.774 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:46.774 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:46.774 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:46.774 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:46.774 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:46.774 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:46.774 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:46.775 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:46.775 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:46.775 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:46.775 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:46.775 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:46.775 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:46.775 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:46.775 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.752+0000 7f9cbe0a9640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-22T23:25:46.775 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.753+0000 7f9cb67fc640 1 -- 10.20.193.45:0/2709799301 <== mon.8 v1:10.20.193.45:6793/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9cac0034f0 con 0x7f9cb80a6d00 2026-02-22T23:25:46.776 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.753+0000 7f9cb67fc640 10 monclient: handle_config config(0 keys) 2026-02-22T23:25:46.776 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.753+0000 7f9cbe0a9640 10 monclient: get_monmap_and_config success 2026-02-22T23:25:46.776 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.753+0000 7f9cbe0a9640 4 set_mon_vals no callback set 2026-02-22T23:25:46.776 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.753+0000 7f9cb67fc640 1 -- 10.20.193.45:0/2709799301 <== mon.8 v1:10.20.193.45:6793/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f9cac005060 con 0x7f9cb80a6d00 2026-02-22T23:25:46.776 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.753+0000 7f9cb67fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:25:46.777 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.753+0000 7effdca98640 1 Processor -- start 2026-02-22T23:25:46.777 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.753+0000 7f9cb67fc640 10 monclient: got monmap 1 from mon.e (according to old e1) 2026-02-22T23:25:46.777 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.753+0000 7f9cb67fc640 10 monclient: dump: 2026-02-22T23:25:46.778 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:46.778 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:46.778 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:46.778 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:46.778 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:46.778 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:46.778 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:46.778 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:46.778 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:46.778 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:46.779 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:46.779 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:46.779 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:46.779 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:46.779 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:46.779 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:46.779 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.753+0000 7fa2037ed640 1 Processor -- start 2026-02-22T23:25:46.780 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.753+0000 7f3ea77fe640 1 -- 10.20.193.45:0/3387173525 <== mon.6 v1:10.20.193.45:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 858152708 0 0) 0x7f3eb00a4090 con 0x7f3eb00a2f60 2026-02-22T23:25:46.780 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.753+0000 7f3ea77fe640 10 monclient(hunting): _negotiate 2026-02-22T23:25:46.780 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.753+0000 7f3ea77fe640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:46.780 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.753+0000 7f3ea77fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:46.780 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.753+0000 7f3ea77fe640 10 monclient(hunting): my global_id is 4317 2026-02-22T23:25:46.780 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.753+0000 7f3ea77fe640 1 -- 10.20.193.45:0/3387173525 --> v1:10.20.193.45:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3e9c003620 con 0x7f3eb00a2f60 2026-02-22T23:25:46.780 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.753+0000 7effdca98640 1 -- start start 2026-02-22T23:25:46.780 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.753+0000 7effdca98640 10 monclient: init 2026-02-22T23:25:46.781 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.753+0000 7fa2037ed640 1 -- start start 2026-02-22T23:25:46.781 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.753+0000 7fa2037ed640 10 monclient: init 2026-02-22T23:25:46.782 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.753+0000 7f3ea77fe640 1 -- 10.20.193.45:0/3387173525 <== mon.6 v1:10.20.193.45:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 730131997 0 0) 0x7f3e9c003620 con 0x7f3eb00a2f60 2026-02-22T23:25:46.782 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.753+0000 7f3ea77fe640 1 -- 10.20.193.45:0/3387173525 >> v1:10.20.193.73:6790/0 conn(0x7f3eb00a3a50 legacy=0x7f3eb013bd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:46.783 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.753+0000 7f3ea77fe640 1 -- 10.20.193.45:0/3387173525 >> v1:10.20.193.73:6789/0 conn(0x7f3eb013d420 legacy=0x7f3eb013f810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:46.783 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.753+0000 7f3ea77fe640 10 monclient: _finish_hunting 0 2026-02-22T23:25:46.783 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.753+0000 7f3ea77fe640 1 monclient: found mon.noname-d 2026-02-22T23:25:46.783 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.753+0000 7f3ea77fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T23:25:46.783 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.753+0000 7f3ea77fe640 10 monclient: _send_mon_message to mon.noname-d at v1:10.20.193.45:6792/0 2026-02-22T23:25:46.783 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.753+0000 7f3ea77fe640 1 -- 10.20.193.45:0/3387173525 --> v1:10.20.193.45:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3eb009fba0 con 0x7f3eb00a2f60 2026-02-22T23:25:46.783 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.753+0000 7f3ea77fe640 10 monclient: _finish_auth 0 2026-02-22T23:25:46.783 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.753+0000 7f3ea77fe640 10 monclient: _check_auth_tickets 2026-02-22T23:25:46.783 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.753+0000 7f3ea77fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T23:25:46.783 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.753+0000 7f3eb6f55640 5 monclient: authenticate success, global_id 4317 2026-02-22T23:25:46.783 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.753+0000 7f3eb6f55640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-22T23:25:46.783 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.753+0000 7f3ea77fe640 1 -- 10.20.193.45:0/3387173525 <== mon.6 v1:10.20.193.45:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f3ea0003040 con 0x7f3eb00a2f60 2026-02-22T23:25:46.783 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.753+0000 7f3ea77fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:25:46.783 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.753+0000 7f3ea77fe640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2026-02-22T23:25:46.784 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.753+0000 7f3ea77fe640 10 monclient: dump: 2026-02-22T23:25:46.784 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:46.784 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:46.784 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:46.784 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:46.784 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:46.784 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:46.784 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:46.784 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:46.784 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:46.784 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:46.784 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:46.784 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:46.784 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:46.784 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:46.785 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:46.785 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:46.785 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.753+0000 7f3eb6f55640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-22T23:25:46.785 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.753+0000 7f3ea77fe640 1 -- 10.20.193.45:0/3387173525 <== mon.6 v1:10.20.193.45:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3ea0003260 con 0x7f3eb00a2f60 2026-02-22T23:25:46.785 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.753+0000 7f3ea77fe640 10 monclient: handle_config config(0 keys) 2026-02-22T23:25:46.785 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.753+0000 7f3eb6f55640 10 monclient: get_monmap_and_config success 2026-02-22T23:25:46.785 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.753+0000 7f3eb6f55640 4 set_mon_vals no callback set 2026-02-22T23:25:46.785 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.753+0000 7f3ea77fe640 1 -- 10.20.193.45:0/3387173525 <== mon.6 v1:10.20.193.45:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f3ea0004ce0 con 0x7f3eb00a2f60 2026-02-22T23:25:46.785 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.753+0000 7f3ea77fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:25:46.785 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.753+0000 7f3ea77fe640 10 monclient: got monmap 1 from mon.d (according to old e1) 2026-02-22T23:25:46.785 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.753+0000 7f3ea77fe640 10 monclient: dump: 2026-02-22T23:25:46.785 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:46.785 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:46.785 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:46.785 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:46.786 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:46.786 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:46.786 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:46.786 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:46.786 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:46.786 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:46.786 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:46.786 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:46.786 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:46.786 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:46.786 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:46.786 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:46.787 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.753+0000 7f9cbe0a9640 10 monclient: shutdown 2026-02-22T23:25:46.787 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.753+0000 7f9cbe0a9640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T23:25:46.787 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.753+0000 7f9cbe0a9640 1 -- 10.20.193.45:0/2709799301 >> v1:10.20.193.45:6793/0 conn(0x7f9cb80a6d00 legacy=0x7f9cb81417b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:46.787 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.753+0000 7effdca98640 10 monclient: _reopen_session rank -1 2026-02-22T23:25:46.787 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.753+0000 7effdca98640 10 monclient: _add_conns ranks=[0,1,7,2,8,4,3,6,5] 2026-02-22T23:25:46.787 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.753+0000 7f9cbe0a9640 1 -- 10.20.193.45:0/2709799301 shutdown_connections 2026-02-22T23:25:46.787 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.753+0000 7f9cbe0a9640 1 -- 10.20.193.45:0/2709799301 >> 10.20.193.45:0/2709799301 conn(0x7f9cb80abb50 msgr2=0x7f9cb80a7f00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:25:46.788 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.753+0000 7effdca98640 10 monclient(hunting): picked mon.noname-a con 0x7effd80a5e00 addr v1:10.20.193.45:6789/0 2026-02-22T23:25:46.788 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.753+0000 7effdca98640 10 monclient(hunting): picked mon.noname-f con 0x7effd80a68f0 addr v1:10.20.193.73:6789/0 2026-02-22T23:25:46.788 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.753+0000 7effdca98640 10 monclient(hunting): picked mon.noname-i con 0x7effd80a6d00 addr v1:10.20.193.73:6792/0 2026-02-22T23:25:46.788 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.753+0000 7f9cbe0a9640 1 -- 10.20.193.45:0/2709799301 shutdown_connections 2026-02-22T23:25:46.788 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.753+0000 7effdca98640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7effd80a2d00 con 0x7effd80a5e00 2026-02-22T23:25:46.789 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.753+0000 7f9cbe0a9640 1 -- 10.20.193.45:0/2709799301 wait complete. 2026-02-22T23:25:46.789 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.753+0000 7fa2037ed640 10 monclient: _reopen_session rank -1 2026-02-22T23:25:46.789 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.753+0000 7effdca98640 1 -- --> v1:10.20.193.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7effd80a2fe0 con 0x7effd80a68f0 2026-02-22T23:25:46.789 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.753+0000 7effdca98640 1 -- --> v1:10.20.193.73:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7effd80a32c0 con 0x7effd80a6d00 2026-02-22T23:25:46.790 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.753+0000 7fa2037ed640 10 monclient: _add_conns ranks=[3,8,6,2,4,0,1,5,7] 2026-02-22T23:25:46.790 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.753+0000 7effdca98640 10 monclient(hunting): _renew_subs 2026-02-22T23:25:46.790 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.753+0000 7effdca98640 10 monclient(hunting): authenticate will time out at 678.369564s 2026-02-22T23:25:46.790 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.753+0000 7effd6575640 1 --1- >> v1:10.20.193.45:6789/0 conn(0x7effd80a5e00 0x7effd80a61e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.45:6789/0 says I am v1:10.20.193.45:58232/0 (socket says 10.20.193.45:58232) 2026-02-22T23:25:46.790 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.753+0000 7effd6575640 1 -- 10.20.193.45:0/85739709 learned_addr learned my addr 10.20.193.45:0/85739709 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-22T23:25:46.790 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.753+0000 7fa2037ed640 10 monclient(hunting): picked mon.noname-g con 0x7fa1fc0733c0 addr v1:10.20.193.73:6790/0 2026-02-22T23:25:46.791 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.753+0000 7fa2037ed640 10 monclient(hunting): picked mon.noname-e con 0x7fa1fc0a32c0 addr v1:10.20.193.45:6793/0 2026-02-22T23:25:46.791 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.753+0000 7fa2037ed640 10 monclient(hunting): picked mon.noname-d con 0x7fa1fc13d2b0 addr v1:10.20.193.45:6792/0 2026-02-22T23:25:46.791 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.753+0000 7f3eb6f55640 10 monclient: shutdown 2026-02-22T23:25:46.791 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.753+0000 7f3eb6f55640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T23:25:46.791 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.753+0000 7f3eb6f55640 1 -- 10.20.193.45:0/3387173525 >> v1:10.20.193.45:6792/0 conn(0x7f3eb00a2f60 legacy=0x7f3eb00a3340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:46.791 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.753+0000 7fa2037ed640 1 -- --> v1:10.20.193.73:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa1fc0a2600 con 0x7fa1fc0733c0 2026-02-22T23:25:46.792 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.753+0000 7fa2037ed640 1 -- --> v1:10.20.193.45:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa1fc0a1c50 con 0x7fa1fc13d2b0 2026-02-22T23:25:46.792 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.753+0000 7fa2037ed640 1 -- --> v1:10.20.193.45:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa1fc0a28e0 con 0x7fa1fc0a32c0 2026-02-22T23:25:46.792 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.753+0000 7fa200d61640 1 --1- >> v1:10.20.193.45:6793/0 conn(0x7fa1fc0a32c0 0x7fa1fc13bb90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.45:6793/0 says I am v1:10.20.193.45:36758/0 (socket says 10.20.193.45:36758) 2026-02-22T23:25:46.792 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.753+0000 7fa2037ed640 10 monclient(hunting): _renew_subs 2026-02-22T23:25:46.792 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.753+0000 7fa200d61640 1 -- 10.20.193.45:0/2566194011 learned_addr learned my addr 10.20.193.45:0/2566194011 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-22T23:25:46.792 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.753+0000 7f3eb6f55640 1 -- 10.20.193.45:0/3387173525 shutdown_connections 2026-02-22T23:25:46.792 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.753+0000 7fa2037ed640 10 monclient(hunting): authenticate will time out at 678.369680s 2026-02-22T23:25:46.792 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.753+0000 7f3eb6f55640 1 -- 10.20.193.45:0/3387173525 >> 10.20.193.45:0/3387173525 conn(0x7f3eb00a8530 msgr2=0x7f3eb00a8940 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:25:46.793 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.753+0000 7effd5573640 1 -- 10.20.193.45:0/85739709 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2391609773 0 0) 0x7effd80a2d00 con 0x7effd80a5e00 2026-02-22T23:25:46.793 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.753+0000 7effd5573640 10 monclient(hunting): _negotiate 2026-02-22T23:25:46.793 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.753+0000 7effd5573640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:46.793 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.753+0000 7effd5573640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:46.793 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.753+0000 7effd5573640 10 monclient(hunting): my global_id is 4311 2026-02-22T23:25:46.793 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.753+0000 7effd5573640 1 -- 10.20.193.45:0/85739709 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7effc4003620 con 0x7effd80a5e00 2026-02-22T23:25:46.793 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.753+0000 7f3eb6f55640 1 -- 10.20.193.45:0/3387173525 shutdown_connections 2026-02-22T23:25:46.793 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.753+0000 7f3eb6f55640 1 -- 10.20.193.45:0/3387173525 wait complete. 2026-02-22T23:25:46.793 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.753+0000 7fa1ebfff640 1 -- 10.20.193.45:0/2566194011 <== mon.8 v1:10.20.193.45:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2905422231 0 0) 0x7fa1fc0a28e0 con 0x7fa1fc0a32c0 2026-02-22T23:25:46.794 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.753+0000 7fa1ebfff640 10 monclient(hunting): _negotiate 2026-02-22T23:25:46.794 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.753+0000 7fa1ebfff640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:46.794 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.753+0000 7fa1ebfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:46.794 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.753+0000 7fa1ebfff640 10 monclient(hunting): my global_id is 4328 2026-02-22T23:25:46.794 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.753+0000 7fa1ebfff640 1 -- 10.20.193.45:0/2566194011 --> v1:10.20.193.45:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa1e4003620 con 0x7fa1fc0a32c0 2026-02-22T23:25:46.794 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.753+0000 7fa1ebfff640 1 -- 10.20.193.45:0/2566194011 <== mon.6 v1:10.20.193.45:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2826014052 0 0) 0x7fa1fc0a1c50 con 0x7fa1fc13d2b0 2026-02-22T23:25:46.794 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.753+0000 7fa1ebfff640 10 monclient(hunting): _negotiate 2026-02-22T23:25:46.794 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.753+0000 7effd5573640 1 -- 10.20.193.45:0/85739709 <== mon.0 v1:10.20.193.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 138639390 0 0) 0x7effc4003620 con 0x7effd80a5e00 2026-02-22T23:25:46.794 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.753+0000 7effd5573640 1 -- 10.20.193.45:0/85739709 >> v1:10.20.193.73:6792/0 conn(0x7effd80a6d00 legacy=0x7effd81417b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:46.794 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.753+0000 7fa1ebfff640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:46.795 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.753+0000 7fa1ebfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:46.795 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.753+0000 7fa1ebfff640 10 monclient(hunting): my global_id is 4326 2026-02-22T23:25:46.795 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.753+0000 7fa1ebfff640 1 -- 10.20.193.45:0/2566194011 --> v1:10.20.193.45:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa1fc0a28e0 con 0x7fa1fc13d2b0 2026-02-22T23:25:46.795 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.753+0000 7effd5573640 1 -- 10.20.193.45:0/85739709 >> v1:10.20.193.73:6789/0 conn(0x7effd80a68f0 legacy=0x7effd813e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T23:25:46.795 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.753+0000 7effd5573640 10 monclient: _finish_hunting 0 2026-02-22T23:25:46.795 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.753+0000 7effd5573640 1 monclient: found mon.noname-a 2026-02-22T23:25:46.795 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.753+0000 7effd5573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T23:25:46.795 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.753+0000 7effd5573640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.45:6789/0 2026-02-22T23:25:46.795 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.753+0000 7effd5573640 1 -- 10.20.193.45:0/85739709 --> v1:10.20.193.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effd80a35a0 con 0x7effd80a5e00 2026-02-22T23:25:46.795 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.753+0000 7effd5573640 10 monclient: _finish_auth 0 2026-02-22T23:25:46.796 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.753+0000 7effd5573640 10 monclient: _check_auth_tickets 2026-02-22T23:25:46.796 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.753+0000 7effd5573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T23:25:46.796 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.753+0000 7effd5573640 1 -- 10.20.193.45:0/85739709 <== mon.0 v1:10.20.193.45:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7effcc003040 con 0x7effd80a5e00 2026-02-22T23:25:46.796 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.753+0000 7effdca98640 5 monclient: authenticate success, global_id 4311 2026-02-22T23:25:46.797 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.753+0000 7fa1ebfff640 1 -- 10.20.193.45:0/2566194011 <== mon.3 v1:10.20.193.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 334697784 0 0) 0x7fa1ec002920 con 0x7fa1fc0733c0 2026-02-22T23:25:46.797 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.753+0000 7fa1ebfff640 10 monclient(hunting): _negotiate 2026-02-22T23:25:46.797 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.753+0000 7fa1ebfff640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:46.797 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.753+0000 7fa1ebfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:46.797 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.753+0000 7fa1ebfff640 10 monclient(hunting): my global_id is 4341 2026-02-22T23:25:46.797 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.753+0000 7fa1ebfff640 1 -- 10.20.193.45:0/2566194011 --> v1:10.20.193.73:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa1fc0a1c50 con 0x7fa1fc0733c0 2026-02-22T23:25:46.797 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.753+0000 7fa1ebfff640 1 -- 10.20.193.45:0/2566194011 <== mon.8 v1:10.20.193.45:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2743490653 0 0) 0x7fa1e4003620 con 0x7fa1fc0a32c0 2026-02-22T23:25:46.797 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.753+0000 7fa1ebfff640 1 -- 10.20.193.45:0/2566194011 >> v1:10.20.193.45:6792/0 conn(0x7fa1fc13d2b0 legacy=0x7fa1fc13f6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:46.797 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.753+0000 7fa1ebfff640 1 -- 10.20.193.45:0/2566194011 >> v1:10.20.193.73:6790/0 conn(0x7fa1fc0733c0 legacy=0x7fa1fc0737a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:46.797 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.753+0000 7fa1ebfff640 10 monclient: _finish_hunting 0 2026-02-22T23:25:46.797 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.753+0000 7fa1ebfff640 1 monclient: found mon.noname-e 2026-02-22T23:25:46.797 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.753+0000 7fa1ebfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T23:25:46.797 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.753+0000 7fa1ebfff640 10 monclient: _send_mon_message to mon.noname-e at v1:10.20.193.45:6793/0 2026-02-22T23:25:46.797 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.753+0000 7fa1ebfff640 1 -- 10.20.193.45:0/2566194011 --> v1:10.20.193.45:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1fc073eb0 con 0x7fa1fc0a32c0 2026-02-22T23:25:46.798 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.753+0000 7fa1ebfff640 10 monclient: _finish_auth 0 2026-02-22T23:25:46.798 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.753+0000 7fa1ebfff640 10 monclient: _check_auth_tickets 2026-02-22T23:25:46.798 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.753+0000 7fa1ebfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T23:25:46.798 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.753+0000 7fa1ebfff640 1 -- 10.20.193.45:0/2566194011 <== mon.8 v1:10.20.193.45:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7fa1f0003040 con 0x7fa1fc0a32c0 2026-02-22T23:25:46.798 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.753+0000 7fa1ebfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:25:46.798 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.753+0000 7fa1ebfff640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2026-02-22T23:25:46.798 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.753+0000 7fa1ebfff640 10 monclient: dump: 2026-02-22T23:25:46.798 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:46.798 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:46.798 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:46.798 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:46.798 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:46.798 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:46.798 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:46.798 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:46.798 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:46.798 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:46.798 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:46.798 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:46.798 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:46.798 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:46.799 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:46.799 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:46.799 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.753+0000 7fa2037ed640 5 monclient: authenticate success, global_id 4328 2026-02-22T23:25:46.799 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.753+0000 7fa2037ed640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-22T23:25:46.799 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.753+0000 7fa1ebfff640 1 -- 10.20.193.45:0/2566194011 <== mon.8 v1:10.20.193.45:6793/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa1f0003260 con 0x7fa1fc0a32c0 2026-02-22T23:25:46.799 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.753+0000 7fa1ebfff640 10 monclient: handle_config config(0 keys) 2026-02-22T23:25:46.799 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.753+0000 7fa1ebfff640 1 -- 10.20.193.45:0/2566194011 <== mon.8 v1:10.20.193.45:6793/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7fa1f0004ce0 con 0x7fa1fc0a32c0 2026-02-22T23:25:46.799 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.753+0000 7fa1ebfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:25:46.799 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.753+0000 7fa1ebfff640 10 monclient: got monmap 1 from mon.e (according to old e1) 2026-02-22T23:25:46.799 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.753+0000 7fa1ebfff640 10 monclient: dump: 2026-02-22T23:25:46.799 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:46.799 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:46.799 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:46.799 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:46.799 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:46.799 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:46.799 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:46.799 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:46.799 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:46.799 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:46.799 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:46.799 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:46.800 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:46.800 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:46.800 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:46.800 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:46.800 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.754+0000 7fa2037ed640 10 monclient: get_monmap_and_config success 2026-02-22T23:25:46.800 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.754+0000 7fa2037ed640 4 set_mon_vals no callback set 2026-02-22T23:25:46.800 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.753+0000 7effdca98640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-22T23:25:46.800 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.753+0000 7effd5573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:25:46.800 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.753+0000 7effd5573640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T23:25:46.800 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.753+0000 7effd5573640 10 monclient: dump: 2026-02-22T23:25:46.800 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:46.800 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:46.800 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:46.800 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:46.800 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:46.801 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:46.801 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:46.801 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:46.801 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:46.801 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:46.801 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:46.801 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:46.801 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:46.801 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:46.801 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:46.801 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:46.801 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.753+0000 7effdca98640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-22T23:25:46.801 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.753+0000 7effd5573640 1 -- 10.20.193.45:0/85739709 <== mon.0 v1:10.20.193.45:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7effcc0031e0 con 0x7effd80a5e00 2026-02-22T23:25:46.801 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.754+0000 7f9cbe0a9640 10 monclient: build_initial_monmap 2026-02-22T23:25:46.801 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.754+0000 7effd5573640 10 monclient: handle_config config(0 keys) 2026-02-22T23:25:46.802 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.754+0000 7effd5573640 1 -- 10.20.193.45:0/85739709 <== mon.0 v1:10.20.193.45:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7effcc004ce0 con 0x7effd80a5e00 2026-02-22T23:25:46.802 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.754+0000 7effd5573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:25:46.802 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.754+0000 7effd5573640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T23:25:46.802 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.754+0000 7effd5573640 10 monclient: dump: 2026-02-22T23:25:46.802 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:46.802 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:46.802 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:46.802 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:46.802 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:46.802 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:46.802 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:46.802 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:46.802 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:46.802 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:46.802 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:46.802 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:46.802 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:46.802 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:46.802 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:46.802 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:46.802 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.754+0000 7effdca98640 10 monclient: get_monmap_and_config success 2026-02-22T23:25:46.802 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.754+0000 7effdca98640 4 set_mon_vals no callback set 2026-02-22T23:25:46.803 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.754+0000 7f9cbe0a9640 10 monclient: monmap: 2026-02-22T23:25:46.803 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-22T23:25:46.803 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T23:25:46.803 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-22T23:25:46.803 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-22T23:25:46.803 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-22T23:25:46.803 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-22T23:25:46.803 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-22T23:25:46.803 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.noname-f 2026-02-22T23:25:46.803 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.noname-b 2026-02-22T23:25:46.803 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.noname-g 2026-02-22T23:25:46.803 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.noname-c 2026-02-22T23:25:46.803 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.noname-h 2026-02-22T23:25:46.803 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.noname-d 2026-02-22T23:25:46.803 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.noname-i 2026-02-22T23:25:46.803 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.noname-e 2026-02-22T23:25:46.803 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:46.803 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.754+0000 7f3eb6f55640 10 monclient: build_initial_monmap 2026-02-22T23:25:46.804 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.754+0000 7f3eb6f55640 10 monclient: monmap: 2026-02-22T23:25:46.804 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-22T23:25:46.804 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T23:25:46.804 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-22T23:25:46.804 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-22T23:25:46.804 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-22T23:25:46.804 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-22T23:25:46.804 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-22T23:25:46.804 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.noname-f 2026-02-22T23:25:46.804 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.noname-b 2026-02-22T23:25:46.804 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.noname-g 2026-02-22T23:25:46.804 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.noname-c 2026-02-22T23:25:46.804 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.noname-h 2026-02-22T23:25:46.804 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.noname-d 2026-02-22T23:25:46.804 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.noname-i 2026-02-22T23:25:46.804 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.noname-e 2026-02-22T23:25:46.804 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:46.804 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.754+0000 7fa2037ed640 10 monclient: shutdown 2026-02-22T23:25:46.804 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.754+0000 7fa2037ed640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T23:25:46.804 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.754+0000 7fa2037ed640 1 -- 10.20.193.45:0/2566194011 >> v1:10.20.193.45:6793/0 conn(0x7fa1fc0a32c0 legacy=0x7fa1fc13bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:46.805 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.754+0000 7effdca98640 10 monclient: shutdown 2026-02-22T23:25:46.805 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.754+0000 7effdca98640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T23:25:46.805 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.754+0000 7effdca98640 1 -- 10.20.193.45:0/85739709 >> v1:10.20.193.45:6789/0 conn(0x7effd80a5e00 legacy=0x7effd80a61e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:46.805 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.754+0000 7fa2037ed640 1 -- 10.20.193.45:0/2566194011 shutdown_connections 2026-02-22T23:25:46.805 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.754+0000 7fa2037ed640 1 -- 10.20.193.45:0/2566194011 >> 10.20.193.45:0/2566194011 conn(0x7fa1fc0a9970 msgr2=0x7fa1fc0a5c90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:25:46.805 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.754+0000 7fa2037ed640 1 -- 10.20.193.45:0/2566194011 shutdown_connections 2026-02-22T23:25:46.805 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.754+0000 7effdca98640 1 -- 10.20.193.45:0/85739709 shutdown_connections 2026-02-22T23:25:46.805 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.754+0000 7effdca98640 1 -- 10.20.193.45:0/85739709 >> 10.20.193.45:0/85739709 conn(0x7effd80abb50 msgr2=0x7effd80a7f00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:25:46.805 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.754+0000 7fa2037ed640 1 -- 10.20.193.45:0/2566194011 wait complete. 2026-02-22T23:25:46.806 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.754+0000 7effdca98640 1 -- 10.20.193.45:0/85739709 shutdown_connections 2026-02-22T23:25:46.806 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.754+0000 7effdca98640 1 -- 10.20.193.45:0/85739709 wait complete. 2026-02-22T23:25:46.806 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.754+0000 7f3eb6f55640 1 Processor -- start 2026-02-22T23:25:46.806 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.754+0000 7f9cbe0a9640 1 Processor -- start 2026-02-22T23:25:46.806 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.754+0000 7f3eb6f55640 1 -- start start 2026-02-22T23:25:46.806 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.754+0000 7f3eb6f55640 10 monclient: init 2026-02-22T23:25:46.806 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.754+0000 7f9cbe0a9640 1 -- start start 2026-02-22T23:25:46.806 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.754+0000 7f9cbe0a9640 10 monclient: init 2026-02-22T23:25:46.807 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.754+0000 7f3eb6f55640 10 monclient: _reopen_session rank -1 2026-02-22T23:25:46.807 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.754+0000 7f3eb6f55640 10 monclient: _add_conns ranks=[4,8,3,0,1,7,5,2,6] 2026-02-22T23:25:46.807 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.754+0000 7effdca98640 10 monclient: build_initial_monmap 2026-02-22T23:25:46.807 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.754+0000 7f3eb6f55640 10 monclient(hunting): picked mon.noname-c con 0x7f3eb00a2f60 addr v1:10.20.193.45:6791/0 2026-02-22T23:25:46.807 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.754+0000 7f3eb6f55640 10 monclient(hunting): picked mon.noname-e con 0x7f3eb00a3a50 addr v1:10.20.193.45:6793/0 2026-02-22T23:25:46.807 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.754+0000 7effdca98640 10 monclient: monmap: 2026-02-22T23:25:46.807 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-22T23:25:46.807 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T23:25:46.807 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-22T23:25:46.807 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-22T23:25:46.807 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-22T23:25:46.807 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-22T23:25:46.807 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-22T23:25:46.807 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.noname-f 2026-02-22T23:25:46.808 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.noname-b 2026-02-22T23:25:46.808 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.noname-g 2026-02-22T23:25:46.808 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.noname-c 2026-02-22T23:25:46.808 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.noname-h 2026-02-22T23:25:46.808 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.noname-d 2026-02-22T23:25:46.808 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.noname-i 2026-02-22T23:25:46.808 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.noname-e 2026-02-22T23:25:46.808 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:46.808 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.754+0000 7f3eb6f55640 10 monclient(hunting): picked mon.noname-g con 0x7f3eb013d420 addr v1:10.20.193.73:6790/0 2026-02-22T23:25:46.808 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.754+0000 7f3eb6f55640 1 -- --> v1:10.20.193.73:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3eb0127570 con 0x7f3eb013d420 2026-02-22T23:25:46.808 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.754+0000 7f3eb6f55640 1 -- --> v1:10.20.193.45:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3eb00733b0 con 0x7f3eb00a2f60 2026-02-22T23:25:46.808 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.754+0000 7f3eb6f55640 1 -- --> v1:10.20.193.45:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3eb00a5680 con 0x7f3eb00a3a50 2026-02-22T23:25:46.808 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.754+0000 7f3eb6f55640 10 monclient(hunting): _renew_subs 2026-02-22T23:25:46.808 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.754+0000 7f3eb6f55640 10 monclient(hunting): authenticate will time out at 678.370737s 2026-02-22T23:25:46.808 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.754+0000 7f9cbe0a9640 10 monclient: _reopen_session rank -1 2026-02-22T23:25:46.809 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.754+0000 7f3eb4cca640 1 --1- >> v1:10.20.193.45:6791/0 conn(0x7f3eb00a2f60 0x7f3eb01cd830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.45:6791/0 says I am v1:10.20.193.45:37926/0 (socket says 10.20.193.45:37926) 2026-02-22T23:25:46.809 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.754+0000 7f3eb4cca640 1 -- 10.20.193.45:0/3187627287 learned_addr learned my addr 10.20.193.45:0/3187627287 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-22T23:25:46.809 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.754+0000 7f9cbe0a9640 10 monclient: _add_conns ranks=[1,0,3,7,5,4,8,2,6] 2026-02-22T23:25:46.809 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.754+0000 7f9cbe0a9640 10 monclient(hunting): picked mon.noname-f con 0x7f9cb80a5e00 addr v1:10.20.193.73:6789/0 2026-02-22T23:25:46.809 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.754+0000 7f9cbe0a9640 10 monclient(hunting): picked mon.noname-a con 0x7f9cb80a68f0 addr v1:10.20.193.45:6789/0 2026-02-22T23:25:46.809 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.754+0000 7f9cbe0a9640 10 monclient(hunting): picked mon.noname-g con 0x7f9cb80a6d00 addr v1:10.20.193.73:6790/0 2026-02-22T23:25:46.809 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.754+0000 7f9cbe0a9640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9cb80aa0e0 con 0x7f9cb80a68f0 2026-02-22T23:25:46.809 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.754+0000 7f9cbe0a9640 1 -- --> v1:10.20.193.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9cb80a1b70 con 0x7f9cb80a5e00 2026-02-22T23:25:46.809 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.754+0000 7f9cbe0a9640 1 -- --> v1:10.20.193.73:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9cb8128e40 con 0x7f9cb80a6d00 2026-02-22T23:25:46.809 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.754+0000 7f9cbe0a9640 10 monclient(hunting): _renew_subs 2026-02-22T23:25:46.809 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.754+0000 7f9cbe0a9640 10 monclient(hunting): authenticate will time out at 678.370840s 2026-02-22T23:25:46.810 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.754+0000 7effdca98640 1 Processor -- start 2026-02-22T23:25:46.810 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.754+0000 7fa2037ed640 10 monclient: build_initial_monmap 2026-02-22T23:25:46.810 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.754+0000 7fa2037ed640 10 monclient: monmap: 2026-02-22T23:25:46.810 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-22T23:25:46.810 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T23:25:46.810 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-22T23:25:46.810 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-22T23:25:46.810 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-22T23:25:46.810 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-22T23:25:46.810 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-22T23:25:46.810 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.noname-f 2026-02-22T23:25:46.810 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.noname-b 2026-02-22T23:25:46.810 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.noname-g 2026-02-22T23:25:46.810 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.noname-c 2026-02-22T23:25:46.810 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.noname-h 2026-02-22T23:25:46.810 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.noname-d 2026-02-22T23:25:46.810 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.noname-i 2026-02-22T23:25:46.810 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.noname-e 2026-02-22T23:25:46.810 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:46.810 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.754+0000 7fa2037ed640 1 Processor -- start 2026-02-22T23:25:46.811 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.754+0000 7f3ea57fa640 1 -- 10.20.193.45:0/3187627287 <== mon.4 v1:10.20.193.45:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 207282830 0 0) 0x7f3eb00733b0 con 0x7f3eb00a2f60 2026-02-22T23:25:46.811 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.754+0000 7f3ea57fa640 10 monclient(hunting): _negotiate 2026-02-22T23:25:46.811 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.754+0000 7f3ea57fa640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:46.811 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.754+0000 7f3ea57fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:46.811 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.754+0000 7f9cb6ffd640 1 --1- >> v1:10.20.193.45:6789/0 conn(0x7f9cb80a68f0 0x7f9cb81d4690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.45:6789/0 says I am v1:10.20.193.45:58248/0 (socket says 10.20.193.45:58248) 2026-02-22T23:25:46.811 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.754+0000 7f9cb6ffd640 1 -- 10.20.193.45:0/2920422300 learned_addr learned my addr 10.20.193.45:0/2920422300 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-22T23:25:46.811 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.754+0000 7f3ea57fa640 10 monclient(hunting): my global_id is 4324 2026-02-22T23:25:46.811 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.754+0000 7effdca98640 1 -- start start 2026-02-22T23:25:46.811 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.754+0000 7effdca98640 10 monclient: init 2026-02-22T23:25:46.811 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.754+0000 7f3ea57fa640 1 -- 10.20.193.45:0/3187627287 --> v1:10.20.193.45:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3e80003620 con 0x7f3eb00a2f60 2026-02-22T23:25:46.811 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.754+0000 7f3ea57fa640 1 -- 10.20.193.45:0/3187627287 <== mon.8 v1:10.20.193.45:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1242447512 0 0) 0x7f3eb00a5680 con 0x7f3eb00a3a50 2026-02-22T23:25:46.812 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.754+0000 7f3ea57fa640 10 monclient(hunting): _negotiate 2026-02-22T23:25:46.812 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.754+0000 7f3ea57fa640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:46.812 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.754+0000 7f3ea57fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:46.812 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.754+0000 7f3ea57fa640 10 monclient(hunting): my global_id is 4337 2026-02-22T23:25:46.812 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.754+0000 7f3ea57fa640 1 -- 10.20.193.45:0/3187627287 --> v1:10.20.193.45:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3eb00733b0 con 0x7f3eb00a3a50 2026-02-22T23:25:46.812 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.754+0000 7fa2037ed640 1 -- start start 2026-02-22T23:25:46.812 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.754+0000 7fa2037ed640 10 monclient: init 2026-02-22T23:25:46.812 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.755+0000 7f9c93fff640 1 -- 10.20.193.45:0/2920422300 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3272195147 0 0) 0x7f9cb80a32c0 con 0x7f9cb80a68f0 2026-02-22T23:25:46.812 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.755+0000 7f9c93fff640 10 monclient(hunting): _negotiate 2026-02-22T23:25:46.812 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.755+0000 7f9c93fff640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:46.812 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.755+0000 7f9c93fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:46.812 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.755+0000 7f9c93fff640 10 monclient(hunting): my global_id is 4320 2026-02-22T23:25:46.812 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.755+0000 7f9c93fff640 1 -- 10.20.193.45:0/2920422300 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9c88003620 con 0x7f9cb80a68f0 2026-02-22T23:25:46.813 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.755+0000 7f3ea57fa640 1 -- 10.20.193.45:0/3187627287 <== mon.3 v1:10.20.193.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2919735101 0 0) 0x7f3eb0127570 con 0x7f3eb013d420 2026-02-22T23:25:46.813 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.755+0000 7f3ea57fa640 10 monclient(hunting): _negotiate 2026-02-22T23:25:46.813 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.755+0000 7f3ea57fa640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:46.813 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.755+0000 7f3ea57fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:46.813 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.755+0000 7f3ea57fa640 10 monclient(hunting): my global_id is 4350 2026-02-22T23:25:46.813 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.755+0000 7f3ea57fa640 1 -- 10.20.193.45:0/3187627287 --> v1:10.20.193.73:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3eb00a5680 con 0x7f3eb013d420 2026-02-22T23:25:46.813 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.755+0000 7f3ea57fa640 1 -- 10.20.193.45:0/3187627287 <== mon.4 v1:10.20.193.45:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2962677840 0 0) 0x7f3e80003620 con 0x7f3eb00a2f60 2026-02-22T23:25:46.813 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.755+0000 7f3ea57fa640 1 -- 10.20.193.45:0/3187627287 --> v1:10.20.193.45:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3eb0127570 con 0x7f3eb00a2f60 2026-02-22T23:25:46.813 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.755+0000 7f3ea57fa640 1 -- 10.20.193.45:0/3187627287 <== mon.8 v1:10.20.193.45:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4010384982 0 0) 0x7f3eb00733b0 con 0x7f3eb00a3a50 2026-02-22T23:25:46.813 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.755+0000 7f3ea57fa640 1 -- 10.20.193.45:0/3187627287 --> v1:10.20.193.45:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3e80003620 con 0x7f3eb00a3a50 2026-02-22T23:25:46.813 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.755+0000 7f9c93fff640 1 -- 10.20.193.45:0/2920422300 <== mon.1 v1:10.20.193.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3487580887 0 0) 0x7f9ca40029b0 con 0x7f9cb80a5e00 2026-02-22T23:25:46.813 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.755+0000 7f9c93fff640 10 monclient(hunting): _negotiate 2026-02-22T23:25:46.813 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.755+0000 7f9c93fff640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:46.813 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.755+0000 7f9c93fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:46.813 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.755+0000 7f9c93fff640 10 monclient(hunting): my global_id is 4393 2026-02-22T23:25:46.813 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.755+0000 7f9c93fff640 1 -- 10.20.193.45:0/2920422300 --> v1:10.20.193.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9cb80a32c0 con 0x7f9cb80a5e00 2026-02-22T23:25:46.813 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.755+0000 7f9c93fff640 1 -- 10.20.193.45:0/2920422300 <== mon.0 v1:10.20.193.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 335155155 0 0) 0x7f9c88003620 con 0x7f9cb80a68f0 2026-02-22T23:25:46.814 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.755+0000 7effdca98640 10 monclient: _reopen_session rank -1 2026-02-22T23:25:46.814 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.755+0000 7f3ea57fa640 1 -- 10.20.193.45:0/3187627287 <== mon.4 v1:10.20.193.45:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f3ea0004c20 con 0x7f3eb00a2f60 2026-02-22T23:25:46.814 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.755+0000 7f3ea57fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-22T23:25:46.814 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.755+0000 7f3ea57fa640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-22T23:25:46.814 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.755+0000 7f9c93fff640 1 -- 10.20.193.45:0/2920422300 --> v1:10.20.193.45:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9ca40029b0 con 0x7f9cb80a68f0 2026-02-22T23:25:46.814 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.755+0000 7f9c93fff640 1 -- 10.20.193.45:0/2920422300 <== mon.0 v1:10.20.193.45:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f9ca80032e0 con 0x7f9cb80a68f0 2026-02-22T23:25:46.814 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.755+0000 7f9c93fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-22T23:25:46.814 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.755+0000 7effdca98640 10 monclient: _add_conns ranks=[3,2,8,5,0,1,7,4,6] 2026-02-22T23:25:46.814 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.755+0000 7f3ea57fa640 10 monclient(hunting): dump: 2026-02-22T23:25:46.814 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:46.814 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:46.814 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:46.814 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:46.814 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:46.814 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:46.815 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:46.815 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:46.815 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:46.815 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:46.815 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:46.815 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:46.815 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:46.815 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:46.815 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:46.815 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:46.815 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.755+0000 7f3ea57fa640 10 monclient(hunting): _finish_auth 0 2026-02-22T23:25:46.815 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.755+0000 7f9c93fff640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T23:25:46.815 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.755+0000 7f3ea57fa640 1 -- 10.20.193.45:0/3187627287 <== mon.8 v1:10.20.193.45:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f3e980031e0 con 0x7f3eb00a3a50 2026-02-22T23:25:46.815 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.755+0000 7f3ea57fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-22T23:25:46.815 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.755+0000 7f9c93fff640 10 monclient(hunting): dump: 2026-02-22T23:25:46.815 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:46.815 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:46.815 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:46.815 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:46.815 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:46.815 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:46.815 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:46.815 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:46.816 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:46.816 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:46.816 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:46.816 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:46.816 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:46.816 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:46.816 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:46.816 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:46.816 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.755+0000 7f9c93fff640 10 monclient(hunting): _finish_auth 0 2026-02-22T23:25:46.816 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.755+0000 7effdca98640 10 monclient(hunting): picked mon.noname-g con 0x7effd80a5e00 addr v1:10.20.193.73:6790/0 2026-02-22T23:25:46.816 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.755+0000 7effdca98640 10 monclient(hunting): picked mon.noname-b con 0x7effd80a68f0 addr v1:10.20.193.45:6790/0 2026-02-22T23:25:46.816 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.755+0000 7effdca98640 10 monclient(hunting): picked mon.noname-e con 0x7effd80a6d00 addr v1:10.20.193.45:6793/0 2026-02-22T23:25:46.816 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.755+0000 7effdca98640 1 -- --> v1:10.20.193.45:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7effd80a0330 con 0x7effd80a68f0 2026-02-22T23:25:46.816 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.755+0000 7effdca98640 1 -- --> v1:10.20.193.73:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7effd80a9fe0 con 0x7effd80a5e00 2026-02-22T23:25:46.816 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.755+0000 7effdca98640 1 -- --> v1:10.20.193.45:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7effd80a07d0 con 0x7effd80a6d00 2026-02-22T23:25:46.816 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.755+0000 7effdca98640 10 monclient(hunting): _renew_subs 2026-02-22T23:25:46.816 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.755+0000 7effdca98640 10 monclient(hunting): authenticate will time out at 678.371277s 2026-02-22T23:25:46.817 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.755+0000 7f3ea57fa640 10 monclient(hunting): got monmap 1 from mon.e (according to old e1) 2026-02-22T23:25:46.817 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.755+0000 7f3ea57fa640 10 monclient(hunting): dump: 2026-02-22T23:25:46.817 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:46.817 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:46.817 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:46.817 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:46.817 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:46.817 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:46.817 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:46.817 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:46.817 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:46.817 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:46.817 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:46.817 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:46.817 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:46.817 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:46.817 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:46.817 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:46.817 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.755+0000 7f9c93fff640 1 -- 10.20.193.45:0/2920422300 <== mon.3 v1:10.20.193.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1500603899 0 0) 0x7f9cb8128e40 con 0x7f9cb80a6d00 2026-02-22T23:25:46.817 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.755+0000 7f9c93fff640 10 monclient(hunting): _negotiate 2026-02-22T23:25:46.817 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.755+0000 7f9c93fff640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:46.817 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.755+0000 7f9c93fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:46.817 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.755+0000 7f9c93fff640 10 monclient(hunting): my global_id is 4359 2026-02-22T23:25:46.817 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.755+0000 7f9c93fff640 1 -- 10.20.193.45:0/2920422300 --> v1:10.20.193.73:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9c88003620 con 0x7f9cb80a6d00 2026-02-22T23:25:46.818 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.755+0000 7effd5d74640 1 --1- >> v1:10.20.193.45:6790/0 conn(0x7effd80a68f0 0x7effd809f260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.45:6790/0 says I am v1:10.20.193.45:50934/0 (socket says 10.20.193.45:50934) 2026-02-22T23:25:46.818 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.755+0000 7f9c93fff640 1 -- 10.20.193.45:0/2920422300 <== mon.0 v1:10.20.193.45:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4115863813 0 0) 0x7f9ca40029b0 con 0x7f9cb80a68f0 2026-02-22T23:25:46.818 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.755+0000 7effd5d74640 1 -- 10.20.193.45:0/2002835060 learned_addr learned my addr 10.20.193.45:0/2002835060 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-22T23:25:46.818 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.755+0000 7fa2037ed640 10 monclient: _reopen_session rank -1 2026-02-22T23:25:46.818 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.755+0000 7f9c93fff640 1 -- 10.20.193.45:0/2920422300 >> v1:10.20.193.73:6790/0 conn(0x7f9cb80a6d00 legacy=0x7f9cb81d7dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:46.818 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.755+0000 7f9c93fff640 1 -- 10.20.193.45:0/2920422300 >> v1:10.20.193.73:6789/0 conn(0x7f9cb80a5e00 legacy=0x7f9cb81417a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:46.818 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.755+0000 7f9c93fff640 10 monclient: _finish_hunting 0 2026-02-22T23:25:46.818 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.755+0000 7f9c93fff640 1 monclient: found mon.a 2026-02-22T23:25:46.818 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.755+0000 7f9c93fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T23:25:46.818 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.755+0000 7fa2037ed640 10 monclient: _add_conns ranks=[5,3,8,4,7,2,1,0,6] 2026-02-22T23:25:46.819 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.755+0000 7f9c93fff640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-22T23:25:46.819 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.755+0000 7f9c93fff640 1 -- 10.20.193.45:0/2920422300 --> v1:10.20.193.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9cb8127bb0 con 0x7f9cb80a68f0 2026-02-22T23:25:46.819 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.755+0000 7f9c93fff640 10 monclient: _finish_auth 0 2026-02-22T23:25:46.819 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.755+0000 7f9c93fff640 10 monclient: _check_auth_tickets 2026-02-22T23:25:46.819 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.755+0000 7f9c93fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T23:25:46.819 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.755+0000 7f9cbe0a9640 5 monclient: authenticate success, global_id 4320 2026-02-22T23:25:46.819 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.755+0000 7f9cbe0a9640 10 monclient: _renew_subs 2026-02-22T23:25:46.819 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.755+0000 7f9cbe0a9640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-22T23:25:46.819 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.755+0000 7f9cbe0a9640 1 -- 10.20.193.45:0/2920422300 --> v1:10.20.193.45:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f9cb80a9bb0 con 0x7f9cb80a68f0 2026-02-22T23:25:46.819 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.755+0000 7f9cbe0a9640 10 monclient: _renew_subs 2026-02-22T23:25:46.819 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.755+0000 7f9cbe0a9640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-22T23:25:46.819 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.755+0000 7f9cbe0a9640 1 -- 10.20.193.45:0/2920422300 --> v1:10.20.193.45:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f9cb8128b60 con 0x7f9cb80a68f0 2026-02-22T23:25:46.819 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.755+0000 7fa2037ed640 10 monclient(hunting): picked mon.noname-h con 0x7fa1fc0733c0 addr v1:10.20.193.73:6791/0 2026-02-22T23:25:46.819 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.755+0000 7fa2037ed640 10 monclient(hunting): picked mon.noname-g con 0x7fa1fc0a32c0 addr v1:10.20.193.73:6790/0 2026-02-22T23:25:46.819 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.755+0000 7f3ea57fa640 1 -- 10.20.193.45:0/3187627287 <== mon.3 v1:10.20.193.73:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1933033380 0 0) 0x7f3eb00a5680 con 0x7f3eb013d420 2026-02-22T23:25:46.819 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.755+0000 7f3ea57fa640 1 -- 10.20.193.45:0/3187627287 --> v1:10.20.193.73:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3eb00733b0 con 0x7f3eb013d420 2026-02-22T23:25:46.819 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.755+0000 7f9c93fff640 1 -- 10.20.193.45:0/2920422300 <== mon.0 v1:10.20.193.45:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9ca8004b90 con 0x7f9cb80a68f0 2026-02-22T23:25:46.820 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.755+0000 7f3ea57fa640 1 -- 10.20.193.45:0/3187627287 <== mon.4 v1:10.20.193.45:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2560354061 0 0) 0x7f3eb0127570 con 0x7f3eb00a2f60 2026-02-22T23:25:46.820 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.755+0000 7f9c93fff640 10 monclient: handle_config config(0 keys) 2026-02-22T23:25:46.820 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.755+0000 7f9c93fff640 1 -- 10.20.193.45:0/2920422300 <== mon.0 v1:10.20.193.45:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f9ca8005180 con 0x7f9cb80a68f0 2026-02-22T23:25:46.820 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.755+0000 7f9c93fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:25:46.820 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.755+0000 7f9cb5ffb640 4 set_mon_vals no callback set 2026-02-22T23:25:46.820 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.755+0000 7f9c93fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T23:25:46.820 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.755+0000 7f3ea57fa640 1 -- 10.20.193.45:0/3187627287 >> v1:10.20.193.45:6793/0 conn(0x7f3eb00a3a50 legacy=0x7f3eb01d2870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:46.820 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.755+0000 7f9c93fff640 10 monclient: dump: 2026-02-22T23:25:46.820 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:46.820 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:46.820 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:46.820 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:46.820 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:46.820 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:46.820 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:46.820 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:46.820 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:46.820 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:46.820 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:46.821 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:46.821 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:46.821 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:46.821 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:46.821 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:46.821 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.755+0000 7effbeffd640 1 -- 10.20.193.45:0/2002835060 <== mon.2 v1:10.20.193.45:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3399419361 0 0) 0x7effd80a0330 con 0x7effd80a68f0 2026-02-22T23:25:46.821 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.755+0000 7effbeffd640 10 monclient(hunting): _negotiate 2026-02-22T23:25:46.821 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.755+0000 7effbeffd640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:46.821 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.755+0000 7effbeffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:46.821 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.755+0000 7effbeffd640 10 monclient(hunting): my global_id is 4349 2026-02-22T23:25:46.821 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.755+0000 7effbeffd640 1 -- 10.20.193.45:0/2002835060 --> v1:10.20.193.45:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7effa4003620 con 0x7effd80a68f0 2026-02-22T23:25:46.821 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.755+0000 7effbeffd640 1 -- 10.20.193.45:0/2002835060 <== mon.8 v1:10.20.193.45:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3218689497 0 0) 0x7effd80a07d0 con 0x7effd80a6d00 2026-02-22T23:25:46.821 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.755+0000 7effbeffd640 10 monclient(hunting): _negotiate 2026-02-22T23:25:46.821 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.755+0000 7effbeffd640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:46.821 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.755+0000 7effbeffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:46.821 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.755+0000 7effbeffd640 10 monclient(hunting): my global_id is 4346 2026-02-22T23:25:46.821 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.755+0000 7effbeffd640 1 -- 10.20.193.45:0/2002835060 --> v1:10.20.193.45:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7effd80a0330 con 0x7effd80a6d00 2026-02-22T23:25:46.821 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.755+0000 7fa2037ed640 10 monclient(hunting): picked mon.noname-e con 0x7fa1fc13d2b0 addr v1:10.20.193.45:6793/0 2026-02-22T23:25:46.821 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.755+0000 7fa2037ed640 1 -- --> v1:10.20.193.73:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa1fc1217a0 con 0x7fa1fc0a32c0 2026-02-22T23:25:46.821 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.755+0000 7fa2037ed640 1 -- --> v1:10.20.193.73:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa1fc121a80 con 0x7fa1fc0733c0 2026-02-22T23:25:46.822 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.755+0000 7f3ea57fa640 1 -- 10.20.193.45:0/3187627287 >> v1:10.20.193.73:6790/0 conn(0x7f3eb013d420 legacy=0x7f3eb01d5fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:46.822 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.755+0000 7f3ea57fa640 10 monclient: _finish_hunting 0 2026-02-22T23:25:46.822 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.755+0000 7f3ea57fa640 1 monclient: found mon.c 2026-02-22T23:25:46.822 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.755+0000 7f3ea57fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T23:25:46.822 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.755+0000 7f3ea57fa640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.45:6791/0 2026-02-22T23:25:46.822 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.755+0000 7f3ea57fa640 1 -- 10.20.193.45:0/3187627287 --> v1:10.20.193.45:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3eb0126fb0 con 0x7f3eb00a2f60 2026-02-22T23:25:46.822 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.755+0000 7f3ea57fa640 10 monclient: _finish_auth 0 2026-02-22T23:25:46.822 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.755+0000 7f3ea57fa640 10 monclient: _check_auth_tickets 2026-02-22T23:25:46.822 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.755+0000 7f3ea57fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T23:25:46.822 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.755+0000 7fa201d63640 1 --1- >> v1:10.20.193.45:6793/0 conn(0x7fa1fc13d2b0 0x7fa1fc1dc430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.45:6793/0 says I am v1:10.20.193.45:36786/0 (socket says 10.20.193.45:36786) 2026-02-22T23:25:46.822 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.755+0000 7fa201d63640 1 -- 10.20.193.45:0/349051587 learned_addr learned my addr 10.20.193.45:0/349051587 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-22T23:25:46.822 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.755+0000 7fa200d61640 1 --1- >> v1:10.20.193.73:6790/0 conn(0x7fa1fc0a32c0 0x7fa1fc13bf80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.73:6790/0 says I am v1:10.20.193.45:34542/0 (socket says 10.20.193.45:34542) 2026-02-22T23:25:46.822 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.755+0000 7f3eb6f55640 5 monclient: authenticate success, global_id 4324 2026-02-22T23:25:46.822 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.755+0000 7f3eb6f55640 10 monclient: _renew_subs 2026-02-22T23:25:46.822 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.755+0000 7f3eb6f55640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.45:6791/0 2026-02-22T23:25:46.822 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.755+0000 7f3eb6f55640 1 -- 10.20.193.45:0/3187627287 --> v1:10.20.193.45:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f3eb0127290 con 0x7f3eb00a2f60 2026-02-22T23:25:46.823 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.755+0000 7fa2037ed640 1 -- 10.20.193.45:0/349051587 --> v1:10.20.193.45:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa1fc1207f0 con 0x7fa1fc13d2b0 2026-02-22T23:25:46.823 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.755+0000 7f3eb6f55640 10 monclient: _renew_subs 2026-02-22T23:25:46.823 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.755+0000 7f3eb6f55640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.45:6791/0 2026-02-22T23:25:46.823 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.755+0000 7effbeffd640 1 -- 10.20.193.45:0/2002835060 <== mon.8 v1:10.20.193.45:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1355543378 0 0) 0x7effd80a0330 con 0x7effd80a6d00 2026-02-22T23:25:46.823 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.755+0000 7f3eb6f55640 1 -- 10.20.193.45:0/3187627287 --> v1:10.20.193.45:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7f3eb01245c0 con 0x7f3eb00a2f60 2026-02-22T23:25:46.823 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.755+0000 7effbeffd640 1 -- 10.20.193.45:0/2002835060 --> v1:10.20.193.45:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7effd80a07d0 con 0x7effd80a6d00 2026-02-22T23:25:46.823 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.755+0000 7effbeffd640 1 -- 10.20.193.45:0/2002835060 <== mon.2 v1:10.20.193.45:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3866891040 0 0) 0x7effa4003620 con 0x7effd80a68f0 2026-02-22T23:25:46.823 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.755+0000 7fa2037ed640 10 monclient(hunting): _renew_subs 2026-02-22T23:25:46.823 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.755+0000 7fa2037ed640 10 monclient(hunting): authenticate will time out at 678.371624s 2026-02-22T23:25:46.823 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.755+0000 7effbeffd640 1 -- 10.20.193.45:0/2002835060 --> v1:10.20.193.45:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7effd80a0330 con 0x7effd80a68f0 2026-02-22T23:25:46.823 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.755+0000 7effbeffd640 1 -- 10.20.193.45:0/2002835060 <== mon.8 v1:10.20.193.45:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7effc80035e0 con 0x7effd80a6d00 2026-02-22T23:25:46.824 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.755+0000 7effbeffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-22T23:25:46.824 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.755+0000 7effbeffd640 10 monclient(hunting): got monmap 1 from mon.noname-e (according to old e1) 2026-02-22T23:25:46.824 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.755+0000 7effbeffd640 10 monclient(hunting): dump: 2026-02-22T23:25:46.824 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:46.824 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:46.824 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:46.824 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:46.824 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:46.824 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:46.824 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:46.824 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:46.824 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:46.824 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:46.824 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:46.824 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:46.824 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:46.824 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:46.824 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:46.824 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:46.824 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.755+0000 7effbeffd640 10 monclient(hunting): _finish_auth 0 2026-02-22T23:25:46.824 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.755+0000 7effbeffd640 1 -- 10.20.193.45:0/2002835060 <== mon.2 v1:10.20.193.45:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7effc0003300 con 0x7effd80a68f0 2026-02-22T23:25:46.824 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.755+0000 7effbeffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-22T23:25:46.824 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.755+0000 7effbeffd640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-22T23:25:46.824 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.755+0000 7effbeffd640 10 monclient(hunting): dump: 2026-02-22T23:25:46.824 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:46.824 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:46.824 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:46.824 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:46.824 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:46.824 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:46.824 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:46.824 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:46.824 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:46.824 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:46.824 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:46.824 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:46.824 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:46.825 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:46.825 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:46.825 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:46.825 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.755+0000 7fa1e9ffb640 1 -- 10.20.193.45:0/349051587 <== mon.8 v1:10.20.193.45:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2039470506 0 0) 0x7fa1fc1207f0 con 0x7fa1fc13d2b0 2026-02-22T23:25:46.825 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.755+0000 7fa1e9ffb640 10 monclient(hunting): _negotiate 2026-02-22T23:25:46.825 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.755+0000 7fa1e9ffb640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:46.825 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.755+0000 7fa1e9ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:46.825 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.755+0000 7fa1e9ffb640 10 monclient(hunting): my global_id is 4355 2026-02-22T23:25:46.825 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.755+0000 7fa1e9ffb640 1 -- 10.20.193.45:0/349051587 --> v1:10.20.193.45:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa1cc003620 con 0x7fa1fc13d2b0 2026-02-22T23:25:46.825 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.755+0000 7effbeffd640 1 -- 10.20.193.45:0/2002835060 <== mon.8 v1:10.20.193.45:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4014059546 0 0) 0x7effd80a07d0 con 0x7effd80a6d00 2026-02-22T23:25:46.825 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.755+0000 7effbeffd640 1 -- 10.20.193.45:0/2002835060 >> v1:10.20.193.73:6790/0 conn(0x7effd80a5e00 legacy=0x7effd809eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:46.826 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.755+0000 7effbeffd640 1 -- 10.20.193.45:0/2002835060 >> v1:10.20.193.45:6790/0 conn(0x7effd80a68f0 legacy=0x7effd809f260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:46.826 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.755+0000 7effbeffd640 10 monclient: _finish_hunting 0 2026-02-22T23:25:46.826 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.755+0000 7effbeffd640 1 monclient: found mon.e 2026-02-22T23:25:46.826 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.755+0000 7effbeffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T23:25:46.826 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.755+0000 7effbeffd640 10 monclient: _send_mon_message to mon.e at v1:10.20.193.45:6793/0 2026-02-22T23:25:46.826 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.755+0000 7effbeffd640 1 -- 10.20.193.45:0/2002835060 --> v1:10.20.193.45:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effd8122a50 con 0x7effd80a6d00 2026-02-22T23:25:46.826 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.755+0000 7effbeffd640 10 monclient: _finish_auth 0 2026-02-22T23:25:46.826 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.755+0000 7effbeffd640 10 monclient: _check_auth_tickets 2026-02-22T23:25:46.826 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.755+0000 7effbeffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T23:25:46.826 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.755+0000 7effdca98640 5 monclient: authenticate success, global_id 4346 2026-02-22T23:25:46.826 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.755+0000 7effdca98640 10 monclient: _renew_subs 2026-02-22T23:25:46.826 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.755+0000 7effdca98640 10 monclient: _send_mon_message to mon.e at v1:10.20.193.45:6793/0 2026-02-22T23:25:46.826 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.755+0000 7effdca98640 1 -- 10.20.193.45:0/2002835060 --> v1:10.20.193.45:6793/0 -- mon_subscribe({mgrmap=0+}) -- 0x7effd80a9bb0 con 0x7effd80a6d00 2026-02-22T23:25:46.826 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.755+0000 7effdca98640 10 monclient: _renew_subs 2026-02-22T23:25:46.826 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.755+0000 7effdca98640 10 monclient: _send_mon_message to mon.e at v1:10.20.193.45:6793/0 2026-02-22T23:25:46.826 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.755+0000 7effdca98640 1 -- 10.20.193.45:0/2002835060 --> v1:10.20.193.45:6793/0 -- mon_subscribe({osdmap=0}) -- 0x7effd8122770 con 0x7effd80a6d00 2026-02-22T23:25:46.826 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.755+0000 7effbeffd640 1 -- 10.20.193.45:0/2002835060 <== mon.8 v1:10.20.193.45:6793/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7effc8003d40 con 0x7effd80a6d00 2026-02-22T23:25:46.826 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.755+0000 7effbeffd640 10 monclient: handle_config config(0 keys) 2026-02-22T23:25:46.826 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.755+0000 7effbeffd640 1 -- 10.20.193.45:0/2002835060 <== mon.8 v1:10.20.193.45:6793/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7effc8004270 con 0x7effd80a6d00 2026-02-22T23:25:46.826 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.755+0000 7effbeffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:25:46.826 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.755+0000 7effd4d72640 4 set_mon_vals no callback set 2026-02-22T23:25:46.826 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.755+0000 7effbeffd640 10 monclient: got monmap 1 from mon.e (according to old e1) 2026-02-22T23:25:46.826 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.755+0000 7effbeffd640 10 monclient: dump: 2026-02-22T23:25:46.826 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:46.826 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:46.826 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:46.826 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:46.826 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:46.826 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:46.826 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:46.826 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:46.826 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:46.826 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:46.826 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:46.826 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:46.826 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:46.826 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:46.826 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:46.827 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:46.827 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.755+0000 7fa1e9ffb640 1 -- 10.20.193.45:0/349051587 <== mon.3 v1:10.20.193.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3697513105 0 0) 0x7fa1fc1217a0 con 0x7fa1fc0a32c0 2026-02-22T23:25:46.827 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.755+0000 7fa1e9ffb640 10 monclient(hunting): _negotiate 2026-02-22T23:25:46.827 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.755+0000 7fa1e9ffb640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:46.827 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.755+0000 7fa1e9ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:46.827 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.755+0000 7fa1e9ffb640 10 monclient(hunting): my global_id is 4368 2026-02-22T23:25:46.827 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.755+0000 7fa1e9ffb640 1 -- 10.20.193.45:0/349051587 --> v1:10.20.193.73:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa1fc1207f0 con 0x7fa1fc0a32c0 2026-02-22T23:25:46.827 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.755+0000 7fa1e9ffb640 1 -- 10.20.193.45:0/349051587 <== mon.8 v1:10.20.193.45:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1548024185 0 0) 0x7fa1cc003620 con 0x7fa1fc13d2b0 2026-02-22T23:25:46.827 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.755+0000 7fa1e9ffb640 1 -- 10.20.193.45:0/349051587 --> v1:10.20.193.45:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa1fc1217a0 con 0x7fa1fc13d2b0 2026-02-22T23:25:46.827 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.755+0000 7fa1e9ffb640 1 -- 10.20.193.45:0/349051587 <== mon.8 v1:10.20.193.45:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7fa1f80035b0 con 0x7fa1fc13d2b0 2026-02-22T23:25:46.827 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.755+0000 7fa1e9ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-22T23:25:46.827 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.755+0000 7fa1e9ffb640 10 monclient(hunting): got monmap 1 from mon.noname-e (according to old e1) 2026-02-22T23:25:46.827 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.755+0000 7fa1e9ffb640 10 monclient(hunting): dump: 2026-02-22T23:25:46.827 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:46.827 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:46.827 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:46.827 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:46.827 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:46.827 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:46.827 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:46.827 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:46.827 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:46.827 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:46.827 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:46.827 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:46.827 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:46.827 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:46.827 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:46.827 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:46.827 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.755+0000 7fa1e9ffb640 10 monclient(hunting): _finish_auth 0 2026-02-22T23:25:46.827 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.755+0000 7fa1e9ffb640 1 -- 10.20.193.45:0/349051587 <== mon.5 v1:10.20.193.73:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1195602456 0 0) 0x7fa1fc121a80 con 0x7fa1fc0733c0 2026-02-22T23:25:46.827 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.755+0000 7fa1e9ffb640 10 monclient(hunting): _negotiate 2026-02-22T23:25:46.828 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.755+0000 7fa1e9ffb640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:46.828 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.755+0000 7fa1e9ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:46.828 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.755+0000 7fa1e9ffb640 10 monclient(hunting): my global_id is 4343 2026-02-22T23:25:46.828 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.755+0000 7fa1e9ffb640 1 -- 10.20.193.45:0/349051587 --> v1:10.20.193.73:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa1cc003620 con 0x7fa1fc0733c0 2026-02-22T23:25:46.828 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.755+0000 7f9cbe0a9640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T23:25:46.828 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.755+0000 7f9cbe0a9640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T23:25:46.828 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.755+0000 7f9cbe0a9640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-22T23:25:46.828 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.756+0000 7f3ea57fa640 1 -- 10.20.193.45:0/3187627287 <== mon.4 v1:10.20.193.45:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3ea0004fa0 con 0x7f3eb00a2f60 2026-02-22T23:25:46.828 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.756+0000 7f3ea57fa640 10 monclient: handle_config config(0 keys) 2026-02-22T23:25:46.828 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.756+0000 7f3ea6ffd640 4 set_mon_vals no callback set 2026-02-22T23:25:46.828 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.755+0000 7fa1e9ffb640 1 -- 10.20.193.45:0/349051587 <== mon.8 v1:10.20.193.45:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3235836644 0 0) 0x7fa1fc1217a0 con 0x7fa1fc13d2b0 2026-02-22T23:25:46.828 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.755+0000 7fa1e9ffb640 1 -- 10.20.193.45:0/349051587 >> v1:10.20.193.73:6791/0 conn(0x7fa1fc0733c0 legacy=0x7fa1fc13b870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:46.828 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.755+0000 7fa1e9ffb640 1 -- 10.20.193.45:0/349051587 >> v1:10.20.193.73:6790/0 conn(0x7fa1fc0a32c0 legacy=0x7fa1fc13bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:46.828 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.756+0000 7fa1e9ffb640 10 monclient: _finish_hunting 0 2026-02-22T23:25:46.828 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.756+0000 7f9c93fff640 1 -- 10.20.193.45:0/2920422300 <== mon.0 v1:10.20.193.45:6789/0 7 ==== mgrmap(e 5) ==== 50225+0+0 (unknown 2330357642 0 0) 0x7f9ca8005320 con 0x7f9cb80a68f0 2026-02-22T23:25:46.828 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.755+0000 7f9cbe0a9640 1 -- 10.20.193.45:0/2920422300 --> v1:10.20.193.45:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9cb8127750 con 0x7f9cb80a68f0 2026-02-22T23:25:46.828 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.756+0000 7fa1e9ffb640 1 monclient: found mon.e 2026-02-22T23:25:46.828 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.756+0000 7fa1e9ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T23:25:46.828 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.756+0000 7fa1e9ffb640 10 monclient: _send_mon_message to mon.e at v1:10.20.193.45:6793/0 2026-02-22T23:25:46.829 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.756+0000 7fa1e9ffb640 1 -- 10.20.193.45:0/349051587 --> v1:10.20.193.45:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1fc11ff10 con 0x7fa1fc13d2b0 2026-02-22T23:25:46.829 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.756+0000 7fa1e9ffb640 10 monclient: _finish_auth 0 2026-02-22T23:25:46.829 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.756+0000 7fa1e9ffb640 10 monclient: _check_auth_tickets 2026-02-22T23:25:46.829 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.756+0000 7fa1e9ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T23:25:46.829 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.756+0000 7f3e7effd640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T23:25:46.829 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.756+0000 7f3ea57fa640 1 -- 10.20.193.45:0/3187627287 <== mon.4 v1:10.20.193.45:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f3ea0005490 con 0x7f3eb00a2f60 2026-02-22T23:25:46.829 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.756+0000 7f3e7effd640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T23:25:46.829 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.756+0000 7f3e7effd640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.45:6791/0 2026-02-22T23:25:46.829 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.756+0000 7effdca98640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T23:25:46.829 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.756+0000 7effdca98640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T23:25:46.829 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.756+0000 7effdca98640 10 monclient: _send_mon_message to mon.e at v1:10.20.193.45:6793/0 2026-02-22T23:25:46.829 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.756+0000 7f3e7effd640 1 -- 10.20.193.45:0/3187627287 --> v1:10.20.193.45:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e74005180 con 0x7f3eb00a2f60 2026-02-22T23:25:46.829 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.756+0000 7f3ea57fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:25:46.829 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.756+0000 7fa2037ed640 5 monclient: authenticate success, global_id 4355 2026-02-22T23:25:46.829 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.756+0000 7fa2037ed640 10 monclient: _renew_subs 2026-02-22T23:25:46.829 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.756+0000 7fa2037ed640 10 monclient: _send_mon_message to mon.e at v1:10.20.193.45:6793/0 2026-02-22T23:25:46.829 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.756+0000 7fa2037ed640 1 -- 10.20.193.45:0/349051587 --> v1:10.20.193.45:6793/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fa1fc139980 con 0x7fa1fc13d2b0 2026-02-22T23:25:46.829 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.756+0000 7effdca98640 1 -- 10.20.193.45:0/2002835060 --> v1:10.20.193.45:6793/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7effd8122ed0 con 0x7effd80a6d00 2026-02-22T23:25:46.830 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.756+0000 7f3ea57fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T23:25:46.830 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.756+0000 7f3ea57fa640 10 monclient: dump: 2026-02-22T23:25:46.830 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:46.830 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:46.830 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:46.830 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:46.830 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:46.830 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:46.830 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:46.830 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:46.830 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:46.830 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:46.830 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:46.830 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:46.830 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:46.830 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:46.830 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:46.830 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:46.830 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.756+0000 7f3ea57fa640 1 -- 10.20.193.45:0/3187627287 <== mon.4 v1:10.20.193.45:6791/0 7 ==== mgrmap(e 5) ==== 50225+0+0 (unknown 2330357642 0 0) 0x7f3ea0011a70 con 0x7f3eb00a2f60 2026-02-22T23:25:46.830 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.756+0000 7fa1e9ffb640 1 -- 10.20.193.45:0/349051587 <== mon.8 v1:10.20.193.45:6793/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa1f8003830 con 0x7fa1fc13d2b0 2026-02-22T23:25:46.830 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.756+0000 7fa1e9ffb640 10 monclient: handle_config config(0 keys) 2026-02-22T23:25:46.830 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.756+0000 7fa1eb7fe640 4 set_mon_vals no callback set 2026-02-22T23:25:46.830 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.756+0000 7fa2037ed640 10 monclient: _renew_subs 2026-02-22T23:25:46.830 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.756+0000 7fa2037ed640 10 monclient: _send_mon_message to mon.e at v1:10.20.193.45:6793/0 2026-02-22T23:25:46.830 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.756+0000 7fa2037ed640 1 -- 10.20.193.45:0/349051587 --> v1:10.20.193.45:6793/0 -- mon_subscribe({osdmap=0}) -- 0x7fa1fc13c690 con 0x7fa1fc13d2b0 2026-02-22T23:25:46.830 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.756+0000 7fa1e9ffb640 1 -- 10.20.193.45:0/349051587 <== mon.8 v1:10.20.193.45:6793/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7fa1f8004080 con 0x7fa1fc13d2b0 2026-02-22T23:25:46.831 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.756+0000 7effbeffd640 1 -- 10.20.193.45:0/2002835060 <== mon.8 v1:10.20.193.45:6793/0 7 ==== mgrmap(e 5) ==== 50225+0+0 (unknown 2330357642 0 0) 0x7effc8004410 con 0x7effd80a6d00 2026-02-22T23:25:46.831 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.756+0000 7fa1e9ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:25:46.831 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.756+0000 7fa1e9ffb640 10 monclient: got monmap 1 from mon.e (according to old e1) 2026-02-22T23:25:46.831 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.756+0000 7fa1e9ffb640 10 monclient: dump: 2026-02-22T23:25:46.831 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:46.831 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:46.831 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:46.831 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:46.831 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:46.831 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:46.831 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:46.831 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:46.831 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:46.831 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:46.831 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:46.831 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:46.831 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:46.831 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:46.831 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:46.831 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:46.831 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.756+0000 7effbeffd640 1 -- 10.20.193.45:0/2002835060 <== mon.8 v1:10.20.193.45:6793/0 8 ==== osd_map(19..19 src has 1..19) ==== 3558+0+0 (unknown 1288710973 0 0) 0x7effc804cd70 con 0x7effd80a6d00 2026-02-22T23:25:46.831 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.756+0000 7f3ea57fa640 1 -- 10.20.193.45:0/3187627287 <== mon.4 v1:10.20.193.45:6791/0 8 ==== osd_map(19..19 src has 1..19) ==== 3558+0+0 (unknown 1288710973 0 0) 0x7f3ea004dfa0 con 0x7f3eb00a2f60 2026-02-22T23:25:46.831 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.756+0000 7f9c93fff640 1 -- 10.20.193.45:0/2920422300 <== mon.0 v1:10.20.193.45:6789/0 8 ==== osd_map(19..19 src has 1..19) ==== 3558+0+0 (unknown 1288710973 0 0) 0x7f9ca804dba0 con 0x7f9cb80a68f0 2026-02-22T23:25:46.831 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.756+0000 7f9cb77fe640 10 monclient: get_auth_request con 0x7f9c8803f790 auth_method 0 2026-02-22T23:25:46.832 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.756+0000 7f3ea7fff640 10 monclient: get_auth_request con 0x7f3e800400e0 auth_method 0 2026-02-22T23:25:46.832 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.757+0000 7effd6575640 10 monclient: get_auth_request con 0x7effa403fe50 auth_method 0 2026-02-22T23:25:46.832 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.756+0000 7fa1e9ffb640 1 -- 10.20.193.45:0/349051587 <== mon.8 v1:10.20.193.45:6793/0 7 ==== mgrmap(e 5) ==== 50225+0+0 (unknown 2330357642 0 0) 0x7fa1f80042a0 con 0x7fa1fc13d2b0 2026-02-22T23:25:46.832 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.756+0000 7fa2037ed640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T23:25:46.832 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.757+0000 7fa2037ed640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T23:25:46.832 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.757+0000 7fa2037ed640 10 monclient: _send_mon_message to mon.e at v1:10.20.193.45:6793/0 2026-02-22T23:25:46.832 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.757+0000 7fa2037ed640 1 -- 10.20.193.45:0/349051587 --> v1:10.20.193.45:6793/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa1fc121dc0 con 0x7fa1fc13d2b0 2026-02-22T23:25:46.832 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.757+0000 7fa201562640 10 monclient: get_auth_request con 0x7fa1cc03f810 auth_method 0 2026-02-22T23:25:46.832 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.758+0000 7f9c93fff640 1 -- 10.20.193.45:0/2920422300 <== mon.0 v1:10.20.193.45:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (unknown 1092875540 0 2568732696) 0x7f9cb80aa0e0 con 0x7f9cb80a68f0 2026-02-22T23:25:46.832 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.758+0000 7f9c93fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T23:25:46.832 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.758+0000 7f9c93fff640 10 monclient: _finish_command 1 = system:0 2026-02-22T23:25:46.832 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.759+0000 7f3ea57fa640 1 -- 10.20.193.45:0/3187627287 <== mon.4 v1:10.20.193.45:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (unknown 1092875540 0 2568732696) 0x7f3ea0017b40 con 0x7f3eb00a2f60 2026-02-22T23:25:46.832 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.759+0000 7f3ea57fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T23:25:46.832 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.759+0000 7f3ea57fa640 10 monclient: _finish_command 1 = system:0 2026-02-22T23:25:46.832 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.759+0000 7fa1e9ffb640 1 -- 10.20.193.45:0/349051587 <== mon.8 v1:10.20.193.45:6793/0 8 ==== osd_map(19..19 src has 1..19) ==== 3558+0+0 (unknown 1288710973 0 0) 0x7fa1f804cd20 con 0x7fa1fc13d2b0 2026-02-22T23:25:46.832 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.759+0000 7effbeffd640 1 -- 10.20.193.45:0/2002835060 <== mon.8 v1:10.20.193.45:6793/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (unknown 1092875540 0 2568732696) 0x7effc80168d0 con 0x7effd80a6d00 2026-02-22T23:25:46.832 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.759+0000 7effbeffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T23:25:46.832 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.759+0000 7effbeffd640 10 monclient: _finish_command 1 = system:0 2026-02-22T23:25:46.833 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.761+0000 7fa1e9ffb640 1 -- 10.20.193.45:0/349051587 <== mon.8 v1:10.20.193.45:6793/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (unknown 1092875540 0 2568732696) 0x7fa1f8017a40 con 0x7fa1fc13d2b0 2026-02-22T23:25:46.833 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.761+0000 7fa1e9ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T23:25:46.833 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.761+0000 7fa1e9ffb640 10 monclient: _finish_command 1 = system:0 2026-02-22T23:25:46.833 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.794+0000 7fc5cf3a0640 10 monclient: get_monmap_and_config 2026-02-22T23:25:46.833 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.794+0000 7fc5cf3a0640 10 monclient: build_initial_monmap 2026-02-22T23:25:46.833 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.794+0000 7fc5cf3a0640 10 monclient: monmap: 2026-02-22T23:25:46.833 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-22T23:25:46.833 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:46.833 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:25:46.794809+0000 2026-02-22T23:25:46.833 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:25:46.794809+0000 2026-02-22T23:25:46.833 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-22T23:25:46.833 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:46.833 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-22T23:25:46.833 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.noname-f 2026-02-22T23:25:46.833 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.noname-b 2026-02-22T23:25:46.833 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.noname-g 2026-02-22T23:25:46.833 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.noname-c 2026-02-22T23:25:46.833 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.noname-h 2026-02-22T23:25:46.833 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.noname-d 2026-02-22T23:25:46.833 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.noname-i 2026-02-22T23:25:46.833 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.noname-e 2026-02-22T23:25:46.833 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:46.833 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.794+0000 7ff849da9640 10 monclient: get_monmap_and_config 2026-02-22T23:25:46.833 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.794+0000 7ff849da9640 10 monclient: build_initial_monmap 2026-02-22T23:25:46.833 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.794+0000 7ff849da9640 10 monclient: monmap: 2026-02-22T23:25:46.833 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-22T23:25:46.833 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:46.833 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:25:46.794978+0000 2026-02-22T23:25:46.833 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:25:46.794978+0000 2026-02-22T23:25:46.833 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-22T23:25:46.833 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:46.833 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-22T23:25:46.834 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.noname-f 2026-02-22T23:25:46.834 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.noname-b 2026-02-22T23:25:46.834 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.noname-g 2026-02-22T23:25:46.834 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.noname-c 2026-02-22T23:25:46.834 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.noname-h 2026-02-22T23:25:46.834 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.noname-d 2026-02-22T23:25:46.834 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.noname-i 2026-02-22T23:25:46.834 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.noname-e 2026-02-22T23:25:46.834 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:46.834 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.794+0000 7fc5cf3a0640 1 Processor -- start 2026-02-22T23:25:46.834 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.795+0000 7fc5cf3a0640 1 -- start start 2026-02-22T23:25:46.834 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.795+0000 7fc5cf3a0640 10 monclient: init 2026-02-22T23:25:46.834 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.795+0000 7fc5cf3a0640 10 monclient: _reopen_session rank -1 2026-02-22T23:25:46.834 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.795+0000 7ff849da9640 1 Processor -- start 2026-02-22T23:25:46.834 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.795+0000 7fc5cf3a0640 10 monclient: _add_conns ranks=[1,2,7,5,3,6,8,0,4] 2026-02-22T23:25:46.834 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.795+0000 7fc5cf3a0640 10 monclient(hunting): picked mon.noname-f con 0x7fc5c80a5e00 addr v1:10.20.193.73:6789/0 2026-02-22T23:25:46.834 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.795+0000 7fc5cf3a0640 10 monclient(hunting): picked mon.noname-b con 0x7fc5c80a68f0 addr v1:10.20.193.45:6790/0 2026-02-22T23:25:46.834 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.795+0000 7fc5cf3a0640 10 monclient(hunting): picked mon.noname-i con 0x7fc5c80a6d00 addr v1:10.20.193.73:6792/0 2026-02-22T23:25:46.834 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.795+0000 7fc5cf3a0640 1 -- --> v1:10.20.193.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc5c80a2d00 con 0x7fc5c80a5e00 2026-02-22T23:25:46.834 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.795+0000 7fc5cf3a0640 1 -- --> v1:10.20.193.45:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc5c80a2fe0 con 0x7fc5c80a68f0 2026-02-22T23:25:46.834 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.795+0000 7ff849da9640 1 -- start start 2026-02-22T23:25:46.835 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.795+0000 7fc5cf3a0640 1 -- --> v1:10.20.193.73:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc5c80a32c0 con 0x7fc5c80a6d00 2026-02-22T23:25:46.835 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.795+0000 7fc5cf3a0640 10 monclient(hunting): _renew_subs 2026-02-22T23:25:46.835 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.795+0000 7fc5cf3a0640 10 monclient(hunting): authenticate will time out at 678.411368s 2026-02-22T23:25:46.835 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.795+0000 7ff849da9640 10 monclient: init 2026-02-22T23:25:46.835 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.795+0000 7fc5cd115640 1 --1- >> v1:10.20.193.73:6789/0 conn(0x7fc5c80a5e00 0x7fc5c80a61e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.73:6789/0 says I am v1:10.20.193.45:44362/0 (socket says 10.20.193.45:44362) 2026-02-22T23:25:46.835 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.795+0000 7fc5cd115640 1 -- 10.20.193.45:0/2863062426 learned_addr learned my addr 10.20.193.45:0/2863062426 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-22T23:25:46.835 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.795+0000 7fc5cc914640 1 --1- >> v1:10.20.193.45:6790/0 conn(0x7fc5c80a68f0 0x7fc5c813e080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.45:6790/0 says I am v1:10.20.193.45:50950/0 (socket says 10.20.193.45:50950) 2026-02-22T23:25:46.835 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.795+0000 7fc5b7fff640 1 -- 10.20.193.45:0/2863062426 <== mon.2 v1:10.20.193.45:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2159117973 0 0) 0x7fc5c80a2fe0 con 0x7fc5c80a68f0 2026-02-22T23:25:46.835 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.795+0000 7fc5b7fff640 10 monclient(hunting): _negotiate 2026-02-22T23:25:46.835 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.795+0000 7fc5b7fff640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:46.835 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.795+0000 7fc5b7fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:46.835 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.795+0000 7fc5b7fff640 10 monclient(hunting): my global_id is 4358 2026-02-22T23:25:46.835 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.795+0000 7fc5b7fff640 1 -- 10.20.193.45:0/2863062426 --> v1:10.20.193.45:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc5b0003620 con 0x7fc5c80a68f0 2026-02-22T23:25:46.835 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.795+0000 7fc5b7fff640 1 -- 10.20.193.45:0/2863062426 <== mon.1 v1:10.20.193.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4161230422 0 0) 0x7fc5c80a2d00 con 0x7fc5c80a5e00 2026-02-22T23:25:46.835 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.795+0000 7fc5b7fff640 10 monclient(hunting): _negotiate 2026-02-22T23:25:46.835 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.795+0000 7fc5b7fff640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:46.835 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.795+0000 7fc5b7fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:46.835 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.795+0000 7fc5b7fff640 10 monclient(hunting): my global_id is 4402 2026-02-22T23:25:46.835 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.795+0000 7fc5b7fff640 1 -- 10.20.193.45:0/2863062426 --> v1:10.20.193.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc5c80a2fe0 con 0x7fc5c80a5e00 2026-02-22T23:25:46.835 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.795+0000 7ff849da9640 10 monclient: _reopen_session rank -1 2026-02-22T23:25:46.835 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.795+0000 7ff849da9640 10 monclient: _add_conns ranks=[0,6,5,4,2,1,8,3,7] 2026-02-22T23:25:46.836 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.795+0000 7ff849da9640 10 monclient(hunting): picked mon.noname-a con 0x7ff8440a5e00 addr v1:10.20.193.45:6789/0 2026-02-22T23:25:46.836 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.795+0000 7ff849da9640 10 monclient(hunting): picked mon.noname-d con 0x7ff8440a68f0 addr v1:10.20.193.45:6792/0 2026-02-22T23:25:46.836 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.795+0000 7fc5b7fff640 1 -- 10.20.193.45:0/2863062426 <== mon.2 v1:10.20.193.45:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 943733805 0 0) 0x7fc5b0003620 con 0x7fc5c80a68f0 2026-02-22T23:25:46.836 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.795+0000 7fc5b7fff640 1 -- 10.20.193.45:0/2863062426 >> v1:10.20.193.73:6792/0 conn(0x7fc5c80a6d00 legacy=0x7fc5c81417b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:46.836 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.795+0000 7ff849da9640 10 monclient(hunting): picked mon.noname-h con 0x7ff8440a6d00 addr v1:10.20.193.73:6791/0 2026-02-22T23:25:46.836 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.795+0000 7fc5b7fff640 1 -- 10.20.193.45:0/2863062426 >> v1:10.20.193.73:6789/0 conn(0x7fc5c80a5e00 legacy=0x7fc5c80a61e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:46.836 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.795+0000 7fc5b7fff640 10 monclient: _finish_hunting 0 2026-02-22T23:25:46.836 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.795+0000 7fc5b7fff640 1 monclient: found mon.noname-b 2026-02-22T23:25:46.836 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.795+0000 7fc5b7fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T23:25:46.836 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.795+0000 7ff849da9640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff8440a2d00 con 0x7ff8440a5e00 2026-02-22T23:25:46.836 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.795+0000 7ff849da9640 1 -- --> v1:10.20.193.73:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff8440a2fe0 con 0x7ff8440a6d00 2026-02-22T23:25:46.836 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.795+0000 7fc5b7fff640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.45:6790/0 2026-02-22T23:25:46.836 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.795+0000 7fc5b7fff640 1 -- 10.20.193.45:0/2863062426 --> v1:10.20.193.45:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5c80a35a0 con 0x7fc5c80a68f0 2026-02-22T23:25:46.836 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.795+0000 7fc5b7fff640 10 monclient: _finish_auth 0 2026-02-22T23:25:46.836 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.795+0000 7ff849da9640 1 -- --> v1:10.20.193.45:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff8440a32c0 con 0x7ff8440a68f0 2026-02-22T23:25:46.836 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.795+0000 7ff849da9640 10 monclient(hunting): _renew_subs 2026-02-22T23:25:46.836 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.795+0000 7ff849da9640 10 monclient(hunting): authenticate will time out at 678.411872s 2026-02-22T23:25:46.837 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.795+0000 7fc5b7fff640 10 monclient: _check_auth_tickets 2026-02-22T23:25:46.837 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.795+0000 7fc5b7fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T23:25:46.837 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.795+0000 7fc5b7fff640 1 -- 10.20.193.45:0/2863062426 <== mon.2 v1:10.20.193.45:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7fc5bc003040 con 0x7fc5c80a68f0 2026-02-22T23:25:46.837 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.795+0000 7fc5b7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:25:46.837 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.795+0000 7fc5b7fff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-22T23:25:46.837 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.795+0000 7fc5b7fff640 10 monclient: dump: 2026-02-22T23:25:46.837 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:46.837 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:46.837 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:46.837 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:46.837 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:46.837 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:46.837 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:46.837 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:46.837 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:46.837 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:46.837 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:46.837 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:46.837 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:46.837 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:46.837 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:46.837 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:46.837 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.795+0000 7fc5cf3a0640 5 monclient: authenticate success, global_id 4358 2026-02-22T23:25:46.837 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.795+0000 7fc5cf3a0640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-22T23:25:46.837 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.795+0000 7fc5b7fff640 1 -- 10.20.193.45:0/2863062426 <== mon.2 v1:10.20.193.45:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc5bc003260 con 0x7fc5c80a68f0 2026-02-22T23:25:46.837 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.795+0000 7fc5b7fff640 10 monclient: handle_config config(0 keys) 2026-02-22T23:25:46.837 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.795+0000 7fc5cf3a0640 10 monclient: get_monmap_and_config success 2026-02-22T23:25:46.837 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.795+0000 7fc5cf3a0640 4 set_mon_vals no callback set 2026-02-22T23:25:46.837 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.795+0000 7ff8437fe640 1 --1- >> v1:10.20.193.45:6789/0 conn(0x7ff8440a5e00 0x7ff8440a61e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.45:6789/0 says I am v1:10.20.193.45:58250/0 (socket says 10.20.193.45:58250) 2026-02-22T23:25:46.837 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.795+0000 7fc5b7fff640 1 -- 10.20.193.45:0/2863062426 <== mon.2 v1:10.20.193.45:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7fc5bc004c20 con 0x7fc5c80a68f0 2026-02-22T23:25:46.837 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.795+0000 7fc5b7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:25:46.837 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.795+0000 7fc5b7fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-22T23:25:46.837 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.795+0000 7fc5b7fff640 10 monclient: dump: 2026-02-22T23:25:46.837 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:46.838 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:46.838 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:46.838 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:46.838 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:46.838 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:46.838 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:46.838 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:46.838 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:46.838 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:46.838 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:46.838 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:46.838 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:46.838 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:46.838 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:46.838 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:46.838 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.795+0000 7ff8437fe640 1 -- 10.20.193.45:0/971807373 learned_addr learned my addr 10.20.193.45:0/971807373 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-22T23:25:46.838 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.796+0000 7ff8427fc640 1 -- 10.20.193.45:0/971807373 <== mon.6 v1:10.20.193.45:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3854895451 0 0) 0x7ff8440a32c0 con 0x7ff8440a68f0 2026-02-22T23:25:46.838 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.796+0000 7ff8427fc640 10 monclient(hunting): _negotiate 2026-02-22T23:25:46.838 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.796+0000 7ff8427fc640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:46.838 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.796+0000 7ff8427fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:46.838 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.796+0000 7ff8427fc640 10 monclient(hunting): my global_id is 4335 2026-02-22T23:25:46.838 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.796+0000 7ff8427fc640 1 -- 10.20.193.45:0/971807373 --> v1:10.20.193.45:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff828003620 con 0x7ff8440a68f0 2026-02-22T23:25:46.838 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.796+0000 7ff8427fc640 1 -- 10.20.193.45:0/971807373 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3206366904 0 0) 0x7ff8440a2d00 con 0x7ff8440a5e00 2026-02-22T23:25:46.838 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.796+0000 7ff8427fc640 10 monclient(hunting): _negotiate 2026-02-22T23:25:46.838 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.796+0000 7ff8427fc640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:46.838 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.796+0000 7ff8427fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:46.838 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.796+0000 7ff8427fc640 10 monclient(hunting): my global_id is 4329 2026-02-22T23:25:46.838 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.796+0000 7ff8427fc640 1 -- 10.20.193.45:0/971807373 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff8440a32c0 con 0x7ff8440a5e00 2026-02-22T23:25:46.839 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.796+0000 7fc5cf3a0640 10 monclient: shutdown 2026-02-22T23:25:46.839 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.796+0000 7fc5cf3a0640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T23:25:46.839 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.796+0000 7fc5cf3a0640 1 -- 10.20.193.45:0/2863062426 >> v1:10.20.193.45:6790/0 conn(0x7fc5c80a68f0 legacy=0x7fc5c813e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:46.839 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.796+0000 7fc5cf3a0640 1 -- 10.20.193.45:0/2863062426 shutdown_connections 2026-02-22T23:25:46.839 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.796+0000 7fc5cf3a0640 1 -- 10.20.193.45:0/2863062426 >> 10.20.193.45:0/2863062426 conn(0x7fc5c80abb50 msgr2=0x7fc5c80a7f00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:25:46.839 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.796+0000 7fc5cf3a0640 1 -- 10.20.193.45:0/2863062426 shutdown_connections 2026-02-22T23:25:46.839 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.796+0000 7fc5cf3a0640 1 -- 10.20.193.45:0/2863062426 wait complete. 2026-02-22T23:25:46.839 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.796+0000 7ff8427fc640 1 -- 10.20.193.45:0/971807373 <== mon.6 v1:10.20.193.45:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2478183319 0 0) 0x7ff828003620 con 0x7ff8440a68f0 2026-02-22T23:25:46.839 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.796+0000 7ff8427fc640 1 -- 10.20.193.45:0/971807373 >> v1:10.20.193.73:6791/0 conn(0x7ff8440a6d00 legacy=0x7ff8441417b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:46.839 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.796+0000 7ff8427fc640 1 -- 10.20.193.45:0/971807373 >> v1:10.20.193.45:6789/0 conn(0x7ff8440a5e00 legacy=0x7ff8440a61e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:46.839 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.796+0000 7ff8427fc640 10 monclient: _finish_hunting 0 2026-02-22T23:25:46.839 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.796+0000 7ff8427fc640 1 monclient: found mon.noname-d 2026-02-22T23:25:46.839 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.796+0000 7ff8427fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T23:25:46.839 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.796+0000 7ff8427fc640 10 monclient: _send_mon_message to mon.noname-d at v1:10.20.193.45:6792/0 2026-02-22T23:25:46.839 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.796+0000 7ff8427fc640 1 -- 10.20.193.45:0/971807373 --> v1:10.20.193.45:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8440a35a0 con 0x7ff8440a68f0 2026-02-22T23:25:46.839 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.796+0000 7ff8427fc640 10 monclient: _finish_auth 0 2026-02-22T23:25:46.839 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.796+0000 7ff8427fc640 10 monclient: _check_auth_tickets 2026-02-22T23:25:46.839 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.796+0000 7ff8427fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T23:25:46.839 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.796+0000 7ff8427fc640 1 -- 10.20.193.45:0/971807373 <== mon.6 v1:10.20.193.45:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7ff834003040 con 0x7ff8440a68f0 2026-02-22T23:25:46.839 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.796+0000 7ff849da9640 5 monclient: authenticate success, global_id 4335 2026-02-22T23:25:46.839 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.796+0000 7ff849da9640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-22T23:25:46.839 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.796+0000 7ff8427fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:25:46.840 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.796+0000 7ff8427fc640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2026-02-22T23:25:46.840 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.796+0000 7ff8427fc640 10 monclient: dump: 2026-02-22T23:25:46.840 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:46.840 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:46.840 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:46.840 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:46.840 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:46.840 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:46.840 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:46.840 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:46.840 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:46.840 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:46.840 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:46.840 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:46.840 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:46.840 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:46.840 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:46.840 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:46.840 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.796+0000 7ff849da9640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-22T23:25:46.840 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.796+0000 7ff8427fc640 1 -- 10.20.193.45:0/971807373 <== mon.6 v1:10.20.193.45:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff834003260 con 0x7ff8440a68f0 2026-02-22T23:25:46.840 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.796+0000 7ff8427fc640 10 monclient: handle_config config(0 keys) 2026-02-22T23:25:46.840 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.796+0000 7ff8427fc640 1 -- 10.20.193.45:0/971807373 <== mon.6 v1:10.20.193.45:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7ff834003a50 con 0x7ff8440a68f0 2026-02-22T23:25:46.840 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.796+0000 7ff849da9640 10 monclient: get_monmap_and_config success 2026-02-22T23:25:46.840 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.796+0000 7ff849da9640 4 set_mon_vals no callback set 2026-02-22T23:25:46.840 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.796+0000 7ff8427fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:25:46.840 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.796+0000 7ff8427fc640 10 monclient: got monmap 1 from mon.d (according to old e1) 2026-02-22T23:25:46.840 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.796+0000 7ff8427fc640 10 monclient: dump: 2026-02-22T23:25:46.840 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:46.840 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:46.840 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:46.840 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:46.840 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:46.840 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:46.840 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:46.840 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:46.840 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:46.840 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:46.840 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:46.840 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:46.840 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:46.840 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:46.840 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:46.840 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:46.841 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.796+0000 7fc5cf3a0640 10 monclient: build_initial_monmap 2026-02-22T23:25:46.841 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.796+0000 7ff849da9640 10 monclient: shutdown 2026-02-22T23:25:46.841 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.796+0000 7ff849da9640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T23:25:46.841 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.796+0000 7fc5cf3a0640 10 monclient: monmap: 2026-02-22T23:25:46.841 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-22T23:25:46.841 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T23:25:46.841 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-22T23:25:46.841 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-22T23:25:46.841 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-22T23:25:46.841 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-22T23:25:46.841 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-22T23:25:46.841 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.noname-f 2026-02-22T23:25:46.841 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.noname-b 2026-02-22T23:25:46.841 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.noname-g 2026-02-22T23:25:46.841 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.noname-c 2026-02-22T23:25:46.841 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.noname-h 2026-02-22T23:25:46.841 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.noname-d 2026-02-22T23:25:46.841 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.noname-i 2026-02-22T23:25:46.841 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.noname-e 2026-02-22T23:25:46.841 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:46.841 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.796+0000 7ff849da9640 1 -- 10.20.193.45:0/971807373 >> v1:10.20.193.45:6792/0 conn(0x7ff8440a68f0 legacy=0x7ff84413e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:46.841 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.796+0000 7ff849da9640 1 -- 10.20.193.45:0/971807373 shutdown_connections 2026-02-22T23:25:46.841 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.796+0000 7ff849da9640 1 -- 10.20.193.45:0/971807373 >> 10.20.193.45:0/971807373 conn(0x7ff8440abb50 msgr2=0x7ff8440a7f00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:25:46.841 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.796+0000 7ff849da9640 1 -- 10.20.193.45:0/971807373 shutdown_connections 2026-02-22T23:25:46.841 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.796+0000 7ff849da9640 1 -- 10.20.193.45:0/971807373 wait complete. 2026-02-22T23:25:46.842 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.796+0000 7fc5cf3a0640 1 Processor -- start 2026-02-22T23:25:46.842 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.796+0000 7fc5cf3a0640 1 -- start start 2026-02-22T23:25:46.842 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.796+0000 7fc5cf3a0640 10 monclient: init 2026-02-22T23:25:46.842 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.797+0000 7ff849da9640 10 monclient: build_initial_monmap 2026-02-22T23:25:46.842 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.797+0000 7ff849da9640 10 monclient: monmap: 2026-02-22T23:25:46.842 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-22T23:25:46.842 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T23:25:46.842 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-22T23:25:46.842 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-22T23:25:46.842 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-22T23:25:46.842 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-22T23:25:46.842 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-22T23:25:46.842 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.noname-f 2026-02-22T23:25:46.842 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.noname-b 2026-02-22T23:25:46.842 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.noname-g 2026-02-22T23:25:46.842 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.noname-c 2026-02-22T23:25:46.842 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.noname-h 2026-02-22T23:25:46.842 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.noname-d 2026-02-22T23:25:46.842 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.noname-i 2026-02-22T23:25:46.842 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.noname-e 2026-02-22T23:25:46.842 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:46.842 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.797+0000 7fc5cf3a0640 10 monclient: _reopen_session rank -1 2026-02-22T23:25:46.842 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.797+0000 7fc5cf3a0640 10 monclient: _add_conns ranks=[7,5,4,1,8,6,3,0,2] 2026-02-22T23:25:46.842 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.797+0000 7fc5cf3a0640 10 monclient(hunting): picked mon.noname-i con 0x7fc5c80a5e00 addr v1:10.20.193.73:6792/0 2026-02-22T23:25:46.843 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.797+0000 7fc5cf3a0640 10 monclient(hunting): picked mon.noname-h con 0x7fc5c80a68f0 addr v1:10.20.193.73:6791/0 2026-02-22T23:25:46.843 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.797+0000 7fc5cf3a0640 10 monclient(hunting): picked mon.noname-c con 0x7fc5c80a6d00 addr v1:10.20.193.45:6791/0 2026-02-22T23:25:46.843 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.797+0000 7fc5cf3a0640 1 -- --> v1:10.20.193.45:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc5c8141010 con 0x7fc5c80a6d00 2026-02-22T23:25:46.843 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.797+0000 7fc5cf3a0640 1 -- --> v1:10.20.193.73:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc5c8128f90 con 0x7fc5c80a68f0 2026-02-22T23:25:46.843 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.797+0000 7fc5cf3a0640 1 -- --> v1:10.20.193.73:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc5c8129270 con 0x7fc5c80a5e00 2026-02-22T23:25:46.843 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.797+0000 7fc5cf3a0640 10 monclient(hunting): _renew_subs 2026-02-22T23:25:46.843 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.797+0000 7fc5cf3a0640 10 monclient(hunting): authenticate will time out at 678.413305s 2026-02-22T23:25:46.843 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.797+0000 7ff849da9640 1 Processor -- start 2026-02-22T23:25:46.843 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.797+0000 7fc5cd916640 1 --1- >> v1:10.20.193.45:6791/0 conn(0x7fc5c80a6d00 0x7fc5c81d7d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.45:6791/0 says I am v1:10.20.193.45:37938/0 (socket says 10.20.193.45:37938) 2026-02-22T23:25:46.843 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.797+0000 7fc5cd115640 1 --1- >> v1:10.20.193.73:6792/0 conn(0x7fc5c80a5e00 0x7fc5c8125300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.73:6792/0 says I am v1:10.20.193.45:51446/0 (socket says 10.20.193.45:51446) 2026-02-22T23:25:46.843 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.797+0000 7fc5cd916640 1 -- 10.20.193.45:0/3426111554 learned_addr learned my addr 10.20.193.45:0/3426111554 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-22T23:25:46.843 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.797+0000 7ff849da9640 1 -- start start 2026-02-22T23:25:46.843 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.797+0000 7ff849da9640 10 monclient: init 2026-02-22T23:25:46.843 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.797+0000 7fc5b5ffb640 1 -- 10.20.193.45:0/3426111554 <== mon.4 v1:10.20.193.45:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3421730460 0 0) 0x7fc5c8141010 con 0x7fc5c80a6d00 2026-02-22T23:25:46.843 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.797+0000 7fc5b5ffb640 10 monclient(hunting): _negotiate 2026-02-22T23:25:46.843 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.797+0000 7fc5b5ffb640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:46.843 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.797+0000 7fc5b5ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:46.843 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.797+0000 7fc5b5ffb640 10 monclient(hunting): my global_id is 4333 2026-02-22T23:25:46.843 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.797+0000 7fc5b5ffb640 1 -- 10.20.193.45:0/3426111554 --> v1:10.20.193.45:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc598003620 con 0x7fc5c80a6d00 2026-02-22T23:25:46.843 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.797+0000 7fc5b5ffb640 1 -- 10.20.193.45:0/3426111554 <== mon.7 v1:10.20.193.73:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 157644909 0 0) 0x7fc5c8129270 con 0x7fc5c80a5e00 2026-02-22T23:25:46.843 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.797+0000 7fc5b5ffb640 10 monclient(hunting): _negotiate 2026-02-22T23:25:46.843 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.797+0000 7fc5b5ffb640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:46.844 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.797+0000 7fc5b5ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:46.844 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.797+0000 7fc5b5ffb640 10 monclient(hunting): my global_id is 4273 2026-02-22T23:25:46.844 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.797+0000 7fc5b5ffb640 1 -- 10.20.193.45:0/3426111554 --> v1:10.20.193.73:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc5c8141010 con 0x7fc5c80a5e00 2026-02-22T23:25:46.844 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.797+0000 7fc5b5ffb640 1 -- 10.20.193.45:0/3426111554 <== mon.5 v1:10.20.193.73:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2964892101 0 0) 0x7fc5c8128f90 con 0x7fc5c80a68f0 2026-02-22T23:25:46.844 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.797+0000 7fc5b5ffb640 10 monclient(hunting): _negotiate 2026-02-22T23:25:46.844 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.797+0000 7fc5b5ffb640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:46.844 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.797+0000 7fc5b5ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:46.844 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.797+0000 7fc5b5ffb640 10 monclient(hunting): my global_id is 4361 2026-02-22T23:25:46.844 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.797+0000 7fc5b5ffb640 1 -- 10.20.193.45:0/3426111554 --> v1:10.20.193.73:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc5c8129270 con 0x7fc5c80a68f0 2026-02-22T23:25:46.844 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.797+0000 7ff849da9640 10 monclient: _reopen_session rank -1 2026-02-22T23:25:46.844 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.797+0000 7ff849da9640 10 monclient: _add_conns ranks=[2,4,1,0,7,6,5,3,8] 2026-02-22T23:25:46.844 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.797+0000 7ff849da9640 10 monclient(hunting): picked mon.noname-b con 0x7ff8440a5e00 addr v1:10.20.193.45:6790/0 2026-02-22T23:25:46.844 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.797+0000 7ff849da9640 10 monclient(hunting): picked mon.noname-c con 0x7ff8440a68f0 addr v1:10.20.193.45:6791/0 2026-02-22T23:25:46.844 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.797+0000 7ff849da9640 10 monclient(hunting): picked mon.noname-f con 0x7ff8440a6d00 addr v1:10.20.193.73:6789/0 2026-02-22T23:25:46.844 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.797+0000 7ff849da9640 1 -- --> v1:10.20.193.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff844127a30 con 0x7ff8440a6d00 2026-02-22T23:25:46.844 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.797+0000 7ff849da9640 1 -- --> v1:10.20.193.45:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff844128c00 con 0x7ff8440a5e00 2026-02-22T23:25:46.844 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.797+0000 7ff849da9640 1 -- --> v1:10.20.193.45:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff8440a9fd0 con 0x7ff8440a68f0 2026-02-22T23:25:46.844 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.797+0000 7ff849da9640 10 monclient(hunting): _renew_subs 2026-02-22T23:25:46.844 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.797+0000 7fc5b5ffb640 1 -- 10.20.193.45:0/3426111554 <== mon.4 v1:10.20.193.45:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1980098971 0 0) 0x7fc598003620 con 0x7fc5c80a6d00 2026-02-22T23:25:46.844 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.797+0000 7ff849da9640 10 monclient(hunting): authenticate will time out at 678.413726s 2026-02-22T23:25:46.845 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.797+0000 7fc5b5ffb640 1 -- 10.20.193.45:0/3426111554 --> v1:10.20.193.45:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc5c8128f90 con 0x7fc5c80a6d00 2026-02-22T23:25:46.845 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.797+0000 7fc5b5ffb640 1 -- 10.20.193.45:0/3426111554 <== mon.4 v1:10.20.193.45:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7fc5c40036d0 con 0x7fc5c80a6d00 2026-02-22T23:25:46.845 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.797+0000 7fc5b5ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-22T23:25:46.845 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.797+0000 7fc5b5ffb640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-22T23:25:46.845 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.797+0000 7fc5b5ffb640 10 monclient(hunting): dump: 2026-02-22T23:25:46.845 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:46.845 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:46.845 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:46.845 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:46.845 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:46.845 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:46.845 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:46.845 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:46.845 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:46.845 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:46.845 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:46.845 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:46.845 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:46.845 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:46.845 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:46.845 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:46.845 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.797+0000 7fc5b5ffb640 10 monclient(hunting): _finish_auth 0 2026-02-22T23:25:46.845 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.797+0000 7fc5b5ffb640 1 -- 10.20.193.45:0/3426111554 <== mon.7 v1:10.20.193.73:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3549707371 0 0) 0x7fc5c8141010 con 0x7fc5c80a5e00 2026-02-22T23:25:46.845 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.797+0000 7fc5b5ffb640 1 -- 10.20.193.45:0/3426111554 --> v1:10.20.193.73:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc598003620 con 0x7fc5c80a5e00 2026-02-22T23:25:46.845 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.797+0000 7fc5b5ffb640 1 -- 10.20.193.45:0/3426111554 <== mon.7 v1:10.20.193.73:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7fc5b80030d0 con 0x7fc5c80a5e00 2026-02-22T23:25:46.845 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.797+0000 7fc5b5ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-22T23:25:46.845 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.797+0000 7ff8437fe640 1 --1- >> v1:10.20.193.45:6790/0 conn(0x7ff8440a5e00 0x7ff844125280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.45:6790/0 says I am v1:10.20.193.45:50952/0 (socket says 10.20.193.45:50952) 2026-02-22T23:25:46.845 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.797+0000 7ff8437fe640 1 -- 10.20.193.45:0/1355321200 learned_addr learned my addr 10.20.193.45:0/1355321200 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-22T23:25:46.846 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.797+0000 7fc5b5ffb640 10 monclient(hunting): got monmap 1 from mon.i (according to old e1) 2026-02-22T23:25:46.846 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.797+0000 7fc5b5ffb640 10 monclient(hunting): dump: 2026-02-22T23:25:46.846 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:46.846 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:46.846 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:46.846 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:46.846 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:46.846 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:46.846 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:46.846 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:46.846 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:46.846 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:46.846 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:46.846 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:46.846 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:46.846 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:46.846 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:46.846 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:46.846 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.797+0000 7fc5b5ffb640 1 -- 10.20.193.45:0/3426111554 <== mon.5 v1:10.20.193.73:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2397863775 0 0) 0x7fc5c8129270 con 0x7fc5c80a68f0 2026-02-22T23:25:46.846 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.797+0000 7fc5b5ffb640 1 -- 10.20.193.45:0/3426111554 --> v1:10.20.193.73:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc5c8141010 con 0x7fc5c80a68f0 2026-02-22T23:25:46.846 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.797+0000 7fc5b5ffb640 1 -- 10.20.193.45:0/3426111554 <== mon.5 v1:10.20.193.73:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7fc5bc003000 con 0x7fc5c80a68f0 2026-02-22T23:25:46.846 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.797+0000 7fc5b5ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-22T23:25:46.846 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.797+0000 7fc5b5ffb640 10 monclient(hunting): got monmap 1 from mon.h (according to old e1) 2026-02-22T23:25:46.846 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.797+0000 7fc5b5ffb640 10 monclient(hunting): dump: 2026-02-22T23:25:46.846 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:46.846 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:46.846 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:46.846 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:46.846 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:46.846 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:46.846 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:46.846 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:46.846 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:46.846 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:46.847 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:46.847 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:46.847 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:46.847 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:46.847 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:46.847 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:46.847 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.797+0000 7fc5b5ffb640 1 -- 10.20.193.45:0/3426111554 <== mon.4 v1:10.20.193.45:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3930600790 0 0) 0x7fc5c8128f90 con 0x7fc5c80a6d00 2026-02-22T23:25:46.847 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.797+0000 7fc5b5ffb640 1 -- 10.20.193.45:0/3426111554 >> v1:10.20.193.73:6792/0 conn(0x7fc5c80a5e00 legacy=0x7fc5c8125300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:46.847 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.797+0000 7fc5b5ffb640 1 -- 10.20.193.45:0/3426111554 >> v1:10.20.193.73:6791/0 conn(0x7fc5c80a68f0 legacy=0x7fc5c8125a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:46.847 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.797+0000 7fc5b5ffb640 10 monclient: _finish_hunting 0 2026-02-22T23:25:46.847 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.797+0000 7fc5b5ffb640 1 monclient: found mon.c 2026-02-22T23:25:46.847 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.797+0000 7fc5b5ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T23:25:46.847 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.797+0000 7fc5b5ffb640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.45:6791/0 2026-02-22T23:25:46.847 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.797+0000 7fc5b5ffb640 1 -- 10.20.193.45:0/3426111554 --> v1:10.20.193.45:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5c80aa0f0 con 0x7fc5c80a6d00 2026-02-22T23:25:46.847 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.797+0000 7fc5b5ffb640 10 monclient: _finish_auth 0 2026-02-22T23:25:46.847 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.797+0000 7fc5b5ffb640 10 monclient: _check_auth_tickets 2026-02-22T23:25:46.847 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.797+0000 7fc5b5ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T23:25:46.847 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.797+0000 7fc5cf3a0640 5 monclient: authenticate success, global_id 4333 2026-02-22T23:25:46.847 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.797+0000 7fc5cf3a0640 10 monclient: _renew_subs 2026-02-22T23:25:46.847 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.797+0000 7fc5cf3a0640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.45:6791/0 2026-02-22T23:25:46.847 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.797+0000 7fc5cf3a0640 1 -- 10.20.193.45:0/3426111554 --> v1:10.20.193.45:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fc5c80a9ba0 con 0x7fc5c80a6d00 2026-02-22T23:25:46.847 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.797+0000 7ff81ffff640 1 -- 10.20.193.45:0/1355321200 <== mon.2 v1:10.20.193.45:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1356300466 0 0) 0x7ff844128c00 con 0x7ff8440a5e00 2026-02-22T23:25:46.847 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.797+0000 7ff81ffff640 10 monclient(hunting): _negotiate 2026-02-22T23:25:46.847 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.797+0000 7ff81ffff640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:46.847 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.797+0000 7ff81ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:46.847 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.797+0000 7ff81ffff640 10 monclient(hunting): my global_id is 4367 2026-02-22T23:25:46.847 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.797+0000 7fc5cf3a0640 10 monclient: _renew_subs 2026-02-22T23:25:46.847 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.797+0000 7fc5cf3a0640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.45:6791/0 2026-02-22T23:25:46.847 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.797+0000 7ff81ffff640 1 -- 10.20.193.45:0/1355321200 --> v1:10.20.193.45:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff814003620 con 0x7ff8440a5e00 2026-02-22T23:25:46.848 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.797+0000 7fc5cf3a0640 1 -- 10.20.193.45:0/3426111554 --> v1:10.20.193.45:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7fc5c8126120 con 0x7fc5c80a6d00 2026-02-22T23:25:46.848 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.797+0000 7ff81ffff640 1 -- 10.20.193.45:0/1355321200 <== mon.4 v1:10.20.193.45:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 838571914 0 0) 0x7ff8440a9fd0 con 0x7ff8440a68f0 2026-02-22T23:25:46.848 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.797+0000 7ff81ffff640 10 monclient(hunting): _negotiate 2026-02-22T23:25:46.848 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.797+0000 7ff81ffff640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:46.848 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.797+0000 7ff81ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:46.848 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.797+0000 7ff81ffff640 10 monclient(hunting): my global_id is 4342 2026-02-22T23:25:46.848 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.797+0000 7ff81ffff640 1 -- 10.20.193.45:0/1355321200 --> v1:10.20.193.45:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff844128c00 con 0x7ff8440a68f0 2026-02-22T23:25:46.848 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.797+0000 7fc5b5ffb640 1 -- 10.20.193.45:0/3426111554 <== mon.4 v1:10.20.193.45:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc5c4003d40 con 0x7fc5c80a6d00 2026-02-22T23:25:46.848 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.797+0000 7fc5b5ffb640 10 monclient: handle_config config(0 keys) 2026-02-22T23:25:46.848 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.797+0000 7fc5b5ffb640 1 -- 10.20.193.45:0/3426111554 <== mon.4 v1:10.20.193.45:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7fc5c40042f0 con 0x7fc5c80a6d00 2026-02-22T23:25:46.848 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.797+0000 7fc5b5ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:25:46.848 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.797+0000 7fc5b77fe640 4 set_mon_vals no callback set 2026-02-22T23:25:46.848 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.797+0000 7fc5b5ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T23:25:46.848 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.797+0000 7fc5b5ffb640 10 monclient: dump: 2026-02-22T23:25:46.848 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:46.848 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:46.848 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:46.848 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:46.848 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:46.848 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:46.848 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:46.848 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:46.848 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:46.848 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:46.848 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:46.848 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:46.848 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:46.848 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:46.849 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:46.849 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:46.849 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.798+0000 7ff81ffff640 1 -- 10.20.193.45:0/1355321200 <== mon.2 v1:10.20.193.45:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 475319940 0 0) 0x7ff814003620 con 0x7ff8440a5e00 2026-02-22T23:25:46.849 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.798+0000 7ff81ffff640 1 -- 10.20.193.45:0/1355321200 --> v1:10.20.193.45:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff8440a9fd0 con 0x7ff8440a5e00 2026-02-22T23:25:46.849 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.798+0000 7ff81ffff640 1 -- 10.20.193.45:0/1355321200 <== mon.2 v1:10.20.193.45:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7ff830003170 con 0x7ff8440a5e00 2026-02-22T23:25:46.849 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.798+0000 7ff81ffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-22T23:25:46.849 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.798+0000 7ff81ffff640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-22T23:25:46.849 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.798+0000 7ff81ffff640 10 monclient(hunting): dump: 2026-02-22T23:25:46.849 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:46.849 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:46.849 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:46.849 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:46.849 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:46.849 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:46.849 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:46.849 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:46.849 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:46.849 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:46.849 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:46.849 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:46.849 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:46.850 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:46.850 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:46.850 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:46.850 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.798+0000 7ff81ffff640 10 monclient(hunting): _finish_auth 0 2026-02-22T23:25:46.850 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.798+0000 7ff81ffff640 1 -- 10.20.193.45:0/1355321200 <== mon.2 v1:10.20.193.45:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2220124462 0 0) 0x7ff8440a9fd0 con 0x7ff8440a5e00 2026-02-22T23:25:46.850 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.798+0000 7ff81ffff640 1 -- 10.20.193.45:0/1355321200 >> v1:10.20.193.45:6791/0 conn(0x7ff8440a68f0 legacy=0x7ff844125990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:46.850 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.798+0000 7ff81ffff640 1 -- 10.20.193.45:0/1355321200 >> v1:10.20.193.73:6789/0 conn(0x7ff8440a6d00 legacy=0x7ff8441d7d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:46.850 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.798+0000 7ff81ffff640 10 monclient: _finish_hunting 0 2026-02-22T23:25:46.850 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.798+0000 7ff81ffff640 1 monclient: found mon.b 2026-02-22T23:25:46.850 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.798+0000 7ff81ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T23:25:46.850 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.798+0000 7ff81ffff640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.45:6790/0 2026-02-22T23:25:46.850 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.798+0000 7ff81ffff640 1 -- 10.20.193.45:0/1355321200 --> v1:10.20.193.45:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8441291c0 con 0x7ff8440a5e00 2026-02-22T23:25:46.850 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.798+0000 7ff81ffff640 10 monclient: _finish_auth 0 2026-02-22T23:25:46.850 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.798+0000 7ff81ffff640 10 monclient: _check_auth_tickets 2026-02-22T23:25:46.850 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.798+0000 7ff81ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T23:25:46.850 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.798+0000 7ff849da9640 5 monclient: authenticate success, global_id 4367 2026-02-22T23:25:46.850 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.798+0000 7ff849da9640 10 monclient: _renew_subs 2026-02-22T23:25:46.850 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.798+0000 7ff849da9640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.45:6790/0 2026-02-22T23:25:46.850 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.798+0000 7ff849da9640 1 -- 10.20.193.45:0/1355321200 --> v1:10.20.193.45:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7ff8441260a0 con 0x7ff8440a5e00 2026-02-22T23:25:46.850 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.798+0000 7ff849da9640 10 monclient: _renew_subs 2026-02-22T23:25:46.850 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.798+0000 7ff849da9640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.45:6790/0 2026-02-22T23:25:46.850 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.798+0000 7ff849da9640 1 -- 10.20.193.45:0/1355321200 --> v1:10.20.193.45:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7ff844127780 con 0x7ff8440a5e00 2026-02-22T23:25:46.850 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.798+0000 7ff81ffff640 1 -- 10.20.193.45:0/1355321200 <== mon.2 v1:10.20.193.45:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff830003390 con 0x7ff8440a5e00 2026-02-22T23:25:46.850 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.798+0000 7ff81ffff640 10 monclient: handle_config config(0 keys) 2026-02-22T23:25:46.850 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.798+0000 7ff81ffff640 1 -- 10.20.193.45:0/1355321200 <== mon.2 v1:10.20.193.45:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7ff830004ed0 con 0x7ff8440a5e00 2026-02-22T23:25:46.850 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.798+0000 7ff81ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:25:46.850 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.798+0000 7ff81ffff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-22T23:25:46.850 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.798+0000 7ff841ffb640 4 set_mon_vals no callback set 2026-02-22T23:25:46.850 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.798+0000 7ff81ffff640 10 monclient: dump: 2026-02-22T23:25:46.850 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:46.850 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:46.850 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:46.850 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:46.850 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:46.850 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:46.850 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:46.850 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:46.850 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:46.850 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:46.850 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:46.850 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:46.850 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:46.850 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:46.850 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:46.850 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:46.851 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.798+0000 7fc5cf3a0640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T23:25:46.851 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.798+0000 7fc5cf3a0640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T23:25:46.851 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.798+0000 7fc5cf3a0640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.45:6791/0 2026-02-22T23:25:46.851 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.798+0000 7fc5cf3a0640 1 -- 10.20.193.45:0/3426111554 --> v1:10.20.193.45:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc5c8127e20 con 0x7fc5c80a6d00 2026-02-22T23:25:46.851 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.798+0000 7ff849da9640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T23:25:46.851 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.798+0000 7ff849da9640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T23:25:46.851 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.798+0000 7ff849da9640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.45:6790/0 2026-02-22T23:25:46.851 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.798+0000 7ff849da9640 1 -- 10.20.193.45:0/1355321200 --> v1:10.20.193.45:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff8440008d0 con 0x7ff8440a5e00 2026-02-22T23:25:46.851 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.798+0000 7fc5b5ffb640 1 -- 10.20.193.45:0/3426111554 <== mon.4 v1:10.20.193.45:6791/0 7 ==== mgrmap(e 5) ==== 50225+0+0 (unknown 2330357642 0 0) 0x7fc5c4004490 con 0x7fc5c80a6d00 2026-02-22T23:25:46.851 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.798+0000 7ff81ffff640 1 -- 10.20.193.45:0/1355321200 <== mon.2 v1:10.20.193.45:6790/0 7 ==== mgrmap(e 5) ==== 50225+0+0 (unknown 2330357642 0 0) 0x7ff8300114b0 con 0x7ff8440a5e00 2026-02-22T23:25:46.851 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.798+0000 7fc5b5ffb640 1 -- 10.20.193.45:0/3426111554 <== mon.4 v1:10.20.193.45:6791/0 8 ==== osd_map(19..19 src has 1..19) ==== 3558+0+0 (unknown 1288710973 0 0) 0x7fc5c404e080 con 0x7fc5c80a6d00 2026-02-22T23:25:46.851 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.798+0000 7ff81ffff640 1 -- 10.20.193.45:0/1355321200 <== mon.2 v1:10.20.193.45:6790/0 8 ==== osd_map(19..19 src has 1..19) ==== 3558+0+0 (unknown 1288710973 0 0) 0x7ff83004dbc0 con 0x7ff8440a5e00 2026-02-22T23:25:46.851 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.799+0000 7ff842ffd640 10 monclient: get_auth_request con 0x7ff81403f8e0 auth_method 0 2026-02-22T23:25:46.851 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.799+0000 7fc5cd115640 10 monclient: get_auth_request con 0x7fc598040260 auth_method 0 2026-02-22T23:25:46.852 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.801+0000 7fc5b5ffb640 1 -- 10.20.193.45:0/3426111554 <== mon.4 v1:10.20.193.45:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (unknown 1092875540 0 2568732696) 0x7fc5c4017be0 con 0x7fc5c80a6d00 2026-02-22T23:25:46.852 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.801+0000 7fc5b5ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T23:25:46.852 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.801+0000 7fc5b5ffb640 10 monclient: _finish_command 1 = system:0 2026-02-22T23:25:46.852 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.802+0000 7ff81ffff640 1 -- 10.20.193.45:0/1355321200 <== mon.2 v1:10.20.193.45:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (unknown 1092875540 0 2568732696) 0x7ff8300176c0 con 0x7ff8440a5e00 2026-02-22T23:25:46.852 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.802+0000 7ff81ffff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T23:25:46.852 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.802+0000 7ff81ffff640 10 monclient: _finish_command 1 = system:0 2026-02-22T23:25:46.852 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.845+0000 7f9cbe0a9640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 5}] 2026-02-22T23:25:46.852 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.845+0000 7f9cbe0a9640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 5}] 2026-02-22T23:25:46.852 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.845+0000 7f9cbe0a9640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-22T23:25:46.852 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.845+0000 7f9cbe0a9640 1 -- 10.20.193.45:0/2920422300 --> v1:10.20.193.45:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f9cb81291e0 con 0x7f9cb80a68f0 2026-02-22T23:25:46.852 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.845+0000 7f9c93fff640 1 -- 10.20.193.45:0/2920422300 <== mon.0 v1:10.20.193.45:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (unknown 2131975755 0 956180462) 0x7f9ca80177e0 con 0x7f9cb80a68f0 2026-02-22T23:25:46.852 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.845+0000 7f9c93fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 5}] 2026-02-22T23:25:46.852 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.845+0000 7f9c93fff640 10 monclient: _finish_command 2 = system:0 2026-02-22T23:25:46.852 INFO:teuthology.orchestra.run.trial045.stdout:51539607555 2026-02-22T23:25:46.852 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.846+0000 7f3e7effd640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 2}] 2026-02-22T23:25:46.852 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.846+0000 7f3e7effd640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 2}] 2026-02-22T23:25:46.852 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.846+0000 7f3e7effd640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.45:6791/0 2026-02-22T23:25:46.852 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.846+0000 7f3e7effd640 1 -- 10.20.193.45:0/3187627287 --> v1:10.20.193.45:6791/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f3e74005470 con 0x7f3eb00a2f60 2026-02-22T23:25:46.852 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.846+0000 7f3ea57fa640 1 -- 10.20.193.45:0/3187627287 <== mon.4 v1:10.20.193.45:6791/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (unknown 92182286 0 727498649) 0x7f3ea001b790 con 0x7f3eb00a2f60 2026-02-22T23:25:46.853 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.846+0000 7f3ea57fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 2}] 2026-02-22T23:25:46.853 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.846+0000 7f3ea57fa640 10 monclient: _finish_command 2 = system:0 2026-02-22T23:25:46.853 INFO:teuthology.orchestra.run.trial045.stdout:51539607554 2026-02-22T23:25:46.853 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.847+0000 7effdca98640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 3}] 2026-02-22T23:25:46.853 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.847+0000 7effdca98640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 3}] 2026-02-22T23:25:46.853 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.847+0000 7effdca98640 10 monclient: _send_mon_message to mon.e at v1:10.20.193.45:6793/0 2026-02-22T23:25:46.853 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.847+0000 7effdca98640 1 -- 10.20.193.45:0/2002835060 --> v1:10.20.193.45:6793/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7effd806ce10 con 0x7effd80a6d00 2026-02-22T23:25:46.853 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.847+0000 7f9cbe0a9640 1 -- 10.20.193.45:0/2920422300 >> v1:10.20.193.73:6800/2222410180 conn(0x7f9c8803f790 legacy=0x7f9c88041c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:46.853 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.847+0000 7f9cbe0a9640 10 monclient: shutdown 2026-02-22T23:25:46.853 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.847+0000 7f9cbe0a9640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T23:25:46.853 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.847+0000 7f9cbe0a9640 1 -- 10.20.193.45:0/2920422300 >> v1:10.20.193.45:6789/0 conn(0x7f9cb80a68f0 legacy=0x7f9cb81d4690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:46.853 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.847+0000 7f9cbe0a9640 1 -- 10.20.193.45:0/2920422300 shutdown_connections 2026-02-22T23:25:46.853 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.847+0000 7f9cbe0a9640 1 -- 10.20.193.45:0/2920422300 >> 10.20.193.45:0/2920422300 conn(0x7f9cb80abb50 msgr2=0x7f9cb81425a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:25:46.853 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.847+0000 7effbeffd640 1 -- 10.20.193.45:0/2002835060 <== mon.8 v1:10.20.193.45:6793/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (unknown 383520633 0 847495621) 0x7effc80161d0 con 0x7effd80a6d00 2026-02-22T23:25:46.853 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.847+0000 7effbeffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 3}] 2026-02-22T23:25:46.853 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.847+0000 7effbeffd640 10 monclient: _finish_command 2 = system:0 2026-02-22T23:25:46.853 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.847+0000 7f9cbe0a9640 1 -- 10.20.193.45:0/2920422300 shutdown_connections 2026-02-22T23:25:46.854 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.847+0000 7f9cbe0a9640 1 -- 10.20.193.45:0/2920422300 wait complete. 2026-02-22T23:25:46.854 INFO:teuthology.orchestra.run.trial045.stdout:47244640259 2026-02-22T23:25:46.854 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.848+0000 7f3e7effd640 1 -- 10.20.193.45:0/3187627287 >> v1:10.20.193.73:6800/2222410180 conn(0x7f3e800400e0 legacy=0x7f3e800425a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:46.854 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.848+0000 7f3e7effd640 10 monclient: shutdown 2026-02-22T23:25:46.854 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.848+0000 7f3e7effd640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T23:25:46.854 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.848+0000 7f3e7effd640 1 -- 10.20.193.45:0/3187627287 >> v1:10.20.193.45:6791/0 conn(0x7f3eb00a2f60 legacy=0x7f3eb01cd830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:46.854 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.848+0000 7f3e7effd640 1 -- 10.20.193.45:0/3187627287 shutdown_connections 2026-02-22T23:25:46.854 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.848+0000 7f3e7effd640 1 -- 10.20.193.45:0/3187627287 >> 10.20.193.45:0/3187627287 conn(0x7f3eb00a8530 msgr2=0x7f3eb00a1c20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:25:46.854 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.848+0000 7f3e7effd640 1 -- 10.20.193.45:0/3187627287 shutdown_connections 2026-02-22T23:25:46.854 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.848+0000 7f3e7effd640 1 -- 10.20.193.45:0/3187627287 wait complete. 2026-02-22T23:25:46.854 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.849+0000 7effdca98640 1 -- 10.20.193.45:0/2002835060 >> v1:10.20.193.73:6800/2222410180 conn(0x7effa403fe50 legacy=0x7effa4042310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:46.854 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.849+0000 7effdca98640 10 monclient: shutdown 2026-02-22T23:25:46.854 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.849+0000 7effdca98640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T23:25:46.854 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.849+0000 7effdca98640 1 -- 10.20.193.45:0/2002835060 >> v1:10.20.193.45:6793/0 conn(0x7effd80a6d00 legacy=0x7effd81d7d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:46.854 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.849+0000 7effdca98640 1 -- 10.20.193.45:0/2002835060 shutdown_connections 2026-02-22T23:25:46.854 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.849+0000 7effdca98640 1 -- 10.20.193.45:0/2002835060 >> 10.20.193.45:0/2002835060 conn(0x7effd80abb50 msgr2=0x7effd80a4010 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:25:46.854 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.849+0000 7effdca98640 1 -- 10.20.193.45:0/2002835060 shutdown_connections 2026-02-22T23:25:46.854 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.849+0000 7effdca98640 1 -- 10.20.193.45:0/2002835060 wait complete. 2026-02-22T23:25:46.855 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.851+0000 7fa2037ed640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 4}] 2026-02-22T23:25:46.855 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.851+0000 7fa2037ed640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 4}] 2026-02-22T23:25:46.855 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.851+0000 7fa2037ed640 10 monclient: _send_mon_message to mon.e at v1:10.20.193.45:6793/0 2026-02-22T23:25:46.855 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.851+0000 7fa2037ed640 1 -- 10.20.193.45:0/349051587 --> v1:10.20.193.45:6793/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7fa1fc068a10 con 0x7fa1fc13d2b0 2026-02-22T23:25:46.855 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.851+0000 7fa1e9ffb640 1 -- 10.20.193.45:0/349051587 <== mon.8 v1:10.20.193.45:6793/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (unknown 1823589948 0 727498649) 0x7fa1f8017340 con 0x7fa1fc13d2b0 2026-02-22T23:25:46.855 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.851+0000 7fa1e9ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 4}] 2026-02-22T23:25:46.855 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.851+0000 7fa1e9ffb640 10 monclient: _finish_command 2 = system:0 2026-02-22T23:25:46.855 INFO:teuthology.orchestra.run.trial045.stdout:51539607554 2026-02-22T23:25:46.855 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.853+0000 7fa2037ed640 1 -- 10.20.193.45:0/349051587 >> v1:10.20.193.73:6800/2222410180 conn(0x7fa1cc03f810 legacy=0x7fa1cc041cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:46.855 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.853+0000 7fa2037ed640 10 monclient: shutdown 2026-02-22T23:25:46.855 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.853+0000 7fa2037ed640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T23:25:46.855 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.853+0000 7fa2037ed640 1 -- 10.20.193.45:0/349051587 >> v1:10.20.193.45:6793/0 conn(0x7fa1fc13d2b0 legacy=0x7fa1fc1dc430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:46.855 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.854+0000 7fa2037ed640 1 -- 10.20.193.45:0/349051587 shutdown_connections 2026-02-22T23:25:46.855 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.854+0000 7fa2037ed640 1 -- 10.20.193.45:0/349051587 >> 10.20.193.45:0/349051587 conn(0x7fa1fc0a9970 msgr2=0x7fa1fc0a47d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:25:46.855 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.854+0000 7fa2037ed640 1 -- 10.20.193.45:0/349051587 shutdown_connections 2026-02-22T23:25:46.855 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.854+0000 7fa2037ed640 1 -- 10.20.193.45:0/349051587 wait complete. 2026-02-22T23:25:46.856 INFO:tasks.ceph.ceph_manager.ceph:need seq 51539607556 got 51539607555 for osd.5 2026-02-22T23:25:46.856 INFO:tasks.ceph.ceph_manager.ceph:need seq 51539607555 got 51539607554 for osd.2 2026-02-22T23:25:46.857 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640260 got 47244640259 for osd.3 2026-02-22T23:25:46.862 INFO:tasks.ceph.ceph_manager.ceph:need seq 51539607555 got 51539607554 for osd.4 2026-02-22T23:25:46.890 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.890+0000 7ff849da9640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 1}] 2026-02-22T23:25:46.890 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.890+0000 7ff849da9640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 1}] 2026-02-22T23:25:46.890 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.890+0000 7ff849da9640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.45:6790/0 2026-02-22T23:25:46.890 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.890+0000 7ff849da9640 1 -- 10.20.193.45:0/1355321200 --> v1:10.20.193.45:6790/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7ff8440a5770 con 0x7ff8440a5e00 2026-02-22T23:25:46.890 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.890+0000 7ff81ffff640 1 -- 10.20.193.45:0/1355321200 <== mon.2 v1:10.20.193.45:6790/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (unknown 832126871 0 727498649) 0x7ff830016fc0 con 0x7ff8440a5e00 2026-02-22T23:25:46.890 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.890+0000 7ff81ffff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 1}] 2026-02-22T23:25:46.890 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.890+0000 7ff81ffff640 10 monclient: _finish_command 2 = system:0 2026-02-22T23:25:46.890 INFO:teuthology.orchestra.run.trial045.stdout:51539607554 2026-02-22T23:25:46.891 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.891+0000 7ff849da9640 1 -- 10.20.193.45:0/1355321200 >> v1:10.20.193.73:6800/2222410180 conn(0x7ff81403f8e0 legacy=0x7ff814041da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:46.891 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.891+0000 7ff849da9640 10 monclient: shutdown 2026-02-22T23:25:46.891 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.891+0000 7ff849da9640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T23:25:46.891 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.891+0000 7ff849da9640 1 -- 10.20.193.45:0/1355321200 >> v1:10.20.193.45:6790/0 conn(0x7ff8440a5e00 legacy=0x7ff844125280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:46.891 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.891+0000 7ff849da9640 1 -- 10.20.193.45:0/1355321200 shutdown_connections 2026-02-22T23:25:46.892 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.891+0000 7ff849da9640 1 -- 10.20.193.45:0/1355321200 >> 10.20.193.45:0/1355321200 conn(0x7ff8440abb50 msgr2=0x7ff8441425a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:25:46.892 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.891+0000 7ff849da9640 1 -- 10.20.193.45:0/1355321200 shutdown_connections 2026-02-22T23:25:46.892 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.891+0000 7ff849da9640 1 -- 10.20.193.45:0/1355321200 wait complete. 2026-02-22T23:25:46.893 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.893+0000 7fc5cf3a0640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 0}] 2026-02-22T23:25:46.893 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.893+0000 7fc5cf3a0640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 0}] 2026-02-22T23:25:46.893 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.893+0000 7fc5cf3a0640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.45:6791/0 2026-02-22T23:25:46.893 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.893+0000 7fc5cf3a0640 1 -- 10.20.193.45:0/3426111554 --> v1:10.20.193.45:6791/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fc5c806ce10 con 0x7fc5c80a6d00 2026-02-22T23:25:46.893 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.893+0000 7fc5b5ffb640 1 -- 10.20.193.45:0/3426111554 <== mon.4 v1:10.20.193.45:6791/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (unknown 574334944 0 727498649) 0x7fc5c40174e0 con 0x7fc5c80a6d00 2026-02-22T23:25:46.893 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.893+0000 7fc5b5ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 0}] 2026-02-22T23:25:46.893 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.893+0000 7fc5b5ffb640 10 monclient: _finish_command 2 = system:0 2026-02-22T23:25:46.894 INFO:teuthology.orchestra.run.trial045.stdout:51539607554 2026-02-22T23:25:46.895 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.895+0000 7fc5cf3a0640 1 -- 10.20.193.45:0/3426111554 >> v1:10.20.193.73:6800/2222410180 conn(0x7fc598040260 legacy=0x7fc598042720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:46.895 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.895+0000 7fc5cf3a0640 10 monclient: shutdown 2026-02-22T23:25:46.895 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.895+0000 7fc5cf3a0640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T23:25:46.895 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.895+0000 7fc5cf3a0640 1 -- 10.20.193.45:0/3426111554 >> v1:10.20.193.45:6791/0 conn(0x7fc5c80a6d00 legacy=0x7fc5c81d7d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:46.895 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.895+0000 7fc5cf3a0640 1 -- 10.20.193.45:0/3426111554 shutdown_connections 2026-02-22T23:25:46.895 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.895+0000 7fc5cf3a0640 1 -- 10.20.193.45:0/3426111554 >> 10.20.193.45:0/3426111554 conn(0x7fc5c80abb50 msgr2=0x7fc5c8142510 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:25:46.895 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.895+0000 7fc5cf3a0640 1 -- 10.20.193.45:0/3426111554 shutdown_connections 2026-02-22T23:25:46.895 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:46.895+0000 7fc5cf3a0640 1 -- 10.20.193.45:0/3426111554 wait complete. 2026-02-22T23:25:46.899 INFO:tasks.ceph.ceph_manager.ceph:need seq 51539607555 got 51539607554 for osd.1 2026-02-22T23:25:46.903 INFO:tasks.ceph.ceph_manager.ceph:need seq 51539607555 got 51539607554 for osd.0 2026-02-22T23:25:47.856 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2026-02-22T23:25:47.857 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-22T23:25:47.857 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-22T23:25:47.862 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2026-02-22T23:25:47.900 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-22T23:25:47.904 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-22T23:25:47.929 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.929+0000 7f31b0f11640 10 monclient: get_monmap_and_config 2026-02-22T23:25:47.929 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.929+0000 7f31b0f11640 10 monclient: build_initial_monmap 2026-02-22T23:25:47.929 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.929+0000 7f31b0f11640 10 monclient: monmap: 2026-02-22T23:25:47.929 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-22T23:25:47.929 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:47.929 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:25:47.929361+0000 2026-02-22T23:25:47.929 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:25:47.929361+0000 2026-02-22T23:25:47.929 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-22T23:25:47.929 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:47.929 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-22T23:25:47.929 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.noname-f 2026-02-22T23:25:47.929 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.noname-b 2026-02-22T23:25:47.929 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.noname-g 2026-02-22T23:25:47.929 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.noname-c 2026-02-22T23:25:47.929 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.noname-h 2026-02-22T23:25:47.929 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.noname-d 2026-02-22T23:25:47.929 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.noname-i 2026-02-22T23:25:47.929 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.noname-e 2026-02-22T23:25:47.929 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:47.929 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.929+0000 7fdc232f5640 10 monclient: get_monmap_and_config 2026-02-22T23:25:47.929 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.929+0000 7fdc232f5640 10 monclient: build_initial_monmap 2026-02-22T23:25:47.929 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.929+0000 7fdc232f5640 10 monclient: monmap: 2026-02-22T23:25:47.929 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-22T23:25:47.930 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:47.930 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:25:47.929414+0000 2026-02-22T23:25:47.930 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:25:47.929414+0000 2026-02-22T23:25:47.930 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-22T23:25:47.930 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:47.930 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-22T23:25:47.930 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.noname-f 2026-02-22T23:25:47.930 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.noname-b 2026-02-22T23:25:47.930 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.noname-g 2026-02-22T23:25:47.930 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.noname-c 2026-02-22T23:25:47.930 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.noname-h 2026-02-22T23:25:47.930 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.noname-d 2026-02-22T23:25:47.930 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.noname-i 2026-02-22T23:25:47.930 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.noname-e 2026-02-22T23:25:47.930 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:47.930 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.929+0000 7f232ffca640 10 monclient: get_monmap_and_config 2026-02-22T23:25:47.930 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.929+0000 7f232ffca640 10 monclient: build_initial_monmap 2026-02-22T23:25:47.930 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.929+0000 7f232ffca640 10 monclient: monmap: 2026-02-22T23:25:47.930 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-22T23:25:47.930 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:47.930 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:25:47.929559+0000 2026-02-22T23:25:47.930 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:25:47.929559+0000 2026-02-22T23:25:47.930 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-22T23:25:47.930 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:47.930 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-22T23:25:47.930 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.noname-f 2026-02-22T23:25:47.930 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.noname-b 2026-02-22T23:25:47.930 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.noname-g 2026-02-22T23:25:47.930 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.noname-c 2026-02-22T23:25:47.931 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.noname-h 2026-02-22T23:25:47.931 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.noname-d 2026-02-22T23:25:47.931 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.noname-i 2026-02-22T23:25:47.931 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.noname-e 2026-02-22T23:25:47.931 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:47.931 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.929+0000 7f31b0f11640 1 Processor -- start 2026-02-22T23:25:47.931 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.929+0000 7fdc232f5640 1 Processor -- start 2026-02-22T23:25:47.931 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.929+0000 7fdc232f5640 1 -- start start 2026-02-22T23:25:47.931 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.929+0000 7fdc232f5640 10 monclient: init 2026-02-22T23:25:47.931 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.929+0000 7f31b0f11640 1 -- start start 2026-02-22T23:25:47.931 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.929+0000 7f31b0f11640 10 monclient: init 2026-02-22T23:25:47.931 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.929+0000 7f232ffca640 1 Processor -- start 2026-02-22T23:25:47.931 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.929+0000 7f232ffca640 1 -- start start 2026-02-22T23:25:47.931 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.929+0000 7f232ffca640 10 monclient: init 2026-02-22T23:25:47.932 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.929+0000 7fdc232f5640 10 monclient: _reopen_session rank -1 2026-02-22T23:25:47.932 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.929+0000 7fdc232f5640 10 monclient: _add_conns ranks=[2,1,8,4,7,6,0,3,5] 2026-02-22T23:25:47.932 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.929+0000 7fdc232f5640 10 monclient(hunting): picked mon.noname-b con 0x7fdc1c0a5e00 addr v1:10.20.193.45:6790/0 2026-02-22T23:25:47.932 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.929+0000 7fdc232f5640 10 monclient(hunting): picked mon.noname-f con 0x7fdc1c0a68f0 addr v1:10.20.193.73:6789/0 2026-02-22T23:25:47.932 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.929+0000 7fdc232f5640 10 monclient(hunting): picked mon.noname-e con 0x7fdc1c0a6d00 addr v1:10.20.193.45:6793/0 2026-02-22T23:25:47.932 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.929+0000 7fdc232f5640 1 -- --> v1:10.20.193.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdc1c0a2d00 con 0x7fdc1c0a68f0 2026-02-22T23:25:47.932 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.929+0000 7fdc232f5640 1 -- --> v1:10.20.193.45:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdc1c0a2fe0 con 0x7fdc1c0a5e00 2026-02-22T23:25:47.932 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.929+0000 7fdc232f5640 1 -- --> v1:10.20.193.45:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdc1c0a32c0 con 0x7fdc1c0a6d00 2026-02-22T23:25:47.932 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.929+0000 7fdc232f5640 10 monclient(hunting): _renew_subs 2026-02-22T23:25:47.932 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.929+0000 7fdc232f5640 10 monclient(hunting): authenticate will time out at 679.545989s 2026-02-22T23:25:47.932 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.930+0000 7f232ffca640 10 monclient: _reopen_session rank -1 2026-02-22T23:25:47.932 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.930+0000 7f232ffca640 10 monclient: _add_conns ranks=[3,0,6,7,5,2,8,4,1] 2026-02-22T23:25:47.932 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.930+0000 7f232ffca640 10 monclient(hunting): picked mon.noname-g con 0x7f23280a5e00 addr v1:10.20.193.73:6790/0 2026-02-22T23:25:47.933 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.930+0000 7f232ffca640 10 monclient(hunting): picked mon.noname-a con 0x7f23280a68f0 addr v1:10.20.193.45:6789/0 2026-02-22T23:25:47.933 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.930+0000 7f232ffca640 10 monclient(hunting): picked mon.noname-d con 0x7f23280a6d00 addr v1:10.20.193.45:6792/0 2026-02-22T23:25:47.933 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.930+0000 7f232ffca640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23280a2d00 con 0x7f23280a68f0 2026-02-22T23:25:47.933 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.930+0000 7f232ffca640 1 -- --> v1:10.20.193.73:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23280a2fe0 con 0x7f23280a5e00 2026-02-22T23:25:47.933 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.930+0000 7f232ffca640 1 -- --> v1:10.20.193.45:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23280a32c0 con 0x7f23280a6d00 2026-02-22T23:25:47.933 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.930+0000 7f232ffca640 10 monclient(hunting): _renew_subs 2026-02-22T23:25:47.933 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.930+0000 7f232ffca640 10 monclient(hunting): authenticate will time out at 679.546100s 2026-02-22T23:25:47.933 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.930+0000 7fdc2186b640 1 --1- >> v1:10.20.193.45:6793/0 conn(0x7fdc1c0a6d00 0x7fdc1c1417b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.45:6793/0 says I am v1:10.20.193.45:36792/0 (socket says 10.20.193.45:36792) 2026-02-22T23:25:47.933 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.930+0000 7f31b0f11640 10 monclient: _reopen_session rank -1 2026-02-22T23:25:47.933 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.930+0000 7f31b0f11640 10 monclient: _add_conns ranks=[6,0,4,5,1,2,8,3,7] 2026-02-22T23:25:47.933 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.930+0000 7f31b0f11640 10 monclient(hunting): picked mon.noname-d con 0x7f31ac0a4610 addr v1:10.20.193.45:6792/0 2026-02-22T23:25:47.933 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.930+0000 7fdc2106a640 1 --1- >> v1:10.20.193.45:6790/0 conn(0x7fdc1c0a5e00 0x7fdc1c0a61e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.45:6790/0 says I am v1:10.20.193.45:50954/0 (socket says 10.20.193.45:50954) 2026-02-22T23:25:47.933 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.930+0000 7fdc2186b640 1 -- 10.20.193.45:0/802021518 learned_addr learned my addr 10.20.193.45:0/802021518 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-22T23:25:47.933 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.930+0000 7f31b0f11640 10 monclient(hunting): picked mon.noname-a con 0x7f31ac0a5100 addr v1:10.20.193.45:6789/0 2026-02-22T23:25:47.933 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.930+0000 7f31b0f11640 10 monclient(hunting): picked mon.noname-c con 0x7f31ac0a3f10 addr v1:10.20.193.45:6791/0 2026-02-22T23:25:47.933 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.930+0000 7f31b0f11640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f31ac06f720 con 0x7f31ac0a5100 2026-02-22T23:25:47.933 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.930+0000 7f31b0f11640 1 -- --> v1:10.20.193.45:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f31ac0a7250 con 0x7f31ac0a3f10 2026-02-22T23:25:47.934 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.930+0000 7f31b0f11640 1 -- --> v1:10.20.193.45:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f31ac0a2c90 con 0x7f31ac0a4610 2026-02-22T23:25:47.934 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.930+0000 7f31b0f11640 10 monclient(hunting): _renew_subs 2026-02-22T23:25:47.934 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.930+0000 7f31b0f11640 10 monclient(hunting): authenticate will time out at 679.546159s 2026-02-22T23:25:47.934 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.930+0000 7f31aa575640 1 --1- >> v1:10.20.193.45:6792/0 conn(0x7f31ac0a4610 0x7f31ac0a49f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.45:6792/0 says I am v1:10.20.193.45:56890/0 (socket says 10.20.193.45:56890) 2026-02-22T23:25:47.934 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.930+0000 7f31aa575640 1 -- 10.20.193.45:0/3938033264 learned_addr learned my addr 10.20.193.45:0/3938033264 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-22T23:25:47.934 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.930+0000 7f31a9d74640 1 --1- 10.20.193.45:0/3938033264 >> v1:10.20.193.45:6789/0 conn(0x7f31ac0a5100 0x7f31ac13de70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.45:6789/0 says I am v1:10.20.193.45:58258/0 (socket says 10.20.193.45:58258) 2026-02-22T23:25:47.934 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.930+0000 7f232d53e640 1 --1- >> v1:10.20.193.45:6789/0 conn(0x7f23280a68f0 0x7f232813e080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.45:6789/0 says I am v1:10.20.193.45:58252/0 (socket says 10.20.193.45:58252) 2026-02-22T23:25:47.934 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.930+0000 7f232e540640 1 --1- >> v1:10.20.193.45:6792/0 conn(0x7f23280a6d00 0x7f23281417b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.45:6792/0 says I am v1:10.20.193.45:56884/0 (socket says 10.20.193.45:56884) 2026-02-22T23:25:47.934 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.930+0000 7f232d53e640 1 -- 10.20.193.45:0/417211156 learned_addr learned my addr 10.20.193.45:0/417211156 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-22T23:25:47.934 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.930+0000 7fdc0bfff640 1 -- 10.20.193.45:0/802021518 <== mon.8 v1:10.20.193.45:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4089244006 0 0) 0x7fdc1c0a32c0 con 0x7fdc1c0a6d00 2026-02-22T23:25:47.934 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.930+0000 7fdc0bfff640 10 monclient(hunting): _negotiate 2026-02-22T23:25:47.934 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.930+0000 7fdc0bfff640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:47.934 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.930+0000 7fdc0bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:47.934 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.930+0000 7fdc0bfff640 10 monclient(hunting): my global_id is 4364 2026-02-22T23:25:47.934 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.930+0000 7fdc0bfff640 1 -- 10.20.193.45:0/802021518 --> v1:10.20.193.45:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdc04003620 con 0x7fdc1c0a6d00 2026-02-22T23:25:47.934 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.930+0000 7fdc0bfff640 1 -- 10.20.193.45:0/802021518 <== mon.2 v1:10.20.193.45:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3420037204 0 0) 0x7fdc1c0a2fe0 con 0x7fdc1c0a5e00 2026-02-22T23:25:47.934 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.930+0000 7fdc0bfff640 10 monclient(hunting): _negotiate 2026-02-22T23:25:47.934 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.930+0000 7fdc0bfff640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:47.934 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.930+0000 7fdc0bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:47.934 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.930+0000 7fdc0bfff640 10 monclient(hunting): my global_id is 4376 2026-02-22T23:25:47.934 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.930+0000 7fdc0bfff640 1 -- 10.20.193.45:0/802021518 --> v1:10.20.193.45:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdc1c0a32c0 con 0x7fdc1c0a5e00 2026-02-22T23:25:47.935 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.930+0000 7f232cd3d640 1 -- 10.20.193.45:0/417211156 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1567623034 0 0) 0x7f23280a2d00 con 0x7f23280a68f0 2026-02-22T23:25:47.935 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.930+0000 7f232cd3d640 10 monclient(hunting): _negotiate 2026-02-22T23:25:47.935 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.930+0000 7f232cd3d640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:47.935 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.930+0000 7f31a9573640 1 -- 10.20.193.45:0/3938033264 <== mon.6 v1:10.20.193.45:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 289242604 0 0) 0x7f31ac0a2c90 con 0x7f31ac0a4610 2026-02-22T23:25:47.935 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.930+0000 7f31a9573640 10 monclient(hunting): _negotiate 2026-02-22T23:25:47.935 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.930+0000 7f31a9573640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:47.935 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.930+0000 7f31a9573640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:47.935 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.930+0000 7f232cd3d640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:47.935 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.930+0000 7f232cd3d640 10 monclient(hunting): my global_id is 4338 2026-02-22T23:25:47.935 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.930+0000 7f31a9573640 10 monclient(hunting): my global_id is 4344 2026-02-22T23:25:47.935 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.930+0000 7f232cd3d640 1 -- 10.20.193.45:0/417211156 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2310003620 con 0x7f23280a68f0 2026-02-22T23:25:47.935 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.930+0000 7f31a9573640 1 -- 10.20.193.45:0/3938033264 --> v1:10.20.193.45:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3198003620 con 0x7f31ac0a4610 2026-02-22T23:25:47.935 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.930+0000 7f232cd3d640 1 -- 10.20.193.45:0/417211156 <== mon.6 v1:10.20.193.45:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3227798945 0 0) 0x7f23280a32c0 con 0x7f23280a6d00 2026-02-22T23:25:47.935 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.930+0000 7f232cd3d640 10 monclient(hunting): _negotiate 2026-02-22T23:25:47.935 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.930+0000 7f232cd3d640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:47.936 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.930+0000 7f31a9573640 1 -- 10.20.193.45:0/3938033264 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 310170930 0 0) 0x7f31ac06f720 con 0x7f31ac0a5100 2026-02-22T23:25:47.936 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.930+0000 7f31a9573640 10 monclient(hunting): _negotiate 2026-02-22T23:25:47.936 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.930+0000 7f31a9573640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:47.936 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.930+0000 7f31a9573640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:47.936 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.930+0000 7f31a9573640 10 monclient(hunting): my global_id is 4347 2026-02-22T23:25:47.936 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.930+0000 7f232cd3d640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:47.936 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.930+0000 7f232cd3d640 10 monclient(hunting): my global_id is 4353 2026-02-22T23:25:47.936 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.930+0000 7f31a9573640 1 -- 10.20.193.45:0/3938033264 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f31ac0a2c90 con 0x7f31ac0a5100 2026-02-22T23:25:47.936 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.930+0000 7f31a9573640 1 -- 10.20.193.45:0/3938033264 <== mon.4 v1:10.20.193.45:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2993871701 0 0) 0x7f31ac0a7250 con 0x7f31ac0a3f10 2026-02-22T23:25:47.936 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.930+0000 7f232cd3d640 1 -- 10.20.193.45:0/417211156 --> v1:10.20.193.45:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f23280a2d00 con 0x7f23280a6d00 2026-02-22T23:25:47.936 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.930+0000 7f232cd3d640 1 -- 10.20.193.45:0/417211156 <== mon.3 v1:10.20.193.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2356256115 0 0) 0x7f23280a2fe0 con 0x7f23280a5e00 2026-02-22T23:25:47.936 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.930+0000 7f31a9573640 10 monclient(hunting): _negotiate 2026-02-22T23:25:47.936 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.930+0000 7f31a9573640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:47.936 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.930+0000 7f31a9573640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:47.936 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.930+0000 7f31a9573640 10 monclient(hunting): my global_id is 4351 2026-02-22T23:25:47.937 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.930+0000 7f232cd3d640 10 monclient(hunting): _negotiate 2026-02-22T23:25:47.937 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.930+0000 7f232cd3d640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:47.937 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.930+0000 7f232cd3d640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:47.937 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.930+0000 7f232cd3d640 10 monclient(hunting): my global_id is 4377 2026-02-22T23:25:47.937 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.930+0000 7f31a9573640 1 -- 10.20.193.45:0/3938033264 --> v1:10.20.193.45:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f31ac06f720 con 0x7f31ac0a3f10 2026-02-22T23:25:47.937 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.930+0000 7f232cd3d640 1 -- 10.20.193.45:0/417211156 --> v1:10.20.193.73:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f23280a32c0 con 0x7f23280a5e00 2026-02-22T23:25:47.937 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.930+0000 7fdc0bfff640 1 -- 10.20.193.45:0/802021518 <== mon.8 v1:10.20.193.45:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2871370471 0 0) 0x7fdc04003620 con 0x7fdc1c0a6d00 2026-02-22T23:25:47.937 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.930+0000 7fdc0bfff640 1 -- 10.20.193.45:0/802021518 >> v1:10.20.193.45:6790/0 conn(0x7fdc1c0a5e00 legacy=0x7fdc1c0a61e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:47.937 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.930+0000 7fdc0bfff640 1 -- 10.20.193.45:0/802021518 >> v1:10.20.193.73:6789/0 conn(0x7fdc1c0a68f0 legacy=0x7fdc1c13e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:47.937 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.930+0000 7fdc0bfff640 10 monclient: _finish_hunting 0 2026-02-22T23:25:47.937 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.930+0000 7fdc0bfff640 1 monclient: found mon.noname-e 2026-02-22T23:25:47.937 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.930+0000 7fdc0bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T23:25:47.938 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.930+0000 7fdc0bfff640 10 monclient: _send_mon_message to mon.noname-e at v1:10.20.193.45:6793/0 2026-02-22T23:25:47.938 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.930+0000 7fdc0bfff640 1 -- 10.20.193.45:0/802021518 --> v1:10.20.193.45:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc1c0a35a0 con 0x7fdc1c0a6d00 2026-02-22T23:25:47.938 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.930+0000 7fdc0bfff640 10 monclient: _finish_auth 0 2026-02-22T23:25:47.938 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.930+0000 7fdc0bfff640 10 monclient: _check_auth_tickets 2026-02-22T23:25:47.938 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.930+0000 7fdc0bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T23:25:47.938 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.930+0000 7fdc0bfff640 1 -- 10.20.193.45:0/802021518 <== mon.8 v1:10.20.193.45:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7fdc180033c0 con 0x7fdc1c0a6d00 2026-02-22T23:25:47.938 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.930+0000 7fdc0bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:25:47.938 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.930+0000 7fdc0bfff640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2026-02-22T23:25:47.938 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.930+0000 7f31a9573640 1 -- 10.20.193.45:0/3938033264 <== mon.6 v1:10.20.193.45:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3556927197 0 0) 0x7f3198003620 con 0x7f31ac0a4610 2026-02-22T23:25:47.938 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.930+0000 7fdc0bfff640 10 monclient: dump: 2026-02-22T23:25:47.938 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:47.938 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:47.938 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:47.938 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:47.938 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:47.938 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:47.938 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:47.938 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:47.938 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:47.938 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:47.938 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:47.938 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:47.938 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:47.938 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:47.939 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:47.939 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:47.939 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.930+0000 7f31a9573640 1 -- 10.20.193.45:0/3938033264 >> v1:10.20.193.45:6791/0 conn(0x7f31ac0a3f10 legacy=0x7f31ac1415a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:47.939 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.930+0000 7f31a9573640 1 -- 10.20.193.45:0/3938033264 >> v1:10.20.193.45:6789/0 conn(0x7f31ac0a5100 legacy=0x7f31ac13de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:47.939 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.930+0000 7f232cd3d640 1 -- 10.20.193.45:0/417211156 <== mon.0 v1:10.20.193.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2664696102 0 0) 0x7f2310003620 con 0x7f23280a68f0 2026-02-22T23:25:47.939 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.930+0000 7f232cd3d640 1 -- 10.20.193.45:0/417211156 >> v1:10.20.193.45:6792/0 conn(0x7f23280a6d00 legacy=0x7f23281417b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:47.939 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.930+0000 7f31a9573640 10 monclient: _finish_hunting 0 2026-02-22T23:25:47.939 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.930+0000 7f31a9573640 1 monclient: found mon.noname-d 2026-02-22T23:25:47.939 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.930+0000 7f31a9573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T23:25:47.939 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.930+0000 7f232cd3d640 1 -- 10.20.193.45:0/417211156 >> v1:10.20.193.73:6790/0 conn(0x7f23280a5e00 legacy=0x7f23280a61e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:47.939 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.930+0000 7f232cd3d640 10 monclient: _finish_hunting 0 2026-02-22T23:25:47.939 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.930+0000 7f232cd3d640 1 monclient: found mon.noname-a 2026-02-22T23:25:47.939 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.930+0000 7f31a9573640 10 monclient: _send_mon_message to mon.noname-d at v1:10.20.193.45:6792/0 2026-02-22T23:25:47.940 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.930+0000 7f31a9573640 1 -- 10.20.193.45:0/3938033264 --> v1:10.20.193.45:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31ac0a3250 con 0x7f31ac0a4610 2026-02-22T23:25:47.940 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.930+0000 7f31a9573640 10 monclient: _finish_auth 0 2026-02-22T23:25:47.940 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.930+0000 7f31a9573640 10 monclient: _check_auth_tickets 2026-02-22T23:25:47.940 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.930+0000 7f232cd3d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T23:25:47.940 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.930+0000 7f31a9573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T23:25:47.940 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.930+0000 7f31a9573640 1 -- 10.20.193.45:0/3938033264 <== mon.6 v1:10.20.193.45:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f31a0003040 con 0x7f31ac0a4610 2026-02-22T23:25:47.940 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.930+0000 7f31a9573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:25:47.940 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.930+0000 7f232cd3d640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.45:6789/0 2026-02-22T23:25:47.940 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.930+0000 7f232cd3d640 1 -- 10.20.193.45:0/417211156 --> v1:10.20.193.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23280a35a0 con 0x7f23280a68f0 2026-02-22T23:25:47.940 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.930+0000 7f232cd3d640 10 monclient: _finish_auth 0 2026-02-22T23:25:47.940 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.930+0000 7f232cd3d640 10 monclient: _check_auth_tickets 2026-02-22T23:25:47.940 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.930+0000 7f31a9573640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2026-02-22T23:25:47.940 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.930+0000 7f31a9573640 10 monclient: dump: 2026-02-22T23:25:47.940 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:47.940 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:47.940 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:47.941 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:47.941 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:47.941 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:47.941 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:47.941 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:47.941 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:47.941 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:47.941 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:47.941 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:47.941 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:47.941 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:47.941 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:47.941 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:47.941 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.930+0000 7f31b0f11640 5 monclient: authenticate success, global_id 4344 2026-02-22T23:25:47.941 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.930+0000 7f31b0f11640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-22T23:25:47.941 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.930+0000 7f232cd3d640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T23:25:47.941 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.930+0000 7f232cd3d640 1 -- 10.20.193.45:0/417211156 <== mon.0 v1:10.20.193.45:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f231c003040 con 0x7f23280a68f0 2026-02-22T23:25:47.941 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.930+0000 7f232cd3d640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:25:47.941 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.930+0000 7f232cd3d640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T23:25:47.941 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.930+0000 7f232cd3d640 10 monclient: dump: 2026-02-22T23:25:47.941 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:47.941 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:47.941 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:47.941 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:47.941 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:47.941 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:47.941 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:47.942 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:47.942 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:47.942 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:47.942 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:47.942 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:47.942 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:47.942 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:47.942 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:47.942 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:47.942 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.930+0000 7f232ffca640 5 monclient: authenticate success, global_id 4338 2026-02-22T23:25:47.942 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.930+0000 7f232ffca640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-22T23:25:47.942 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.930+0000 7fdc232f5640 5 monclient: authenticate success, global_id 4364 2026-02-22T23:25:47.942 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.930+0000 7fdc232f5640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-22T23:25:47.942 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.930+0000 7fdc0bfff640 1 -- 10.20.193.45:0/802021518 <== mon.8 v1:10.20.193.45:6793/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fdc180035e0 con 0x7fdc1c0a6d00 2026-02-22T23:25:47.942 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.930+0000 7fdc0bfff640 10 monclient: handle_config config(0 keys) 2026-02-22T23:25:47.942 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.930+0000 7fdc0bfff640 1 -- 10.20.193.45:0/802021518 <== mon.8 v1:10.20.193.45:6793/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7fdc18005060 con 0x7fdc1c0a6d00 2026-02-22T23:25:47.942 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.930+0000 7fdc0bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:25:47.942 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.930+0000 7f232cd3d640 1 -- 10.20.193.45:0/417211156 <== mon.0 v1:10.20.193.45:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f231c003260 con 0x7f23280a68f0 2026-02-22T23:25:47.942 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.930+0000 7f232cd3d640 10 monclient: handle_config config(0 keys) 2026-02-22T23:25:47.943 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.930+0000 7fdc0bfff640 10 monclient: got monmap 1 from mon.e (according to old e1) 2026-02-22T23:25:47.943 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.930+0000 7f232cd3d640 1 -- 10.20.193.45:0/417211156 <== mon.0 v1:10.20.193.45:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f231c004ce0 con 0x7f23280a68f0 2026-02-22T23:25:47.943 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.930+0000 7f232cd3d640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:25:47.943 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.930+0000 7fdc0bfff640 10 monclient: dump: 2026-02-22T23:25:47.943 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:47.943 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:47.943 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:47.943 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:47.943 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:47.943 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:47.943 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:47.943 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:47.943 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:47.943 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:47.943 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:47.943 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:47.943 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:47.943 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:47.943 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:47.943 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:47.943 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.930+0000 7fdc232f5640 10 monclient: get_monmap_and_config success 2026-02-22T23:25:47.944 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.930+0000 7f31a9573640 1 -- 10.20.193.45:0/3938033264 <== mon.6 v1:10.20.193.45:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f31a0003260 con 0x7f31ac0a4610 2026-02-22T23:25:47.944 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.930+0000 7f31a9573640 10 monclient: handle_config config(0 keys) 2026-02-22T23:25:47.944 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.930+0000 7f31a9573640 1 -- 10.20.193.45:0/3938033264 <== mon.6 v1:10.20.193.45:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f31a0004ce0 con 0x7f31ac0a4610 2026-02-22T23:25:47.944 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.930+0000 7f31b0f11640 10 monclient: get_monmap_and_config success 2026-02-22T23:25:47.944 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.930+0000 7f232cd3d640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T23:25:47.944 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.930+0000 7f232cd3d640 10 monclient: dump: 2026-02-22T23:25:47.944 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:47.944 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:47.944 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:47.944 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:47.944 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:47.944 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:47.944 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:47.944 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:47.944 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:47.944 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:47.944 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:47.944 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:47.944 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:47.944 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:47.944 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:47.944 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:47.944 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.930+0000 7f232ffca640 10 monclient: get_monmap_and_config success 2026-02-22T23:25:47.944 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.930+0000 7f232ffca640 4 set_mon_vals no callback set 2026-02-22T23:25:47.945 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.930+0000 7fdc232f5640 4 set_mon_vals no callback set 2026-02-22T23:25:47.945 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.930+0000 7f31b0f11640 4 set_mon_vals no callback set 2026-02-22T23:25:47.945 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.930+0000 7f31a9573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:25:47.945 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.930+0000 7f31a9573640 10 monclient: got monmap 1 from mon.d (according to old e1) 2026-02-22T23:25:47.945 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.930+0000 7f31a9573640 10 monclient: dump: 2026-02-22T23:25:47.945 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:47.945 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:47.945 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:47.945 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:47.945 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:47.945 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:47.945 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:47.945 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:47.945 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:47.945 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:47.945 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:47.945 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:47.945 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:47.945 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:47.945 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:47.945 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:47.946 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.930+0000 7f232ffca640 10 monclient: shutdown 2026-02-22T23:25:47.946 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.930+0000 7f232ffca640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T23:25:47.946 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.930+0000 7f232ffca640 1 -- 10.20.193.45:0/417211156 >> v1:10.20.193.45:6789/0 conn(0x7f23280a68f0 legacy=0x7f232813e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:47.946 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.930+0000 7f232ffca640 1 -- 10.20.193.45:0/417211156 shutdown_connections 2026-02-22T23:25:47.946 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.930+0000 7f232ffca640 1 -- 10.20.193.45:0/417211156 >> 10.20.193.45:0/417211156 conn(0x7f23280abb50 msgr2=0x7f23280a7f00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:25:47.946 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.930+0000 7fdc232f5640 10 monclient: shutdown 2026-02-22T23:25:47.946 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.930+0000 7fdc232f5640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T23:25:47.946 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.930+0000 7fdc232f5640 1 -- 10.20.193.45:0/802021518 >> v1:10.20.193.45:6793/0 conn(0x7fdc1c0a6d00 legacy=0x7fdc1c1417b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:47.946 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.930+0000 7f232ffca640 1 -- 10.20.193.45:0/417211156 shutdown_connections 2026-02-22T23:25:47.946 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.931+0000 7f232ffca640 1 -- 10.20.193.45:0/417211156 wait complete. 2026-02-22T23:25:47.946 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.931+0000 7fdc232f5640 1 -- 10.20.193.45:0/802021518 shutdown_connections 2026-02-22T23:25:47.946 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.931+0000 7fdc232f5640 1 -- 10.20.193.45:0/802021518 >> 10.20.193.45:0/802021518 conn(0x7fdc1c0abb50 msgr2=0x7fdc1c0a7f00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:25:47.947 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.931+0000 7fdc232f5640 1 -- 10.20.193.45:0/802021518 shutdown_connections 2026-02-22T23:25:47.947 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.931+0000 7f31b0f11640 10 monclient: shutdown 2026-02-22T23:25:47.947 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.931+0000 7fdc232f5640 1 -- 10.20.193.45:0/802021518 wait complete. 2026-02-22T23:25:47.947 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.931+0000 7f31b0f11640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T23:25:47.947 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.931+0000 7f31b0f11640 1 -- 10.20.193.45:0/3938033264 >> v1:10.20.193.45:6792/0 conn(0x7f31ac0a4610 legacy=0x7f31ac0a49f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:47.947 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.931+0000 7f31b0f11640 1 -- 10.20.193.45:0/3938033264 shutdown_connections 2026-02-22T23:25:47.947 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.931+0000 7f31b0f11640 1 -- 10.20.193.45:0/3938033264 >> 10.20.193.45:0/3938033264 conn(0x7f31ac0a7f70 msgr2=0x7f31ac0a8380 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:25:47.947 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.931+0000 7f31b0f11640 1 -- 10.20.193.45:0/3938033264 shutdown_connections 2026-02-22T23:25:47.947 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.931+0000 7f31b0f11640 1 -- 10.20.193.45:0/3938033264 wait complete. 2026-02-22T23:25:47.947 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.931+0000 7f232ffca640 10 monclient: build_initial_monmap 2026-02-22T23:25:47.947 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.931+0000 7f232ffca640 10 monclient: monmap: 2026-02-22T23:25:47.948 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-22T23:25:47.948 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T23:25:47.948 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-22T23:25:47.948 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-22T23:25:47.948 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-22T23:25:47.948 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-22T23:25:47.948 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-22T23:25:47.948 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.noname-f 2026-02-22T23:25:47.948 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.noname-b 2026-02-22T23:25:47.948 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.noname-g 2026-02-22T23:25:47.948 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.noname-c 2026-02-22T23:25:47.948 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.noname-h 2026-02-22T23:25:47.948 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.noname-d 2026-02-22T23:25:47.948 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.noname-i 2026-02-22T23:25:47.948 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.noname-e 2026-02-22T23:25:47.948 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:47.948 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.931+0000 7fdc232f5640 10 monclient: build_initial_monmap 2026-02-22T23:25:47.948 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.931+0000 7f31b0f11640 10 monclient: build_initial_monmap 2026-02-22T23:25:47.948 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.931+0000 7fdc232f5640 10 monclient: monmap: 2026-02-22T23:25:47.948 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-22T23:25:47.948 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T23:25:47.949 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-22T23:25:47.949 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-22T23:25:47.949 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-22T23:25:47.949 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-22T23:25:47.949 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-22T23:25:47.949 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.noname-f 2026-02-22T23:25:47.949 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.noname-b 2026-02-22T23:25:47.949 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.noname-g 2026-02-22T23:25:47.949 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.noname-c 2026-02-22T23:25:47.949 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.noname-h 2026-02-22T23:25:47.949 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.noname-d 2026-02-22T23:25:47.949 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.noname-i 2026-02-22T23:25:47.949 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.noname-e 2026-02-22T23:25:47.949 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:47.949 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.931+0000 7f31b0f11640 10 monclient: monmap: 2026-02-22T23:25:47.949 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-22T23:25:47.949 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T23:25:47.949 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-22T23:25:47.949 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-22T23:25:47.949 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-22T23:25:47.949 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-22T23:25:47.949 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-22T23:25:47.949 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.noname-f 2026-02-22T23:25:47.949 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.noname-b 2026-02-22T23:25:47.949 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.noname-g 2026-02-22T23:25:47.949 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.noname-c 2026-02-22T23:25:47.949 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.noname-h 2026-02-22T23:25:47.950 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.noname-d 2026-02-22T23:25:47.950 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.noname-i 2026-02-22T23:25:47.950 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.noname-e 2026-02-22T23:25:47.950 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:47.950 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.931+0000 7f232ffca640 1 Processor -- start 2026-02-22T23:25:47.950 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.931+0000 7f232ffca640 1 -- start start 2026-02-22T23:25:47.950 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.931+0000 7f232ffca640 10 monclient: init 2026-02-22T23:25:47.950 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.931+0000 7f31b0f11640 1 Processor -- start 2026-02-22T23:25:47.950 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.931+0000 7fdc232f5640 1 Processor -- start 2026-02-22T23:25:47.950 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.931+0000 7f31b0f11640 1 -- start start 2026-02-22T23:25:47.950 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.931+0000 7f31b0f11640 10 monclient: init 2026-02-22T23:25:47.950 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.931+0000 7fdc232f5640 1 -- start start 2026-02-22T23:25:47.950 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.931+0000 7fdc232f5640 10 monclient: init 2026-02-22T23:25:47.951 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.931+0000 7f232ffca640 10 monclient: _reopen_session rank -1 2026-02-22T23:25:47.951 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.931+0000 7f232ffca640 10 monclient: _add_conns ranks=[1,4,2,8,7,5,0,6,3] 2026-02-22T23:25:47.951 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.931+0000 7f232ffca640 10 monclient(hunting): picked mon.noname-f con 0x7f23280a5e00 addr v1:10.20.193.73:6789/0 2026-02-22T23:25:47.951 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.931+0000 7f232ffca640 10 monclient(hunting): picked mon.noname-c con 0x7f23280a68f0 addr v1:10.20.193.45:6791/0 2026-02-22T23:25:47.951 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.931+0000 7f232ffca640 10 monclient(hunting): picked mon.noname-b con 0x7f23280a6d00 addr v1:10.20.193.45:6790/0 2026-02-22T23:25:47.951 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.931+0000 7f232ffca640 1 -- --> v1:10.20.193.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2328129010 con 0x7f23280a5e00 2026-02-22T23:25:47.951 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.931+0000 7f232ffca640 1 -- --> v1:10.20.193.45:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23280aa060 con 0x7f23280a6d00 2026-02-22T23:25:47.951 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.931+0000 7f232ffca640 1 -- --> v1:10.20.193.45:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2328128d30 con 0x7f23280a68f0 2026-02-22T23:25:47.951 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.931+0000 7f232ffca640 10 monclient(hunting): _renew_subs 2026-02-22T23:25:47.951 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.931+0000 7f232ffca640 10 monclient(hunting): authenticate will time out at 679.547978s 2026-02-22T23:25:47.951 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.932+0000 7f232d53e640 1 --1- >> v1:10.20.193.45:6791/0 conn(0x7f23280a68f0 0x7f23281d4580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.45:6791/0 says I am v1:10.20.193.45:37962/0 (socket says 10.20.193.45:37962) 2026-02-22T23:25:47.951 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.932+0000 7f232d53e640 1 -- 10.20.193.45:0/327049672 learned_addr learned my addr 10.20.193.45:0/327049672 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-22T23:25:47.952 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.932+0000 7f31b0f11640 10 monclient: _reopen_session rank -1 2026-02-22T23:25:47.952 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.932+0000 7f31b0f11640 10 monclient: _add_conns ranks=[5,6,3,0,4,8,1,2,7] 2026-02-22T23:25:47.952 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.932+0000 7f31b0f11640 10 monclient(hunting): picked mon.noname-h con 0x7f31ac0a3f10 addr v1:10.20.193.73:6791/0 2026-02-22T23:25:47.952 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.932+0000 7f31b0f11640 10 monclient(hunting): picked mon.noname-d con 0x7f31ac0a4610 addr v1:10.20.193.45:6792/0 2026-02-22T23:25:47.952 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.932+0000 7f31b0f11640 10 monclient(hunting): picked mon.noname-g con 0x7f31ac0a5100 addr v1:10.20.193.73:6790/0 2026-02-22T23:25:47.952 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.932+0000 7f31b0f11640 1 -- --> v1:10.20.193.73:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f31ac121ac0 con 0x7f31ac0a5100 2026-02-22T23:25:47.952 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.932+0000 7f31b0f11640 1 -- --> v1:10.20.193.73:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f31ac122c50 con 0x7f31ac0a3f10 2026-02-22T23:25:47.952 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.932+0000 7f31b0f11640 1 -- --> v1:10.20.193.45:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f31ac140250 con 0x7f31ac0a4610 2026-02-22T23:25:47.952 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.932+0000 7f31b0f11640 10 monclient(hunting): _renew_subs 2026-02-22T23:25:47.952 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.932+0000 7f31b0f11640 10 monclient(hunting): authenticate will time out at 679.548125s 2026-02-22T23:25:47.952 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.932+0000 7f23167fc640 1 -- 10.20.193.45:0/327049672 <== mon.4 v1:10.20.193.45:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3328142940 0 0) 0x7f2328128d30 con 0x7f23280a68f0 2026-02-22T23:25:47.952 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.932+0000 7f23167fc640 10 monclient(hunting): _negotiate 2026-02-22T23:25:47.952 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.932+0000 7fdc232f5640 10 monclient: _reopen_session rank -1 2026-02-22T23:25:47.952 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.932+0000 7f23167fc640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:47.952 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.932+0000 7f23167fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:47.952 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.932+0000 7f23167fc640 10 monclient(hunting): my global_id is 4360 2026-02-22T23:25:47.953 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.932+0000 7fdc232f5640 10 monclient: _add_conns ranks=[5,1,2,6,7,8,0,4,3] 2026-02-22T23:25:47.953 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.932+0000 7f23167fc640 1 -- 10.20.193.45:0/327049672 --> v1:10.20.193.45:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f22f8003620 con 0x7f23280a68f0 2026-02-22T23:25:47.953 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.932+0000 7f23167fc640 1 -- 10.20.193.45:0/327049672 <== mon.2 v1:10.20.193.45:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2658304686 0 0) 0x7f23280aa060 con 0x7f23280a6d00 2026-02-22T23:25:47.953 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.932+0000 7f31a9d74640 1 --1- >> v1:10.20.193.45:6792/0 conn(0x7f31ac0a4610 0x7f31ac13fb40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.45:6792/0 says I am v1:10.20.193.45:56904/0 (socket says 10.20.193.45:56904) 2026-02-22T23:25:47.953 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.932+0000 7f23167fc640 10 monclient(hunting): _negotiate 2026-02-22T23:25:47.953 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.932+0000 7f23167fc640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:47.953 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.932+0000 7f23167fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:47.953 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.932+0000 7fdc232f5640 10 monclient(hunting): picked mon.noname-h con 0x7fdc1c0a5e00 addr v1:10.20.193.73:6791/0 2026-02-22T23:25:47.953 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.932+0000 7f31a9d74640 1 -- 10.20.193.45:0/2083576879 learned_addr learned my addr 10.20.193.45:0/2083576879 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-22T23:25:47.954 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.932+0000 7f23167fc640 10 monclient(hunting): my global_id is 4385 2026-02-22T23:25:47.954 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.932+0000 7f23167fc640 1 -- 10.20.193.45:0/327049672 --> v1:10.20.193.45:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2328128d30 con 0x7f23280a6d00 2026-02-22T23:25:47.954 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.932+0000 7fdc232f5640 10 monclient(hunting): picked mon.noname-f con 0x7fdc1c0a68f0 addr v1:10.20.193.73:6789/0 2026-02-22T23:25:47.954 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.932+0000 7fdc232f5640 10 monclient(hunting): picked mon.noname-b con 0x7fdc1c0a6d00 addr v1:10.20.193.45:6790/0 2026-02-22T23:25:47.954 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.932+0000 7fdc232f5640 1 -- --> v1:10.20.193.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdc1c121a50 con 0x7fdc1c0a68f0 2026-02-22T23:25:47.954 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.932+0000 7fdc232f5640 1 -- --> v1:10.20.193.45:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdc1c121fa0 con 0x7fdc1c0a6d00 2026-02-22T23:25:47.954 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.932+0000 7fdc232f5640 1 -- --> v1:10.20.193.73:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdc1c122bc0 con 0x7fdc1c0a5e00 2026-02-22T23:25:47.954 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.932+0000 7fdc232f5640 10 monclient(hunting): _renew_subs 2026-02-22T23:25:47.954 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.932+0000 7fdc232f5640 10 monclient(hunting): authenticate will time out at 679.548263s 2026-02-22T23:25:47.954 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.932+0000 7fdc2186b640 1 --1- >> v1:10.20.193.45:6790/0 conn(0x7fdc1c0a6d00 0x7fdc1c1d8830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.45:6790/0 says I am v1:10.20.193.45:50978/0 (socket says 10.20.193.45:50978) 2026-02-22T23:25:47.954 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.932+0000 7fdc2186b640 1 -- 10.20.193.45:0/4256543904 learned_addr learned my addr 10.20.193.45:0/4256543904 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-22T23:25:47.954 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.932+0000 7f23167fc640 1 -- 10.20.193.45:0/327049672 <== mon.1 v1:10.20.193.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2954272027 0 0) 0x7f2328129010 con 0x7f23280a5e00 2026-02-22T23:25:47.955 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.932+0000 7f23167fc640 10 monclient(hunting): _negotiate 2026-02-22T23:25:47.955 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.932+0000 7f23167fc640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:47.955 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.932+0000 7f23167fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:47.955 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.932+0000 7f23167fc640 10 monclient(hunting): my global_id is 4429 2026-02-22T23:25:47.955 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.932+0000 7f3192ffd640 1 -- 10.20.193.45:0/2083576879 <== mon.6 v1:10.20.193.45:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 631515814 0 0) 0x7f31ac140250 con 0x7f31ac0a4610 2026-02-22T23:25:47.955 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.932+0000 7f3192ffd640 10 monclient(hunting): _negotiate 2026-02-22T23:25:47.955 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.932+0000 7f3192ffd640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:47.955 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.932+0000 7f23167fc640 1 -- 10.20.193.45:0/327049672 --> v1:10.20.193.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f23280aa060 con 0x7f23280a5e00 2026-02-22T23:25:47.955 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.932+0000 7f23167fc640 1 -- 10.20.193.45:0/327049672 <== mon.2 v1:10.20.193.45:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 859895965 0 0) 0x7f2328128d30 con 0x7f23280a6d00 2026-02-22T23:25:47.955 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.932+0000 7f3192ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:47.955 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.932+0000 7f3192ffd640 10 monclient(hunting): my global_id is 4362 2026-02-22T23:25:47.955 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.932+0000 7f23167fc640 1 -- 10.20.193.45:0/327049672 --> v1:10.20.193.45:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2328129010 con 0x7f23280a6d00 2026-02-22T23:25:47.955 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.932+0000 7f23167fc640 1 -- 10.20.193.45:0/327049672 <== mon.4 v1:10.20.193.45:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3925088729 0 0) 0x7f22f8003620 con 0x7f23280a68f0 2026-02-22T23:25:47.955 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.932+0000 7f3192ffd640 1 -- 10.20.193.45:0/2083576879 --> v1:10.20.193.45:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3178003620 con 0x7f31ac0a4610 2026-02-22T23:25:47.956 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.932+0000 7f23167fc640 1 -- 10.20.193.45:0/327049672 --> v1:10.20.193.45:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2328128d30 con 0x7f23280a68f0 2026-02-22T23:25:47.956 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.932+0000 7f23167fc640 1 -- 10.20.193.45:0/327049672 <== mon.2 v1:10.20.193.45:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f2324003660 con 0x7f23280a6d00 2026-02-22T23:25:47.956 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.932+0000 7f23167fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-22T23:25:47.956 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.932+0000 7f23167fc640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-22T23:25:47.956 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.932+0000 7f23167fc640 10 monclient(hunting): dump: 2026-02-22T23:25:47.956 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:47.956 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:47.956 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:47.956 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:47.956 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:47.956 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:47.956 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:47.956 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:47.956 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:47.956 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:47.956 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:47.956 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:47.956 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:47.956 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:47.956 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:47.956 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:47.956 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.932+0000 7f23167fc640 10 monclient(hunting): _finish_auth 0 2026-02-22T23:25:47.957 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.932+0000 7f23167fc640 1 -- 10.20.193.45:0/327049672 <== mon.4 v1:10.20.193.45:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f231c004c20 con 0x7f23280a68f0 2026-02-22T23:25:47.957 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.932+0000 7f23167fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-22T23:25:47.957 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.932+0000 7f23167fc640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-22T23:25:47.957 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.932+0000 7f23167fc640 10 monclient(hunting): dump: 2026-02-22T23:25:47.957 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:47.957 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:47.957 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:47.957 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:47.957 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:47.957 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:47.957 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:47.957 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:47.957 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:47.957 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:47.957 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:47.957 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:47.957 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:47.957 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:47.957 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:47.957 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:47.957 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.932+0000 7f3192ffd640 1 -- 10.20.193.45:0/2083576879 <== mon.5 v1:10.20.193.73:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1164835311 0 0) 0x7f31ac122c50 con 0x7f31ac0a3f10 2026-02-22T23:25:47.957 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.932+0000 7f3192ffd640 10 monclient(hunting): _negotiate 2026-02-22T23:25:47.957 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.932+0000 7f3192ffd640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:47.957 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.932+0000 7f3192ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:47.957 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.932+0000 7f3192ffd640 10 monclient(hunting): my global_id is 4370 2026-02-22T23:25:47.958 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.932+0000 7f3192ffd640 1 -- 10.20.193.45:0/2083576879 --> v1:10.20.193.73:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f31ac140250 con 0x7f31ac0a3f10 2026-02-22T23:25:47.958 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.932+0000 7fdc09ffb640 1 -- 10.20.193.45:0/4256543904 <== mon.2 v1:10.20.193.45:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1797348019 0 0) 0x7fdc1c121fa0 con 0x7fdc1c0a6d00 2026-02-22T23:25:47.958 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.932+0000 7fdc09ffb640 10 monclient(hunting): _negotiate 2026-02-22T23:25:47.958 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.932+0000 7fdc09ffb640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:47.958 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.932+0000 7fdc09ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:47.958 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.932+0000 7fdc09ffb640 10 monclient(hunting): my global_id is 4394 2026-02-22T23:25:47.958 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.932+0000 7fdc09ffb640 1 -- 10.20.193.45:0/4256543904 --> v1:10.20.193.45:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdbec003620 con 0x7fdc1c0a6d00 2026-02-22T23:25:47.958 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.932+0000 7f23167fc640 1 -- 10.20.193.45:0/327049672 <== mon.1 v1:10.20.193.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3567785989 0 0) 0x7f23280aa060 con 0x7f23280a5e00 2026-02-22T23:25:47.958 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.932+0000 7f23167fc640 1 -- 10.20.193.45:0/327049672 --> v1:10.20.193.73:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f22f8003620 con 0x7f23280a5e00 2026-02-22T23:25:47.958 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.932+0000 7f23167fc640 1 -- 10.20.193.45:0/327049672 <== mon.4 v1:10.20.193.45:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 310662800 0 0) 0x7f2328128d30 con 0x7f23280a68f0 2026-02-22T23:25:47.958 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.932+0000 7f23167fc640 1 -- 10.20.193.45:0/327049672 >> v1:10.20.193.45:6790/0 conn(0x7f23280a6d00 legacy=0x7f23281d7cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:47.958 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.932+0000 7f23167fc640 1 -- 10.20.193.45:0/327049672 >> v1:10.20.193.73:6789/0 conn(0x7f23280a5e00 legacy=0x7f23281416b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:47.958 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.932+0000 7f23167fc640 10 monclient: _finish_hunting 0 2026-02-22T23:25:47.958 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.932+0000 7f23167fc640 1 monclient: found mon.c 2026-02-22T23:25:47.958 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.932+0000 7f23167fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T23:25:47.959 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.932+0000 7f23167fc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.45:6791/0 2026-02-22T23:25:47.959 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.932+0000 7f23167fc640 1 -- 10.20.193.45:0/327049672 --> v1:10.20.193.45:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2328141dc0 con 0x7f23280a68f0 2026-02-22T23:25:47.959 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.932+0000 7f23167fc640 10 monclient: _finish_auth 0 2026-02-22T23:25:47.959 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.932+0000 7f23167fc640 10 monclient: _check_auth_tickets 2026-02-22T23:25:47.959 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.932+0000 7f23167fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T23:25:47.959 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.932+0000 7f232ffca640 5 monclient: authenticate success, global_id 4360 2026-02-22T23:25:47.959 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.932+0000 7f232ffca640 10 monclient: _renew_subs 2026-02-22T23:25:47.959 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.932+0000 7f232ffca640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.45:6791/0 2026-02-22T23:25:47.959 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.932+0000 7f232ffca640 1 -- 10.20.193.45:0/327049672 --> v1:10.20.193.45:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f2328127aa0 con 0x7f23280a68f0 2026-02-22T23:25:47.959 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.932+0000 7f3192ffd640 1 -- 10.20.193.45:0/2083576879 <== mon.6 v1:10.20.193.45:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3930546200 0 0) 0x7f3178003620 con 0x7f31ac0a4610 2026-02-22T23:25:47.959 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.932+0000 7fdc09ffb640 1 -- 10.20.193.45:0/4256543904 <== mon.1 v1:10.20.193.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2273873114 0 0) 0x7fdc1c121a50 con 0x7fdc1c0a68f0 2026-02-22T23:25:47.959 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.932+0000 7fdc09ffb640 10 monclient(hunting): _negotiate 2026-02-22T23:25:47.959 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.932+0000 7fdc09ffb640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:47.959 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.932+0000 7fdc09ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:47.959 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.932+0000 7f3192ffd640 1 -- 10.20.193.45:0/2083576879 --> v1:10.20.193.45:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f31ac122c50 con 0x7f31ac0a4610 2026-02-22T23:25:47.959 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.932+0000 7fdc09ffb640 10 monclient(hunting): my global_id is 4438 2026-02-22T23:25:47.959 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.932+0000 7fdc09ffb640 1 -- 10.20.193.45:0/4256543904 --> v1:10.20.193.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdc1c121fa0 con 0x7fdc1c0a68f0 2026-02-22T23:25:47.960 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.932+0000 7f3192ffd640 1 -- 10.20.193.45:0/2083576879 <== mon.6 v1:10.20.193.45:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f3194003320 con 0x7f31ac0a4610 2026-02-22T23:25:47.960 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.932+0000 7f3192ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-22T23:25:47.960 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.932+0000 7f3192ffd640 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2026-02-22T23:25:47.960 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.932+0000 7f3192ffd640 10 monclient(hunting): dump: 2026-02-22T23:25:47.960 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:47.960 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:47.960 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:47.960 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:47.960 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:47.960 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:47.960 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:47.960 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:47.960 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:47.960 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:47.960 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:47.960 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:47.960 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:47.960 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:47.960 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:47.960 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:47.960 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.932+0000 7f3192ffd640 10 monclient(hunting): _finish_auth 0 2026-02-22T23:25:47.961 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.932+0000 7f232ffca640 10 monclient: _renew_subs 2026-02-22T23:25:47.961 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.932+0000 7f232ffca640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.45:6791/0 2026-02-22T23:25:47.961 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.932+0000 7f232ffca640 1 -- 10.20.193.45:0/327049672 --> v1:10.20.193.45:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7f23281cf3e0 con 0x7f23280a68f0 2026-02-22T23:25:47.961 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.932+0000 7f23167fc640 1 -- 10.20.193.45:0/327049672 <== mon.4 v1:10.20.193.45:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f231c004fa0 con 0x7f23280a68f0 2026-02-22T23:25:47.961 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.932+0000 7f23167fc640 10 monclient: handle_config config(0 keys) 2026-02-22T23:25:47.961 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.932+0000 7fdc09ffb640 1 -- 10.20.193.45:0/4256543904 <== mon.5 v1:10.20.193.73:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 684211028 0 0) 0x7fdc1c122bc0 con 0x7fdc1c0a5e00 2026-02-22T23:25:47.961 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.932+0000 7fdc09ffb640 10 monclient(hunting): _negotiate 2026-02-22T23:25:47.961 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.932+0000 7fdc09ffb640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:47.961 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.932+0000 7f23167fc640 1 -- 10.20.193.45:0/327049672 <== mon.4 v1:10.20.193.45:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f231c005490 con 0x7f23280a68f0 2026-02-22T23:25:47.961 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.932+0000 7f23167fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:25:47.961 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.932+0000 7f23167fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T23:25:47.961 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.932+0000 7fdc09ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:47.961 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.932+0000 7fdc09ffb640 10 monclient(hunting): my global_id is 4379 2026-02-22T23:25:47.961 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.932+0000 7fdc09ffb640 1 -- 10.20.193.45:0/4256543904 --> v1:10.20.193.73:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdc1c121a50 con 0x7fdc1c0a5e00 2026-02-22T23:25:47.962 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.932+0000 7f2317fff640 4 set_mon_vals no callback set 2026-02-22T23:25:47.962 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.932+0000 7f23167fc640 10 monclient: dump: 2026-02-22T23:25:47.962 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:47.962 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:47.962 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:47.962 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:47.962 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:47.962 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:47.962 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:47.962 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:47.962 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:47.962 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:47.962 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:47.962 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:47.962 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:47.962 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:47.962 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:47.962 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:47.963 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.932+0000 7f3192ffd640 1 -- 10.20.193.45:0/2083576879 <== mon.5 v1:10.20.193.73:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1480072713 0 0) 0x7f31ac140250 con 0x7f31ac0a3f10 2026-02-22T23:25:47.963 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.932+0000 7f3192ffd640 1 -- 10.20.193.45:0/2083576879 --> v1:10.20.193.73:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3178003620 con 0x7f31ac0a3f10 2026-02-22T23:25:47.963 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.932+0000 7f3192ffd640 1 -- 10.20.193.45:0/2083576879 <== mon.5 v1:10.20.193.73:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f31a0004c20 con 0x7f31ac0a3f10 2026-02-22T23:25:47.963 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.932+0000 7f3192ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-22T23:25:47.963 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.932+0000 7f3192ffd640 10 monclient(hunting): got monmap 1 from mon.h (according to old e1) 2026-02-22T23:25:47.963 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.932+0000 7f3192ffd640 10 monclient(hunting): dump: 2026-02-22T23:25:47.963 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:47.963 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:47.963 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:47.963 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:47.963 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:47.963 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:47.963 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:47.963 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:47.963 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:47.963 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:47.963 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:47.963 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:47.963 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:47.963 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:47.963 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:47.963 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:47.963 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.932+0000 7f3192ffd640 1 -- 10.20.193.45:0/2083576879 <== mon.6 v1:10.20.193.45:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 325878592 0 0) 0x7f31ac122c50 con 0x7f31ac0a4610 2026-02-22T23:25:47.963 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.932+0000 7f3192ffd640 1 -- 10.20.193.45:0/2083576879 >> v1:10.20.193.73:6791/0 conn(0x7f31ac0a3f10 legacy=0x7f31ac13f430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:47.963 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.932+0000 7f3192ffd640 1 -- 10.20.193.45:0/2083576879 >> v1:10.20.193.73:6790/0 conn(0x7f31ac0a5100 legacy=0x7f31ac1d7d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:47.963 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.932+0000 7f3192ffd640 10 monclient: _finish_hunting 0 2026-02-22T23:25:47.963 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.932+0000 7f3192ffd640 1 monclient: found mon.d 2026-02-22T23:25:47.963 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.932+0000 7f3192ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T23:25:47.964 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.932+0000 7f3192ffd640 10 monclient: _send_mon_message to mon.d at v1:10.20.193.45:6792/0 2026-02-22T23:25:47.964 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.932+0000 7f3192ffd640 1 -- 10.20.193.45:0/2083576879 --> v1:10.20.193.45:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31ac0a17f0 con 0x7f31ac0a4610 2026-02-22T23:25:47.964 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.932+0000 7f3192ffd640 10 monclient: _finish_auth 0 2026-02-22T23:25:47.964 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.932+0000 7f3192ffd640 10 monclient: _check_auth_tickets 2026-02-22T23:25:47.964 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.932+0000 7f3192ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T23:25:47.964 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.932+0000 7f31b0f11640 5 monclient: authenticate success, global_id 4362 2026-02-22T23:25:47.964 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.932+0000 7f31b0f11640 10 monclient: _renew_subs 2026-02-22T23:25:47.964 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.932+0000 7f31b0f11640 10 monclient: _send_mon_message to mon.d at v1:10.20.193.45:6792/0 2026-02-22T23:25:47.964 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.932+0000 7f31b0f11640 1 -- 10.20.193.45:0/2083576879 --> v1:10.20.193.45:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f31ac06e5c0 con 0x7f31ac0a4610 2026-02-22T23:25:47.964 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.932+0000 7fdc09ffb640 1 -- 10.20.193.45:0/4256543904 <== mon.1 v1:10.20.193.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 282092369 0 0) 0x7fdc1c121fa0 con 0x7fdc1c0a68f0 2026-02-22T23:25:47.964 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.932+0000 7fdc09ffb640 1 -- 10.20.193.45:0/4256543904 --> v1:10.20.193.73:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fdc1c122bc0 con 0x7fdc1c0a68f0 2026-02-22T23:25:47.964 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.932+0000 7fdc09ffb640 1 -- 10.20.193.45:0/4256543904 <== mon.1 v1:10.20.193.73:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7fdc10003250 con 0x7fdc1c0a68f0 2026-02-22T23:25:47.964 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.932+0000 7fdc09ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-22T23:25:47.964 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.932+0000 7fdc09ffb640 10 monclient(hunting): got monmap 1 from mon.noname-f (according to old e1) 2026-02-22T23:25:47.964 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.932+0000 7fdc09ffb640 10 monclient(hunting): dump: 2026-02-22T23:25:47.964 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:47.964 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:47.964 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:47.964 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:47.964 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:47.964 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:47.964 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:47.964 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:47.964 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:47.964 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:47.965 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:47.965 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:47.965 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:47.965 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:47.965 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:47.965 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:47.965 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.932+0000 7fdc09ffb640 10 monclient(hunting): _finish_auth 0 2026-02-22T23:25:47.965 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.932+0000 7f3192ffd640 1 -- 10.20.193.45:0/2083576879 <== mon.6 v1:10.20.193.45:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3194004b90 con 0x7f31ac0a4610 2026-02-22T23:25:47.965 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.932+0000 7f31b0f11640 10 monclient: _renew_subs 2026-02-22T23:25:47.965 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.932+0000 7f31b0f11640 10 monclient: _send_mon_message to mon.d at v1:10.20.193.45:6792/0 2026-02-22T23:25:47.965 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.932+0000 7f31b0f11640 1 -- 10.20.193.45:0/2083576879 --> v1:10.20.193.45:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7f31ac122970 con 0x7f31ac0a4610 2026-02-22T23:25:47.965 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.932+0000 7fdc09ffb640 1 -- 10.20.193.45:0/4256543904 <== mon.5 v1:10.20.193.73:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1657976924 0 0) 0x7fdc1c121a50 con 0x7fdc1c0a5e00 2026-02-22T23:25:47.966 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.932+0000 7fdc09ffb640 1 -- 10.20.193.45:0/4256543904 --> v1:10.20.193.73:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fdc1c121fa0 con 0x7fdc1c0a5e00 2026-02-22T23:25:47.966 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.932+0000 7fdc09ffb640 1 -- 10.20.193.45:0/4256543904 <== mon.5 v1:10.20.193.73:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7fdc0c003180 con 0x7fdc1c0a5e00 2026-02-22T23:25:47.966 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.932+0000 7fdc09ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-22T23:25:47.966 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.932+0000 7fdc09ffb640 10 monclient(hunting): got monmap 1 from mon.h (according to old e1) 2026-02-22T23:25:47.966 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.932+0000 7fdc09ffb640 10 monclient(hunting): dump: 2026-02-22T23:25:47.966 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:47.966 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:47.966 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:47.966 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:47.966 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:47.966 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:47.966 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:47.966 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:47.966 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:47.966 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:47.966 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:47.966 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:47.966 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:47.966 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:47.966 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:47.966 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:47.966 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.932+0000 7fdc09ffb640 1 -- 10.20.193.45:0/4256543904 <== mon.1 v1:10.20.193.73:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3787922661 0 0) 0x7fdc1c122bc0 con 0x7fdc1c0a68f0 2026-02-22T23:25:47.966 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.932+0000 7fdc09ffb640 1 -- 10.20.193.45:0/4256543904 >> v1:10.20.193.73:6791/0 conn(0x7fdc1c0a5e00 legacy=0x7fdc1c1d00f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:47.966 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.932+0000 7fdc09ffb640 1 -- 10.20.193.45:0/4256543904 >> v1:10.20.193.45:6790/0 conn(0x7fdc1c0a6d00 legacy=0x7fdc1c1d8830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:47.966 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.932+0000 7fdc09ffb640 10 monclient: _finish_hunting 0 2026-02-22T23:25:47.966 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.932+0000 7fdc09ffb640 1 monclient: found mon.f 2026-02-22T23:25:47.966 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.932+0000 7fdc09ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T23:25:47.966 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.932+0000 7fdc09ffb640 10 monclient: _send_mon_message to mon.f at v1:10.20.193.73:6789/0 2026-02-22T23:25:47.966 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.932+0000 7fdc09ffb640 1 -- 10.20.193.45:0/4256543904 --> v1:10.20.193.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc1c0a0b10 con 0x7fdc1c0a68f0 2026-02-22T23:25:47.966 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.932+0000 7fdc09ffb640 10 monclient: _finish_auth 0 2026-02-22T23:25:47.966 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.932+0000 7fdc09ffb640 10 monclient: _check_auth_tickets 2026-02-22T23:25:47.967 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.932+0000 7fdc09ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T23:25:47.967 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.932+0000 7f3192ffd640 10 monclient: handle_config config(0 keys) 2026-02-22T23:25:47.967 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.932+0000 7f3192ffd640 1 -- 10.20.193.45:0/2083576879 <== mon.6 v1:10.20.193.45:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f3194005080 con 0x7f31ac0a4610 2026-02-22T23:25:47.967 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.932+0000 7f3192ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:25:47.967 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.932+0000 7f31a8d72640 4 set_mon_vals no callback set 2026-02-22T23:25:47.967 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.932+0000 7f3192ffd640 10 monclient: got monmap 1 from mon.d (according to old e1) 2026-02-22T23:25:47.967 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.932+0000 7f3192ffd640 10 monclient: dump: 2026-02-22T23:25:47.967 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:47.967 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:47.967 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:47.967 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:47.967 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:47.967 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:47.967 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:47.967 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:47.967 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:47.967 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:47.967 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:47.967 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:47.967 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:47.967 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:47.967 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:47.967 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:47.968 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.932+0000 7fdc09ffb640 1 -- 10.20.193.45:0/4256543904 <== mon.1 v1:10.20.193.73:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fdc100036a0 con 0x7fdc1c0a68f0 2026-02-22T23:25:47.968 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.932+0000 7fdc09ffb640 10 monclient: handle_config config(0 keys) 2026-02-22T23:25:47.968 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.932+0000 7fdc09ffb640 1 -- 10.20.193.45:0/4256543904 <== mon.1 v1:10.20.193.73:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7fdc10003c10 con 0x7fdc1c0a68f0 2026-02-22T23:25:47.968 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.932+0000 7fdc09ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:25:47.968 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.932+0000 7fdc09ffb640 10 monclient: got monmap 1 from mon.f (according to old e1) 2026-02-22T23:25:47.968 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.932+0000 7fdc09ffb640 10 monclient: dump: 2026-02-22T23:25:47.968 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:47.968 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:47.968 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:47.968 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:47.968 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:47.968 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:47.968 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:47.968 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:47.968 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:47.968 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:47.968 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:47.968 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:47.968 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:47.968 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:47.968 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:47.968 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:47.968 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.932+0000 7fdc0b7fe640 4 set_mon_vals no callback set 2026-02-22T23:25:47.968 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.933+0000 7f232ffca640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T23:25:47.968 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.933+0000 7f232ffca640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T23:25:47.969 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.933+0000 7f232ffca640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.45:6791/0 2026-02-22T23:25:47.969 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.933+0000 7f31b0f11640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T23:25:47.969 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.933+0000 7f31b0f11640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T23:25:47.969 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.933+0000 7f31b0f11640 10 monclient: _send_mon_message to mon.d at v1:10.20.193.45:6792/0 2026-02-22T23:25:47.969 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.933+0000 7f3192ffd640 1 -- 10.20.193.45:0/2083576879 <== mon.6 v1:10.20.193.45:6792/0 7 ==== mgrmap(e 5) ==== 50225+0+0 (unknown 2330357642 0 0) 0x7f3194011660 con 0x7f31ac0a4610 2026-02-22T23:25:47.969 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.933+0000 7f232ffca640 1 -- 10.20.193.45:0/327049672 --> v1:10.20.193.45:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23280a1b30 con 0x7f23280a68f0 2026-02-22T23:25:47.969 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.933+0000 7f31b0f11640 1 -- 10.20.193.45:0/2083576879 --> v1:10.20.193.45:6792/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f31ac0008d0 con 0x7f31ac0a4610 2026-02-22T23:25:47.969 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.933+0000 7f23167fc640 1 -- 10.20.193.45:0/327049672 <== mon.4 v1:10.20.193.45:6791/0 7 ==== mgrmap(e 5) ==== 50225+0+0 (unknown 2330357642 0 0) 0x7f231c0030e0 con 0x7f23280a68f0 2026-02-22T23:25:47.969 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.933+0000 7fdc232f5640 5 monclient: authenticate success, global_id 4438 2026-02-22T23:25:47.969 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.933+0000 7fdc232f5640 10 monclient: _renew_subs 2026-02-22T23:25:47.969 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.933+0000 7fdc232f5640 10 monclient: _send_mon_message to mon.f at v1:10.20.193.73:6789/0 2026-02-22T23:25:47.969 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.933+0000 7fdc232f5640 1 -- 10.20.193.45:0/4256543904 --> v1:10.20.193.73:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fdc1c142020 con 0x7fdc1c0a68f0 2026-02-22T23:25:47.969 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.933+0000 7fdc232f5640 10 monclient: _renew_subs 2026-02-22T23:25:47.969 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.933+0000 7fdc232f5640 10 monclient: _send_mon_message to mon.f at v1:10.20.193.73:6789/0 2026-02-22T23:25:47.970 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.933+0000 7fdc232f5640 1 -- 10.20.193.45:0/4256543904 --> v1:10.20.193.73:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fdc1c09ff50 con 0x7fdc1c0a68f0 2026-02-22T23:25:47.970 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.933+0000 7f23167fc640 1 -- 10.20.193.45:0/327049672 <== mon.4 v1:10.20.193.45:6791/0 8 ==== osd_map(19..19 src has 1..19) ==== 3558+0+0 (unknown 1288710973 0 0) 0x7f231c04dcd0 con 0x7f23280a68f0 2026-02-22T23:25:47.970 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.933+0000 7f3192ffd640 1 -- 10.20.193.45:0/2083576879 <== mon.6 v1:10.20.193.45:6792/0 8 ==== osd_map(19..19 src has 1..19) ==== 3558+0+0 (unknown 1288710973 0 0) 0x7f319404dd00 con 0x7f31ac0a4610 2026-02-22T23:25:47.970 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.933+0000 7f232dd3f640 10 monclient: get_auth_request con 0x7f22f803fff0 auth_method 0 2026-02-22T23:25:47.970 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.933+0000 7f31aa575640 10 monclient: get_auth_request con 0x7f317803fe30 auth_method 0 2026-02-22T23:25:47.970 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.933+0000 7fdc232f5640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T23:25:47.970 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.933+0000 7fdc232f5640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T23:25:47.970 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.933+0000 7fdc232f5640 10 monclient: _send_mon_message to mon.f at v1:10.20.193.73:6789/0 2026-02-22T23:25:47.970 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.933+0000 7fdc232f5640 1 -- 10.20.193.45:0/4256543904 --> v1:10.20.193.73:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdc1c142720 con 0x7fdc1c0a68f0 2026-02-22T23:25:47.970 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.934+0000 7fdc09ffb640 1 -- 10.20.193.45:0/4256543904 <== mon.1 v1:10.20.193.73:6789/0 7 ==== mgrmap(e 5) ==== 50225+0+0 (unknown 2330357642 0 0) 0x7fdc10003db0 con 0x7fdc1c0a68f0 2026-02-22T23:25:47.970 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.934+0000 7fdc09ffb640 1 -- 10.20.193.45:0/4256543904 <== mon.1 v1:10.20.193.73:6789/0 8 ==== osd_map(19..19 src has 1..19) ==== 3558+0+0 (unknown 1288710973 0 0) 0x7fdc1004c9c0 con 0x7fdc1c0a68f0 2026-02-22T23:25:47.970 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.934+0000 7fdc2106a640 10 monclient: get_auth_request con 0x7fdbec040000 auth_method 0 2026-02-22T23:25:47.971 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.935+0000 7f23167fc640 1 -- 10.20.193.45:0/327049672 <== mon.4 v1:10.20.193.45:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (unknown 1092875540 0 2568732696) 0x7f231c0177d0 con 0x7f23280a68f0 2026-02-22T23:25:47.971 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.935+0000 7f23167fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T23:25:47.971 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.935+0000 7f23167fc640 10 monclient: _finish_command 1 = system:0 2026-02-22T23:25:47.971 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.935+0000 7f3192ffd640 1 -- 10.20.193.45:0/2083576879 <== mon.6 v1:10.20.193.45:6792/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (unknown 1092875540 0 2568732696) 0x7f3194017800 con 0x7f31ac0a4610 2026-02-22T23:25:47.971 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.935+0000 7f3192ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T23:25:47.971 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.935+0000 7f3192ffd640 10 monclient: _finish_command 1 = system:0 2026-02-22T23:25:47.971 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.936+0000 7fdc09ffb640 1 -- 10.20.193.45:0/4256543904 <== mon.1 v1:10.20.193.73:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (unknown 1092875540 0 2568732696) 0x7fdc1c142720 con 0x7fdc1c0a68f0 2026-02-22T23:25:47.971 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.936+0000 7fdc09ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T23:25:47.971 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.936+0000 7fdc09ffb640 10 monclient: _finish_command 1 = system:0 2026-02-22T23:25:47.972 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.973+0000 7f1bb43fe640 10 monclient: get_monmap_and_config 2026-02-22T23:25:47.972 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.973+0000 7f1bb43fe640 10 monclient: build_initial_monmap 2026-02-22T23:25:47.973 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.973+0000 7f1bb43fe640 10 monclient: monmap: 2026-02-22T23:25:47.973 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-22T23:25:47.973 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:47.973 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:25:47.973313+0000 2026-02-22T23:25:47.973 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:25:47.973313+0000 2026-02-22T23:25:47.973 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-22T23:25:47.973 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:47.973 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-22T23:25:47.973 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.noname-f 2026-02-22T23:25:47.973 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.noname-b 2026-02-22T23:25:47.973 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.noname-g 2026-02-22T23:25:47.973 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.noname-c 2026-02-22T23:25:47.973 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.noname-h 2026-02-22T23:25:47.973 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.noname-d 2026-02-22T23:25:47.973 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.noname-i 2026-02-22T23:25:47.973 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.noname-e 2026-02-22T23:25:47.973 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:47.973 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.973+0000 7f8f858b2640 10 monclient: get_monmap_and_config 2026-02-22T23:25:47.973 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.973+0000 7f8f858b2640 10 monclient: build_initial_monmap 2026-02-22T23:25:47.973 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.973+0000 7f8f858b2640 10 monclient: monmap: 2026-02-22T23:25:47.973 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-22T23:25:47.973 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:47.973 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:25:47.973397+0000 2026-02-22T23:25:47.973 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:25:47.973397+0000 2026-02-22T23:25:47.973 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-22T23:25:47.973 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:47.973 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-22T23:25:47.974 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.noname-f 2026-02-22T23:25:47.974 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.noname-b 2026-02-22T23:25:47.974 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.noname-g 2026-02-22T23:25:47.974 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.noname-c 2026-02-22T23:25:47.974 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.noname-h 2026-02-22T23:25:47.974 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.noname-d 2026-02-22T23:25:47.974 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.noname-i 2026-02-22T23:25:47.974 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.noname-e 2026-02-22T23:25:47.974 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:47.974 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.973+0000 7f95d396f640 10 monclient: get_monmap_and_config 2026-02-22T23:25:47.974 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.973+0000 7f95d396f640 10 monclient: build_initial_monmap 2026-02-22T23:25:47.974 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.973+0000 7f95d396f640 10 monclient: monmap: 2026-02-22T23:25:47.974 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-22T23:25:47.974 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:47.974 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:25:47.973443+0000 2026-02-22T23:25:47.974 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:25:47.973443+0000 2026-02-22T23:25:47.974 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-22T23:25:47.974 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:47.974 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-22T23:25:47.974 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.noname-f 2026-02-22T23:25:47.974 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.noname-b 2026-02-22T23:25:47.974 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.noname-g 2026-02-22T23:25:47.974 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.noname-c 2026-02-22T23:25:47.974 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.noname-h 2026-02-22T23:25:47.974 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.noname-d 2026-02-22T23:25:47.974 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.noname-i 2026-02-22T23:25:47.974 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.noname-e 2026-02-22T23:25:47.974 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:47.975 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.973+0000 7f1bb43fe640 1 Processor -- start 2026-02-22T23:25:47.975 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.973+0000 7f8f858b2640 1 Processor -- start 2026-02-22T23:25:47.975 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.973+0000 7f1bb43fe640 1 -- start start 2026-02-22T23:25:47.975 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.973+0000 7f1bb43fe640 10 monclient: init 2026-02-22T23:25:47.975 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.973+0000 7f8f858b2640 1 -- start start 2026-02-22T23:25:47.975 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.973+0000 7f8f858b2640 10 monclient: init 2026-02-22T23:25:47.975 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.973+0000 7f95d396f640 1 Processor -- start 2026-02-22T23:25:47.975 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.973+0000 7f95d396f640 1 -- start start 2026-02-22T23:25:47.975 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.973+0000 7f95d396f640 10 monclient: init 2026-02-22T23:25:47.976 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.973+0000 7f1bb43fe640 10 monclient: _reopen_session rank -1 2026-02-22T23:25:47.976 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.973+0000 7f1bb43fe640 10 monclient: _add_conns ranks=[7,3,4,6,0,1,5,8,2] 2026-02-22T23:25:47.976 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.973+0000 7f1bb43fe640 10 monclient(hunting): picked mon.noname-i con 0x7f1bac0a5d90 addr v1:10.20.193.73:6792/0 2026-02-22T23:25:47.976 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.973+0000 7f1bb43fe640 10 monclient(hunting): picked mon.noname-g con 0x7f1bac0a6880 addr v1:10.20.193.73:6790/0 2026-02-22T23:25:47.976 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.973+0000 7f1bb43fe640 10 monclient(hunting): picked mon.noname-c con 0x7f1bac0a3d30 addr v1:10.20.193.45:6791/0 2026-02-22T23:25:47.976 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.973+0000 7f1bb43fe640 1 -- --> v1:10.20.193.73:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1bac0a7200 con 0x7f1bac0a6880 2026-02-22T23:25:47.976 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.973+0000 7f1bb43fe640 1 -- --> v1:10.20.193.45:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1bac0a8c90 con 0x7f1bac0a3d30 2026-02-22T23:25:47.976 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.973+0000 7f1bb43fe640 1 -- --> v1:10.20.193.73:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1bac0a6ef0 con 0x7f1bac0a5d90 2026-02-22T23:25:47.976 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.973+0000 7f1bb43fe640 10 monclient(hunting): _renew_subs 2026-02-22T23:25:47.976 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.973+0000 7f1bb43fe640 10 monclient(hunting): authenticate will time out at 679.589937s 2026-02-22T23:25:47.976 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.973+0000 7f8f858b2640 10 monclient: _reopen_session rank -1 2026-02-22T23:25:47.976 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.973+0000 7f8f858b2640 10 monclient: _add_conns ranks=[7,2,1,4,3,0,6,8,5] 2026-02-22T23:25:47.976 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.973+0000 7f8f858b2640 10 monclient(hunting): picked mon.noname-i con 0x7f8f80138e10 addr v1:10.20.193.73:6792/0 2026-02-22T23:25:47.976 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.974+0000 7f8f858b2640 10 monclient(hunting): picked mon.noname-b con 0x7f8f800a3630 addr v1:10.20.193.45:6790/0 2026-02-22T23:25:47.976 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.974+0000 7f8f858b2640 10 monclient(hunting): picked mon.noname-f con 0x7f8f8013f310 addr v1:10.20.193.73:6789/0 2026-02-22T23:25:47.976 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.974+0000 7f8f858b2640 1 -- --> v1:10.20.193.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8f800a3210 con 0x7f8f8013f310 2026-02-22T23:25:47.976 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.974+0000 7f1bb2974640 1 --1- >> v1:10.20.193.45:6791/0 conn(0x7f1bac0a3d30 0x7f1bac141740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.45:6791/0 says I am v1:10.20.193.45:37966/0 (socket says 10.20.193.45:37966) 2026-02-22T23:25:47.977 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.974+0000 7f1bb2974640 1 -- 10.20.193.45:0/3503668068 learned_addr learned my addr 10.20.193.45:0/3503668068 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-22T23:25:47.977 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.974+0000 7f8f858b2640 1 -- --> v1:10.20.193.45:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8f800a2970 con 0x7f8f800a3630 2026-02-22T23:25:47.977 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.974+0000 7f8f858b2640 1 -- --> v1:10.20.193.73:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8f800a2260 con 0x7f8f80138e10 2026-02-22T23:25:47.977 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.974+0000 7f8f858b2640 10 monclient(hunting): _renew_subs 2026-02-22T23:25:47.977 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.974+0000 7f8f858b2640 10 monclient(hunting): authenticate will time out at 679.590067s 2026-02-22T23:25:47.977 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.974+0000 7f8f7e7fc640 1 --1- >> v1:10.20.193.45:6790/0 conn(0x7f8f800a3630 0x7f8f8013dbf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.45:6790/0 says I am v1:10.20.193.45:50994/0 (socket says 10.20.193.45:50994) 2026-02-22T23:25:47.977 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.974+0000 7f8f7effd640 1 --1- >> v1:10.20.193.73:6792/0 conn(0x7f8f80138e10 0x7f8f801391f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.73:6792/0 says I am v1:10.20.193.45:51472/0 (socket says 10.20.193.45:51472) 2026-02-22T23:25:47.977 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.974+0000 7f8f7e7fc640 1 -- 10.20.193.45:0/122743881 learned_addr learned my addr 10.20.193.45:0/122743881 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-22T23:25:47.977 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.974+0000 7f95d396f640 10 monclient: _reopen_session rank -1 2026-02-22T23:25:47.977 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.974+0000 7f95d396f640 10 monclient: _add_conns ranks=[1,4,7,8,5,2,0,6,3] 2026-02-22T23:25:47.977 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.974+0000 7f95d396f640 10 monclient(hunting): picked mon.noname-f con 0x7f95cc0a5d90 addr v1:10.20.193.73:6789/0 2026-02-22T23:25:47.977 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.974+0000 7f95d396f640 10 monclient(hunting): picked mon.noname-c con 0x7f95cc0a6880 addr v1:10.20.193.45:6791/0 2026-02-22T23:25:47.977 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.974+0000 7f95d396f640 10 monclient(hunting): picked mon.noname-i con 0x7f95cc0a3d30 addr v1:10.20.193.73:6792/0 2026-02-22T23:25:47.977 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.974+0000 7f1bb1171640 1 -- 10.20.193.45:0/3503668068 <== mon.4 v1:10.20.193.45:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3566495801 0 0) 0x7f1bac0a8c90 con 0x7f1bac0a3d30 2026-02-22T23:25:47.977 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.974+0000 7f1bb1171640 10 monclient(hunting): _negotiate 2026-02-22T23:25:47.977 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.974+0000 7f1bb1171640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:47.978 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.974+0000 7f95d396f640 1 -- --> v1:10.20.193.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f95cc0a7200 con 0x7f95cc0a5d90 2026-02-22T23:25:47.978 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.974+0000 7f1bb1171640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:47.978 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.974+0000 7f1bb1171640 10 monclient(hunting): my global_id is 4369 2026-02-22T23:25:47.978 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.974+0000 7f95d396f640 1 -- --> v1:10.20.193.45:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f95cc0a8c90 con 0x7f95cc0a6880 2026-02-22T23:25:47.978 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.974+0000 7f95d396f640 1 -- --> v1:10.20.193.73:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f95cc0a6ef0 con 0x7f95cc0a3d30 2026-02-22T23:25:47.978 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.974+0000 7f95d396f640 10 monclient(hunting): _renew_subs 2026-02-22T23:25:47.978 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.974+0000 7f1bb1171640 1 -- 10.20.193.45:0/3503668068 --> v1:10.20.193.45:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1b94003620 con 0x7f1bac0a3d30 2026-02-22T23:25:47.978 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.974+0000 7f95d396f640 10 monclient(hunting): authenticate will time out at 679.590259s 2026-02-22T23:25:47.978 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.974+0000 7f1bb1171640 1 -- 10.20.193.45:0/3503668068 <== mon.3 v1:10.20.193.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1991843351 0 0) 0x7f1bac0a7200 con 0x7f1bac0a6880 2026-02-22T23:25:47.978 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.974+0000 7f1bb1171640 10 monclient(hunting): _negotiate 2026-02-22T23:25:47.978 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.974+0000 7f1bb1171640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:47.979 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.974+0000 7f1bb1171640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:47.979 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.974+0000 7f1bb1171640 10 monclient(hunting): my global_id is 4386 2026-02-22T23:25:47.979 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.974+0000 7f1bb1171640 1 -- 10.20.193.45:0/3503668068 --> v1:10.20.193.73:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1bac0a8c90 con 0x7f1bac0a6880 2026-02-22T23:25:47.979 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.974+0000 7f1bb1171640 1 -- 10.20.193.45:0/3503668068 <== mon.7 v1:10.20.193.73:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1519896910 0 0) 0x7f1bac0a6ef0 con 0x7f1bac0a5d90 2026-02-22T23:25:47.979 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.974+0000 7f1bb1171640 10 monclient(hunting): _negotiate 2026-02-22T23:25:47.979 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.974+0000 7f1bb1171640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:47.979 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.974+0000 7f1bb1171640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:47.979 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.974+0000 7f1bb1171640 10 monclient(hunting): my global_id is 4282 2026-02-22T23:25:47.979 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.974+0000 7f1bb1171640 1 -- 10.20.193.45:0/3503668068 --> v1:10.20.193.73:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1bac0a7200 con 0x7f1bac0a5d90 2026-02-22T23:25:47.979 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.974+0000 7f95d0ee3640 1 --1- >> v1:10.20.193.45:6791/0 conn(0x7f95cc0a6880 0x7f95cc13e010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.45:6791/0 says I am v1:10.20.193.45:37982/0 (socket says 10.20.193.45:37982) 2026-02-22T23:25:47.979 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.974+0000 7f95d0ee3640 1 -- 10.20.193.45:0/201589718 learned_addr learned my addr 10.20.193.45:0/201589718 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-22T23:25:47.979 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.974+0000 7f8f7dffb640 1 -- 10.20.193.45:0/122743881 <== mon.2 v1:10.20.193.45:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2110801832 0 0) 0x7f8f800a2970 con 0x7f8f800a3630 2026-02-22T23:25:47.979 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.974+0000 7f8f7dffb640 10 monclient(hunting): _negotiate 2026-02-22T23:25:47.979 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.974+0000 7f8f7dffb640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:47.979 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.974+0000 7f8f7dffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:47.979 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.974+0000 7f8f7dffb640 10 monclient(hunting): my global_id is 4403 2026-02-22T23:25:47.979 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.974+0000 7f8f7dffb640 1 -- 10.20.193.45:0/122743881 --> v1:10.20.193.45:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8f6c003620 con 0x7f8f800a3630 2026-02-22T23:25:47.979 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.974+0000 7f1bb1171640 1 -- 10.20.193.45:0/3503668068 <== mon.4 v1:10.20.193.45:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3371544225 0 0) 0x7f1b94003620 con 0x7f1bac0a3d30 2026-02-22T23:25:47.980 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.974+0000 7f1bb1171640 1 -- 10.20.193.45:0/3503668068 >> v1:10.20.193.73:6792/0 conn(0x7f1bac0a5d90 legacy=0x7f1bac0a6170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:47.980 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.974+0000 7f1bb1171640 1 -- 10.20.193.45:0/3503668068 >> v1:10.20.193.73:6790/0 conn(0x7f1bac0a6880 legacy=0x7f1bac13e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:47.980 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.974+0000 7f1bb1171640 10 monclient: _finish_hunting 0 2026-02-22T23:25:47.980 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.974+0000 7f1bb1171640 1 monclient: found mon.noname-c 2026-02-22T23:25:47.980 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.974+0000 7f1bb1171640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T23:25:47.980 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.974+0000 7f1bb1171640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.45:6791/0 2026-02-22T23:25:47.980 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.974+0000 7f1bb1171640 1 -- 10.20.193.45:0/3503668068 --> v1:10.20.193.45:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bac0a2c20 con 0x7f1bac0a3d30 2026-02-22T23:25:47.980 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.974+0000 7f8f7dffb640 1 -- 10.20.193.45:0/122743881 <== mon.7 v1:10.20.193.73:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2911373693 0 0) 0x7f8f800a2260 con 0x7f8f80138e10 2026-02-22T23:25:47.980 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.974+0000 7f8f7dffb640 10 monclient(hunting): _negotiate 2026-02-22T23:25:47.980 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.974+0000 7f8f7dffb640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:47.980 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.974+0000 7f1bb1171640 10 monclient: _finish_auth 0 2026-02-22T23:25:47.980 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.974+0000 7f1bb1171640 10 monclient: _check_auth_tickets 2026-02-22T23:25:47.980 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.974+0000 7f1bb1171640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T23:25:47.980 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.974+0000 7f1bb1171640 1 -- 10.20.193.45:0/3503668068 <== mon.4 v1:10.20.193.45:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f1ba80033c0 con 0x7f1bac0a3d30 2026-02-22T23:25:47.980 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.974+0000 7f1bb1171640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:25:47.980 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.974+0000 7f8f7dffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:47.980 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.974+0000 7f8f7dffb640 10 monclient(hunting): my global_id is 4291 2026-02-22T23:25:47.980 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.974+0000 7f8f7dffb640 1 -- 10.20.193.45:0/122743881 --> v1:10.20.193.73:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8f800a2970 con 0x7f8f80138e10 2026-02-22T23:25:47.980 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.974+0000 7f1bb1171640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-22T23:25:47.980 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.974+0000 7f1bb1171640 10 monclient: dump: 2026-02-22T23:25:47.981 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:47.981 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:47.981 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:47.981 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:47.981 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:47.981 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:47.981 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:47.981 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:47.981 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:47.981 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:47.981 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:47.981 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:47.981 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:47.981 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:47.981 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:47.981 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:47.981 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.974+0000 7f8f7dffb640 1 -- 10.20.193.45:0/122743881 <== mon.1 v1:10.20.193.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3985886023 0 0) 0x7f8f800a3210 con 0x7f8f8013f310 2026-02-22T23:25:47.981 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.974+0000 7f8f7dffb640 10 monclient(hunting): _negotiate 2026-02-22T23:25:47.981 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.974+0000 7f8f7dffb640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:47.981 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.974+0000 7f1bb43fe640 5 monclient: authenticate success, global_id 4369 2026-02-22T23:25:47.981 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.974+0000 7f1bb43fe640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-22T23:25:47.982 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.974+0000 7f8f7dffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:47.982 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.974+0000 7f8f7dffb640 10 monclient(hunting): my global_id is 4447 2026-02-22T23:25:47.982 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.974+0000 7f8f7dffb640 1 -- 10.20.193.45:0/122743881 --> v1:10.20.193.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8f800a2260 con 0x7f8f8013f310 2026-02-22T23:25:47.982 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.974+0000 7f95bbfff640 1 -- 10.20.193.45:0/201589718 <== mon.4 v1:10.20.193.45:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 715867708 0 0) 0x7f95cc0a8c90 con 0x7f95cc0a6880 2026-02-22T23:25:47.982 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.974+0000 7f95bbfff640 10 monclient(hunting): _negotiate 2026-02-22T23:25:47.982 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.974+0000 7f95bbfff640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:47.982 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.974+0000 7f95bbfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:47.982 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.974+0000 7f95bbfff640 10 monclient(hunting): my global_id is 4378 2026-02-22T23:25:47.982 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.974+0000 7f95bbfff640 1 -- 10.20.193.45:0/201589718 --> v1:10.20.193.45:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f95b4003620 con 0x7f95cc0a6880 2026-02-22T23:25:47.982 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.974+0000 7f1bb1171640 1 -- 10.20.193.45:0/3503668068 <== mon.4 v1:10.20.193.45:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1ba80035e0 con 0x7f1bac0a3d30 2026-02-22T23:25:47.982 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.974+0000 7f1bb1171640 10 monclient: handle_config config(0 keys) 2026-02-22T23:25:47.982 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.974+0000 7f1bb1171640 1 -- 10.20.193.45:0/3503668068 <== mon.4 v1:10.20.193.45:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f1ba8005060 con 0x7f1bac0a3d30 2026-02-22T23:25:47.982 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.974+0000 7f8f7dffb640 1 -- 10.20.193.45:0/122743881 <== mon.2 v1:10.20.193.45:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2046710171 0 0) 0x7f8f6c003620 con 0x7f8f800a3630 2026-02-22T23:25:47.982 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.974+0000 7f1bb1171640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:25:47.982 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.974+0000 7f1bb1171640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T23:25:47.982 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.974+0000 7f1bb1171640 10 monclient: dump: 2026-02-22T23:25:47.983 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:47.983 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:47.983 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:47.983 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:47.983 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:47.983 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:47.983 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:47.983 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:47.983 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:47.983 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:47.983 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:47.983 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:47.983 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:47.983 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:47.983 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:47.983 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:47.983 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.974+0000 7f8f7dffb640 1 -- 10.20.193.45:0/122743881 >> v1:10.20.193.73:6792/0 conn(0x7f8f80138e10 legacy=0x7f8f801391f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:47.983 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.974+0000 7f8f7dffb640 1 -- 10.20.193.45:0/122743881 >> v1:10.20.193.73:6789/0 conn(0x7f8f8013f310 legacy=0x7f8f80141700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:47.983 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.974+0000 7f1bb43fe640 10 monclient: get_monmap_and_config success 2026-02-22T23:25:47.983 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.974+0000 7f1bb43fe640 4 set_mon_vals no callback set 2026-02-22T23:25:47.984 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.974+0000 7f8f7dffb640 10 monclient: _finish_hunting 0 2026-02-22T23:25:47.984 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.974+0000 7f8f7dffb640 1 monclient: found mon.noname-b 2026-02-22T23:25:47.984 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.974+0000 7f8f7dffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T23:25:47.984 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.974+0000 7f8f7dffb640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.45:6790/0 2026-02-22T23:25:47.984 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.974+0000 7f8f7dffb640 1 -- 10.20.193.45:0/122743881 --> v1:10.20.193.45:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f800a4510 con 0x7f8f800a3630 2026-02-22T23:25:47.984 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.974+0000 7f8f7dffb640 10 monclient: _finish_auth 0 2026-02-22T23:25:47.984 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.974+0000 7f8f7dffb640 10 monclient: _check_auth_tickets 2026-02-22T23:25:47.984 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.974+0000 7f8f7dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T23:25:47.984 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.974+0000 7f8f7dffb640 1 -- 10.20.193.45:0/122743881 <== mon.2 v1:10.20.193.45:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f8f68003040 con 0x7f8f800a3630 2026-02-22T23:25:47.984 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.974+0000 7f8f7dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:25:47.984 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.974+0000 7f8f7dffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-22T23:25:47.984 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.974+0000 7f8f7dffb640 10 monclient: dump: 2026-02-22T23:25:47.984 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:47.984 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:47.984 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:47.984 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:47.984 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:47.984 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:47.984 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:47.984 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:47.984 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:47.984 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:47.984 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:47.984 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:47.984 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:47.984 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:47.984 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:47.984 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:47.984 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.974+0000 7f95bbfff640 1 -- 10.20.193.45:0/201589718 <== mon.1 v1:10.20.193.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 414549411 0 0) 0x7f95cc0a7200 con 0x7f95cc0a5d90 2026-02-22T23:25:47.985 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.974+0000 7f95bbfff640 10 monclient(hunting): _negotiate 2026-02-22T23:25:47.985 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.974+0000 7f95bbfff640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:47.985 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.974+0000 7f95bbfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:47.985 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.974+0000 7f95bbfff640 10 monclient(hunting): my global_id is 4456 2026-02-22T23:25:47.985 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.974+0000 7f95bbfff640 1 -- 10.20.193.45:0/201589718 --> v1:10.20.193.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f95cc0a8c90 con 0x7f95cc0a5d90 2026-02-22T23:25:47.985 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.974+0000 7f8f858b2640 5 monclient: authenticate success, global_id 4403 2026-02-22T23:25:47.985 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.974+0000 7f8f858b2640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-22T23:25:47.985 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.974+0000 7f95bbfff640 1 -- 10.20.193.45:0/201589718 <== mon.4 v1:10.20.193.45:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1052239251 0 0) 0x7f95b4003620 con 0x7f95cc0a6880 2026-02-22T23:25:47.985 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.974+0000 7f95bbfff640 1 -- 10.20.193.45:0/201589718 >> v1:10.20.193.73:6792/0 conn(0x7f95cc0a3d30 legacy=0x7f95cc141740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T23:25:47.985 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.974+0000 7f95bbfff640 1 -- 10.20.193.45:0/201589718 >> v1:10.20.193.73:6789/0 conn(0x7f95cc0a5d90 legacy=0x7f95cc0a6170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:47.985 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.974+0000 7f95bbfff640 10 monclient: _finish_hunting 0 2026-02-22T23:25:47.985 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.974+0000 7f95bbfff640 1 monclient: found mon.noname-c 2026-02-22T23:25:47.985 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.974+0000 7f8f7dffb640 1 -- 10.20.193.45:0/122743881 <== mon.2 v1:10.20.193.45:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f8f680031e0 con 0x7f8f800a3630 2026-02-22T23:25:47.985 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.974+0000 7f8f7dffb640 10 monclient: handle_config config(0 keys) 2026-02-22T23:25:47.985 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.974+0000 7f8f7dffb640 1 -- 10.20.193.45:0/122743881 <== mon.2 v1:10.20.193.45:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f8f68004ce0 con 0x7f8f800a3630 2026-02-22T23:25:47.985 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.974+0000 7f8f7dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:25:47.986 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.974+0000 7f95bbfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T23:25:47.986 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.974+0000 7f95bbfff640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.45:6791/0 2026-02-22T23:25:47.986 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.974+0000 7f95bbfff640 1 -- 10.20.193.45:0/201589718 --> v1:10.20.193.45:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95cc0a2c20 con 0x7f95cc0a6880 2026-02-22T23:25:47.986 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.974+0000 7f95bbfff640 10 monclient: _finish_auth 0 2026-02-22T23:25:47.986 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.974+0000 7f95bbfff640 10 monclient: _check_auth_tickets 2026-02-22T23:25:47.986 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.974+0000 7f95bbfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T23:25:47.986 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.974+0000 7f95bbfff640 1 -- 10.20.193.45:0/201589718 <== mon.4 v1:10.20.193.45:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f95c0003040 con 0x7f95cc0a6880 2026-02-22T23:25:47.986 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.974+0000 7f95bbfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:25:47.986 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.974+0000 7f8f7dffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-22T23:25:47.986 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.974+0000 7f8f7dffb640 10 monclient: dump: 2026-02-22T23:25:47.986 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:47.986 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:47.986 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:47.986 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:47.986 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:47.986 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:47.986 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:47.986 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:47.986 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:47.986 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:47.986 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:47.986 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:47.986 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:47.986 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:47.986 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:47.986 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:47.986 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.974+0000 7f95bbfff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-22T23:25:47.986 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.974+0000 7f95bbfff640 10 monclient: dump: 2026-02-22T23:25:47.987 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:47.987 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:47.987 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:47.987 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:47.987 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:47.987 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:47.987 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:47.987 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:47.987 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:47.987 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:47.987 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:47.987 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:47.987 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:47.987 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:47.987 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:47.987 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:47.987 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.974+0000 7f8f858b2640 10 monclient: get_monmap_and_config success 2026-02-22T23:25:47.987 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.974+0000 7f8f858b2640 4 set_mon_vals no callback set 2026-02-22T23:25:47.987 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.974+0000 7f95d396f640 5 monclient: authenticate success, global_id 4378 2026-02-22T23:25:47.987 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.974+0000 7f95d396f640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-22T23:25:47.987 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.974+0000 7f95bbfff640 1 -- 10.20.193.45:0/201589718 <== mon.4 v1:10.20.193.45:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f95c0003260 con 0x7f95cc0a6880 2026-02-22T23:25:47.987 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.974+0000 7f95bbfff640 10 monclient: handle_config config(0 keys) 2026-02-22T23:25:47.988 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.974+0000 7f95bbfff640 1 -- 10.20.193.45:0/201589718 <== mon.4 v1:10.20.193.45:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f95c0004ce0 con 0x7f95cc0a6880 2026-02-22T23:25:47.988 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.974+0000 7f95bbfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:25:47.988 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.974+0000 7f95bbfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T23:25:47.988 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.974+0000 7f95bbfff640 10 monclient: dump: 2026-02-22T23:25:47.988 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:47.988 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:47.988 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:47.988 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:47.988 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:47.988 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:47.988 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:47.988 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:47.988 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:47.988 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:47.988 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:47.988 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:47.988 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:47.988 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:47.988 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:47.988 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:47.988 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.974+0000 7f95d396f640 10 monclient: get_monmap_and_config success 2026-02-22T23:25:47.988 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.974+0000 7f95d396f640 4 set_mon_vals no callback set 2026-02-22T23:25:47.988 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.974+0000 7f1bb43fe640 10 monclient: shutdown 2026-02-22T23:25:47.988 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.974+0000 7f1bb43fe640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T23:25:47.988 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.974+0000 7f1bb43fe640 1 -- 10.20.193.45:0/3503668068 >> v1:10.20.193.45:6791/0 conn(0x7f1bac0a3d30 legacy=0x7f1bac141740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:47.988 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.974+0000 7f1bb43fe640 1 -- 10.20.193.45:0/3503668068 shutdown_connections 2026-02-22T23:25:47.988 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.974+0000 7f1bb43fe640 1 -- 10.20.193.45:0/3503668068 >> 10.20.193.45:0/3503668068 conn(0x7f1bac0ab9c0 msgr2=0x7f1bac0a7e90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:25:47.988 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.974+0000 7f1bb43fe640 1 -- 10.20.193.45:0/3503668068 shutdown_connections 2026-02-22T23:25:47.989 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.974+0000 7f1bb43fe640 1 -- 10.20.193.45:0/3503668068 wait complete. 2026-02-22T23:25:47.989 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.975+0000 7f95d396f640 10 monclient: shutdown 2026-02-22T23:25:47.989 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.975+0000 7f95d396f640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T23:25:47.989 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.975+0000 7f95d396f640 1 -- 10.20.193.45:0/201589718 >> v1:10.20.193.45:6791/0 conn(0x7f95cc0a6880 legacy=0x7f95cc13e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:47.989 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.975+0000 7f8f858b2640 10 monclient: shutdown 2026-02-22T23:25:47.989 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.975+0000 7f8f858b2640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T23:25:47.989 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.975+0000 7f8f858b2640 1 -- 10.20.193.45:0/122743881 >> v1:10.20.193.45:6790/0 conn(0x7f8f800a3630 legacy=0x7f8f8013dbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:47.989 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.975+0000 7f95d396f640 1 -- 10.20.193.45:0/201589718 shutdown_connections 2026-02-22T23:25:47.989 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.975+0000 7f95d396f640 1 -- 10.20.193.45:0/201589718 >> 10.20.193.45:0/201589718 conn(0x7f95cc0ab9c0 msgr2=0x7f95cc0a7e90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:25:47.989 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.975+0000 7f8f858b2640 1 -- 10.20.193.45:0/122743881 shutdown_connections 2026-02-22T23:25:47.989 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.975+0000 7f8f858b2640 1 -- 10.20.193.45:0/122743881 >> 10.20.193.45:0/122743881 conn(0x7f8f800a7780 msgr2=0x7f8f800a3b60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:25:47.989 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.975+0000 7f95d396f640 1 -- 10.20.193.45:0/201589718 shutdown_connections 2026-02-22T23:25:47.989 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.975+0000 7f8f858b2640 1 -- 10.20.193.45:0/122743881 shutdown_connections 2026-02-22T23:25:47.990 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.975+0000 7f95d396f640 1 -- 10.20.193.45:0/201589718 wait complete. 2026-02-22T23:25:47.990 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.975+0000 7f1bb43fe640 10 monclient: build_initial_monmap 2026-02-22T23:25:47.990 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.975+0000 7f1bb43fe640 10 monclient: monmap: 2026-02-22T23:25:47.990 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-22T23:25:47.990 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T23:25:47.990 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-22T23:25:47.990 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-22T23:25:47.990 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-22T23:25:47.990 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-22T23:25:47.990 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-22T23:25:47.990 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.noname-f 2026-02-22T23:25:47.990 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.noname-b 2026-02-22T23:25:47.990 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.noname-g 2026-02-22T23:25:47.990 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.noname-c 2026-02-22T23:25:47.990 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.noname-h 2026-02-22T23:25:47.990 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.noname-d 2026-02-22T23:25:47.990 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.noname-i 2026-02-22T23:25:47.990 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.noname-e 2026-02-22T23:25:47.990 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:47.990 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.975+0000 7f8f858b2640 1 -- 10.20.193.45:0/122743881 wait complete. 2026-02-22T23:25:47.990 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.975+0000 7f1bb43fe640 1 Processor -- start 2026-02-22T23:25:47.991 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.975+0000 7f1bb43fe640 1 -- start start 2026-02-22T23:25:47.991 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.975+0000 7f1bb43fe640 10 monclient: init 2026-02-22T23:25:47.991 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.975+0000 7f8f858b2640 10 monclient: build_initial_monmap 2026-02-22T23:25:47.991 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.975+0000 7f8f858b2640 10 monclient: monmap: 2026-02-22T23:25:47.991 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-22T23:25:47.991 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T23:25:47.991 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-22T23:25:47.991 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-22T23:25:47.991 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-22T23:25:47.991 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-22T23:25:47.991 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-22T23:25:47.991 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.noname-f 2026-02-22T23:25:47.991 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.noname-b 2026-02-22T23:25:47.991 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.noname-g 2026-02-22T23:25:47.991 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.noname-c 2026-02-22T23:25:47.991 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.noname-h 2026-02-22T23:25:47.991 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.noname-d 2026-02-22T23:25:47.991 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.noname-i 2026-02-22T23:25:47.991 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.noname-e 2026-02-22T23:25:47.991 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:47.991 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.975+0000 7f95d396f640 10 monclient: build_initial_monmap 2026-02-22T23:25:47.991 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.975+0000 7f95d396f640 10 monclient: monmap: 2026-02-22T23:25:47.991 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-22T23:25:47.991 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T23:25:47.991 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-22T23:25:47.991 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-22T23:25:47.991 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-22T23:25:47.992 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-22T23:25:47.992 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-22T23:25:47.992 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.noname-f 2026-02-22T23:25:47.992 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.noname-b 2026-02-22T23:25:47.992 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.noname-g 2026-02-22T23:25:47.992 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.noname-c 2026-02-22T23:25:47.992 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.noname-h 2026-02-22T23:25:47.992 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.noname-d 2026-02-22T23:25:47.992 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.noname-i 2026-02-22T23:25:47.992 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.noname-e 2026-02-22T23:25:47.992 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:47.992 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.975+0000 7f95d396f640 1 Processor -- start 2026-02-22T23:25:47.992 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.975+0000 7f8f858b2640 1 Processor -- start 2026-02-22T23:25:47.992 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.975+0000 7f95d396f640 1 -- start start 2026-02-22T23:25:47.992 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.975+0000 7f95d396f640 10 monclient: init 2026-02-22T23:25:47.992 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.975+0000 7f1bb43fe640 10 monclient: _reopen_session rank -1 2026-02-22T23:25:47.992 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.975+0000 7f8f858b2640 1 -- start start 2026-02-22T23:25:47.992 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.975+0000 7f1bb43fe640 10 monclient: _add_conns ranks=[1,3,4,0,5,2,6,7,8] 2026-02-22T23:25:47.993 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.975+0000 7f8f858b2640 10 monclient: init 2026-02-22T23:25:47.993 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.975+0000 7f1bb43fe640 10 monclient(hunting): picked mon.noname-f con 0x7f1bac0a3d30 addr v1:10.20.193.73:6789/0 2026-02-22T23:25:47.993 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.975+0000 7f1bb43fe640 10 monclient(hunting): picked mon.noname-g con 0x7f1bac0a5d90 addr v1:10.20.193.73:6790/0 2026-02-22T23:25:47.993 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.975+0000 7f1bb43fe640 10 monclient(hunting): picked mon.noname-c con 0x7f1bac0a6880 addr v1:10.20.193.45:6791/0 2026-02-22T23:25:47.993 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.975+0000 7f1bb43fe640 1 -- --> v1:10.20.193.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1bac0a1430 con 0x7f1bac0a3d30 2026-02-22T23:25:47.993 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.975+0000 7f1bb43fe640 1 -- --> v1:10.20.193.73:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1bac0a9db0 con 0x7f1bac0a5d90 2026-02-22T23:25:47.993 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.975+0000 7f1bb43fe640 1 -- --> v1:10.20.193.45:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1bac1cfe70 con 0x7f1bac0a6880 2026-02-22T23:25:47.993 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.975+0000 7f1bb43fe640 10 monclient(hunting): _renew_subs 2026-02-22T23:25:47.993 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.975+0000 7f1bb43fe640 10 monclient(hunting): authenticate will time out at 679.591997s 2026-02-22T23:25:47.993 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.976+0000 7f1bb1972640 1 --1- >> v1:10.20.193.73:6790/0 conn(0x7f1bac0a5d90 0x7f1bac1d4630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.73:6790/0 says I am v1:10.20.193.45:34578/0 (socket says 10.20.193.45:34578) 2026-02-22T23:25:47.993 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.976+0000 7f1bb2173640 1 --1- >> v1:10.20.193.73:6789/0 conn(0x7f1bac0a3d30 0x7f1bac141760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.73:6789/0 says I am v1:10.20.193.45:44428/0 (socket says 10.20.193.45:44428) 2026-02-22T23:25:47.993 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.976+0000 7f1bb1972640 1 -- 10.20.193.45:0/2258100007 learned_addr learned my addr 10.20.193.45:0/2258100007 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-22T23:25:47.993 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.976+0000 7f8f858b2640 10 monclient: _reopen_session rank -1 2026-02-22T23:25:47.993 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.976+0000 7f95d396f640 10 monclient: _reopen_session rank -1 2026-02-22T23:25:47.993 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.976+0000 7f8f858b2640 10 monclient: _add_conns ranks=[4,8,1,3,7,0,2,5,6] 2026-02-22T23:25:47.994 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.976+0000 7f95d396f640 10 monclient: _add_conns ranks=[7,3,1,5,0,8,4,2,6] 2026-02-22T23:25:47.994 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.976+0000 7f8f858b2640 10 monclient(hunting): picked mon.noname-c con 0x7f8f800a3630 addr v1:10.20.193.45:6791/0 2026-02-22T23:25:47.994 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.976+0000 7f8f858b2640 10 monclient(hunting): picked mon.noname-e con 0x7f8f80138e10 addr v1:10.20.193.45:6793/0 2026-02-22T23:25:47.994 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.976+0000 7f95d396f640 10 monclient(hunting): picked mon.noname-i con 0x7f95cc0a3d30 addr v1:10.20.193.73:6792/0 2026-02-22T23:25:47.994 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.976+0000 7f8f858b2640 10 monclient(hunting): picked mon.noname-f con 0x7f8f8013f310 addr v1:10.20.193.73:6789/0 2026-02-22T23:25:47.994 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.976+0000 7f95d396f640 10 monclient(hunting): picked mon.noname-g con 0x7f95cc0a5d90 addr v1:10.20.193.73:6790/0 2026-02-22T23:25:47.994 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.976+0000 7f8f858b2640 1 -- --> v1:10.20.193.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8f80142bc0 con 0x7f8f8013f310 2026-02-22T23:25:47.994 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.976+0000 7f8f858b2640 1 -- --> v1:10.20.193.45:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8f801d0bf0 con 0x7f8f800a3630 2026-02-22T23:25:47.994 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.976+0000 7f8f858b2640 1 -- --> v1:10.20.193.45:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8f8013d920 con 0x7f8f80138e10 2026-02-22T23:25:47.994 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.976+0000 7f8f858b2640 10 monclient(hunting): _renew_subs 2026-02-22T23:25:47.994 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.976+0000 7f8f858b2640 10 monclient(hunting): authenticate will time out at 679.592288s 2026-02-22T23:25:47.994 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.976+0000 7f1b92ffd640 1 -- 10.20.193.45:0/2258100007 <== mon.3 v1:10.20.193.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3437962490 0 0) 0x7f1bac0a9db0 con 0x7f1bac0a5d90 2026-02-22T23:25:47.995 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.976+0000 7f1b92ffd640 10 monclient(hunting): _negotiate 2026-02-22T23:25:47.995 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.976+0000 7f95d396f640 10 monclient(hunting): picked mon.noname-f con 0x7f95cc0a6880 addr v1:10.20.193.73:6789/0 2026-02-22T23:25:47.995 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.976+0000 7f95d396f640 1 -- --> v1:10.20.193.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f95cc0a9870 con 0x7f95cc0a6880 2026-02-22T23:25:47.995 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.976+0000 7f95d396f640 1 -- --> v1:10.20.193.73:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f95cc0a1a30 con 0x7f95cc0a5d90 2026-02-22T23:25:47.995 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.976+0000 7f1b92ffd640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:47.995 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.976+0000 7f1b92ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:47.995 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.976+0000 7f1b92ffd640 10 monclient(hunting): my global_id is 4395 2026-02-22T23:25:47.995 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.976+0000 7f95d396f640 1 -- --> v1:10.20.193.73:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f95cc141cc0 con 0x7f95cc0a3d30 2026-02-22T23:25:47.995 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.976+0000 7f95d396f640 10 monclient(hunting): _renew_subs 2026-02-22T23:25:47.995 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.976+0000 7f95d396f640 10 monclient(hunting): authenticate will time out at 679.592299s 2026-02-22T23:25:47.995 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.976+0000 7f1b92ffd640 1 -- 10.20.193.45:0/2258100007 --> v1:10.20.193.73:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1b7c003620 con 0x7f1bac0a5d90 2026-02-22T23:25:47.995 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.976+0000 7f8f7effd640 1 --1- >> v1:10.20.193.45:6791/0 conn(0x7f8f800a3630 0x7f8f801cfdd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.45:6791/0 says I am v1:10.20.193.45:38000/0 (socket says 10.20.193.45:38000) 2026-02-22T23:25:47.995 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.976+0000 7f8f7effd640 1 -- 10.20.193.45:0/3424619899 learned_addr learned my addr 10.20.193.45:0/3424619899 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-22T23:25:47.995 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.976+0000 7f1b92ffd640 1 -- 10.20.193.45:0/2258100007 <== mon.1 v1:10.20.193.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2111936064 0 0) 0x7f1bac0a1430 con 0x7f1bac0a3d30 2026-02-22T23:25:47.995 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.976+0000 7f1b92ffd640 10 monclient(hunting): _negotiate 2026-02-22T23:25:47.995 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.976+0000 7f1b92ffd640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:47.995 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.976+0000 7f1b92ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:47.996 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.976+0000 7f1b92ffd640 10 monclient(hunting): my global_id is 4465 2026-02-22T23:25:47.996 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.976+0000 7f1b92ffd640 1 -- 10.20.193.45:0/2258100007 --> v1:10.20.193.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1bac0a9db0 con 0x7f1bac0a3d30 2026-02-22T23:25:47.996 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.976+0000 7f95d16e4640 1 --1- >> v1:10.20.193.73:6792/0 conn(0x7f95cc0a3d30 0x7f95cc125560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.73:6792/0 says I am v1:10.20.193.45:51494/0 (socket says 10.20.193.45:51494) 2026-02-22T23:25:47.996 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.976+0000 7f95d16e4640 1 -- 10.20.193.45:0/43267479 learned_addr learned my addr 10.20.193.45:0/43267479 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-22T23:25:47.996 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.976+0000 7f95d0ee3640 1 --1- 10.20.193.45:0/43267479 >> v1:10.20.193.73:6790/0 conn(0x7f95cc0a5d90 0x7f95cc125c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.73:6790/0 says I am v1:10.20.193.45:34588/0 (socket says 10.20.193.45:34588) 2026-02-22T23:25:47.996 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.976+0000 7f1b92ffd640 1 -- 10.20.193.45:0/2258100007 <== mon.3 v1:10.20.193.73:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1714814203 0 0) 0x7f1b7c003620 con 0x7f1bac0a5d90 2026-02-22T23:25:47.996 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.976+0000 7f1b92ffd640 1 -- 10.20.193.45:0/2258100007 --> v1:10.20.193.73:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1bac0a1430 con 0x7f1bac0a5d90 2026-02-22T23:25:47.996 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.976+0000 7f1b92ffd640 1 -- 10.20.193.45:0/2258100007 <== mon.3 v1:10.20.193.73:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f1ba00042c0 con 0x7f1bac0a5d90 2026-02-22T23:25:47.996 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.976+0000 7f1b92ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-22T23:25:47.996 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.976+0000 7f1b92ffd640 10 monclient(hunting): got monmap 1 from mon.noname-g (according to old e1) 2026-02-22T23:25:47.996 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.976+0000 7f1b92ffd640 10 monclient(hunting): dump: 2026-02-22T23:25:47.996 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:47.996 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:47.996 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:47.996 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:47.996 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:47.996 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:47.996 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:47.996 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:47.996 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:47.996 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:47.996 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:47.996 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:47.996 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:47.996 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:47.997 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:47.997 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:47.997 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.976+0000 7f1b92ffd640 10 monclient(hunting): _finish_auth 0 2026-02-22T23:25:47.997 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.976+0000 7f8f57fff640 1 -- 10.20.193.45:0/3424619899 <== mon.4 v1:10.20.193.45:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 280390201 0 0) 0x7f8f801d0bf0 con 0x7f8f800a3630 2026-02-22T23:25:47.997 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.976+0000 7f8f57fff640 10 monclient(hunting): _negotiate 2026-02-22T23:25:47.997 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.976+0000 7f8f57fff640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:47.997 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.976+0000 7f8f57fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:47.997 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.976+0000 7f8f57fff640 10 monclient(hunting): my global_id is 4387 2026-02-22T23:25:47.997 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.976+0000 7f8f57fff640 1 -- 10.20.193.45:0/3424619899 --> v1:10.20.193.45:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8f50003620 con 0x7f8f800a3630 2026-02-22T23:25:47.997 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.976+0000 7f8f57fff640 1 -- 10.20.193.45:0/3424619899 <== mon.8 v1:10.20.193.45:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3021394287 0 0) 0x7f8f8013d920 con 0x7f8f80138e10 2026-02-22T23:25:47.997 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.976+0000 7f8f57fff640 10 monclient(hunting): _negotiate 2026-02-22T23:25:47.997 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.976+0000 7f8f57fff640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:47.997 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.976+0000 7f8f57fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:47.997 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.976+0000 7f8f57fff640 10 monclient(hunting): my global_id is 4373 2026-02-22T23:25:47.997 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.976+0000 7f8f57fff640 1 -- 10.20.193.45:0/3424619899 --> v1:10.20.193.45:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8f801d0bf0 con 0x7f8f80138e10 2026-02-22T23:25:47.997 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.976+0000 7f1b92ffd640 1 -- 10.20.193.45:0/2258100007 <== mon.3 v1:10.20.193.73:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2149692205 0 0) 0x7f1bac0a1430 con 0x7f1bac0a5d90 2026-02-22T23:25:47.997 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.976+0000 7f1b92ffd640 1 -- 10.20.193.45:0/2258100007 >> v1:10.20.193.45:6791/0 conn(0x7f1bac0a6880 legacy=0x7f1bac1d7d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:47.997 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.976+0000 7f95b9ffb640 1 -- 10.20.193.45:0/43267479 <== mon.3 v1:10.20.193.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 366710965 0 0) 0x7f95cc0a1a30 con 0x7f95cc0a5d90 2026-02-22T23:25:47.997 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.976+0000 7f95b9ffb640 10 monclient(hunting): _negotiate 2026-02-22T23:25:47.997 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.976+0000 7f95b9ffb640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:47.997 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.976+0000 7f95b9ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:47.997 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.976+0000 7f95b9ffb640 10 monclient(hunting): my global_id is 4404 2026-02-22T23:25:47.997 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.976+0000 7f95b9ffb640 1 -- 10.20.193.45:0/43267479 --> v1:10.20.193.73:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f959c003620 con 0x7f95cc0a5d90 2026-02-22T23:25:47.998 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.976+0000 7f8f57fff640 1 -- 10.20.193.45:0/3424619899 <== mon.4 v1:10.20.193.45:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1567555747 0 0) 0x7f8f50003620 con 0x7f8f800a3630 2026-02-22T23:25:47.998 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.976+0000 7f8f57fff640 1 -- 10.20.193.45:0/3424619899 --> v1:10.20.193.45:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f8f8013d920 con 0x7f8f800a3630 2026-02-22T23:25:47.998 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.976+0000 7f8f57fff640 1 -- 10.20.193.45:0/3424619899 <== mon.4 v1:10.20.193.45:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f8f740033a0 con 0x7f8f800a3630 2026-02-22T23:25:47.998 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.976+0000 7f8f57fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-22T23:25:47.998 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.976+0000 7f8f57fff640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-22T23:25:47.998 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.976+0000 7f8f57fff640 10 monclient(hunting): dump: 2026-02-22T23:25:47.998 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:47.998 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:47.998 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:47.998 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:47.998 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:47.998 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:47.998 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:47.998 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:47.998 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:47.998 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:47.998 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:47.998 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:47.998 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:47.998 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:47.998 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:47.998 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:47.998 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.976+0000 7f8f57fff640 10 monclient(hunting): _finish_auth 0 2026-02-22T23:25:47.998 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.976+0000 7f8f57fff640 1 -- 10.20.193.45:0/3424619899 <== mon.8 v1:10.20.193.45:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1000417812 0 0) 0x7f8f801d0bf0 con 0x7f8f80138e10 2026-02-22T23:25:47.998 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.976+0000 7f95b9ffb640 1 -- 10.20.193.45:0/43267479 <== mon.7 v1:10.20.193.73:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2206812831 0 0) 0x7f95cc141cc0 con 0x7f95cc0a3d30 2026-02-22T23:25:47.998 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.976+0000 7f95b9ffb640 10 monclient(hunting): _negotiate 2026-02-22T23:25:47.998 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.976+0000 7f8f57fff640 1 -- 10.20.193.45:0/3424619899 --> v1:10.20.193.45:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f8f50003620 con 0x7f8f80138e10 2026-02-22T23:25:47.999 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.976+0000 7f8f57fff640 1 -- 10.20.193.45:0/3424619899 <== mon.8 v1:10.20.193.45:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f8f68002f80 con 0x7f8f80138e10 2026-02-22T23:25:47.999 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.976+0000 7f8f57fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-22T23:25:47.999 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.976+0000 7f95b9ffb640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:47.999 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.976+0000 7f95b9ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:47.999 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.976+0000 7f95b9ffb640 10 monclient(hunting): my global_id is 4300 2026-02-22T23:25:47.999 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.976+0000 7f95b9ffb640 1 -- 10.20.193.45:0/43267479 --> v1:10.20.193.73:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f95cc0a1a30 con 0x7f95cc0a3d30 2026-02-22T23:25:47.999 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.976+0000 7f8f57fff640 10 monclient(hunting): got monmap 1 from mon.e (according to old e1) 2026-02-22T23:25:47.999 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.976+0000 7f8f57fff640 10 monclient(hunting): dump: 2026-02-22T23:25:47.999 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:47.999 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:47.999 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:47.999 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:47.999 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:47.999 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:47.999 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:47.999 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:47.999 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:47.999 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:47.999 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:47.999 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:47.999 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:47.999 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:47.999 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:47.999 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:47.999 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.976+0000 7f8f57fff640 1 -- 10.20.193.45:0/3424619899 <== mon.8 v1:10.20.193.45:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3002580591 0 0) 0x7f8f50003620 con 0x7f8f80138e10 2026-02-22T23:25:48.000 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.976+0000 7f8f57fff640 1 -- 10.20.193.45:0/3424619899 >> v1:10.20.193.45:6791/0 conn(0x7f8f800a3630 legacy=0x7f8f801cfdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:48.000 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.976+0000 7f8f57fff640 1 -- 10.20.193.45:0/3424619899 >> v1:10.20.193.73:6789/0 conn(0x7f8f8013f310 legacy=0x7f8f801d8030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:48.000 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.976+0000 7f8f57fff640 10 monclient: _finish_hunting 0 2026-02-22T23:25:48.000 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.976+0000 7f8f57fff640 1 monclient: found mon.e 2026-02-22T23:25:48.000 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.976+0000 7f8f57fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T23:25:48.000 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.976+0000 7f8f57fff640 10 monclient: _send_mon_message to mon.e at v1:10.20.193.45:6793/0 2026-02-22T23:25:48.000 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.976+0000 7f8f57fff640 1 -- 10.20.193.45:0/3424619899 --> v1:10.20.193.45:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f8013d0a0 con 0x7f8f80138e10 2026-02-22T23:25:48.000 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.976+0000 7f8f57fff640 10 monclient: _finish_auth 0 2026-02-22T23:25:48.000 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.976+0000 7f8f57fff640 10 monclient: _check_auth_tickets 2026-02-22T23:25:48.000 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.976+0000 7f8f57fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T23:25:48.000 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.976+0000 7f8f858b2640 5 monclient: authenticate success, global_id 4373 2026-02-22T23:25:48.000 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.976+0000 7f8f858b2640 10 monclient: _renew_subs 2026-02-22T23:25:48.000 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.976+0000 7f8f858b2640 10 monclient: _send_mon_message to mon.e at v1:10.20.193.45:6793/0 2026-02-22T23:25:48.000 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.976+0000 7f95b9ffb640 1 -- 10.20.193.45:0/43267479 <== mon.3 v1:10.20.193.73:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2145887835 0 0) 0x7f959c003620 con 0x7f95cc0a5d90 2026-02-22T23:25:48.000 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.976+0000 7f95b9ffb640 1 -- 10.20.193.45:0/43267479 --> v1:10.20.193.73:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f95cc141cc0 con 0x7f95cc0a5d90 2026-02-22T23:25:48.000 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.976+0000 7f8f858b2640 1 -- 10.20.193.45:0/3424619899 --> v1:10.20.193.45:6793/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f8f8013d640 con 0x7f8f80138e10 2026-02-22T23:25:48.000 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.976+0000 7f95b9ffb640 1 -- 10.20.193.45:0/43267479 <== mon.3 v1:10.20.193.73:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f95c0003410 con 0x7f95cc0a5d90 2026-02-22T23:25:48.000 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.976+0000 7f95b9ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-22T23:25:48.000 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.976+0000 7f95b9ffb640 10 monclient(hunting): got monmap 1 from mon.noname-g (according to old e1) 2026-02-22T23:25:48.000 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.976+0000 7f95b9ffb640 10 monclient(hunting): dump: 2026-02-22T23:25:48.000 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:48.000 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:48.000 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:48.000 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:48.000 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:48.000 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:48.000 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:48.000 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:48.000 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:48.001 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:48.001 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:48.001 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:48.001 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:48.001 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:48.001 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:48.001 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:48.001 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.976+0000 7f95b9ffb640 10 monclient(hunting): _finish_auth 0 2026-02-22T23:25:48.001 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.976+0000 7f95b9ffb640 1 -- 10.20.193.45:0/43267479 <== mon.7 v1:10.20.193.73:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4089529258 0 0) 0x7f95cc0a1a30 con 0x7f95cc0a3d30 2026-02-22T23:25:48.001 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.976+0000 7f95b9ffb640 1 -- 10.20.193.45:0/43267479 --> v1:10.20.193.73:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f959c003620 con 0x7f95cc0a3d30 2026-02-22T23:25:48.001 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.976+0000 7f8f858b2640 10 monclient: _renew_subs 2026-02-22T23:25:48.001 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.976+0000 7f8f858b2640 10 monclient: _send_mon_message to mon.e at v1:10.20.193.45:6793/0 2026-02-22T23:25:48.001 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.976+0000 7f8f858b2640 1 -- 10.20.193.45:0/3424619899 --> v1:10.20.193.45:6793/0 -- mon_subscribe({osdmap=0}) -- 0x7f8f8013e3f0 con 0x7f8f80138e10 2026-02-22T23:25:48.001 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.976+0000 7f8f57fff640 1 -- 10.20.193.45:0/3424619899 <== mon.8 v1:10.20.193.45:6793/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f8f68004b90 con 0x7f8f80138e10 2026-02-22T23:25:48.001 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.976+0000 7f8f57fff640 10 monclient: handle_config config(0 keys) 2026-02-22T23:25:48.001 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.976+0000 7f8f57fff640 1 -- 10.20.193.45:0/3424619899 <== mon.8 v1:10.20.193.45:6793/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f8f680052e0 con 0x7f8f80138e10 2026-02-22T23:25:48.001 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.976+0000 7f8f57fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:25:48.001 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.976+0000 7f8f57fff640 10 monclient: got monmap 1 from mon.e (according to old e1) 2026-02-22T23:25:48.001 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.976+0000 7f8f7d7fa640 4 set_mon_vals no callback set 2026-02-22T23:25:48.001 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.976+0000 7f8f57fff640 10 monclient: dump: 2026-02-22T23:25:48.001 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:48.001 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:48.001 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:48.001 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:48.001 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:48.002 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:48.002 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:48.002 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:48.002 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:48.002 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:48.002 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:48.002 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:48.002 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:48.002 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:48.002 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:48.002 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:48.002 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.976+0000 7f95b9ffb640 1 -- 10.20.193.45:0/43267479 <== mon.7 v1:10.20.193.73:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f95bc0033e0 con 0x7f95cc0a3d30 2026-02-22T23:25:48.002 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.976+0000 7f95b9ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-22T23:25:48.002 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.976+0000 7f95b9ffb640 10 monclient(hunting): got monmap 1 from mon.i (according to old e1) 2026-02-22T23:25:48.002 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.976+0000 7f95b9ffb640 10 monclient(hunting): dump: 2026-02-22T23:25:48.002 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:48.002 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:48.002 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:48.002 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:48.002 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:48.002 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:48.002 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:48.002 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:48.002 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:48.002 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:48.003 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:48.003 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:48.003 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:48.003 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:48.003 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:48.003 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:48.003 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.976+0000 7f95b9ffb640 1 -- 10.20.193.45:0/43267479 <== mon.3 v1:10.20.193.73:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 898036508 0 0) 0x7f95cc141cc0 con 0x7f95cc0a5d90 2026-02-22T23:25:48.003 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.977+0000 7f95b9ffb640 1 -- 10.20.193.45:0/43267479 >> v1:10.20.193.73:6792/0 conn(0x7f95cc0a3d30 legacy=0x7f95cc125560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:48.003 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.977+0000 7f95b9ffb640 1 -- 10.20.193.45:0/43267479 >> v1:10.20.193.73:6789/0 conn(0x7f95cc0a6880 legacy=0x7f95cc126380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:48.003 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.977+0000 7f95b9ffb640 10 monclient: _finish_hunting 0 2026-02-22T23:25:48.003 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.977+0000 7f95b9ffb640 1 monclient: found mon.g 2026-02-22T23:25:48.003 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.977+0000 7f95b9ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T23:25:48.003 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.977+0000 7f95b9ffb640 10 monclient: _send_mon_message to mon.g at v1:10.20.193.73:6790/0 2026-02-22T23:25:48.003 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.977+0000 7f95b9ffb640 1 -- 10.20.193.45:0/43267479 --> v1:10.20.193.73:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95cc1292c0 con 0x7f95cc0a5d90 2026-02-22T23:25:48.003 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.977+0000 7f95b9ffb640 10 monclient: _finish_auth 0 2026-02-22T23:25:48.003 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.977+0000 7f95b9ffb640 10 monclient: _check_auth_tickets 2026-02-22T23:25:48.003 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.977+0000 7f95b9ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T23:25:48.003 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.977+0000 7f95d396f640 5 monclient: authenticate success, global_id 4404 2026-02-22T23:25:48.003 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.977+0000 7f95d396f640 10 monclient: _renew_subs 2026-02-22T23:25:48.003 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.977+0000 7f95d396f640 10 monclient: _send_mon_message to mon.g at v1:10.20.193.73:6790/0 2026-02-22T23:25:48.003 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.977+0000 7f95d396f640 1 -- 10.20.193.45:0/43267479 --> v1:10.20.193.73:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f95cc128a20 con 0x7f95cc0a5d90 2026-02-22T23:25:48.003 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.977+0000 7f95d396f640 10 monclient: _renew_subs 2026-02-22T23:25:48.003 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.977+0000 7f95d396f640 10 monclient: _send_mon_message to mon.g at v1:10.20.193.73:6790/0 2026-02-22T23:25:48.003 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.977+0000 7f95d396f640 1 -- 10.20.193.45:0/43267479 --> v1:10.20.193.73:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f95cc1d8cf0 con 0x7f95cc0a5d90 2026-02-22T23:25:48.003 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.977+0000 7f95b9ffb640 1 -- 10.20.193.45:0/43267479 <== mon.3 v1:10.20.193.73:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f95c0004ed0 con 0x7f95cc0a5d90 2026-02-22T23:25:48.003 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.977+0000 7f95b9ffb640 10 monclient: handle_config config(0 keys) 2026-02-22T23:25:48.003 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.977+0000 7f95b9ffb640 1 -- 10.20.193.45:0/43267479 <== mon.3 v1:10.20.193.73:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f95c00053c0 con 0x7f95cc0a5d90 2026-02-22T23:25:48.003 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.977+0000 7f95b9ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:25:48.003 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.977+0000 7f95bb7fe640 4 set_mon_vals no callback set 2026-02-22T23:25:48.003 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.977+0000 7f95b9ffb640 10 monclient: got monmap 1 from mon.g (according to old e1) 2026-02-22T23:25:48.003 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.977+0000 7f95b9ffb640 10 monclient: dump: 2026-02-22T23:25:48.003 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:48.003 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:48.003 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:48.003 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:48.003 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:48.003 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:48.003 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:48.003 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:48.003 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:48.003 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:48.003 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:48.003 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:48.003 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:48.003 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:48.004 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:48.004 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:48.004 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.977+0000 7f8f858b2640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T23:25:48.004 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.977+0000 7f8f858b2640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T23:25:48.004 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.977+0000 7f8f858b2640 10 monclient: _send_mon_message to mon.e at v1:10.20.193.45:6793/0 2026-02-22T23:25:48.004 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.977+0000 7f8f858b2640 1 -- 10.20.193.45:0/3424619899 --> v1:10.20.193.45:6793/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f8013ece0 con 0x7f8f80138e10 2026-02-22T23:25:48.004 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.977+0000 7f8f57fff640 1 -- 10.20.193.45:0/3424619899 <== mon.8 v1:10.20.193.45:6793/0 7 ==== mgrmap(e 5) ==== 50225+0+0 (unknown 2330357642 0 0) 0x7f8f680118c0 con 0x7f8f80138e10 2026-02-22T23:25:48.004 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.977+0000 7f95b9ffb640 1 -- 10.20.193.45:0/43267479 <== mon.3 v1:10.20.193.73:6790/0 7 ==== mgrmap(e 5) ==== 50225+0+0 (unknown 2330357642 0 0) 0x7f95c00119a0 con 0x7f95cc0a5d90 2026-02-22T23:25:48.004 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.977+0000 7f95d396f640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T23:25:48.004 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.977+0000 7f95d396f640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T23:25:48.004 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.977+0000 7f95d396f640 10 monclient: _send_mon_message to mon.g at v1:10.20.193.73:6790/0 2026-02-22T23:25:48.004 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.977+0000 7f95d396f640 1 -- 10.20.193.45:0/43267479 --> v1:10.20.193.73:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9590005180 con 0x7f95cc0a5d90 2026-02-22T23:25:48.004 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.977+0000 7f8f57fff640 1 -- 10.20.193.45:0/3424619899 <== mon.8 v1:10.20.193.45:6793/0 8 ==== osd_map(19..19 src has 1..19) ==== 3558+0+0 (unknown 1288710973 0 0) 0x7f8f6804d980 con 0x7f8f80138e10 2026-02-22T23:25:48.004 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.977+0000 7f95b9ffb640 1 -- 10.20.193.45:0/43267479 <== mon.3 v1:10.20.193.73:6790/0 8 ==== osd_map(19..19 src has 1..19) ==== 3558+0+0 (unknown 1288710973 0 0) 0x7f95c004db90 con 0x7f95cc0a5d90 2026-02-22T23:25:48.004 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.977+0000 7f8f7effd640 10 monclient: get_auth_request con 0x7f8f5003fdc0 auth_method 0 2026-02-22T23:25:48.004 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.977+0000 7f95d16e4640 10 monclient: get_auth_request con 0x7f959c03fe20 auth_method 0 2026-02-22T23:25:48.005 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.978+0000 7f1b92ffd640 1 -- 10.20.193.45:0/2258100007 >> v1:10.20.193.73:6789/0 conn(0x7f1bac0a3d30 legacy=0x7f1bac141760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:48.005 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.978+0000 7f1b92ffd640 10 monclient: _finish_hunting 0 2026-02-22T23:25:48.005 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.978+0000 7f1b92ffd640 1 monclient: found mon.g 2026-02-22T23:25:48.005 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.978+0000 7f1b92ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T23:25:48.005 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.978+0000 7f1b92ffd640 10 monclient: _send_mon_message to mon.g at v1:10.20.193.73:6790/0 2026-02-22T23:25:48.005 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.978+0000 7f1b92ffd640 1 -- 10.20.193.45:0/2258100007 --> v1:10.20.193.73:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bac127c70 con 0x7f1bac0a5d90 2026-02-22T23:25:48.005 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.978+0000 7f1b92ffd640 10 monclient: _finish_auth 0 2026-02-22T23:25:48.005 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.978+0000 7f1b92ffd640 10 monclient: _check_auth_tickets 2026-02-22T23:25:48.005 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.978+0000 7f1b92ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T23:25:48.005 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.978+0000 7f1bb43fe640 5 monclient: authenticate success, global_id 4395 2026-02-22T23:25:48.005 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.978+0000 7f1bb43fe640 10 monclient: _renew_subs 2026-02-22T23:25:48.005 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.978+0000 7f1bb43fe640 10 monclient: _send_mon_message to mon.g at v1:10.20.193.73:6790/0 2026-02-22T23:25:48.005 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.978+0000 7f1bb43fe640 1 -- 10.20.193.45:0/2258100007 --> v1:10.20.193.73:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f1bac126dd0 con 0x7f1bac0a5d90 2026-02-22T23:25:48.005 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.978+0000 7f1bb43fe640 10 monclient: _renew_subs 2026-02-22T23:25:48.005 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.978+0000 7f1bb43fe640 10 monclient: _send_mon_message to mon.g at v1:10.20.193.73:6790/0 2026-02-22T23:25:48.005 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.978+0000 7f1bb43fe640 1 -- 10.20.193.45:0/2258100007 --> v1:10.20.193.73:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f1bac1279c0 con 0x7f1bac0a5d90 2026-02-22T23:25:48.005 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.978+0000 7f1bb43fe640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T23:25:48.005 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.978+0000 7f1bb43fe640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T23:25:48.005 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.978+0000 7f1bb43fe640 10 monclient: _send_mon_message to mon.g at v1:10.20.193.73:6790/0 2026-02-22T23:25:48.005 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.978+0000 7f1bb43fe640 1 -- 10.20.193.45:0/2258100007 --> v1:10.20.193.73:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1bac141e70 con 0x7f1bac0a5d90 2026-02-22T23:25:48.005 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.980+0000 7f8f57fff640 1 -- 10.20.193.45:0/3424619899 <== mon.8 v1:10.20.193.45:6793/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (unknown 1092875540 0 2568732696) 0x7f8f68017620 con 0x7f8f80138e10 2026-02-22T23:25:48.005 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.980+0000 7f8f57fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T23:25:48.005 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.980+0000 7f8f57fff640 10 monclient: _finish_command 1 = system:0 2026-02-22T23:25:48.006 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.980+0000 7f1b92ffd640 1 -- 10.20.193.45:0/2258100007 <== mon.3 v1:10.20.193.73:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1ba0002d40 con 0x7f1bac0a5d90 2026-02-22T23:25:48.006 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.980+0000 7f1b92ffd640 10 monclient: handle_config config(0 keys) 2026-02-22T23:25:48.006 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.980+0000 7f1bb0970640 4 set_mon_vals no callback set 2026-02-22T23:25:48.006 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.980+0000 7f1b92ffd640 1 -- 10.20.193.45:0/2258100007 <== mon.3 v1:10.20.193.73:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f1ba00032b0 con 0x7f1bac0a5d90 2026-02-22T23:25:48.006 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.980+0000 7f1b92ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:25:48.006 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.980+0000 7f1b92ffd640 10 monclient: got monmap 1 from mon.g (according to old e1) 2026-02-22T23:25:48.006 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.980+0000 7f1b92ffd640 10 monclient: dump: 2026-02-22T23:25:48.006 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:48.006 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:48.006 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:48.006 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:48.006 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:48.006 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:48.006 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:48.006 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:48.006 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:48.006 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:48.006 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:48.006 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:48.006 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:48.006 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:48.006 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:48.006 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:48.006 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.980+0000 7f95b9ffb640 1 -- 10.20.193.45:0/43267479 <== mon.3 v1:10.20.193.73:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (unknown 1092875540 0 2568732696) 0x7f95c0017690 con 0x7f95cc0a5d90 2026-02-22T23:25:48.006 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.980+0000 7f95b9ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T23:25:48.006 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.980+0000 7f95b9ffb640 10 monclient: _finish_command 1 = system:0 2026-02-22T23:25:48.006 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.981+0000 7f1b92ffd640 1 -- 10.20.193.45:0/2258100007 <== mon.3 v1:10.20.193.73:6790/0 7 ==== mgrmap(e 5) ==== 50225+0+0 (unknown 2330357642 0 0) 0x7f1ba00034d0 con 0x7f1bac0a5d90 2026-02-22T23:25:48.006 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.981+0000 7f1b92ffd640 1 -- 10.20.193.45:0/2258100007 <== mon.3 v1:10.20.193.73:6790/0 8 ==== osd_map(19..19 src has 1..19) ==== 3558+0+0 (unknown 1288710973 0 0) 0x7f1ba004dd40 con 0x7f1bac0a5d90 2026-02-22T23:25:48.006 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.981+0000 7f1bb2173640 10 monclient: get_auth_request con 0x7f1b7c03f620 auth_method 0 2026-02-22T23:25:48.006 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.983+0000 7f1b92ffd640 1 -- 10.20.193.45:0/2258100007 <== mon.3 v1:10.20.193.73:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (unknown 1092875540 0 2568732696) 0x7f1ba00177e0 con 0x7f1bac0a5d90 2026-02-22T23:25:48.006 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.983+0000 7f1b92ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T23:25:48.006 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:47.983+0000 7f1b92ffd640 10 monclient: _finish_command 1 = system:0 2026-02-22T23:25:48.022 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.022+0000 7f31b0f11640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 5}] 2026-02-22T23:25:48.022 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.022+0000 7f31b0f11640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 5}] 2026-02-22T23:25:48.022 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.022+0000 7f31b0f11640 10 monclient: _send_mon_message to mon.d at v1:10.20.193.45:6792/0 2026-02-22T23:25:48.022 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.022+0000 7f31b0f11640 1 -- 10.20.193.45:0/2083576879 --> v1:10.20.193.45:6792/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f31ac13bb30 con 0x7f31ac0a4610 2026-02-22T23:25:48.022 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.022+0000 7f232ffca640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 2}] 2026-02-22T23:25:48.022 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.022+0000 7f232ffca640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 2}] 2026-02-22T23:25:48.022 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.022+0000 7f232ffca640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.45:6791/0 2026-02-22T23:25:48.022 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.022+0000 7f232ffca640 1 -- 10.20.193.45:0/327049672 --> v1:10.20.193.45:6791/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f232806ce10 con 0x7f23280a68f0 2026-02-22T23:25:48.023 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.022+0000 7f3192ffd640 1 -- 10.20.193.45:0/2083576879 <== mon.6 v1:10.20.193.45:6792/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (unknown 2131975755 0 532354816) 0x7f3194017100 con 0x7f31ac0a4610 2026-02-22T23:25:48.023 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.022+0000 7f3192ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 5}] 2026-02-22T23:25:48.023 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.022+0000 7f3192ffd640 10 monclient: _finish_command 2 = system:0 2026-02-22T23:25:48.023 INFO:teuthology.orchestra.run.trial045.stdout:51539607557 2026-02-22T23:25:48.023 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.023+0000 7f23167fc640 1 -- 10.20.193.45:0/327049672 <== mon.4 v1:10.20.193.45:6791/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (unknown 92182286 0 203001719) 0x7f231c01b420 con 0x7f23280a68f0 2026-02-22T23:25:48.023 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.023+0000 7f23167fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 2}] 2026-02-22T23:25:48.023 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.023+0000 7f23167fc640 10 monclient: _finish_command 2 = system:0 2026-02-22T23:25:48.023 INFO:teuthology.orchestra.run.trial045.stdout:51539607556 2026-02-22T23:25:48.024 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.025+0000 7f31b0f11640 1 -- 10.20.193.45:0/2083576879 >> v1:10.20.193.73:6800/2222410180 conn(0x7f317803fe30 legacy=0x7f31780422f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:48.024 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.025+0000 7f31b0f11640 10 monclient: shutdown 2026-02-22T23:25:48.024 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.025+0000 7f31b0f11640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T23:25:48.024 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.025+0000 7f31b0f11640 1 -- 10.20.193.45:0/2083576879 >> v1:10.20.193.45:6792/0 conn(0x7f31ac0a4610 legacy=0x7f31ac13fb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:48.024 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.025+0000 7f31b0f11640 1 -- 10.20.193.45:0/2083576879 shutdown_connections 2026-02-22T23:25:48.024 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.025+0000 7f31b0f11640 1 -- 10.20.193.45:0/2083576879 >> 10.20.193.45:0/2083576879 conn(0x7f31ac0a7f70 msgr2=0x7f31ac142270 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:25:48.025 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.025+0000 7f232ffca640 1 -- 10.20.193.45:0/327049672 >> v1:10.20.193.73:6800/2222410180 conn(0x7f22f803fff0 legacy=0x7f22f80424b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:48.025 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.025+0000 7f232ffca640 10 monclient: shutdown 2026-02-22T23:25:48.025 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.025+0000 7f232ffca640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T23:25:48.025 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.025+0000 7f31b0f11640 1 -- 10.20.193.45:0/2083576879 shutdown_connections 2026-02-22T23:25:48.025 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.025+0000 7f232ffca640 1 -- 10.20.193.45:0/327049672 >> v1:10.20.193.45:6791/0 conn(0x7f23280a68f0 legacy=0x7f23281d4580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:48.025 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.025+0000 7f31b0f11640 1 -- 10.20.193.45:0/2083576879 wait complete. 2026-02-22T23:25:48.025 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.025+0000 7f232ffca640 1 -- 10.20.193.45:0/327049672 shutdown_connections 2026-02-22T23:25:48.025 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.025+0000 7f232ffca640 1 -- 10.20.193.45:0/327049672 >> 10.20.193.45:0/327049672 conn(0x7f23280abb50 msgr2=0x7f2328142580 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:25:48.025 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.025+0000 7f232ffca640 1 -- 10.20.193.45:0/327049672 shutdown_connections 2026-02-22T23:25:48.025 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.025+0000 7f232ffca640 1 -- 10.20.193.45:0/327049672 wait complete. 2026-02-22T23:25:48.025 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.025+0000 7fdc232f5640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 3}] 2026-02-22T23:25:48.025 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.025+0000 7fdc232f5640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 3}] 2026-02-22T23:25:48.025 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.025+0000 7fdc232f5640 10 monclient: _send_mon_message to mon.f at v1:10.20.193.73:6789/0 2026-02-22T23:25:48.025 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.025+0000 7fdc232f5640 1 -- 10.20.193.45:0/4256543904 --> v1:10.20.193.73:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fdc1c069720 con 0x7fdc1c0a68f0 2026-02-22T23:25:48.025 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.025+0000 7fdc09ffb640 1 -- 10.20.193.45:0/4256543904 <== mon.1 v1:10.20.193.73:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (unknown 383520633 0 1444633209) 0x7fdc100164e0 con 0x7fdc1c0a68f0 2026-02-22T23:25:48.025 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.025+0000 7fdc09ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 3}] 2026-02-22T23:25:48.026 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.025+0000 7fdc09ffb640 10 monclient: _finish_command 2 = system:0 2026-02-22T23:25:48.026 INFO:teuthology.orchestra.run.trial045.stdout:47244640260 2026-02-22T23:25:48.027 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.027+0000 7fdc232f5640 1 -- 10.20.193.45:0/4256543904 >> v1:10.20.193.73:6800/2222410180 conn(0x7fdbec040000 legacy=0x7fdbec0424c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:48.027 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.027+0000 7fdc232f5640 10 monclient: shutdown 2026-02-22T23:25:48.027 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.027+0000 7fdc232f5640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T23:25:48.027 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.027+0000 7fdc232f5640 1 -- 10.20.193.45:0/4256543904 >> v1:10.20.193.73:6789/0 conn(0x7fdc1c0a68f0 legacy=0x7fdc1c1d5100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:48.027 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.027+0000 7fdc232f5640 1 -- 10.20.193.45:0/4256543904 shutdown_connections 2026-02-22T23:25:48.027 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.027+0000 7fdc232f5640 1 -- 10.20.193.45:0/4256543904 >> 10.20.193.45:0/4256543904 conn(0x7fdc1c0abb50 msgr2=0x7fdc1c0a4010 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:25:48.027 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.027+0000 7fdc232f5640 1 -- 10.20.193.45:0/4256543904 shutdown_connections 2026-02-22T23:25:48.027 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.027+0000 7fdc232f5640 1 -- 10.20.193.45:0/4256543904 wait complete. 2026-02-22T23:25:48.033 INFO:tasks.ceph.ceph_manager.ceph:need seq 51539607555 got 51539607556 for osd.2 2026-02-22T23:25:48.033 DEBUG:teuthology.parallel:result is None 2026-02-22T23:25:48.034 INFO:tasks.ceph.ceph_manager.ceph:need seq 51539607556 got 51539607557 for osd.5 2026-02-22T23:25:48.034 DEBUG:teuthology.parallel:result is None 2026-02-22T23:25:48.035 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640260 got 47244640260 for osd.3 2026-02-22T23:25:48.035 DEBUG:teuthology.parallel:result is None 2026-02-22T23:25:48.067 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.067+0000 7f95d396f640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 0}] 2026-02-22T23:25:48.067 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.067+0000 7f95d396f640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 0}] 2026-02-22T23:25:48.068 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.067+0000 7f95d396f640 10 monclient: _send_mon_message to mon.g at v1:10.20.193.73:6790/0 2026-02-22T23:25:48.068 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.067+0000 7f95d396f640 1 -- 10.20.193.45:0/43267479 --> v1:10.20.193.73:6790/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f9590005470 con 0x7f95cc0a5d90 2026-02-22T23:25:48.068 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.068+0000 7f95b9ffb640 1 -- 10.20.193.45:0/43267479 <== mon.3 v1:10.20.193.73:6790/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (unknown 574334944 0 203001719) 0x7f95c0016f90 con 0x7f95cc0a5d90 2026-02-22T23:25:48.068 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.068+0000 7f95b9ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 0}] 2026-02-22T23:25:48.068 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.068+0000 7f95b9ffb640 10 monclient: _finish_command 2 = system:0 2026-02-22T23:25:48.068 INFO:teuthology.orchestra.run.trial045.stdout:51539607556 2026-02-22T23:25:48.069 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.069+0000 7f95d396f640 1 -- 10.20.193.45:0/43267479 >> v1:10.20.193.73:6800/2222410180 conn(0x7f959c03fe20 legacy=0x7f959c0422e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:48.069 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.069+0000 7f95d396f640 10 monclient: shutdown 2026-02-22T23:25:48.069 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.069+0000 7f95d396f640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T23:25:48.069 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.069+0000 7f95d396f640 1 -- 10.20.193.45:0/43267479 >> v1:10.20.193.73:6790/0 conn(0x7f95cc0a5d90 legacy=0x7f95cc125c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:48.069 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.069+0000 7f95d396f640 1 -- 10.20.193.45:0/43267479 shutdown_connections 2026-02-22T23:25:48.069 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.069+0000 7f95d396f640 1 -- 10.20.193.45:0/43267479 >> 10.20.193.45:0/43267479 conn(0x7f95cc0ab9c0 msgr2=0x7f95cc142640 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:25:48.069 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.069+0000 7f95d396f640 1 -- 10.20.193.45:0/43267479 shutdown_connections 2026-02-22T23:25:48.069 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.069+0000 7f95d396f640 1 -- 10.20.193.45:0/43267479 wait complete. 2026-02-22T23:25:48.071 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.071+0000 7f8f858b2640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 1}] 2026-02-22T23:25:48.071 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.071+0000 7f8f858b2640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 1}] 2026-02-22T23:25:48.071 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.071+0000 7f8f858b2640 10 monclient: _send_mon_message to mon.e at v1:10.20.193.45:6793/0 2026-02-22T23:25:48.071 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.071+0000 7f8f858b2640 1 -- 10.20.193.45:0/3424619899 --> v1:10.20.193.45:6793/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f8f800a24a0 con 0x7f8f80138e10 2026-02-22T23:25:48.072 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.072+0000 7f8f57fff640 1 -- 10.20.193.45:0/3424619899 <== mon.8 v1:10.20.193.45:6793/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (unknown 832126871 0 203001719) 0x7f8f68016f20 con 0x7f8f80138e10 2026-02-22T23:25:48.072 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.072+0000 7f8f57fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 1}] 2026-02-22T23:25:48.072 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.072+0000 7f8f57fff640 10 monclient: _finish_command 2 = system:0 2026-02-22T23:25:48.072 INFO:teuthology.orchestra.run.trial045.stdout:51539607556 2026-02-22T23:25:48.072 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.072+0000 7f1bb43fe640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 4}] 2026-02-22T23:25:48.072 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.072+0000 7f1bb43fe640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 4}] 2026-02-22T23:25:48.072 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.072+0000 7f1bb43fe640 10 monclient: _send_mon_message to mon.g at v1:10.20.193.73:6790/0 2026-02-22T23:25:48.072 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.072+0000 7f1bb43fe640 1 -- 10.20.193.45:0/2258100007 --> v1:10.20.193.73:6790/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f1bac06ce10 con 0x7f1bac0a5d90 2026-02-22T23:25:48.073 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.073+0000 7f1b92ffd640 1 -- 10.20.193.45:0/2258100007 <== mon.3 v1:10.20.193.73:6790/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (unknown 1823589948 0 203001719) 0x7f1ba00170e0 con 0x7f1bac0a5d90 2026-02-22T23:25:48.073 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.073+0000 7f1b92ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 4}] 2026-02-22T23:25:48.073 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.073+0000 7f1b92ffd640 10 monclient: _finish_command 2 = system:0 2026-02-22T23:25:48.073 INFO:teuthology.orchestra.run.trial045.stdout:51539607556 2026-02-22T23:25:48.074 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.073+0000 7f8f858b2640 1 -- 10.20.193.45:0/3424619899 >> v1:10.20.193.73:6800/2222410180 conn(0x7f8f5003fdc0 legacy=0x7f8f50042280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:48.074 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.073+0000 7f8f858b2640 10 monclient: shutdown 2026-02-22T23:25:48.074 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.073+0000 7f8f858b2640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T23:25:48.074 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.073+0000 7f8f858b2640 1 -- 10.20.193.45:0/3424619899 >> v1:10.20.193.45:6793/0 conn(0x7f8f80138e10 legacy=0x7f8f801d04e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:48.074 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.073+0000 7f8f858b2640 1 -- 10.20.193.45:0/3424619899 shutdown_connections 2026-02-22T23:25:48.074 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.073+0000 7f8f858b2640 1 -- 10.20.193.45:0/3424619899 >> 10.20.193.45:0/3424619899 conn(0x7f8f800a7780 msgr2=0x7f8f80131a90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:25:48.074 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.073+0000 7f8f858b2640 1 -- 10.20.193.45:0/3424619899 shutdown_connections 2026-02-22T23:25:48.074 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.073+0000 7f8f858b2640 1 -- 10.20.193.45:0/3424619899 wait complete. 2026-02-22T23:25:48.075 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.075+0000 7f1bb43fe640 1 -- 10.20.193.45:0/2258100007 >> v1:10.20.193.73:6800/2222410180 conn(0x7f1b7c03f620 legacy=0x7f1b7c041ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:48.075 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.075+0000 7f1bb43fe640 10 monclient: shutdown 2026-02-22T23:25:48.075 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.075+0000 7f1bb43fe640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T23:25:48.075 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.075+0000 7f1bb43fe640 1 -- 10.20.193.45:0/2258100007 >> v1:10.20.193.73:6790/0 conn(0x7f1bac0a5d90 legacy=0x7f1bac1d4630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:48.075 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.075+0000 7f1bb43fe640 1 -- 10.20.193.45:0/2258100007 shutdown_connections 2026-02-22T23:25:48.075 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.075+0000 7f1bb43fe640 1 -- 10.20.193.45:0/2258100007 >> 10.20.193.45:0/2258100007 conn(0x7f1bac0ab9c0 msgr2=0x7f1bac142410 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:25:48.075 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.075+0000 7f1bb43fe640 1 -- 10.20.193.45:0/2258100007 shutdown_connections 2026-02-22T23:25:48.075 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.075+0000 7f1bb43fe640 1 -- 10.20.193.45:0/2258100007 wait complete. 2026-02-22T23:25:48.078 INFO:tasks.ceph.ceph_manager.ceph:need seq 51539607555 got 51539607556 for osd.0 2026-02-22T23:25:48.078 DEBUG:teuthology.parallel:result is None 2026-02-22T23:25:48.081 INFO:tasks.ceph.ceph_manager.ceph:need seq 51539607555 got 51539607556 for osd.1 2026-02-22T23:25:48.081 DEBUG:teuthology.parallel:result is None 2026-02-22T23:25:48.082 INFO:tasks.ceph.ceph_manager.ceph:need seq 51539607555 got 51539607556 for osd.4 2026-02-22T23:25:48.082 DEBUG:teuthology.parallel:result is None 2026-02-22T23:25:48.082 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2026-02-22T23:25:48.083 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-22T23:25:48.189 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.189+0000 7f1462e98640 10 monclient: get_monmap_and_config 2026-02-22T23:25:48.190 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.189+0000 7f1462e98640 10 monclient: build_initial_monmap 2026-02-22T23:25:48.190 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.189+0000 7f1462e98640 10 monclient: monmap: 2026-02-22T23:25:48.190 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-22T23:25:48.190 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:48.190 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:25:48.190106+0000 2026-02-22T23:25:48.190 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:25:48.190106+0000 2026-02-22T23:25:48.190 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-22T23:25:48.190 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:48.190 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-22T23:25:48.190 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.noname-f 2026-02-22T23:25:48.190 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.noname-b 2026-02-22T23:25:48.190 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.noname-g 2026-02-22T23:25:48.190 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.noname-c 2026-02-22T23:25:48.190 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.noname-h 2026-02-22T23:25:48.190 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.noname-d 2026-02-22T23:25:48.190 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.noname-i 2026-02-22T23:25:48.190 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.noname-e 2026-02-22T23:25:48.190 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:48.194 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.190+0000 7f1462e98640 1 Processor -- start 2026-02-22T23:25:48.194 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.190+0000 7f1462e98640 1 -- start start 2026-02-22T23:25:48.194 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.190+0000 7f1462e98640 10 monclient: init 2026-02-22T23:25:48.194 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.190+0000 7f1462e98640 10 monclient: _reopen_session rank -1 2026-02-22T23:25:48.194 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.190+0000 7f1462e98640 10 monclient: _add_conns ranks=[4,7,0,3,5,2,1,6,8] 2026-02-22T23:25:48.194 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.190+0000 7f1462e98640 10 monclient(hunting): picked mon.noname-c con 0x7f145c0a41a0 addr v1:10.20.193.45:6791/0 2026-02-22T23:25:48.194 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.190+0000 7f1462e98640 10 monclient(hunting): picked mon.noname-i con 0x7f145c0a4c90 addr v1:10.20.193.73:6792/0 2026-02-22T23:25:48.194 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.190+0000 7f1462e98640 10 monclient(hunting): picked mon.noname-a con 0x7f145c0a50a0 addr v1:10.20.193.45:6789/0 2026-02-22T23:25:48.194 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.190+0000 7f1462e98640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f145c06e1b0 con 0x7f145c0a50a0 2026-02-22T23:25:48.194 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.190+0000 7f1462e98640 1 -- --> v1:10.20.193.45:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f145c06e490 con 0x7f145c0a41a0 2026-02-22T23:25:48.194 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.190+0000 7f1462e98640 1 -- --> v1:10.20.193.73:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f145c0a5530 con 0x7f145c0a4c90 2026-02-22T23:25:48.194 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.190+0000 7f1462e98640 10 monclient(hunting): _renew_subs 2026-02-22T23:25:48.194 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.190+0000 7f1462e98640 10 monclient(hunting): authenticate will time out at 679.806671s 2026-02-22T23:25:48.194 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.190+0000 7f1460c0d640 1 --1- >> v1:10.20.193.45:6791/0 conn(0x7f145c0a41a0 0x7f145c0a4580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.45:6791/0 says I am v1:10.20.193.45:38008/0 (socket says 10.20.193.45:38008) 2026-02-22T23:25:48.194 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.190+0000 7f1460c0d640 1 -- 10.20.193.45:0/1088966042 learned_addr learned my addr 10.20.193.45:0/1088966042 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-22T23:25:48.194 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.190+0000 7f146140e640 1 --1- 10.20.193.45:0/1088966042 >> v1:10.20.193.45:6789/0 conn(0x7f145c0a50a0 0x7f145c141710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.45:6789/0 says I am v1:10.20.193.45:58260/0 (socket says 10.20.193.45:58260) 2026-02-22T23:25:48.194 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.190+0000 7f14537fe640 1 -- 10.20.193.45:0/1088966042 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2632496935 0 0) 0x7f145c06e1b0 con 0x7f145c0a50a0 2026-02-22T23:25:48.194 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.190+0000 7f14537fe640 10 monclient(hunting): _negotiate 2026-02-22T23:25:48.194 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.190+0000 7f14537fe640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:48.194 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.190+0000 7f14537fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:48.194 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.190+0000 7f14537fe640 10 monclient(hunting): my global_id is 4356 2026-02-22T23:25:48.194 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.190+0000 7f14537fe640 1 -- 10.20.193.45:0/1088966042 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1448003620 con 0x7f145c0a50a0 2026-02-22T23:25:48.194 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.190+0000 7f14537fe640 1 -- 10.20.193.45:0/1088966042 <== mon.4 v1:10.20.193.45:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1637566306 0 0) 0x7f145c06e490 con 0x7f145c0a41a0 2026-02-22T23:25:48.194 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.190+0000 7f14537fe640 10 monclient(hunting): _negotiate 2026-02-22T23:25:48.194 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.190+0000 7f14537fe640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:48.194 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.190+0000 7f14537fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:48.195 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.190+0000 7f14537fe640 10 monclient(hunting): my global_id is 4396 2026-02-22T23:25:48.195 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.190+0000 7f14537fe640 1 -- 10.20.193.45:0/1088966042 --> v1:10.20.193.45:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f145c06e1b0 con 0x7f145c0a41a0 2026-02-22T23:25:48.195 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.191+0000 7f14537fe640 1 -- 10.20.193.45:0/1088966042 <== mon.0 v1:10.20.193.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3407976677 0 0) 0x7f1448003620 con 0x7f145c0a50a0 2026-02-22T23:25:48.195 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.191+0000 7f14537fe640 1 -- 10.20.193.45:0/1088966042 >> v1:10.20.193.73:6792/0 conn(0x7f145c0a4c90 legacy=0x7f145c13dfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:48.195 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.191+0000 7f14537fe640 1 -- 10.20.193.45:0/1088966042 >> v1:10.20.193.45:6791/0 conn(0x7f145c0a41a0 legacy=0x7f145c0a4580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:48.195 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.191+0000 7f14537fe640 10 monclient: _finish_hunting 0 2026-02-22T23:25:48.195 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.191+0000 7f14537fe640 1 monclient: found mon.noname-a 2026-02-22T23:25:48.195 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.191+0000 7f14537fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T23:25:48.195 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.191+0000 7f14537fe640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.45:6789/0 2026-02-22T23:25:48.195 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.191+0000 7f14537fe640 1 -- 10.20.193.45:0/1088966042 --> v1:10.20.193.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f145c06ced0 con 0x7f145c0a50a0 2026-02-22T23:25:48.195 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.191+0000 7f14537fe640 10 monclient: _finish_auth 0 2026-02-22T23:25:48.195 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.191+0000 7f14537fe640 10 monclient: _check_auth_tickets 2026-02-22T23:25:48.195 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.191+0000 7f14537fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T23:25:48.195 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.191+0000 7f14537fe640 1 -- 10.20.193.45:0/1088966042 <== mon.0 v1:10.20.193.45:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f14580033c0 con 0x7f145c0a50a0 2026-02-22T23:25:48.195 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.191+0000 7f14537fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:25:48.195 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.191+0000 7f14537fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T23:25:48.195 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.191+0000 7f14537fe640 10 monclient: dump: 2026-02-22T23:25:48.195 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:48.195 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:48.195 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:48.195 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:48.195 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:48.195 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:48.195 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:48.195 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:48.195 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:48.195 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:48.195 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:48.195 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:48.195 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:48.196 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:48.196 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:48.196 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:48.196 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.191+0000 7f1462e98640 5 monclient: authenticate success, global_id 4356 2026-02-22T23:25:48.196 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.191+0000 7f1462e98640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-22T23:25:48.196 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.191+0000 7f14537fe640 1 -- 10.20.193.45:0/1088966042 <== mon.0 v1:10.20.193.45:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1458003560 con 0x7f145c0a50a0 2026-02-22T23:25:48.196 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.191+0000 7f14537fe640 10 monclient: handle_config config(0 keys) 2026-02-22T23:25:48.196 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.191+0000 7f14537fe640 1 -- 10.20.193.45:0/1088966042 <== mon.0 v1:10.20.193.45:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f1458004fa0 con 0x7f145c0a50a0 2026-02-22T23:25:48.196 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.191+0000 7f14537fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:25:48.196 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.191+0000 7f14537fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T23:25:48.196 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.191+0000 7f14537fe640 10 monclient: dump: 2026-02-22T23:25:48.196 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:48.196 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:48.196 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:48.196 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:48.196 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:48.196 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:48.196 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:48.196 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:48.196 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:48.196 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:48.196 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:48.196 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:48.196 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:48.196 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:48.196 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:48.196 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:48.196 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.191+0000 7f1462e98640 10 monclient: get_monmap_and_config success 2026-02-22T23:25:48.196 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.191+0000 7f1462e98640 4 set_mon_vals no callback set 2026-02-22T23:25:48.196 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.191+0000 7f1462e98640 10 monclient: shutdown 2026-02-22T23:25:48.196 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.191+0000 7f1462e98640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T23:25:48.197 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.191+0000 7f1462e98640 1 -- 10.20.193.45:0/1088966042 >> v1:10.20.193.45:6789/0 conn(0x7f145c0a50a0 legacy=0x7f145c141710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:48.197 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.191+0000 7f1462e98640 1 -- 10.20.193.45:0/1088966042 shutdown_connections 2026-02-22T23:25:48.197 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.191+0000 7f1462e98640 1 -- 10.20.193.45:0/1088966042 >> 10.20.193.45:0/1088966042 conn(0x7f145c0a9720 msgr2=0x7f145c0a9b30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:25:48.197 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.191+0000 7f1462e98640 1 -- 10.20.193.45:0/1088966042 shutdown_connections 2026-02-22T23:25:48.197 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.191+0000 7f1462e98640 1 -- 10.20.193.45:0/1088966042 wait complete. 2026-02-22T23:25:48.197 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.191+0000 7f1462e98640 10 monclient: build_initial_monmap 2026-02-22T23:25:48.197 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.191+0000 7f1462e98640 10 monclient: monmap: 2026-02-22T23:25:48.197 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-22T23:25:48.197 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T23:25:48.197 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-22T23:25:48.197 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-22T23:25:48.197 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-22T23:25:48.197 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-22T23:25:48.197 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-22T23:25:48.197 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.noname-f 2026-02-22T23:25:48.197 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.noname-b 2026-02-22T23:25:48.197 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.noname-g 2026-02-22T23:25:48.197 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.noname-c 2026-02-22T23:25:48.197 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.noname-h 2026-02-22T23:25:48.197 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.noname-d 2026-02-22T23:25:48.197 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.noname-i 2026-02-22T23:25:48.197 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.noname-e 2026-02-22T23:25:48.197 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:48.197 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.191+0000 7f1462e98640 1 Processor -- start 2026-02-22T23:25:48.197 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.191+0000 7f1462e98640 1 -- start start 2026-02-22T23:25:48.197 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.192+0000 7f1462e98640 10 monclient: init 2026-02-22T23:25:48.197 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.192+0000 7f1462e98640 10 monclient: _reopen_session rank -1 2026-02-22T23:25:48.197 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.192+0000 7f1462e98640 10 monclient: _add_conns ranks=[7,8,6,5,3,4,2,1,0] 2026-02-22T23:25:48.197 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.192+0000 7f1462e98640 10 monclient(hunting): picked mon.noname-i con 0x7f145c0a41a0 addr v1:10.20.193.73:6792/0 2026-02-22T23:25:48.197 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.192+0000 7f1462e98640 10 monclient(hunting): picked mon.noname-e con 0x7f145c0a4c90 addr v1:10.20.193.45:6793/0 2026-02-22T23:25:48.198 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.192+0000 7f1462e98640 10 monclient(hunting): picked mon.noname-d con 0x7f145c0a50a0 addr v1:10.20.193.45:6792/0 2026-02-22T23:25:48.198 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.192+0000 7f1462e98640 1 -- --> v1:10.20.193.45:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f145c142080 con 0x7f145c0a50a0 2026-02-22T23:25:48.198 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.192+0000 7f1462e98640 1 -- --> v1:10.20.193.73:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f145c142360 con 0x7f145c0a41a0 2026-02-22T23:25:48.198 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.192+0000 7f1462e98640 1 -- --> v1:10.20.193.45:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f145c0a6b30 con 0x7f145c0a4c90 2026-02-22T23:25:48.198 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.192+0000 7f1462e98640 10 monclient(hunting): _renew_subs 2026-02-22T23:25:48.198 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.192+0000 7f1462e98640 10 monclient(hunting): authenticate will time out at 679.808277s 2026-02-22T23:25:48.198 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.192+0000 7f1453fff640 1 --1- >> v1:10.20.193.45:6793/0 conn(0x7f145c0a4c90 0x7f145c13eab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.45:6793/0 says I am v1:10.20.193.45:36806/0 (socket says 10.20.193.45:36806) 2026-02-22T23:25:48.198 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.192+0000 7f1453fff640 1 -- 10.20.193.45:0/1103053777 learned_addr learned my addr 10.20.193.45:0/1103053777 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-22T23:25:48.198 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.192+0000 7f14517fa640 1 -- 10.20.193.45:0/1103053777 <== mon.8 v1:10.20.193.45:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2448636389 0 0) 0x7f145c0a6b30 con 0x7f145c0a4c90 2026-02-22T23:25:48.198 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.192+0000 7f14517fa640 10 monclient(hunting): _negotiate 2026-02-22T23:25:48.198 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.192+0000 7f14517fa640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:48.198 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.192+0000 7f14517fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:48.198 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.192+0000 7f14517fa640 10 monclient(hunting): my global_id is 4382 2026-02-22T23:25:48.198 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.192+0000 7f14517fa640 1 -- 10.20.193.45:0/1103053777 --> v1:10.20.193.45:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f142c003620 con 0x7f145c0a4c90 2026-02-22T23:25:48.198 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.192+0000 7f14517fa640 1 -- 10.20.193.45:0/1103053777 <== mon.6 v1:10.20.193.45:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2052428134 0 0) 0x7f145c142080 con 0x7f145c0a50a0 2026-02-22T23:25:48.198 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.192+0000 7f14517fa640 10 monclient(hunting): _negotiate 2026-02-22T23:25:48.198 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.192+0000 7f14517fa640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:48.198 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.192+0000 7f14517fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:48.198 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.192+0000 7f14517fa640 10 monclient(hunting): my global_id is 4371 2026-02-22T23:25:48.198 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.192+0000 7f14517fa640 1 -- 10.20.193.45:0/1103053777 --> v1:10.20.193.45:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f145c0a6b30 con 0x7f145c0a50a0 2026-02-22T23:25:48.198 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.192+0000 7f14517fa640 1 -- 10.20.193.45:0/1103053777 <== mon.7 v1:10.20.193.73:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4099704897 0 0) 0x7f145c142360 con 0x7f145c0a41a0 2026-02-22T23:25:48.198 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.192+0000 7f14517fa640 10 monclient(hunting): _negotiate 2026-02-22T23:25:48.198 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.192+0000 7f14517fa640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:48.198 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.192+0000 7f14517fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:48.198 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.192+0000 7f14517fa640 10 monclient(hunting): my global_id is 4309 2026-02-22T23:25:48.198 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.192+0000 7f14517fa640 1 -- 10.20.193.45:0/1103053777 --> v1:10.20.193.73:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f145c142080 con 0x7f145c0a41a0 2026-02-22T23:25:48.198 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.192+0000 7f14517fa640 1 -- 10.20.193.45:0/1103053777 <== mon.8 v1:10.20.193.45:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3669462542 0 0) 0x7f142c003620 con 0x7f145c0a4c90 2026-02-22T23:25:48.198 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.192+0000 7f14517fa640 1 -- 10.20.193.45:0/1103053777 --> v1:10.20.193.45:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f145c142360 con 0x7f145c0a4c90 2026-02-22T23:25:48.198 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.192+0000 7f14517fa640 1 -- 10.20.193.45:0/1103053777 <== mon.6 v1:10.20.193.45:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2087791906 0 0) 0x7f145c0a6b30 con 0x7f145c0a50a0 2026-02-22T23:25:48.198 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.192+0000 7f14517fa640 1 -- 10.20.193.45:0/1103053777 --> v1:10.20.193.45:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f142c003620 con 0x7f145c0a50a0 2026-02-22T23:25:48.199 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.192+0000 7f14517fa640 1 -- 10.20.193.45:0/1103053777 <== mon.8 v1:10.20.193.45:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f14440033e0 con 0x7f145c0a4c90 2026-02-22T23:25:48.199 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.192+0000 7f14517fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-22T23:25:48.199 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.192+0000 7f14517fa640 10 monclient(hunting): got monmap 1 from mon.noname-e (according to old e1) 2026-02-22T23:25:48.199 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.192+0000 7f14517fa640 10 monclient(hunting): dump: 2026-02-22T23:25:48.199 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:48.199 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:48.199 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:48.199 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:48.199 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:48.199 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:48.199 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:48.199 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:48.199 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:48.199 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:48.199 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:48.199 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:48.199 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:48.199 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:48.199 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:48.199 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:48.199 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.192+0000 7f14517fa640 10 monclient(hunting): _finish_auth 0 2026-02-22T23:25:48.199 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.192+0000 7f14517fa640 1 -- 10.20.193.45:0/1103053777 <== mon.6 v1:10.20.193.45:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f1458003280 con 0x7f145c0a50a0 2026-02-22T23:25:48.199 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.192+0000 7f14517fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-22T23:25:48.199 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.192+0000 7f14517fa640 10 monclient(hunting): got monmap 1 from mon.d (according to old e1) 2026-02-22T23:25:48.199 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.192+0000 7f14517fa640 10 monclient(hunting): dump: 2026-02-22T23:25:48.199 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:48.199 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:48.199 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:48.199 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:48.199 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:48.199 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:48.200 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:48.200 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:48.200 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:48.200 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:48.200 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:48.200 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:48.200 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:48.200 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:48.200 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:48.200 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:48.200 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.192+0000 7f14517fa640 1 -- 10.20.193.45:0/1103053777 <== mon.8 v1:10.20.193.45:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 134911446 0 0) 0x7f145c142360 con 0x7f145c0a4c90 2026-02-22T23:25:48.200 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.192+0000 7f14517fa640 1 -- 10.20.193.45:0/1103053777 >> v1:10.20.193.73:6792/0 conn(0x7f145c0a41a0 legacy=0x7f145c13e3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:48.200 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.192+0000 7f14517fa640 1 -- 10.20.193.45:0/1103053777 >> v1:10.20.193.45:6792/0 conn(0x7f145c0a50a0 legacy=0x7f145c1d7cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:48.200 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.192+0000 7f14517fa640 10 monclient: _finish_hunting 0 2026-02-22T23:25:48.200 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.192+0000 7f14517fa640 1 monclient: found mon.e 2026-02-22T23:25:48.200 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.192+0000 7f14517fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T23:25:48.200 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.192+0000 7f14517fa640 10 monclient: _send_mon_message to mon.e at v1:10.20.193.45:6793/0 2026-02-22T23:25:48.200 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.192+0000 7f14517fa640 1 -- 10.20.193.45:0/1103053777 --> v1:10.20.193.45:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f145c0a6600 con 0x7f145c0a4c90 2026-02-22T23:25:48.200 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.192+0000 7f14517fa640 10 monclient: _finish_auth 0 2026-02-22T23:25:48.200 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.192+0000 7f14517fa640 10 monclient: _check_auth_tickets 2026-02-22T23:25:48.200 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.192+0000 7f14517fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T23:25:48.200 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.192+0000 7f1462e98640 5 monclient: authenticate success, global_id 4382 2026-02-22T23:25:48.200 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.192+0000 7f1462e98640 10 monclient: _renew_subs 2026-02-22T23:25:48.200 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.192+0000 7f1462e98640 10 monclient: _send_mon_message to mon.e at v1:10.20.193.45:6793/0 2026-02-22T23:25:48.200 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.192+0000 7f1462e98640 1 -- 10.20.193.45:0/1103053777 --> v1:10.20.193.45:6793/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f145c0a2cb0 con 0x7f145c0a4c90 2026-02-22T23:25:48.200 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.192+0000 7f1462e98640 10 monclient: _renew_subs 2026-02-22T23:25:48.200 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.192+0000 7f1462e98640 10 monclient: _send_mon_message to mon.e at v1:10.20.193.45:6793/0 2026-02-22T23:25:48.200 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.192+0000 7f1462e98640 1 -- 10.20.193.45:0/1103053777 --> v1:10.20.193.45:6793/0 -- mon_subscribe({osdmap=0}) -- 0x7f145c141da0 con 0x7f145c0a4c90 2026-02-22T23:25:48.200 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.192+0000 7f14517fa640 1 -- 10.20.193.45:0/1103053777 <== mon.8 v1:10.20.193.45:6793/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f14440039c0 con 0x7f145c0a4c90 2026-02-22T23:25:48.201 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.192+0000 7f14517fa640 10 monclient: handle_config config(0 keys) 2026-02-22T23:25:48.201 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.192+0000 7f14517fa640 1 -- 10.20.193.45:0/1103053777 <== mon.8 v1:10.20.193.45:6793/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f1444003ef0 con 0x7f145c0a4c90 2026-02-22T23:25:48.201 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.192+0000 7f14517fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:25:48.201 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.192+0000 7f14517fa640 10 monclient: got monmap 1 from mon.e (according to old e1) 2026-02-22T23:25:48.201 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.192+0000 7f1452ffd640 4 set_mon_vals no callback set 2026-02-22T23:25:48.201 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.192+0000 7f14517fa640 10 monclient: dump: 2026-02-22T23:25:48.201 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:48.201 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:48.201 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:48.201 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:48.201 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:48.201 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:48.201 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:48.201 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:48.201 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:48.201 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:48.201 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:48.201 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:48.201 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:48.201 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:48.201 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:48.201 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:48.201 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.193+0000 7f1462e98640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T23:25:48.201 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.193+0000 7f1462e98640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T23:25:48.201 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.193+0000 7f1462e98640 10 monclient: _send_mon_message to mon.e at v1:10.20.193.45:6793/0 2026-02-22T23:25:48.201 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.193+0000 7f1462e98640 1 -- 10.20.193.45:0/1103053777 --> v1:10.20.193.45:6793/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f145c06ea50 con 0x7f145c0a4c90 2026-02-22T23:25:48.201 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.193+0000 7f14517fa640 1 -- 10.20.193.45:0/1103053777 <== mon.8 v1:10.20.193.45:6793/0 7 ==== mgrmap(e 5) ==== 50225+0+0 (unknown 2330357642 0 0) 0x7f1444004090 con 0x7f145c0a4c90 2026-02-22T23:25:48.201 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.193+0000 7f14517fa640 1 -- 10.20.193.45:0/1103053777 <== mon.8 v1:10.20.193.45:6793/0 8 ==== osd_map(19..19 src has 1..19) ==== 3558+0+0 (unknown 1288710973 0 0) 0x7f144404dd70 con 0x7f145c0a4c90 2026-02-22T23:25:48.202 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.193+0000 7f1460c0d640 10 monclient: get_auth_request con 0x7f142c03ffa0 auth_method 0 2026-02-22T23:25:48.202 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.196+0000 7f14517fa640 1 -- 10.20.193.45:0/1103053777 <== mon.8 v1:10.20.193.45:6793/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (unknown 1092875540 0 2568732696) 0x7f1444017870 con 0x7f145c0a4c90 2026-02-22T23:25:48.202 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.196+0000 7f14517fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T23:25:48.202 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.196+0000 7f14517fa640 10 monclient: _finish_command 1 = system:0 2026-02-22T23:25:48.275 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.276+0000 7f1462e98640 1 -- 10.20.193.45:0/1103053777 --> v1:10.20.193.73:6800/2222410180 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f145c140f10 con 0x7f142c03ffa0 2026-02-22T23:25:48.277 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.277+0000 7f14517fa640 1 -- 10.20.193.45:0/1103053777 <== mgr.4111 v1:10.20.193.73:6800/2222410180 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+34176 (unknown 2965378022 0 2528942258) 0x7f145c140f10 con 0x7f142c03ffa0 2026-02-22T23:25:48.277 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-22T23:25:48.278 INFO:teuthology.orchestra.run.trial045.stderr:dumped all 2026-02-22T23:25:48.278 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.277+0000 7f1462e98640 1 -- 10.20.193.45:0/1103053777 >> v1:10.20.193.73:6800/2222410180 conn(0x7f142c03ffa0 legacy=0x7f142c042460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:48.279 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.277+0000 7f1462e98640 10 monclient: shutdown 2026-02-22T23:25:48.279 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.277+0000 7f1462e98640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T23:25:48.279 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.277+0000 7f1462e98640 1 -- 10.20.193.45:0/1103053777 >> v1:10.20.193.45:6793/0 conn(0x7f145c0a4c90 legacy=0x7f145c13eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:48.279 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.277+0000 7f1462e98640 1 -- 10.20.193.45:0/1103053777 shutdown_connections 2026-02-22T23:25:48.279 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.277+0000 7f1462e98640 1 -- 10.20.193.45:0/1103053777 >> 10.20.193.45:0/1103053777 conn(0x7f145c0a9720 msgr2=0x7f145c09f2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:25:48.279 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.277+0000 7f1462e98640 1 -- 10.20.193.45:0/1103053777 shutdown_connections 2026-02-22T23:25:48.279 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.277+0000 7f1462e98640 1 -- 10.20.193.45:0/1103053777 wait complete. 2026-02-22T23:25:48.285 INFO:teuthology.orchestra.run.trial045.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2026-02-22T23:25:47.196528+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":147,"num_write_kb":2674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":115,"ondisk_log_size":115,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":17,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":162864,"kb_used_data":1072,"kb_used_omap":9,"kb_used_meta":161654,"kb_avail":566068176,"statfs":{"total":579820584960,"available":579653812224,"internally_reserved":0,"allocated":1097728,"data_stored":1360146,"data_compressed":22320,"data_compressed_allocated":81920,"data_compressed_original":1024000,"omap_allocated":9561,"internal_metadata":165534375},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.469947"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":19,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-22T23:25:44.735205+0000","last_change":"2026-02-22T23:25:44.735205+0000","last_active":"2026-02-22T23:25:44.735205+0000","last_peered":"2026-02-22T23:25:44.735205+0000","last_clean":"2026-02-22T23:25:44.735205+0000","last_became_active":"2026-02-22T23:25:42.732237+0000","last_became_peered":"2026-02-22T23:25:42.732237+0000","last_unstale":"2026-02-22T23:25:44.735205+0000","last_undegraded":"2026-02-22T23:25:44.735205+0000","last_fullsized":"2026-02-22T23:25:44.735205+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:25:41.723660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:25:41.723660+0000","last_clean_scrub_stamp":"2026-02-22T23:25:41.723660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:02:39.156862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000197314,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":19,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-22T23:25:44.734485+0000","last_change":"2026-02-22T23:25:44.734485+0000","last_active":"2026-02-22T23:25:44.734485+0000","last_peered":"2026-02-22T23:25:44.734485+0000","last_clean":"2026-02-22T23:25:44.734485+0000","last_became_active":"2026-02-22T23:25:42.731608+0000","last_became_peered":"2026-02-22T23:25:42.731608+0000","last_unstale":"2026-02-22T23:25:44.734485+0000","last_undegraded":"2026-02-22T23:25:44.734485+0000","last_fullsized":"2026-02-22T23:25:44.734485+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:25:41.723660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:25:41.723660+0000","last_clean_scrub_stamp":"2026-02-22T23:25:41.723660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:38:27.110138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044396600000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-22T23:25:44.735342+0000","last_change":"2026-02-22T23:25:44.735342+0000","last_active":"2026-02-22T23:25:44.735342+0000","last_peered":"2026-02-22T23:25:44.735342+0000","last_clean":"2026-02-22T23:25:44.735342+0000","last_became_active":"2026-02-22T23:25:42.732947+0000","last_became_peered":"2026-02-22T23:25:42.732947+0000","last_unstale":"2026-02-22T23:25:44.735342+0000","last_undegraded":"2026-02-22T23:25:44.735342+0000","last_fullsized":"2026-02-22T23:25:44.735342+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:25:41.723660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:25:41.723660+0000","last_clean_scrub_stamp":"2026-02-22T23:25:41.723660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T02:33:36.757781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00031882900000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-22T23:25:44.771461+0000","last_change":"2026-02-22T23:25:44.771461+0000","last_active":"2026-02-22T23:25:44.771461+0000","last_peered":"2026-02-22T23:25:44.771461+0000","last_clean":"2026-02-22T23:25:44.771461+0000","last_became_active":"2026-02-22T23:25:42.729582+0000","last_became_peered":"2026-02-22T23:25:42.729582+0000","last_unstale":"2026-02-22T23:25:44.771461+0000","last_undegraded":"2026-02-22T23:25:44.771461+0000","last_fullsized":"2026-02-22T23:25:44.771461+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:25:41.723660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:25:41.723660+0000","last_clean_scrub_stamp":"2026-02-22T23:25:41.723660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T06:30:33.437324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00022341099999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"19'2","reported_seq":21,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-22T23:25:44.736525+0000","last_change":"2026-02-22T23:25:44.735543+0000","last_active":"2026-02-22T23:25:44.736525+0000","last_peered":"2026-02-22T23:25:44.736525+0000","last_clean":"2026-02-22T23:25:44.736525+0000","last_became_active":"2026-02-22T23:25:42.733018+0000","last_became_peered":"2026-02-22T23:25:42.733018+0000","last_unstale":"2026-02-22T23:25:44.736525+0000","last_undegraded":"2026-02-22T23:25:44.736525+0000","last_fullsized":"2026-02-22T23:25:44.736525+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:25:41.723660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:25:41.723660+0000","last_clean_scrub_stamp":"2026-02-22T23:25:41.723660+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T04:28:19.249844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044642500000000002,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":19,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-22T23:25:44.733849+0000","last_change":"2026-02-22T23:25:44.734019+0000","last_active":"2026-02-22T23:25:44.733849+0000","last_peered":"2026-02-22T23:25:44.733849+0000","last_clean":"2026-02-22T23:25:44.733849+0000","last_became_active":"2026-02-22T23:25:42.729332+0000","last_became_peered":"2026-02-22T23:25:42.729332+0000","last_unstale":"2026-02-22T23:25:44.733849+0000","last_undegraded":"2026-02-22T23:25:44.733849+0000","last_fullsized":"2026-02-22T23:25:44.733849+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:25:41.723660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:25:41.723660+0000","last_clean_scrub_stamp":"2026-02-22T23:25:41.723660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T05:15:12.260477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00028113600000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-22T23:25:44.735208+0000","last_change":"2026-02-22T23:25:44.735208+0000","last_active":"2026-02-22T23:25:44.735208+0000","last_peered":"2026-02-22T23:25:44.735208+0000","last_clean":"2026-02-22T23:25:44.735208+0000","last_became_active":"2026-02-22T23:25:42.732106+0000","last_became_peered":"2026-02-22T23:25:42.732106+0000","last_unstale":"2026-02-22T23:25:44.735208+0000","last_undegraded":"2026-02-22T23:25:44.735208+0000","last_fullsized":"2026-02-22T23:25:44.735208+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:25:41.723660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:25:41.723660+0000","last_clean_scrub_stamp":"2026-02-22T23:25:41.723660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:35:08.328395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000186295,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"17'1","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-22T23:25:44.735244+0000","last_change":"2026-02-22T23:25:44.735244+0000","last_active":"2026-02-22T23:25:44.735244+0000","last_peered":"2026-02-22T23:25:44.735244+0000","last_clean":"2026-02-22T23:25:44.735244+0000","last_became_active":"2026-02-22T23:25:42.732702+0000","last_became_peered":"2026-02-22T23:25:42.732702+0000","last_unstale":"2026-02-22T23:25:44.735244+0000","last_undegraded":"2026-02-22T23:25:44.735244+0000","last_fullsized":"2026-02-22T23:25:44.735244+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:25:41.723660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:25:41.723660+0000","last_clean_scrub_stamp":"2026-02-22T23:25:41.723660+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T01:00:00.519442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00023975299999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"14'112","reported_seq":156,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-22T23:25:44.734952+0000","last_change":"2026-02-22T23:25:36.890023+0000","last_active":"2026-02-22T23:25:44.734952+0000","last_peered":"2026-02-22T23:25:44.734952+0000","last_clean":"2026-02-22T23:25:44.734952+0000","last_became_active":"2026-02-22T23:25:36.889147+0000","last_became_peered":"2026-02-22T23:25:36.889147+0000","last_unstale":"2026-02-22T23:25:44.734952+0000","last_undegraded":"2026-02-22T23:25:44.734952+0000","last_fullsized":"2026-02-22T23:25:44.734952+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:25:35.704171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:25:35.704171+0000","last_clean_scrub_stamp":"2026-02-22T23:25:35.704171+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T02:46:45.050923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":1057856,"data_compressed":22320,"data_compressed_allocated":81920,"data_compressed_original":1024000,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":12,"seq":51539607557,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27180,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344660,"statfs":{"total":96636764160,"available":96608931840,"internally_reserved":0,"allocated":217088,"data_stored":576554,"data_compressed":11160,"data_compressed_allocated":40960,"data_compressed_original":512000,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":12,"seq":51539607556,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27132,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344708,"statfs":{"total":96636764160,"available":96608980992,"internally_reserved":0,"allocated":167936,"data_stored":51769,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":12,"seq":51539607556,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27124,"kb_used_data":160,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344716,"statfs":{"total":96636764160,"available":96608989184,"internally_reserved":0,"allocated":163840,"data_stored":51750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":12,"seq":51539607556,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27184,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344656,"statfs":{"total":96636764160,"available":96608927744,"internally_reserved":0,"allocated":225280,"data_stored":580678,"data_compressed":11160,"data_compressed_allocated":40960,"data_compressed_original":512000,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":12,"seq":51539607556,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27128,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344712,"statfs":{"total":96636764160,"available":96608985088,"internally_reserved":0,"allocated":167936,"data_stored":51769,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":11,"seq":47244640260,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27116,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344724,"statfs":{"total":96636764160,"available":96608997376,"internally_reserved":0,"allocated":155648,"data_stored":47626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27589065},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":528928,"data_compressed":11160,"data_compressed_allocated":40960,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":528928,"data_compressed":11160,"data_compressed_allocated":40960,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-22T23:25:48.287 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-22T23:25:48.354 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.354+0000 7fbc6098f640 10 monclient: get_monmap_and_config 2026-02-22T23:25:48.354 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.354+0000 7fbc6098f640 10 monclient: build_initial_monmap 2026-02-22T23:25:48.354 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.354+0000 7fbc6098f640 10 monclient: monmap: 2026-02-22T23:25:48.354 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-22T23:25:48.354 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:48.354 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:25:48.354349+0000 2026-02-22T23:25:48.354 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:25:48.354349+0000 2026-02-22T23:25:48.354 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-22T23:25:48.354 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:48.354 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-22T23:25:48.354 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.noname-f 2026-02-22T23:25:48.354 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.noname-b 2026-02-22T23:25:48.354 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.noname-g 2026-02-22T23:25:48.354 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.noname-c 2026-02-22T23:25:48.354 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.noname-h 2026-02-22T23:25:48.354 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.noname-d 2026-02-22T23:25:48.354 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.noname-i 2026-02-22T23:25:48.354 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.noname-e 2026-02-22T23:25:48.354 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:48.355 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.354+0000 7fbc6098f640 1 Processor -- start 2026-02-22T23:25:48.356 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.354+0000 7fbc6098f640 1 -- start start 2026-02-22T23:25:48.356 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.354+0000 7fbc6098f640 10 monclient: init 2026-02-22T23:25:48.356 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.354+0000 7fbc6098f640 10 monclient: _reopen_session rank -1 2026-02-22T23:25:48.356 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.354+0000 7fbc6098f640 10 monclient: _add_conns ranks=[0,7,6,8,3,5,4,2,1] 2026-02-22T23:25:48.356 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.354+0000 7fbc6098f640 10 monclient(hunting): picked mon.noname-a con 0x7fbc580a5e00 addr v1:10.20.193.45:6789/0 2026-02-22T23:25:48.356 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.354+0000 7fbc6098f640 10 monclient(hunting): picked mon.noname-i con 0x7fbc580a68f0 addr v1:10.20.193.73:6792/0 2026-02-22T23:25:48.356 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.354+0000 7fbc6098f640 10 monclient(hunting): picked mon.noname-d con 0x7fbc580a6d00 addr v1:10.20.193.45:6792/0 2026-02-22T23:25:48.356 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.354+0000 7fbc6098f640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbc580a2d00 con 0x7fbc580a5e00 2026-02-22T23:25:48.356 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.354+0000 7fbc6098f640 1 -- --> v1:10.20.193.45:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbc580a2fe0 con 0x7fbc580a6d00 2026-02-22T23:25:48.356 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.354+0000 7fbc6098f640 1 -- --> v1:10.20.193.73:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbc580a32c0 con 0x7fbc580a68f0 2026-02-22T23:25:48.356 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.354+0000 7fbc6098f640 10 monclient(hunting): _renew_subs 2026-02-22T23:25:48.356 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.354+0000 7fbc6098f640 10 monclient(hunting): authenticate will time out at 679.970931s 2026-02-22T23:25:48.356 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.354+0000 7fbc5e704640 1 --1- >> v1:10.20.193.45:6789/0 conn(0x7fbc580a5e00 0x7fbc580a61e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.45:6789/0 says I am v1:10.20.193.45:58262/0 (socket says 10.20.193.45:58262) 2026-02-22T23:25:48.356 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.354+0000 7fbc5e704640 1 -- 10.20.193.45:0/3448620167 learned_addr learned my addr 10.20.193.45:0/3448620167 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-22T23:25:48.356 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.355+0000 7fbc5d702640 1 -- 10.20.193.45:0/3448620167 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4086978388 0 0) 0x7fbc580a2d00 con 0x7fbc580a5e00 2026-02-22T23:25:48.356 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.355+0000 7fbc5d702640 10 monclient(hunting): _negotiate 2026-02-22T23:25:48.356 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.355+0000 7fbc5d702640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:48.356 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.355+0000 7fbc5d702640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:48.356 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.355+0000 7fbc5d702640 10 monclient(hunting): my global_id is 4365 2026-02-22T23:25:48.356 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.355+0000 7fbc5d702640 1 -- 10.20.193.45:0/3448620167 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbc48003620 con 0x7fbc580a5e00 2026-02-22T23:25:48.356 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.355+0000 7fbc5d702640 1 -- 10.20.193.45:0/3448620167 <== mon.6 v1:10.20.193.45:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1143971014 0 0) 0x7fbc580a2fe0 con 0x7fbc580a6d00 2026-02-22T23:25:48.356 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.355+0000 7fbc5d702640 10 monclient(hunting): _negotiate 2026-02-22T23:25:48.356 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.355+0000 7fbc5d702640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:48.356 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.355+0000 7fbc5d702640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:48.356 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.355+0000 7fbc5d702640 10 monclient(hunting): my global_id is 4380 2026-02-22T23:25:48.356 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.355+0000 7fbc5d702640 1 -- 10.20.193.45:0/3448620167 --> v1:10.20.193.45:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbc580a2d00 con 0x7fbc580a6d00 2026-02-22T23:25:48.356 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.355+0000 7fbc5d702640 1 -- 10.20.193.45:0/3448620167 <== mon.0 v1:10.20.193.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4042129463 0 0) 0x7fbc48003620 con 0x7fbc580a5e00 2026-02-22T23:25:48.356 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.355+0000 7fbc5d702640 1 -- 10.20.193.45:0/3448620167 >> v1:10.20.193.73:6792/0 conn(0x7fbc580a68f0 legacy=0x7fbc5813e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T23:25:48.356 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.355+0000 7fbc5d702640 1 -- 10.20.193.45:0/3448620167 >> v1:10.20.193.45:6792/0 conn(0x7fbc580a6d00 legacy=0x7fbc581417b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:48.356 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.355+0000 7fbc5d702640 10 monclient: _finish_hunting 0 2026-02-22T23:25:48.356 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.355+0000 7fbc5d702640 1 monclient: found mon.noname-a 2026-02-22T23:25:48.356 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.355+0000 7fbc5d702640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T23:25:48.356 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.355+0000 7fbc5d702640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.45:6789/0 2026-02-22T23:25:48.356 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.355+0000 7fbc5d702640 1 -- 10.20.193.45:0/3448620167 --> v1:10.20.193.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc580a35a0 con 0x7fbc580a5e00 2026-02-22T23:25:48.356 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.355+0000 7fbc5d702640 10 monclient: _finish_auth 0 2026-02-22T23:25:48.356 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.355+0000 7fbc5d702640 10 monclient: _check_auth_tickets 2026-02-22T23:25:48.356 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.355+0000 7fbc5d702640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T23:25:48.357 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.355+0000 7fbc5d702640 1 -- 10.20.193.45:0/3448620167 <== mon.0 v1:10.20.193.45:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7fbc50003040 con 0x7fbc580a5e00 2026-02-22T23:25:48.357 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.355+0000 7fbc6098f640 5 monclient: authenticate success, global_id 4365 2026-02-22T23:25:48.357 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.355+0000 7fbc6098f640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-22T23:25:48.357 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.355+0000 7fbc5d702640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:25:48.357 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.355+0000 7fbc5d702640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T23:25:48.357 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.355+0000 7fbc5d702640 10 monclient: dump: 2026-02-22T23:25:48.357 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:48.357 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:48.357 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:48.357 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:48.357 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:48.357 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:48.357 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:48.357 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:48.357 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:48.357 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:48.357 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:48.357 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:48.357 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:48.357 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:48.357 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:48.357 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:48.357 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.355+0000 7fbc6098f640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-22T23:25:48.357 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.355+0000 7fbc5d702640 1 -- 10.20.193.45:0/3448620167 <== mon.0 v1:10.20.193.45:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fbc500031e0 con 0x7fbc580a5e00 2026-02-22T23:25:48.357 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.355+0000 7fbc5d702640 10 monclient: handle_config config(0 keys) 2026-02-22T23:25:48.357 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.355+0000 7fbc5d702640 1 -- 10.20.193.45:0/3448620167 <== mon.0 v1:10.20.193.45:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7fbc50004ce0 con 0x7fbc580a5e00 2026-02-22T23:25:48.357 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.355+0000 7fbc5d702640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:25:48.357 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.355+0000 7fbc5d702640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T23:25:48.357 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.355+0000 7fbc5d702640 10 monclient: dump: 2026-02-22T23:25:48.357 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:48.357 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:48.357 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:48.357 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:48.357 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:48.357 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:48.357 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:48.357 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:48.357 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:48.357 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:48.357 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:48.358 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:48.358 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:48.358 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:48.358 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:48.358 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:48.358 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.355+0000 7fbc6098f640 10 monclient: get_monmap_and_config success 2026-02-22T23:25:48.358 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.355+0000 7fbc6098f640 4 set_mon_vals no callback set 2026-02-22T23:25:48.358 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.355+0000 7fbc6098f640 10 monclient: shutdown 2026-02-22T23:25:48.358 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.355+0000 7fbc6098f640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T23:25:48.358 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.355+0000 7fbc6098f640 1 -- 10.20.193.45:0/3448620167 >> v1:10.20.193.45:6789/0 conn(0x7fbc580a5e00 legacy=0x7fbc580a61e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:48.358 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.355+0000 7fbc6098f640 1 -- 10.20.193.45:0/3448620167 shutdown_connections 2026-02-22T23:25:48.358 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.355+0000 7fbc6098f640 1 -- 10.20.193.45:0/3448620167 >> 10.20.193.45:0/3448620167 conn(0x7fbc580abb50 msgr2=0x7fbc580a7f00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:25:48.358 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.355+0000 7fbc6098f640 1 -- 10.20.193.45:0/3448620167 shutdown_connections 2026-02-22T23:25:48.358 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.355+0000 7fbc6098f640 1 -- 10.20.193.45:0/3448620167 wait complete. 2026-02-22T23:25:48.358 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.356+0000 7fbc6098f640 10 monclient: build_initial_monmap 2026-02-22T23:25:48.358 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.356+0000 7fbc6098f640 10 monclient: monmap: 2026-02-22T23:25:48.358 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-22T23:25:48.358 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T23:25:48.358 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-22T23:25:48.358 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-22T23:25:48.358 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-22T23:25:48.358 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-22T23:25:48.358 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-22T23:25:48.358 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.noname-f 2026-02-22T23:25:48.358 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.noname-b 2026-02-22T23:25:48.358 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.noname-g 2026-02-22T23:25:48.358 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.noname-c 2026-02-22T23:25:48.358 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.noname-h 2026-02-22T23:25:48.358 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.noname-d 2026-02-22T23:25:48.358 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.noname-i 2026-02-22T23:25:48.358 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.noname-e 2026-02-22T23:25:48.358 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:48.358 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.356+0000 7fbc6098f640 1 Processor -- start 2026-02-22T23:25:48.360 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.356+0000 7fbc6098f640 1 -- start start 2026-02-22T23:25:48.360 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.356+0000 7fbc6098f640 10 monclient: init 2026-02-22T23:25:48.360 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.356+0000 7fbc6098f640 10 monclient: _reopen_session rank -1 2026-02-22T23:25:48.360 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.356+0000 7fbc6098f640 10 monclient: _add_conns ranks=[6,7,2,8,5,3,1,0,4] 2026-02-22T23:25:48.360 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.356+0000 7fbc6098f640 10 monclient(hunting): picked mon.noname-d con 0x7fbc580a5e00 addr v1:10.20.193.45:6792/0 2026-02-22T23:25:48.360 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.356+0000 7fbc6098f640 10 monclient(hunting): picked mon.noname-i con 0x7fbc580a68f0 addr v1:10.20.193.73:6792/0 2026-02-22T23:25:48.360 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.356+0000 7fbc6098f640 10 monclient(hunting): picked mon.noname-b con 0x7fbc580a6d00 addr v1:10.20.193.45:6790/0 2026-02-22T23:25:48.360 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.356+0000 7fbc6098f640 1 -- --> v1:10.20.193.45:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbc580a9e00 con 0x7fbc580a6d00 2026-02-22T23:25:48.360 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.356+0000 7fbc6098f640 1 -- --> v1:10.20.193.45:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbc581cff70 con 0x7fbc580a5e00 2026-02-22T23:25:48.360 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.356+0000 7fbc6098f640 1 -- --> v1:10.20.193.73:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbc58128bc0 con 0x7fbc580a68f0 2026-02-22T23:25:48.360 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.356+0000 7fbc6098f640 10 monclient(hunting): _renew_subs 2026-02-22T23:25:48.360 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.356+0000 7fbc6098f640 10 monclient(hunting): authenticate will time out at 679.972656s 2026-02-22T23:25:48.360 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.356+0000 7fbc5ef05640 1 --1- >> v1:10.20.193.45:6790/0 conn(0x7fbc580a6d00 0x7fbc581d7ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.45:6790/0 says I am v1:10.20.193.45:51008/0 (socket says 10.20.193.45:51008) 2026-02-22T23:25:48.360 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.356+0000 7fbc5ef05640 1 -- 10.20.193.45:0/2464255384 learned_addr learned my addr 10.20.193.45:0/2464255384 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-22T23:25:48.360 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.356+0000 7fbc5e704640 1 --1- >> v1:10.20.193.45:6792/0 conn(0x7fbc580a5e00 0x7fbc58141520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.45:6792/0 says I am v1:10.20.193.45:56926/0 (socket says 10.20.193.45:56926) 2026-02-22T23:25:48.360 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.356+0000 7fbc42ffd640 1 -- 10.20.193.45:0/2464255384 <== mon.6 v1:10.20.193.45:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1562500122 0 0) 0x7fbc581cff70 con 0x7fbc580a5e00 2026-02-22T23:25:48.360 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.356+0000 7fbc42ffd640 10 monclient(hunting): _negotiate 2026-02-22T23:25:48.360 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.356+0000 7fbc42ffd640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:48.360 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.356+0000 7fbc42ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:48.360 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.356+0000 7fbc42ffd640 10 monclient(hunting): my global_id is 4389 2026-02-22T23:25:48.360 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.356+0000 7fbc42ffd640 1 -- 10.20.193.45:0/2464255384 --> v1:10.20.193.45:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbc28003620 con 0x7fbc580a5e00 2026-02-22T23:25:48.360 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.356+0000 7fbc42ffd640 1 -- 10.20.193.45:0/2464255384 <== mon.2 v1:10.20.193.45:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1550364799 0 0) 0x7fbc4c002da0 con 0x7fbc580a6d00 2026-02-22T23:25:48.360 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.356+0000 7fbc42ffd640 10 monclient(hunting): _negotiate 2026-02-22T23:25:48.360 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.356+0000 7fbc42ffd640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:48.360 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.356+0000 7fbc42ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:48.360 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.356+0000 7fbc42ffd640 10 monclient(hunting): my global_id is 4412 2026-02-22T23:25:48.360 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.356+0000 7fbc42ffd640 1 -- 10.20.193.45:0/2464255384 --> v1:10.20.193.45:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbc581cff70 con 0x7fbc580a6d00 2026-02-22T23:25:48.360 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.356+0000 7fbc42ffd640 1 -- 10.20.193.45:0/2464255384 <== mon.6 v1:10.20.193.45:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3600893494 0 0) 0x7fbc28003620 con 0x7fbc580a5e00 2026-02-22T23:25:48.360 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.357+0000 7fbc42ffd640 1 -- 10.20.193.45:0/2464255384 --> v1:10.20.193.45:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fbc4c002da0 con 0x7fbc580a5e00 2026-02-22T23:25:48.360 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.357+0000 7fbc42ffd640 1 -- 10.20.193.45:0/2464255384 <== mon.7 v1:10.20.193.73:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3156883682 0 0) 0x7fbc58128bc0 con 0x7fbc580a68f0 2026-02-22T23:25:48.361 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.357+0000 7fbc42ffd640 10 monclient(hunting): _negotiate 2026-02-22T23:25:48.361 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.357+0000 7fbc42ffd640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:48.361 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.357+0000 7fbc42ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:48.361 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.357+0000 7fbc42ffd640 10 monclient(hunting): my global_id is 4318 2026-02-22T23:25:48.361 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.357+0000 7fbc42ffd640 1 -- 10.20.193.45:0/2464255384 --> v1:10.20.193.73:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbc28003620 con 0x7fbc580a68f0 2026-02-22T23:25:48.361 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.357+0000 7fbc42ffd640 1 -- 10.20.193.45:0/2464255384 <== mon.6 v1:10.20.193.45:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7fbc50002fc0 con 0x7fbc580a5e00 2026-02-22T23:25:48.361 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.357+0000 7fbc42ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-22T23:25:48.361 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.357+0000 7fbc42ffd640 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2026-02-22T23:25:48.361 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.357+0000 7fbc42ffd640 10 monclient(hunting): dump: 2026-02-22T23:25:48.361 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:48.361 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:48.361 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:48.361 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:48.361 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:48.361 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:48.361 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:48.361 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:48.361 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:48.361 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:48.361 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:48.361 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:48.361 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:48.361 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:48.361 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:48.361 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:48.361 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.357+0000 7fbc42ffd640 10 monclient(hunting): _finish_auth 0 2026-02-22T23:25:48.361 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.357+0000 7fbc42ffd640 1 -- 10.20.193.45:0/2464255384 <== mon.2 v1:10.20.193.45:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3959140555 0 0) 0x7fbc581cff70 con 0x7fbc580a6d00 2026-02-22T23:25:48.361 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.357+0000 7fbc42ffd640 1 -- 10.20.193.45:0/2464255384 --> v1:10.20.193.45:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fbc58128bc0 con 0x7fbc580a6d00 2026-02-22T23:25:48.361 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.357+0000 7fbc42ffd640 1 -- 10.20.193.45:0/2464255384 <== mon.2 v1:10.20.193.45:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7fbc4c003960 con 0x7fbc580a6d00 2026-02-22T23:25:48.361 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.357+0000 7fbc42ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-22T23:25:48.361 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.357+0000 7fbc42ffd640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-22T23:25:48.361 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.357+0000 7fbc42ffd640 10 monclient(hunting): dump: 2026-02-22T23:25:48.361 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:48.361 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:48.361 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:48.361 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:48.361 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:48.361 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:48.361 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:48.361 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:48.361 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:48.362 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:48.362 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:48.362 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:48.362 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:48.362 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:48.362 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:48.362 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:48.362 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.357+0000 7fbc42ffd640 1 -- 10.20.193.45:0/2464255384 <== mon.6 v1:10.20.193.45:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1827377065 0 0) 0x7fbc4c002da0 con 0x7fbc580a5e00 2026-02-22T23:25:48.362 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.357+0000 7fbc42ffd640 1 -- 10.20.193.45:0/2464255384 >> v1:10.20.193.73:6792/0 conn(0x7fbc580a68f0 legacy=0x7fbc581d4390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:48.362 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.357+0000 7fbc42ffd640 1 -- 10.20.193.45:0/2464255384 >> v1:10.20.193.45:6790/0 conn(0x7fbc580a6d00 legacy=0x7fbc581d7ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:48.362 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.357+0000 7fbc42ffd640 10 monclient: _finish_hunting 0 2026-02-22T23:25:48.362 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.357+0000 7fbc42ffd640 1 monclient: found mon.d 2026-02-22T23:25:48.362 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.357+0000 7fbc42ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T23:25:48.362 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.357+0000 7fbc42ffd640 10 monclient: _send_mon_message to mon.d at v1:10.20.193.45:6792/0 2026-02-22T23:25:48.362 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.357+0000 7fbc42ffd640 1 -- 10.20.193.45:0/2464255384 --> v1:10.20.193.45:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc58127930 con 0x7fbc580a5e00 2026-02-22T23:25:48.362 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.357+0000 7fbc42ffd640 10 monclient: _finish_auth 0 2026-02-22T23:25:48.362 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.357+0000 7fbc42ffd640 10 monclient: _check_auth_tickets 2026-02-22T23:25:48.362 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.357+0000 7fbc42ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T23:25:48.362 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.357+0000 7fbc6098f640 5 monclient: authenticate success, global_id 4389 2026-02-22T23:25:48.362 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.357+0000 7fbc6098f640 10 monclient: _renew_subs 2026-02-22T23:25:48.362 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.357+0000 7fbc6098f640 10 monclient: _send_mon_message to mon.d at v1:10.20.193.45:6792/0 2026-02-22T23:25:48.362 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.357+0000 7fbc6098f640 1 -- 10.20.193.45:0/2464255384 --> v1:10.20.193.45:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fbc580a14e0 con 0x7fbc580a5e00 2026-02-22T23:25:48.362 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.357+0000 7fbc6098f640 10 monclient: _renew_subs 2026-02-22T23:25:48.362 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.357+0000 7fbc6098f640 10 monclient: _send_mon_message to mon.d at v1:10.20.193.45:6792/0 2026-02-22T23:25:48.362 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.357+0000 7fbc6098f640 1 -- 10.20.193.45:0/2464255384 --> v1:10.20.193.45:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7fbc58127460 con 0x7fbc580a5e00 2026-02-22T23:25:48.362 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.357+0000 7fbc42ffd640 1 -- 10.20.193.45:0/2464255384 <== mon.6 v1:10.20.193.45:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fbc50004b90 con 0x7fbc580a5e00 2026-02-22T23:25:48.362 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.357+0000 7fbc42ffd640 10 monclient: handle_config config(0 keys) 2026-02-22T23:25:48.362 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.357+0000 7fbc42ffd640 1 -- 10.20.193.45:0/2464255384 <== mon.6 v1:10.20.193.45:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7fbc50005140 con 0x7fbc580a5e00 2026-02-22T23:25:48.362 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.357+0000 7fbc42ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:25:48.362 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.357+0000 7fbc42ffd640 10 monclient: got monmap 1 from mon.d (according to old e1) 2026-02-22T23:25:48.362 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.357+0000 7fbc42ffd640 10 monclient: dump: 2026-02-22T23:25:48.362 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:48.362 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:48.362 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:48.362 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:48.362 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:48.362 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:48.362 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:48.362 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:48.362 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:48.362 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:48.363 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:48.363 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:48.363 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:48.363 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:48.363 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:48.363 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:48.363 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.357+0000 7fbc5cf01640 4 set_mon_vals no callback set 2026-02-22T23:25:48.363 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.357+0000 7fbc6098f640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T23:25:48.363 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.357+0000 7fbc6098f640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T23:25:48.363 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.357+0000 7fbc6098f640 10 monclient: _send_mon_message to mon.d at v1:10.20.193.45:6792/0 2026-02-22T23:25:48.363 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.357+0000 7fbc6098f640 1 -- 10.20.193.45:0/2464255384 --> v1:10.20.193.45:6792/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbc58141c30 con 0x7fbc580a5e00 2026-02-22T23:25:48.363 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.357+0000 7fbc42ffd640 1 -- 10.20.193.45:0/2464255384 <== mon.6 v1:10.20.193.45:6792/0 7 ==== mgrmap(e 5) ==== 50225+0+0 (unknown 2330357642 0 0) 0x7fbc500052e0 con 0x7fbc580a5e00 2026-02-22T23:25:48.363 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.358+0000 7fbc42ffd640 1 -- 10.20.193.45:0/2464255384 <== mon.6 v1:10.20.193.45:6792/0 8 ==== osd_map(19..19 src has 1..19) ==== 3558+0+0 (unknown 1288710973 0 0) 0x7fbc5004da10 con 0x7fbc580a5e00 2026-02-22T23:25:48.363 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.358+0000 7fbc5df03640 10 monclient: get_auth_request con 0x7fbc2803fea0 auth_method 0 2026-02-22T23:25:48.363 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.360+0000 7fbc42ffd640 1 -- 10.20.193.45:0/2464255384 <== mon.6 v1:10.20.193.45:6792/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (unknown 1092875540 0 2568732696) 0x7fbc50017690 con 0x7fbc580a5e00 2026-02-22T23:25:48.363 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.360+0000 7fbc42ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T23:25:48.363 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.360+0000 7fbc42ffd640 10 monclient: _finish_command 1 = system:0 2026-02-22T23:25:48.444 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.444+0000 7fbc6098f640 1 -- 10.20.193.45:0/2464255384 --> v1:10.20.193.73:6800/2222410180 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fbc5806ce10 con 0x7fbc2803fea0 2026-02-22T23:25:48.445 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.445+0000 7fbc42ffd640 1 -- 10.20.193.45:0/2464255384 <== mgr.4111 v1:10.20.193.73:6800/2222410180 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+34176 (unknown 2965378022 0 2528942258) 0x7fbc5806ce10 con 0x7fbc2803fea0 2026-02-22T23:25:48.445 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-22T23:25:48.445 INFO:teuthology.orchestra.run.trial045.stderr:dumped all 2026-02-22T23:25:48.446 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.446+0000 7fbc6098f640 1 -- 10.20.193.45:0/2464255384 >> v1:10.20.193.73:6800/2222410180 conn(0x7fbc2803fea0 legacy=0x7fbc28042360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:48.446 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.446+0000 7fbc6098f640 10 monclient: shutdown 2026-02-22T23:25:48.446 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.446+0000 7fbc6098f640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T23:25:48.446 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.446+0000 7fbc6098f640 1 -- 10.20.193.45:0/2464255384 >> v1:10.20.193.45:6792/0 conn(0x7fbc580a5e00 legacy=0x7fbc58141520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:48.446 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.446+0000 7fbc6098f640 1 -- 10.20.193.45:0/2464255384 shutdown_connections 2026-02-22T23:25:48.446 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.446+0000 7fbc6098f640 1 -- 10.20.193.45:0/2464255384 >> 10.20.193.45:0/2464255384 conn(0x7fbc580abb50 msgr2=0x7fbc58142380 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:25:48.446 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.446+0000 7fbc6098f640 1 -- 10.20.193.45:0/2464255384 shutdown_connections 2026-02-22T23:25:48.446 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.446+0000 7fbc6098f640 1 -- 10.20.193.45:0/2464255384 wait complete. 2026-02-22T23:25:48.453 INFO:teuthology.orchestra.run.trial045.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2026-02-22T23:25:47.196528+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":147,"num_write_kb":2674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":115,"ondisk_log_size":115,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":17,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":162864,"kb_used_data":1072,"kb_used_omap":9,"kb_used_meta":161654,"kb_avail":566068176,"statfs":{"total":579820584960,"available":579653812224,"internally_reserved":0,"allocated":1097728,"data_stored":1360146,"data_compressed":22320,"data_compressed_allocated":81920,"data_compressed_original":1024000,"omap_allocated":9561,"internal_metadata":165534375},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.469947"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":19,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-22T23:25:44.735205+0000","last_change":"2026-02-22T23:25:44.735205+0000","last_active":"2026-02-22T23:25:44.735205+0000","last_peered":"2026-02-22T23:25:44.735205+0000","last_clean":"2026-02-22T23:25:44.735205+0000","last_became_active":"2026-02-22T23:25:42.732237+0000","last_became_peered":"2026-02-22T23:25:42.732237+0000","last_unstale":"2026-02-22T23:25:44.735205+0000","last_undegraded":"2026-02-22T23:25:44.735205+0000","last_fullsized":"2026-02-22T23:25:44.735205+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:25:41.723660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:25:41.723660+0000","last_clean_scrub_stamp":"2026-02-22T23:25:41.723660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:02:39.156862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000197314,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":19,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-22T23:25:44.734485+0000","last_change":"2026-02-22T23:25:44.734485+0000","last_active":"2026-02-22T23:25:44.734485+0000","last_peered":"2026-02-22T23:25:44.734485+0000","last_clean":"2026-02-22T23:25:44.734485+0000","last_became_active":"2026-02-22T23:25:42.731608+0000","last_became_peered":"2026-02-22T23:25:42.731608+0000","last_unstale":"2026-02-22T23:25:44.734485+0000","last_undegraded":"2026-02-22T23:25:44.734485+0000","last_fullsized":"2026-02-22T23:25:44.734485+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:25:41.723660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:25:41.723660+0000","last_clean_scrub_stamp":"2026-02-22T23:25:41.723660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:38:27.110138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044396600000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-22T23:25:44.735342+0000","last_change":"2026-02-22T23:25:44.735342+0000","last_active":"2026-02-22T23:25:44.735342+0000","last_peered":"2026-02-22T23:25:44.735342+0000","last_clean":"2026-02-22T23:25:44.735342+0000","last_became_active":"2026-02-22T23:25:42.732947+0000","last_became_peered":"2026-02-22T23:25:42.732947+0000","last_unstale":"2026-02-22T23:25:44.735342+0000","last_undegraded":"2026-02-22T23:25:44.735342+0000","last_fullsized":"2026-02-22T23:25:44.735342+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:25:41.723660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:25:41.723660+0000","last_clean_scrub_stamp":"2026-02-22T23:25:41.723660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T02:33:36.757781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00031882900000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-22T23:25:44.771461+0000","last_change":"2026-02-22T23:25:44.771461+0000","last_active":"2026-02-22T23:25:44.771461+0000","last_peered":"2026-02-22T23:25:44.771461+0000","last_clean":"2026-02-22T23:25:44.771461+0000","last_became_active":"2026-02-22T23:25:42.729582+0000","last_became_peered":"2026-02-22T23:25:42.729582+0000","last_unstale":"2026-02-22T23:25:44.771461+0000","last_undegraded":"2026-02-22T23:25:44.771461+0000","last_fullsized":"2026-02-22T23:25:44.771461+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:25:41.723660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:25:41.723660+0000","last_clean_scrub_stamp":"2026-02-22T23:25:41.723660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T06:30:33.437324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00022341099999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"19'2","reported_seq":21,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-22T23:25:44.736525+0000","last_change":"2026-02-22T23:25:44.735543+0000","last_active":"2026-02-22T23:25:44.736525+0000","last_peered":"2026-02-22T23:25:44.736525+0000","last_clean":"2026-02-22T23:25:44.736525+0000","last_became_active":"2026-02-22T23:25:42.733018+0000","last_became_peered":"2026-02-22T23:25:42.733018+0000","last_unstale":"2026-02-22T23:25:44.736525+0000","last_undegraded":"2026-02-22T23:25:44.736525+0000","last_fullsized":"2026-02-22T23:25:44.736525+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:25:41.723660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:25:41.723660+0000","last_clean_scrub_stamp":"2026-02-22T23:25:41.723660+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T04:28:19.249844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044642500000000002,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":19,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-22T23:25:44.733849+0000","last_change":"2026-02-22T23:25:44.734019+0000","last_active":"2026-02-22T23:25:44.733849+0000","last_peered":"2026-02-22T23:25:44.733849+0000","last_clean":"2026-02-22T23:25:44.733849+0000","last_became_active":"2026-02-22T23:25:42.729332+0000","last_became_peered":"2026-02-22T23:25:42.729332+0000","last_unstale":"2026-02-22T23:25:44.733849+0000","last_undegraded":"2026-02-22T23:25:44.733849+0000","last_fullsized":"2026-02-22T23:25:44.733849+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:25:41.723660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:25:41.723660+0000","last_clean_scrub_stamp":"2026-02-22T23:25:41.723660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T05:15:12.260477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00028113600000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-22T23:25:44.735208+0000","last_change":"2026-02-22T23:25:44.735208+0000","last_active":"2026-02-22T23:25:44.735208+0000","last_peered":"2026-02-22T23:25:44.735208+0000","last_clean":"2026-02-22T23:25:44.735208+0000","last_became_active":"2026-02-22T23:25:42.732106+0000","last_became_peered":"2026-02-22T23:25:42.732106+0000","last_unstale":"2026-02-22T23:25:44.735208+0000","last_undegraded":"2026-02-22T23:25:44.735208+0000","last_fullsized":"2026-02-22T23:25:44.735208+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:25:41.723660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:25:41.723660+0000","last_clean_scrub_stamp":"2026-02-22T23:25:41.723660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:35:08.328395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000186295,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"17'1","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-22T23:25:44.735244+0000","last_change":"2026-02-22T23:25:44.735244+0000","last_active":"2026-02-22T23:25:44.735244+0000","last_peered":"2026-02-22T23:25:44.735244+0000","last_clean":"2026-02-22T23:25:44.735244+0000","last_became_active":"2026-02-22T23:25:42.732702+0000","last_became_peered":"2026-02-22T23:25:42.732702+0000","last_unstale":"2026-02-22T23:25:44.735244+0000","last_undegraded":"2026-02-22T23:25:44.735244+0000","last_fullsized":"2026-02-22T23:25:44.735244+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:25:41.723660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:25:41.723660+0000","last_clean_scrub_stamp":"2026-02-22T23:25:41.723660+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T01:00:00.519442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00023975299999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"14'112","reported_seq":156,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-22T23:25:44.734952+0000","last_change":"2026-02-22T23:25:36.890023+0000","last_active":"2026-02-22T23:25:44.734952+0000","last_peered":"2026-02-22T23:25:44.734952+0000","last_clean":"2026-02-22T23:25:44.734952+0000","last_became_active":"2026-02-22T23:25:36.889147+0000","last_became_peered":"2026-02-22T23:25:36.889147+0000","last_unstale":"2026-02-22T23:25:44.734952+0000","last_undegraded":"2026-02-22T23:25:44.734952+0000","last_fullsized":"2026-02-22T23:25:44.734952+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:25:35.704171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:25:35.704171+0000","last_clean_scrub_stamp":"2026-02-22T23:25:35.704171+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T02:46:45.050923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":1057856,"data_compressed":22320,"data_compressed_allocated":81920,"data_compressed_original":1024000,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":12,"seq":51539607557,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27180,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344660,"statfs":{"total":96636764160,"available":96608931840,"internally_reserved":0,"allocated":217088,"data_stored":576554,"data_compressed":11160,"data_compressed_allocated":40960,"data_compressed_original":512000,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":12,"seq":51539607556,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27132,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344708,"statfs":{"total":96636764160,"available":96608980992,"internally_reserved":0,"allocated":167936,"data_stored":51769,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":12,"seq":51539607556,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27124,"kb_used_data":160,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344716,"statfs":{"total":96636764160,"available":96608989184,"internally_reserved":0,"allocated":163840,"data_stored":51750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":12,"seq":51539607556,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27184,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344656,"statfs":{"total":96636764160,"available":96608927744,"internally_reserved":0,"allocated":225280,"data_stored":580678,"data_compressed":11160,"data_compressed_allocated":40960,"data_compressed_original":512000,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":12,"seq":51539607556,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27128,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344712,"statfs":{"total":96636764160,"available":96608985088,"internally_reserved":0,"allocated":167936,"data_stored":51769,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":11,"seq":47244640260,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27116,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344724,"statfs":{"total":96636764160,"available":96608997376,"internally_reserved":0,"allocated":155648,"data_stored":47626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27589065},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":528928,"data_compressed":11160,"data_compressed_allocated":40960,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":528928,"data_compressed":11160,"data_compressed_allocated":40960,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-22T23:25:48.454 INFO:tasks.ceph.ceph_manager.ceph:clean! 2026-02-22T23:25:48.454 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2026-02-22T23:25:48.454 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2026-02-22T23:25:48.454 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-22T23:25:48.521 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.521+0000 7f63915dd640 10 monclient: get_monmap_and_config 2026-02-22T23:25:48.521 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.521+0000 7f63915dd640 10 monclient: build_initial_monmap 2026-02-22T23:25:48.521 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.521+0000 7f63915dd640 10 monclient: monmap: 2026-02-22T23:25:48.521 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-22T23:25:48.521 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:48.521 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:25:48.521443+0000 2026-02-22T23:25:48.521 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:25:48.521443+0000 2026-02-22T23:25:48.521 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-22T23:25:48.521 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:48.521 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-22T23:25:48.521 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.noname-f 2026-02-22T23:25:48.521 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.noname-b 2026-02-22T23:25:48.521 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.noname-g 2026-02-22T23:25:48.521 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.noname-c 2026-02-22T23:25:48.521 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.noname-h 2026-02-22T23:25:48.521 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.noname-d 2026-02-22T23:25:48.521 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.noname-i 2026-02-22T23:25:48.521 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.noname-e 2026-02-22T23:25:48.521 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:48.522 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.521+0000 7f63915dd640 1 Processor -- start 2026-02-22T23:25:48.522 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.521+0000 7f63915dd640 1 -- start start 2026-02-22T23:25:48.522 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.521+0000 7f63915dd640 10 monclient: init 2026-02-22T23:25:48.523 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.521+0000 7f63915dd640 10 monclient: _reopen_session rank -1 2026-02-22T23:25:48.523 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.521+0000 7f63915dd640 10 monclient: _add_conns ranks=[7,1,2,3,5,8,4,6,0] 2026-02-22T23:25:48.523 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.522+0000 7f63915dd640 10 monclient(hunting): picked mon.noname-i con 0x7f638c0a41a0 addr v1:10.20.193.73:6792/0 2026-02-22T23:25:48.523 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.522+0000 7f63915dd640 10 monclient(hunting): picked mon.noname-f con 0x7f638c0a4c90 addr v1:10.20.193.73:6789/0 2026-02-22T23:25:48.523 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.522+0000 7f63915dd640 10 monclient(hunting): picked mon.noname-b con 0x7f638c0a50a0 addr v1:10.20.193.45:6790/0 2026-02-22T23:25:48.523 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.522+0000 7f63915dd640 1 -- --> v1:10.20.193.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f638c06e1b0 con 0x7f638c0a4c90 2026-02-22T23:25:48.523 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.522+0000 7f63915dd640 1 -- --> v1:10.20.193.45:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f638c06e490 con 0x7f638c0a50a0 2026-02-22T23:25:48.523 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.522+0000 7f63915dd640 1 -- --> v1:10.20.193.73:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f638c0a5530 con 0x7f638c0a41a0 2026-02-22T23:25:48.523 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.522+0000 7f63915dd640 10 monclient(hunting): _renew_subs 2026-02-22T23:25:48.523 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.522+0000 7f63915dd640 10 monclient(hunting): authenticate will time out at 680.138059s 2026-02-22T23:25:48.523 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.522+0000 7f638b7fe640 1 --1- >> v1:10.20.193.45:6790/0 conn(0x7f638c0a50a0 0x7f638c141710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.45:6790/0 says I am v1:10.20.193.45:51014/0 (socket says 10.20.193.45:51014) 2026-02-22T23:25:48.523 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.522+0000 7f638b7fe640 1 -- 10.20.193.45:0/3349354834 learned_addr learned my addr 10.20.193.45:0/3349354834 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-22T23:25:48.523 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.522+0000 7f6389ffb640 1 -- 10.20.193.45:0/3349354834 <== mon.2 v1:10.20.193.45:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 218491794 0 0) 0x7f638c06e490 con 0x7f638c0a50a0 2026-02-22T23:25:48.523 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.522+0000 7f6389ffb640 10 monclient(hunting): _negotiate 2026-02-22T23:25:48.523 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.522+0000 7f6389ffb640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:48.523 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.522+0000 7f6389ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:48.523 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.522+0000 7f6389ffb640 10 monclient(hunting): my global_id is 4421 2026-02-22T23:25:48.523 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.522+0000 7f6389ffb640 1 -- 10.20.193.45:0/3349354834 --> v1:10.20.193.45:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6378003620 con 0x7f638c0a50a0 2026-02-22T23:25:48.523 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.522+0000 7f6389ffb640 1 -- 10.20.193.45:0/3349354834 <== mon.7 v1:10.20.193.73:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 707890944 0 0) 0x7f638c0a5530 con 0x7f638c0a41a0 2026-02-22T23:25:48.523 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.522+0000 7f6389ffb640 10 monclient(hunting): _negotiate 2026-02-22T23:25:48.523 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.522+0000 7f6389ffb640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:48.523 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.522+0000 7f6389ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:48.523 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.522+0000 7f6389ffb640 10 monclient(hunting): my global_id is 4327 2026-02-22T23:25:48.523 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.522+0000 7f6389ffb640 1 -- 10.20.193.45:0/3349354834 --> v1:10.20.193.73:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f638c06e490 con 0x7f638c0a41a0 2026-02-22T23:25:48.523 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.522+0000 7f6389ffb640 1 -- 10.20.193.45:0/3349354834 <== mon.1 v1:10.20.193.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1950076580 0 0) 0x7f638c06e1b0 con 0x7f638c0a4c90 2026-02-22T23:25:48.523 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.522+0000 7f6389ffb640 10 monclient(hunting): _negotiate 2026-02-22T23:25:48.523 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.522+0000 7f6389ffb640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:48.523 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.522+0000 7f6389ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:48.523 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.522+0000 7f6389ffb640 10 monclient(hunting): my global_id is 4483 2026-02-22T23:25:48.523 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.522+0000 7f6389ffb640 1 -- 10.20.193.45:0/3349354834 --> v1:10.20.193.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f638c0a5530 con 0x7f638c0a4c90 2026-02-22T23:25:48.523 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.522+0000 7f6389ffb640 1 -- 10.20.193.45:0/3349354834 <== mon.2 v1:10.20.193.45:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 719289455 0 0) 0x7f6378003620 con 0x7f638c0a50a0 2026-02-22T23:25:48.523 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.522+0000 7f6389ffb640 1 -- 10.20.193.45:0/3349354834 >> v1:10.20.193.73:6792/0 conn(0x7f638c0a41a0 legacy=0x7f638c0a4580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:48.523 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.522+0000 7f6389ffb640 1 -- 10.20.193.45:0/3349354834 >> v1:10.20.193.73:6789/0 conn(0x7f638c0a4c90 legacy=0x7f638c13dfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:48.523 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.522+0000 7f6389ffb640 10 monclient: _finish_hunting 0 2026-02-22T23:25:48.523 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.522+0000 7f6389ffb640 1 monclient: found mon.noname-b 2026-02-22T23:25:48.523 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.522+0000 7f6389ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T23:25:48.523 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.522+0000 7f6389ffb640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.45:6790/0 2026-02-22T23:25:48.523 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.522+0000 7f6389ffb640 1 -- 10.20.193.45:0/3349354834 --> v1:10.20.193.45:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f638c06ced0 con 0x7f638c0a50a0 2026-02-22T23:25:48.523 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.522+0000 7f6389ffb640 10 monclient: _finish_auth 0 2026-02-22T23:25:48.523 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.522+0000 7f6389ffb640 10 monclient: _check_auth_tickets 2026-02-22T23:25:48.524 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.522+0000 7f6389ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T23:25:48.524 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.522+0000 7f6389ffb640 1 -- 10.20.193.45:0/3349354834 <== mon.2 v1:10.20.193.45:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f637c0033c0 con 0x7f638c0a50a0 2026-02-22T23:25:48.524 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.522+0000 7f63915dd640 5 monclient: authenticate success, global_id 4421 2026-02-22T23:25:48.524 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.522+0000 7f6389ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:25:48.524 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.522+0000 7f6389ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-22T23:25:48.524 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.522+0000 7f6389ffb640 10 monclient: dump: 2026-02-22T23:25:48.524 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:48.524 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:48.524 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:48.524 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:48.524 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:48.524 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:48.524 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:48.524 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:48.524 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:48.524 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:48.524 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:48.524 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:48.524 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:48.524 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:48.524 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:48.524 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:48.524 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.522+0000 7f63915dd640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-22T23:25:48.524 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.522+0000 7f6389ffb640 1 -- 10.20.193.45:0/3349354834 <== mon.2 v1:10.20.193.45:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f637c0035e0 con 0x7f638c0a50a0 2026-02-22T23:25:48.524 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.522+0000 7f6389ffb640 10 monclient: handle_config config(0 keys) 2026-02-22T23:25:48.524 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.522+0000 7f6389ffb640 1 -- 10.20.193.45:0/3349354834 <== mon.2 v1:10.20.193.45:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f637c005060 con 0x7f638c0a50a0 2026-02-22T23:25:48.524 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.522+0000 7f63915dd640 10 monclient: get_monmap_and_config success 2026-02-22T23:25:48.524 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.522+0000 7f63915dd640 4 set_mon_vals no callback set 2026-02-22T23:25:48.524 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.522+0000 7f6389ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:25:48.524 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.522+0000 7f6389ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-22T23:25:48.524 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.522+0000 7f6389ffb640 10 monclient: dump: 2026-02-22T23:25:48.524 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:48.524 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:48.524 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:48.524 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:48.524 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:48.524 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:48.524 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:48.524 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:48.524 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:48.524 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:48.524 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:48.524 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:48.524 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:48.525 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:48.525 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:48.525 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:48.525 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.522+0000 7f63915dd640 10 monclient: shutdown 2026-02-22T23:25:48.525 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.522+0000 7f63915dd640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T23:25:48.525 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.522+0000 7f63915dd640 1 -- 10.20.193.45:0/3349354834 >> v1:10.20.193.45:6790/0 conn(0x7f638c0a50a0 legacy=0x7f638c141710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:48.525 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.522+0000 7f63915dd640 1 -- 10.20.193.45:0/3349354834 shutdown_connections 2026-02-22T23:25:48.525 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.522+0000 7f63915dd640 1 -- 10.20.193.45:0/3349354834 >> 10.20.193.45:0/3349354834 conn(0x7f638c0a9720 msgr2=0x7f638c0a9b30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:25:48.525 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.522+0000 7f63915dd640 1 -- 10.20.193.45:0/3349354834 shutdown_connections 2026-02-22T23:25:48.525 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.522+0000 7f63915dd640 1 -- 10.20.193.45:0/3349354834 wait complete. 2026-02-22T23:25:48.526 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.523+0000 7f63915dd640 10 monclient: build_initial_monmap 2026-02-22T23:25:48.526 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.523+0000 7f63915dd640 10 monclient: monmap: 2026-02-22T23:25:48.526 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-22T23:25:48.526 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T23:25:48.526 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-22T23:25:48.526 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-22T23:25:48.526 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-22T23:25:48.526 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-22T23:25:48.526 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-22T23:25:48.526 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.noname-f 2026-02-22T23:25:48.526 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.noname-b 2026-02-22T23:25:48.526 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.noname-g 2026-02-22T23:25:48.526 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.noname-c 2026-02-22T23:25:48.526 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.noname-h 2026-02-22T23:25:48.526 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.noname-d 2026-02-22T23:25:48.526 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.noname-i 2026-02-22T23:25:48.526 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.noname-e 2026-02-22T23:25:48.526 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:48.527 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.523+0000 7f63915dd640 1 Processor -- start 2026-02-22T23:25:48.527 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.523+0000 7f63915dd640 1 -- start start 2026-02-22T23:25:48.527 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.523+0000 7f63915dd640 10 monclient: init 2026-02-22T23:25:48.527 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.523+0000 7f63915dd640 10 monclient: _reopen_session rank -1 2026-02-22T23:25:48.527 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.523+0000 7f63915dd640 10 monclient: _add_conns ranks=[4,2,3,0,1,8,5,7,6] 2026-02-22T23:25:48.527 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.523+0000 7f63915dd640 10 monclient(hunting): picked mon.noname-c con 0x7f638c0a41a0 addr v1:10.20.193.45:6791/0 2026-02-22T23:25:48.527 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.523+0000 7f63915dd640 10 monclient(hunting): picked mon.noname-b con 0x7f638c0a4c90 addr v1:10.20.193.45:6790/0 2026-02-22T23:25:48.527 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.523+0000 7f63915dd640 10 monclient(hunting): picked mon.noname-g con 0x7f638c0a50a0 addr v1:10.20.193.73:6790/0 2026-02-22T23:25:48.527 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.523+0000 7f63915dd640 1 -- --> v1:10.20.193.45:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f638c141150 con 0x7f638c0a4c90 2026-02-22T23:25:48.527 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.523+0000 7f63915dd640 1 -- --> v1:10.20.193.73:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f638c141430 con 0x7f638c0a50a0 2026-02-22T23:25:48.527 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.523+0000 7f63915dd640 1 -- --> v1:10.20.193.45:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f638c1419f0 con 0x7f638c0a41a0 2026-02-22T23:25:48.527 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.523+0000 7f63915dd640 10 monclient(hunting): _renew_subs 2026-02-22T23:25:48.527 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.523+0000 7f63915dd640 10 monclient(hunting): authenticate will time out at 680.139813s 2026-02-22T23:25:48.527 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.523+0000 7f638a7fc640 1 --1- >> v1:10.20.193.45:6790/0 conn(0x7f638c0a4c90 0x7f638c1d4ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.45:6790/0 says I am v1:10.20.193.45:51022/0 (socket says 10.20.193.45:51022) 2026-02-22T23:25:48.527 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.523+0000 7f638a7fc640 1 -- 10.20.193.45:0/4063480758 learned_addr learned my addr 10.20.193.45:0/4063480758 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-22T23:25:48.527 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.523+0000 7f636b7fe640 1 -- 10.20.193.45:0/4063480758 <== mon.2 v1:10.20.193.45:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3634344078 0 0) 0x7f638c141150 con 0x7f638c0a4c90 2026-02-22T23:25:48.527 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.523+0000 7f636b7fe640 10 monclient(hunting): _negotiate 2026-02-22T23:25:48.527 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.523+0000 7f636b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:48.527 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.523+0000 7f636b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:48.527 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.523+0000 7f636b7fe640 10 monclient(hunting): my global_id is 4430 2026-02-22T23:25:48.527 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.523+0000 7f636b7fe640 1 -- 10.20.193.45:0/4063480758 --> v1:10.20.193.45:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6358003620 con 0x7f638c0a4c90 2026-02-22T23:25:48.527 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.523+0000 7f636b7fe640 1 -- 10.20.193.45:0/4063480758 <== mon.4 v1:10.20.193.45:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2807741794 0 0) 0x7f638c1419f0 con 0x7f638c0a41a0 2026-02-22T23:25:48.527 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.523+0000 7f636b7fe640 10 monclient(hunting): _negotiate 2026-02-22T23:25:48.527 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.523+0000 7f636b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:48.527 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.523+0000 7f636b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:48.527 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.523+0000 7f636b7fe640 10 monclient(hunting): my global_id is 4405 2026-02-22T23:25:48.527 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.523+0000 7f636b7fe640 1 -- 10.20.193.45:0/4063480758 --> v1:10.20.193.45:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f638c141150 con 0x7f638c0a41a0 2026-02-22T23:25:48.527 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.524+0000 7f636b7fe640 1 -- 10.20.193.45:0/4063480758 <== mon.2 v1:10.20.193.45:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4142006441 0 0) 0x7f6358003620 con 0x7f638c0a4c90 2026-02-22T23:25:48.527 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.524+0000 7f636b7fe640 1 -- 10.20.193.45:0/4063480758 --> v1:10.20.193.45:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f638c1419f0 con 0x7f638c0a4c90 2026-02-22T23:25:48.527 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.524+0000 7f636b7fe640 1 -- 10.20.193.45:0/4063480758 <== mon.2 v1:10.20.193.45:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f63740033c0 con 0x7f638c0a4c90 2026-02-22T23:25:48.527 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.524+0000 7f636b7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-22T23:25:48.527 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.524+0000 7f636b7fe640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-22T23:25:48.527 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.524+0000 7f636b7fe640 10 monclient(hunting): dump: 2026-02-22T23:25:48.527 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:48.527 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:48.527 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:48.527 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:48.527 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:48.527 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:48.527 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:48.527 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:48.527 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:48.528 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:48.528 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:48.528 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:48.528 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:48.528 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:48.528 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:48.528 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:48.528 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.524+0000 7f636b7fe640 10 monclient(hunting): _finish_auth 0 2026-02-22T23:25:48.528 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.524+0000 7f636b7fe640 1 -- 10.20.193.45:0/4063480758 <== mon.4 v1:10.20.193.45:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1460204092 0 0) 0x7f638c141150 con 0x7f638c0a41a0 2026-02-22T23:25:48.528 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.524+0000 7f636b7fe640 1 -- 10.20.193.45:0/4063480758 --> v1:10.20.193.45:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6358003620 con 0x7f638c0a41a0 2026-02-22T23:25:48.528 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.524+0000 7f636b7fe640 1 -- 10.20.193.45:0/4063480758 <== mon.4 v1:10.20.193.45:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f63800032e0 con 0x7f638c0a41a0 2026-02-22T23:25:48.528 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.524+0000 7f636b7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-22T23:25:48.528 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.524+0000 7f636b7fe640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-22T23:25:48.528 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.524+0000 7f636b7fe640 10 monclient(hunting): dump: 2026-02-22T23:25:48.528 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:48.528 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:48.528 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:48.528 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:48.528 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:48.528 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:48.528 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:48.528 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:48.528 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:48.528 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:48.528 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:48.528 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:48.528 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:48.528 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:48.528 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:48.528 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:48.528 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.524+0000 7f636b7fe640 1 -- 10.20.193.45:0/4063480758 <== mon.2 v1:10.20.193.45:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 672709441 0 0) 0x7f638c1419f0 con 0x7f638c0a4c90 2026-02-22T23:25:48.528 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.524+0000 7f636b7fe640 1 -- 10.20.193.45:0/4063480758 >> v1:10.20.193.45:6791/0 conn(0x7f638c0a41a0 legacy=0x7f638c1cff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:48.528 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.524+0000 7f636b7fe640 1 -- 10.20.193.45:0/4063480758 >> v1:10.20.193.73:6790/0 conn(0x7f638c0a50a0 legacy=0x7f638c1d85d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:48.528 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.524+0000 7f636b7fe640 10 monclient: _finish_hunting 0 2026-02-22T23:25:48.528 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.524+0000 7f636b7fe640 1 monclient: found mon.b 2026-02-22T23:25:48.528 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.524+0000 7f636b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T23:25:48.528 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.524+0000 7f636b7fe640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.45:6790/0 2026-02-22T23:25:48.528 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.524+0000 7f636b7fe640 1 -- 10.20.193.45:0/4063480758 --> v1:10.20.193.45:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f638c0a2b80 con 0x7f638c0a4c90 2026-02-22T23:25:48.528 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.524+0000 7f636b7fe640 10 monclient: _finish_auth 0 2026-02-22T23:25:48.528 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.524+0000 7f636b7fe640 10 monclient: _check_auth_tickets 2026-02-22T23:25:48.528 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.524+0000 7f636b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T23:25:48.528 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.524+0000 7f63915dd640 5 monclient: authenticate success, global_id 4430 2026-02-22T23:25:48.528 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.524+0000 7f63915dd640 10 monclient: _renew_subs 2026-02-22T23:25:48.529 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.524+0000 7f63915dd640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.45:6790/0 2026-02-22T23:25:48.529 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.524+0000 7f63915dd640 1 -- 10.20.193.45:0/4063480758 --> v1:10.20.193.45:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f638c0a6780 con 0x7f638c0a4c90 2026-02-22T23:25:48.529 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.524+0000 7f63915dd640 10 monclient: _renew_subs 2026-02-22T23:25:48.529 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.524+0000 7f63915dd640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.45:6790/0 2026-02-22T23:25:48.529 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.524+0000 7f63915dd640 1 -- 10.20.193.45:0/4063480758 --> v1:10.20.193.45:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f638c13ece0 con 0x7f638c0a4c90 2026-02-22T23:25:48.529 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.524+0000 7f636b7fe640 1 -- 10.20.193.45:0/4063480758 <== mon.2 v1:10.20.193.45:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f63740039c0 con 0x7f638c0a4c90 2026-02-22T23:25:48.529 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.524+0000 7f636b7fe640 10 monclient: handle_config config(0 keys) 2026-02-22T23:25:48.529 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.524+0000 7f636b7fe640 1 -- 10.20.193.45:0/4063480758 <== mon.2 v1:10.20.193.45:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f6374003fb0 con 0x7f638c0a4c90 2026-02-22T23:25:48.529 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.524+0000 7f636b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:25:48.529 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.524+0000 7f636b7fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-22T23:25:48.529 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.524+0000 7f63897fa640 4 set_mon_vals no callback set 2026-02-22T23:25:48.529 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.524+0000 7f636b7fe640 10 monclient: dump: 2026-02-22T23:25:48.529 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:48.529 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:48.529 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:48.529 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:48.529 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:48.529 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:48.529 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:48.529 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:48.529 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:48.529 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:48.529 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:48.529 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:48.529 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:48.529 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:48.529 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:48.529 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:48.529 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.524+0000 7f63915dd640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T23:25:48.529 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.524+0000 7f63915dd640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T23:25:48.529 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.524+0000 7f63915dd640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.45:6790/0 2026-02-22T23:25:48.529 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.524+0000 7f63915dd640 1 -- 10.20.193.45:0/4063480758 --> v1:10.20.193.45:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f638c09fec0 con 0x7f638c0a4c90 2026-02-22T23:25:48.529 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.524+0000 7f636b7fe640 1 -- 10.20.193.45:0/4063480758 <== mon.2 v1:10.20.193.45:6790/0 7 ==== mgrmap(e 5) ==== 50225+0+0 (unknown 2330357642 0 0) 0x7f6374004150 con 0x7f638c0a4c90 2026-02-22T23:25:48.529 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.525+0000 7f636b7fe640 1 -- 10.20.193.45:0/4063480758 <== mon.2 v1:10.20.193.45:6790/0 8 ==== osd_map(19..19 src has 1..19) ==== 3558+0+0 (unknown 1288710973 0 0) 0x7f637404dde0 con 0x7f638c0a4c90 2026-02-22T23:25:48.529 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.525+0000 7f638affd640 10 monclient: get_auth_request con 0x7f635803fe80 auth_method 0 2026-02-22T23:25:48.529 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.527+0000 7f636b7fe640 1 -- 10.20.193.45:0/4063480758 <== mon.2 v1:10.20.193.45:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (unknown 1092875540 0 2568732696) 0x7f63740178e0 con 0x7f638c0a4c90 2026-02-22T23:25:48.529 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.527+0000 7f636b7fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T23:25:48.529 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.527+0000 7f636b7fe640 10 monclient: _finish_command 1 = system:0 2026-02-22T23:25:48.626 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.626+0000 7f63915dd640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-22T23:25:48.626 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.626+0000 7f63915dd640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-22T23:25:48.626 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.626+0000 7f63915dd640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.45:6790/0 2026-02-22T23:25:48.626 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.626+0000 7f63915dd640 1 -- 10.20.193.45:0/4063480758 --> v1:10.20.193.45:6790/0 -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f638c06ea50 con 0x7f638c0a4c90 2026-02-22T23:25:48.626 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.626+0000 7f636b7fe640 1 -- 10.20.193.45:0/4063480758 <== mon.2 v1:10.20.193.45:6790/0 10 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (unknown 3730786198 0 4185958460) 0x7f63740171e0 con 0x7f638c0a4c90 2026-02-22T23:25:48.626 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.626+0000 7f636b7fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-22T23:25:48.626 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.626+0000 7f636b7fe640 10 monclient: _finish_command 2 = system:0 2026-02-22T23:25:48.626 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-22T23:25:48.626 INFO:teuthology.orchestra.run.trial045.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2026-02-22T23:25:48.627 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.626+0000 7f63915dd640 1 -- 10.20.193.45:0/4063480758 >> v1:10.20.193.73:6800/2222410180 conn(0x7f635803fe80 legacy=0x7f6358042340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:48.627 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.626+0000 7f63915dd640 10 monclient: shutdown 2026-02-22T23:25:48.627 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.627+0000 7f63915dd640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T23:25:48.627 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.627+0000 7f63915dd640 1 -- 10.20.193.45:0/4063480758 >> v1:10.20.193.45:6790/0 conn(0x7f638c0a4c90 legacy=0x7f638c1d4ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:48.627 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.627+0000 7f63915dd640 1 -- 10.20.193.45:0/4063480758 shutdown_connections 2026-02-22T23:25:48.627 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.627+0000 7f63915dd640 1 -- 10.20.193.45:0/4063480758 >> 10.20.193.45:0/4063480758 conn(0x7f638c0a9720 msgr2=0x7f638c09f3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:25:48.627 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.627+0000 7f63915dd640 1 -- 10.20.193.45:0/4063480758 shutdown_connections 2026-02-22T23:25:48.627 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.627+0000 7f63915dd640 1 -- 10.20.193.45:0/4063480758 wait complete. 2026-02-22T23:25:48.634 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2026-02-22T23:25:48.634 INFO:teuthology.run_tasks:Running task mon_thrash... 2026-02-22T23:25:48.646 INFO:tasks.mon_thrash:Beginning mon_thrash... 2026-02-22T23:25:48.646 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-22T23:25:48.713 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.714+0000 7efc6d7bc640 10 monclient: get_monmap_and_config 2026-02-22T23:25:48.714 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.714+0000 7efc6d7bc640 10 monclient: build_initial_monmap 2026-02-22T23:25:48.714 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.714+0000 7efc6d7bc640 10 monclient: monmap: 2026-02-22T23:25:48.714 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-22T23:25:48.714 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:48.714 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:25:48.714311+0000 2026-02-22T23:25:48.714 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:25:48.714311+0000 2026-02-22T23:25:48.714 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-22T23:25:48.714 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:48.714 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-22T23:25:48.714 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.noname-f 2026-02-22T23:25:48.714 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.noname-b 2026-02-22T23:25:48.714 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.noname-g 2026-02-22T23:25:48.714 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.noname-c 2026-02-22T23:25:48.714 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.noname-h 2026-02-22T23:25:48.714 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.noname-d 2026-02-22T23:25:48.714 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.noname-i 2026-02-22T23:25:48.714 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.noname-e 2026-02-22T23:25:48.714 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:48.715 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.714+0000 7efc6d7bc640 1 Processor -- start 2026-02-22T23:25:48.715 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.714+0000 7efc6d7bc640 1 -- start start 2026-02-22T23:25:48.715 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.714+0000 7efc6d7bc640 10 monclient: init 2026-02-22T23:25:48.715 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.714+0000 7efc6d7bc640 10 monclient: _reopen_session rank -1 2026-02-22T23:25:48.715 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.714+0000 7efc6d7bc640 10 monclient: _add_conns ranks=[2,0,8,1,7,3,5,4,6] 2026-02-22T23:25:48.715 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.714+0000 7efc6d7bc640 10 monclient(hunting): picked mon.noname-b con 0x7efc680a1a60 addr v1:10.20.193.45:6790/0 2026-02-22T23:25:48.715 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.714+0000 7efc6d7bc640 10 monclient(hunting): picked mon.noname-a con 0x7efc6806f1e0 addr v1:10.20.193.45:6789/0 2026-02-22T23:25:48.716 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.714+0000 7efc6d7bc640 10 monclient(hunting): picked mon.noname-e con 0x7efc680a0980 addr v1:10.20.193.45:6793/0 2026-02-22T23:25:48.716 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.714+0000 7efc6d7bc640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efc6809df00 con 0x7efc6806f1e0 2026-02-22T23:25:48.716 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.714+0000 7efc6d7bc640 1 -- --> v1:10.20.193.45:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efc68137660 con 0x7efc680a1a60 2026-02-22T23:25:48.716 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.714+0000 7efc6d7bc640 1 -- --> v1:10.20.193.45:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efc680a4510 con 0x7efc680a0980 2026-02-22T23:25:48.716 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.714+0000 7efc6d7bc640 10 monclient(hunting): _renew_subs 2026-02-22T23:25:48.716 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.714+0000 7efc6d7bc640 10 monclient(hunting): authenticate will time out at 680.330842s 2026-02-22T23:25:48.716 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.714+0000 7efc66ffd640 1 --1- >> v1:10.20.193.45:6790/0 conn(0x7efc680a1a60 0x7efc68136840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.45:6790/0 says I am v1:10.20.193.45:51034/0 (socket says 10.20.193.45:51034) 2026-02-22T23:25:48.716 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.714+0000 7efc66ffd640 1 -- 10.20.193.45:0/63502353 learned_addr learned my addr 10.20.193.45:0/63502353 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-22T23:25:48.716 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.714+0000 7efc677fe640 1 --1- 10.20.193.45:0/63502353 >> v1:10.20.193.45:6793/0 conn(0x7efc680a0980 0x7efc6813ecb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.45:6793/0 says I am v1:10.20.193.45:36822/0 (socket says 10.20.193.45:36822) 2026-02-22T23:25:48.716 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.715+0000 7efc65ffb640 1 -- 10.20.193.45:0/63502353 <== mon.2 v1:10.20.193.45:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1175532746 0 0) 0x7efc68137660 con 0x7efc680a1a60 2026-02-22T23:25:48.716 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.715+0000 7efc65ffb640 10 monclient(hunting): _negotiate 2026-02-22T23:25:48.716 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.715+0000 7efc65ffb640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:48.716 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.715+0000 7efc65ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:48.716 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.715+0000 7efc65ffb640 10 monclient(hunting): my global_id is 4439 2026-02-22T23:25:48.716 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.715+0000 7efc65ffb640 1 -- 10.20.193.45:0/63502353 --> v1:10.20.193.45:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efc54003620 con 0x7efc680a1a60 2026-02-22T23:25:48.716 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.715+0000 7efc65ffb640 1 -- 10.20.193.45:0/63502353 <== mon.8 v1:10.20.193.45:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1267204092 0 0) 0x7efc680a4510 con 0x7efc680a0980 2026-02-22T23:25:48.716 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.715+0000 7efc65ffb640 10 monclient(hunting): _negotiate 2026-02-22T23:25:48.716 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.715+0000 7efc65ffb640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:48.716 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.715+0000 7efc65ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:48.716 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.715+0000 7efc65ffb640 10 monclient(hunting): my global_id is 4391 2026-02-22T23:25:48.716 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.715+0000 7efc65ffb640 1 -- 10.20.193.45:0/63502353 --> v1:10.20.193.45:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efc68137660 con 0x7efc680a0980 2026-02-22T23:25:48.716 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.715+0000 7efc65ffb640 1 -- 10.20.193.45:0/63502353 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 840271429 0 0) 0x7efc50002920 con 0x7efc6806f1e0 2026-02-22T23:25:48.716 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.715+0000 7efc65ffb640 10 monclient(hunting): _negotiate 2026-02-22T23:25:48.716 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.715+0000 7efc65ffb640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:48.716 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.715+0000 7efc65ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:48.716 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.715+0000 7efc65ffb640 10 monclient(hunting): my global_id is 4374 2026-02-22T23:25:48.716 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.715+0000 7efc65ffb640 1 -- 10.20.193.45:0/63502353 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efc680a4510 con 0x7efc6806f1e0 2026-02-22T23:25:48.716 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.715+0000 7efc65ffb640 1 -- 10.20.193.45:0/63502353 <== mon.2 v1:10.20.193.45:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1433228981 0 0) 0x7efc54003620 con 0x7efc680a1a60 2026-02-22T23:25:48.716 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.715+0000 7efc65ffb640 1 -- 10.20.193.45:0/63502353 >> v1:10.20.193.45:6793/0 conn(0x7efc680a0980 legacy=0x7efc6813ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:48.716 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.715+0000 7efc65ffb640 1 -- 10.20.193.45:0/63502353 >> v1:10.20.193.45:6789/0 conn(0x7efc6806f1e0 legacy=0x7efc68136f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:48.716 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.715+0000 7efc65ffb640 10 monclient: _finish_hunting 0 2026-02-22T23:25:48.716 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.715+0000 7efc65ffb640 1 monclient: found mon.noname-b 2026-02-22T23:25:48.716 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.715+0000 7efc65ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T23:25:48.716 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.715+0000 7efc65ffb640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.45:6790/0 2026-02-22T23:25:48.716 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.715+0000 7efc65ffb640 1 -- 10.20.193.45:0/63502353 --> v1:10.20.193.45:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc68143400 con 0x7efc680a1a60 2026-02-22T23:25:48.716 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.715+0000 7efc65ffb640 10 monclient: _finish_auth 0 2026-02-22T23:25:48.716 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.715+0000 7efc65ffb640 10 monclient: _check_auth_tickets 2026-02-22T23:25:48.716 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.715+0000 7efc65ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T23:25:48.716 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.715+0000 7efc6d7bc640 5 monclient: authenticate success, global_id 4439 2026-02-22T23:25:48.717 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.715+0000 7efc65ffb640 1 -- 10.20.193.45:0/63502353 <== mon.2 v1:10.20.193.45:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7efc5c003040 con 0x7efc680a1a60 2026-02-22T23:25:48.717 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.715+0000 7efc65ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:25:48.717 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.715+0000 7efc65ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-22T23:25:48.717 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.715+0000 7efc65ffb640 10 monclient: dump: 2026-02-22T23:25:48.717 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:48.717 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:48.717 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:48.717 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:48.717 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:48.717 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:48.717 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:48.717 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:48.717 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:48.717 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:48.717 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:48.717 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:48.717 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:48.717 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:48.717 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:48.717 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:48.717 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.715+0000 7efc6d7bc640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-22T23:25:48.717 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.715+0000 7efc65ffb640 1 -- 10.20.193.45:0/63502353 <== mon.2 v1:10.20.193.45:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7efc5c0031e0 con 0x7efc680a1a60 2026-02-22T23:25:48.717 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.715+0000 7efc65ffb640 10 monclient: handle_config config(0 keys) 2026-02-22T23:25:48.717 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.715+0000 7efc65ffb640 1 -- 10.20.193.45:0/63502353 <== mon.2 v1:10.20.193.45:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7efc5c004ce0 con 0x7efc680a1a60 2026-02-22T23:25:48.717 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.715+0000 7efc6d7bc640 10 monclient: get_monmap_and_config success 2026-02-22T23:25:48.717 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.715+0000 7efc6d7bc640 4 set_mon_vals no callback set 2026-02-22T23:25:48.717 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.715+0000 7efc65ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:25:48.717 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.715+0000 7efc65ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-22T23:25:48.717 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.715+0000 7efc65ffb640 10 monclient: dump: 2026-02-22T23:25:48.717 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:48.717 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:48.717 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:48.717 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:48.717 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:48.717 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:48.717 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:48.717 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:48.717 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:48.717 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:48.717 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:48.717 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:48.717 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:48.718 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:48.718 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:48.718 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:48.718 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.715+0000 7efc6d7bc640 10 monclient: shutdown 2026-02-22T23:25:48.718 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.715+0000 7efc6d7bc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T23:25:48.718 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.715+0000 7efc6d7bc640 1 -- 10.20.193.45:0/63502353 >> v1:10.20.193.45:6790/0 conn(0x7efc680a1a60 legacy=0x7efc68136840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:48.718 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.715+0000 7efc6d7bc640 1 -- 10.20.193.45:0/63502353 shutdown_connections 2026-02-22T23:25:48.718 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.715+0000 7efc6d7bc640 1 -- 10.20.193.45:0/63502353 >> 10.20.193.45:0/63502353 conn(0x7efc680a7780 msgr2=0x7efc680a3b60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:25:48.718 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.715+0000 7efc6d7bc640 1 -- 10.20.193.45:0/63502353 shutdown_connections 2026-02-22T23:25:48.718 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.715+0000 7efc6d7bc640 1 -- 10.20.193.45:0/63502353 wait complete. 2026-02-22T23:25:48.719 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.716+0000 7efc6d7bc640 10 monclient: build_initial_monmap 2026-02-22T23:25:48.719 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.716+0000 7efc6d7bc640 10 monclient: monmap: 2026-02-22T23:25:48.719 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-22T23:25:48.719 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T23:25:48.719 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-22T23:25:48.719 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-22T23:25:48.719 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-22T23:25:48.719 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-22T23:25:48.719 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-22T23:25:48.719 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.noname-f 2026-02-22T23:25:48.719 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.noname-b 2026-02-22T23:25:48.719 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.noname-g 2026-02-22T23:25:48.719 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.noname-c 2026-02-22T23:25:48.720 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.noname-h 2026-02-22T23:25:48.720 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.noname-d 2026-02-22T23:25:48.720 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.noname-i 2026-02-22T23:25:48.720 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.noname-e 2026-02-22T23:25:48.720 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:48.720 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.716+0000 7efc6d7bc640 1 Processor -- start 2026-02-22T23:25:48.720 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.716+0000 7efc6d7bc640 1 -- start start 2026-02-22T23:25:48.720 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.716+0000 7efc6d7bc640 10 monclient: init 2026-02-22T23:25:48.720 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.716+0000 7efc6d7bc640 10 monclient: _reopen_session rank -1 2026-02-22T23:25:48.720 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.716+0000 7efc6d7bc640 10 monclient: _add_conns ranks=[0,3,8,4,2,5,6,1,7] 2026-02-22T23:25:48.720 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.716+0000 7efc6d7bc640 10 monclient(hunting): picked mon.noname-a con 0x7efc680a0980 addr v1:10.20.193.45:6789/0 2026-02-22T23:25:48.720 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.716+0000 7efc6d7bc640 10 monclient(hunting): picked mon.noname-g con 0x7efc680a1a60 addr v1:10.20.193.73:6790/0 2026-02-22T23:25:48.720 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.716+0000 7efc6d7bc640 10 monclient(hunting): picked mon.noname-e con 0x7efc681cf740 addr v1:10.20.193.45:6793/0 2026-02-22T23:25:48.720 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.716+0000 7efc6d7bc640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efc681cfbf0 con 0x7efc680a0980 2026-02-22T23:25:48.720 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.716+0000 7efc6d7bc640 1 -- --> v1:10.20.193.73:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efc6811e840 con 0x7efc680a1a60 2026-02-22T23:25:48.720 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.716+0000 7efc6d7bc640 1 -- --> v1:10.20.193.45:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efc6813ff10 con 0x7efc681cf740 2026-02-22T23:25:48.720 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.716+0000 7efc6d7bc640 10 monclient(hunting): _renew_subs 2026-02-22T23:25:48.720 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.716+0000 7efc6d7bc640 10 monclient(hunting): authenticate will time out at 680.332607s 2026-02-22T23:25:48.720 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.716+0000 7efc66ffd640 1 --1- >> v1:10.20.193.45:6789/0 conn(0x7efc680a0980 0x7efc681371c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.45:6789/0 says I am v1:10.20.193.45:58288/0 (socket says 10.20.193.45:58288) 2026-02-22T23:25:48.720 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.716+0000 7efc66ffd640 1 -- 10.20.193.45:0/832143668 learned_addr learned my addr 10.20.193.45:0/832143668 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-22T23:25:48.720 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.716+0000 7efc477fe640 1 -- 10.20.193.45:0/832143668 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 394780628 0 0) 0x7efc681cfbf0 con 0x7efc680a0980 2026-02-22T23:25:48.720 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.716+0000 7efc477fe640 10 monclient(hunting): _negotiate 2026-02-22T23:25:48.720 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.716+0000 7efc477fe640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:48.720 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.716+0000 7efc477fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:48.720 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.716+0000 7efc477fe640 10 monclient(hunting): my global_id is 4383 2026-02-22T23:25:48.720 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.716+0000 7efc477fe640 1 -- 10.20.193.45:0/832143668 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efc34003620 con 0x7efc680a0980 2026-02-22T23:25:48.720 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.716+0000 7efc477fe640 1 -- 10.20.193.45:0/832143668 <== mon.8 v1:10.20.193.45:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 824548230 0 0) 0x7efc6813ff10 con 0x7efc681cf740 2026-02-22T23:25:48.720 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.716+0000 7efc477fe640 10 monclient(hunting): _negotiate 2026-02-22T23:25:48.720 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.716+0000 7efc477fe640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:48.720 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.716+0000 7efc477fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:48.720 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.716+0000 7efc477fe640 10 monclient(hunting): my global_id is 4400 2026-02-22T23:25:48.720 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.716+0000 7efc477fe640 1 -- 10.20.193.45:0/832143668 --> v1:10.20.193.45:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efc681cfbf0 con 0x7efc681cf740 2026-02-22T23:25:48.720 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.716+0000 7efc477fe640 1 -- 10.20.193.45:0/832143668 <== mon.0 v1:10.20.193.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2013305468 0 0) 0x7efc34003620 con 0x7efc680a0980 2026-02-22T23:25:48.720 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.716+0000 7efc477fe640 1 -- 10.20.193.45:0/832143668 --> v1:10.20.193.45:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7efc6813ff10 con 0x7efc680a0980 2026-02-22T23:25:48.720 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.716+0000 7efc477fe640 1 -- 10.20.193.45:0/832143668 <== mon.0 v1:10.20.193.45:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7efc5c0048e0 con 0x7efc680a0980 2026-02-22T23:25:48.720 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.716+0000 7efc477fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-22T23:25:48.720 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.716+0000 7efc477fe640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T23:25:48.720 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.716+0000 7efc477fe640 10 monclient(hunting): dump: 2026-02-22T23:25:48.720 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:48.720 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:48.720 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:48.721 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:48.721 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:48.721 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:48.721 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:48.721 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:48.721 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:48.721 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:48.721 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:48.721 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:48.721 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:48.721 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:48.721 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:48.721 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:48.721 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.716+0000 7efc477fe640 10 monclient(hunting): _finish_auth 0 2026-02-22T23:25:48.721 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.716+0000 7efc477fe640 1 -- 10.20.193.45:0/832143668 <== mon.8 v1:10.20.193.45:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4174845379 0 0) 0x7efc681cfbf0 con 0x7efc681cf740 2026-02-22T23:25:48.721 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.716+0000 7efc477fe640 1 -- 10.20.193.45:0/832143668 --> v1:10.20.193.45:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7efc34003620 con 0x7efc681cf740 2026-02-22T23:25:48.721 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.716+0000 7efc477fe640 1 -- 10.20.193.45:0/832143668 <== mon.8 v1:10.20.193.45:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7efc58003010 con 0x7efc681cf740 2026-02-22T23:25:48.721 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.716+0000 7efc477fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-22T23:25:48.721 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.716+0000 7efc477fe640 10 monclient(hunting): got monmap 1 from mon.e (according to old e1) 2026-02-22T23:25:48.721 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.716+0000 7efc477fe640 10 monclient(hunting): dump: 2026-02-22T23:25:48.721 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:48.721 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:48.721 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:48.721 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:48.721 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:48.721 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:48.721 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:48.721 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:48.721 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:48.721 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:48.721 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:48.721 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:48.721 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:48.721 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:48.721 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:48.721 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:48.721 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.716+0000 7efc477fe640 1 -- 10.20.193.45:0/832143668 <== mon.0 v1:10.20.193.45:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3373593366 0 0) 0x7efc6813ff10 con 0x7efc680a0980 2026-02-22T23:25:48.721 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.716+0000 7efc477fe640 1 -- 10.20.193.45:0/832143668 >> v1:10.20.193.45:6793/0 conn(0x7efc681cf740 legacy=0x7efc681d81b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:48.721 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.716+0000 7efc477fe640 1 -- 10.20.193.45:0/832143668 >> v1:10.20.193.73:6790/0 conn(0x7efc680a1a60 legacy=0x7efc681d4a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:48.721 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.716+0000 7efc477fe640 10 monclient: _finish_hunting 0 2026-02-22T23:25:48.721 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.716+0000 7efc477fe640 1 monclient: found mon.a 2026-02-22T23:25:48.721 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.716+0000 7efc477fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T23:25:48.721 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.716+0000 7efc477fe640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-22T23:25:48.721 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.716+0000 7efc477fe640 1 -- 10.20.193.45:0/832143668 --> v1:10.20.193.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc6811e560 con 0x7efc680a0980 2026-02-22T23:25:48.722 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.716+0000 7efc477fe640 10 monclient: _finish_auth 0 2026-02-22T23:25:48.722 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.716+0000 7efc477fe640 10 monclient: _check_auth_tickets 2026-02-22T23:25:48.722 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.716+0000 7efc477fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T23:25:48.722 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.716+0000 7efc6d7bc640 5 monclient: authenticate success, global_id 4383 2026-02-22T23:25:48.722 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.716+0000 7efc6d7bc640 10 monclient: _renew_subs 2026-02-22T23:25:48.722 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.716+0000 7efc6d7bc640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-22T23:25:48.722 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.716+0000 7efc6d7bc640 1 -- 10.20.193.45:0/832143668 --> v1:10.20.193.45:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7efc681378d0 con 0x7efc680a0980 2026-02-22T23:25:48.722 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.717+0000 7efc6d7bc640 10 monclient: _renew_subs 2026-02-22T23:25:48.722 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.717+0000 7efc6d7bc640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-22T23:25:48.722 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.717+0000 7efc6d7bc640 1 -- 10.20.193.45:0/832143668 --> v1:10.20.193.45:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7efc681d98d0 con 0x7efc680a0980 2026-02-22T23:25:48.722 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.717+0000 7efc477fe640 1 -- 10.20.193.45:0/832143668 <== mon.0 v1:10.20.193.45:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7efc5c004d30 con 0x7efc680a0980 2026-02-22T23:25:48.722 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.717+0000 7efc477fe640 10 monclient: handle_config config(0 keys) 2026-02-22T23:25:48.722 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.717+0000 7efc477fe640 1 -- 10.20.193.45:0/832143668 <== mon.0 v1:10.20.193.45:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7efc5c005260 con 0x7efc680a0980 2026-02-22T23:25:48.722 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.717+0000 7efc477fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:25:48.722 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.717+0000 7efc657fa640 4 set_mon_vals no callback set 2026-02-22T23:25:48.722 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.717+0000 7efc477fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T23:25:48.722 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.717+0000 7efc477fe640 10 monclient: dump: 2026-02-22T23:25:48.722 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:48.722 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:48.722 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:48.722 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:48.722 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:48.722 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:48.722 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:48.722 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:48.722 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:48.722 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:48.722 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:48.722 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:48.722 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:48.722 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:48.722 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:48.722 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:48.722 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.717+0000 7efc6d7bc640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T23:25:48.722 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.717+0000 7efc6d7bc640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T23:25:48.722 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.717+0000 7efc6d7bc640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-22T23:25:48.722 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.717+0000 7efc6d7bc640 1 -- 10.20.193.45:0/832143668 --> v1:10.20.193.45:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc68069720 con 0x7efc680a0980 2026-02-22T23:25:48.722 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.717+0000 7efc477fe640 1 -- 10.20.193.45:0/832143668 <== mon.0 v1:10.20.193.45:6789/0 7 ==== mgrmap(e 5) ==== 50225+0+0 (unknown 2330357642 0 0) 0x7efc5c005480 con 0x7efc680a0980 2026-02-22T23:25:48.722 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.717+0000 7efc477fe640 1 -- 10.20.193.45:0/832143668 <== mon.0 v1:10.20.193.45:6789/0 8 ==== osd_map(19..19 src has 1..19) ==== 3558+0+0 (unknown 1288710973 0 0) 0x7efc5c04dbe0 con 0x7efc680a0980 2026-02-22T23:25:48.722 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.717+0000 7efc667fc640 10 monclient: get_auth_request con 0x7efc3403fd30 auth_method 0 2026-02-22T23:25:48.723 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.720+0000 7efc477fe640 1 -- 10.20.193.45:0/832143668 <== mon.0 v1:10.20.193.45:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (unknown 1092875540 0 2568732696) 0x7efc68069720 con 0x7efc680a0980 2026-02-22T23:25:48.723 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.720+0000 7efc477fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T23:25:48.723 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.720+0000 7efc477fe640 10 monclient: _finish_command 1 = system:0 2026-02-22T23:25:48.805 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.804+0000 7efc6d7bc640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2026-02-22T23:25:48.805 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.804+0000 7efc6d7bc640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-22T23:25:48.805 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.804+0000 7efc6d7bc640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-22T23:25:48.805 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.804+0000 7efc6d7bc640 1 -- 10.20.193.45:0/832143668 --> v1:10.20.193.45:6789/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7efc6806ce10 con 0x7efc680a0980 2026-02-22T23:25:48.805 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.805+0000 7efc477fe640 1 -- 10.20.193.45:0/832143668 <== mon.0 v1:10.20.193.45:6789/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) ==== 74+0+10931 (unknown 941590788 0 2623996707) 0x7efc5c017820 con 0x7efc680a0980 2026-02-22T23:25:48.805 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.805+0000 7efc477fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-22T23:25:48.806 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.805+0000 7efc477fe640 10 monclient: _finish_command 2 = system:0 2026-02-22T23:25:48.806 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-22T23:25:48.806 INFO:teuthology.orchestra.run.trial045.stdout:{"epoch":19,"fsid":"4b60f18f-6660-4731-b731-dc85c4078413","created":"2026-02-22T23:25:25.062615+0000","modified":"2026-02-22T23:25:44.732868+0000","last_up_change":"2026-02-22T23:25:34.696475+0000","last_in_change":"2026-02-22T23:25:26.208612+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-22T23:25:35.209511+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6.059999942779541,"score_stable":6.059999942779541,"optimal_score":0.33000001311302185,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2026-02-22T23:25:40.737184+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":19,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ef9d15a7-661e-40c5-a418-7f794c0975b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.45:6801","nonce":1146005631}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.45:6803","nonce":1146005631}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.45:6807","nonce":1146005631}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.45:6805","nonce":1146005631}]},"public_addr":"10.20.193.45:6801/1146005631","cluster_addr":"10.20.193.45:6803/1146005631","heartbeat_back_addr":"10.20.193.45:6807/1146005631","heartbeat_front_addr":"10.20.193.45:6805/1146005631","state":["exists","up"]},{"osd":1,"uuid":"9e62cdef-b0a0-4f67-a778-ac4f7d97ed7e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.45:6800","nonce":628358795}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.45:6802","nonce":628358795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.45:6806","nonce":628358795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.45:6804","nonce":628358795}]},"public_addr":"10.20.193.45:6800/628358795","cluster_addr":"10.20.193.45:6802/628358795","heartbeat_back_addr":"10.20.193.45:6806/628358795","heartbeat_front_addr":"10.20.193.45:6804/628358795","state":["exists","up"]},{"osd":2,"uuid":"bfcf94e1-2623-4443-aaf8-f525210ab7b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.45:6808","nonce":2128209266}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.45:6809","nonce":2128209266}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.45:6811","nonce":2128209266}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.45:6810","nonce":2128209266}]},"public_addr":"10.20.193.45:6808/2128209266","cluster_addr":"10.20.193.45:6809/2128209266","heartbeat_back_addr":"10.20.193.45:6811/2128209266","heartbeat_front_addr":"10.20.193.45:6810/2128209266","state":["exists","up"]},{"osd":3,"uuid":"32e9109d-09f0-4c75-bfbe-bb0fa237ca08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.73:6805","nonce":3607388566}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.73:6806","nonce":3607388566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.73:6808","nonce":3607388566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.73:6807","nonce":3607388566}]},"public_addr":"10.20.193.73:6805/3607388566","cluster_addr":"10.20.193.73:6806/3607388566","heartbeat_back_addr":"10.20.193.73:6808/3607388566","heartbeat_front_addr":"10.20.193.73:6807/3607388566","state":["exists","up"]},{"osd":4,"uuid":"311ec782-d282-48e9-9545-41ac3acb1ac8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.73:6801","nonce":3756325394}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.73:6802","nonce":3756325394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.73:6804","nonce":3756325394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.73:6803","nonce":3756325394}]},"public_addr":"10.20.193.73:6801/3756325394","cluster_addr":"10.20.193.73:6802/3756325394","heartbeat_back_addr":"10.20.193.73:6804/3756325394","heartbeat_front_addr":"10.20.193.73:6803/3756325394","state":["exists","up"]},{"osd":5,"uuid":"4569df35-5988-4308-9e5d-a6b26171c346","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.73:6809","nonce":1794330816}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.73:6810","nonce":1794330816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.73:6812","nonce":1794330816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.73:6811","nonce":1794330816}]},"public_addr":"10.20.193.73:6809/1794330816","cluster_addr":"10.20.193.73:6810/1794330816","heartbeat_back_addr":"10.20.193.73:6812/1794330816","heartbeat_front_addr":"10.20.193.73:6811/1794330816","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-22T23:25:32.907422+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-22T23:25:33.439017+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-22T23:25:32.880978+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-22T23:25:32.610909+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-22T23:25:32.663485+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-22T23:25:33.016218+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-22T23:25:48.807 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.806+0000 7efc6d7bc640 1 -- 10.20.193.45:0/832143668 >> v1:10.20.193.73:6800/2222410180 conn(0x7efc3403fd30 legacy=0x7efc340421f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:48.807 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.806+0000 7efc6d7bc640 10 monclient: shutdown 2026-02-22T23:25:48.807 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.806+0000 7efc6d7bc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T23:25:48.807 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.806+0000 7efc6d7bc640 1 -- 10.20.193.45:0/832143668 >> v1:10.20.193.45:6789/0 conn(0x7efc680a0980 legacy=0x7efc681371c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:48.807 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.806+0000 7efc6d7bc640 1 -- 10.20.193.45:0/832143668 shutdown_connections 2026-02-22T23:25:48.807 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.806+0000 7efc6d7bc640 1 -- 10.20.193.45:0/832143668 >> 10.20.193.45:0/832143668 conn(0x7efc680a7780 msgr2=0x7efc68141830 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:25:48.808 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.806+0000 7efc6d7bc640 1 -- 10.20.193.45:0/832143668 shutdown_connections 2026-02-22T23:25:48.808 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.806+0000 7efc6d7bc640 1 -- 10.20.193.45:0/832143668 wait complete. 2026-02-22T23:25:48.815 INFO:tasks.mon_thrash.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2026-02-22T23:25:35.209511+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 6.059999942779541, 'score_stable': 6.059999942779541, 'optimal_score': 0.33000001311302185, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2026-02-22T23:25:40.737184+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 2, 'snap_epoch': 19, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2026-02-22T23:25:48.816 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2026-02-22T23:25:48.884 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.884+0000 7f5a71ca6640 10 monclient: get_monmap_and_config 2026-02-22T23:25:48.884 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.884+0000 7f5a71ca6640 10 monclient: build_initial_monmap 2026-02-22T23:25:48.884 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.884+0000 7f5a71ca6640 10 monclient: monmap: 2026-02-22T23:25:48.884 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-22T23:25:48.884 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:48.884 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:25:48.884273+0000 2026-02-22T23:25:48.884 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:25:48.884273+0000 2026-02-22T23:25:48.884 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-22T23:25:48.884 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:48.884 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-22T23:25:48.884 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.noname-f 2026-02-22T23:25:48.884 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.noname-b 2026-02-22T23:25:48.884 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.noname-g 2026-02-22T23:25:48.884 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.noname-c 2026-02-22T23:25:48.884 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.noname-h 2026-02-22T23:25:48.884 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.noname-d 2026-02-22T23:25:48.884 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.noname-i 2026-02-22T23:25:48.884 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.noname-e 2026-02-22T23:25:48.884 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:48.886 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.884+0000 7f5a71ca6640 1 Processor -- start 2026-02-22T23:25:48.886 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.884+0000 7f5a71ca6640 1 -- start start 2026-02-22T23:25:48.886 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.884+0000 7f5a71ca6640 10 monclient: init 2026-02-22T23:25:48.886 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.884+0000 7f5a71ca6640 10 monclient: _reopen_session rank -1 2026-02-22T23:25:48.886 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.884+0000 7f5a71ca6640 10 monclient: _add_conns ranks=[8,3,2,1,5,0,6,7,4] 2026-02-22T23:25:48.886 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.884+0000 7f5a71ca6640 10 monclient(hunting): picked mon.noname-e con 0x7f5a6c0a1a60 addr v1:10.20.193.45:6793/0 2026-02-22T23:25:48.886 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.884+0000 7f5a71ca6640 10 monclient(hunting): picked mon.noname-g con 0x7f5a6c06f1e0 addr v1:10.20.193.73:6790/0 2026-02-22T23:25:48.886 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.884+0000 7f5a71ca6640 10 monclient(hunting): picked mon.noname-b con 0x7f5a6c0a0980 addr v1:10.20.193.45:6790/0 2026-02-22T23:25:48.886 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.884+0000 7f5a71ca6640 1 -- --> v1:10.20.193.45:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5a6c09df00 con 0x7f5a6c0a0980 2026-02-22T23:25:48.886 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.884+0000 7f5a71ca6640 1 -- --> v1:10.20.193.73:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5a6c137660 con 0x7f5a6c06f1e0 2026-02-22T23:25:48.886 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.884+0000 7f5a71ca6640 1 -- --> v1:10.20.193.45:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5a6c0a4510 con 0x7f5a6c0a1a60 2026-02-22T23:25:48.886 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.884+0000 7f5a71ca6640 10 monclient(hunting): _renew_subs 2026-02-22T23:25:48.886 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.884+0000 7f5a71ca6640 10 monclient(hunting): authenticate will time out at 680.500883s 2026-02-22T23:25:48.886 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.884+0000 7f5a6b7fe640 1 --1- >> v1:10.20.193.45:6793/0 conn(0x7f5a6c0a1a60 0x7f5a6c136840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.45:6793/0 says I am v1:10.20.193.45:36846/0 (socket says 10.20.193.45:36846) 2026-02-22T23:25:48.886 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.884+0000 7f5a6b7fe640 1 -- 10.20.193.45:0/1113966556 learned_addr learned my addr 10.20.193.45:0/1113966556 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-22T23:25:48.886 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.885+0000 7f5a6a7fc640 1 -- 10.20.193.45:0/1113966556 <== mon.8 v1:10.20.193.45:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2156545009 0 0) 0x7f5a6c0a4510 con 0x7f5a6c0a1a60 2026-02-22T23:25:48.886 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.885+0000 7f5a6a7fc640 10 monclient(hunting): _negotiate 2026-02-22T23:25:48.886 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.885+0000 7f5a6a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:48.886 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.885+0000 7f5a6a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:48.886 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.885+0000 7f5a6a7fc640 10 monclient(hunting): my global_id is 4409 2026-02-22T23:25:48.886 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.885+0000 7f5a6a7fc640 1 -- 10.20.193.45:0/1113966556 --> v1:10.20.193.45:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5a50003620 con 0x7f5a6c0a1a60 2026-02-22T23:25:48.887 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.885+0000 7f5a6a7fc640 1 -- 10.20.193.45:0/1113966556 <== mon.2 v1:10.20.193.45:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 953846328 0 0) 0x7f5a60002ca0 con 0x7f5a6c0a0980 2026-02-22T23:25:48.887 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.885+0000 7f5a6a7fc640 10 monclient(hunting): _negotiate 2026-02-22T23:25:48.887 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.885+0000 7f5a6a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:48.887 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.885+0000 7f5a6a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:48.887 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.885+0000 7f5a6a7fc640 10 monclient(hunting): my global_id is 4448 2026-02-22T23:25:48.887 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.885+0000 7f5a6a7fc640 1 -- 10.20.193.45:0/1113966556 --> v1:10.20.193.45:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5a6c0a4510 con 0x7f5a6c0a0980 2026-02-22T23:25:48.887 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.885+0000 7f5a6a7fc640 1 -- 10.20.193.45:0/1113966556 <== mon.8 v1:10.20.193.45:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 680332539 0 0) 0x7f5a50003620 con 0x7f5a6c0a1a60 2026-02-22T23:25:48.887 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.885+0000 7f5a6a7fc640 1 -- 10.20.193.45:0/1113966556 >> v1:10.20.193.73:6790/0 conn(0x7f5a6c06f1e0 legacy=0x7f5a6c136f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:48.887 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.885+0000 7f5a6a7fc640 1 -- 10.20.193.45:0/1113966556 >> v1:10.20.193.45:6790/0 conn(0x7f5a6c0a0980 legacy=0x7f5a6c13ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:48.887 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.885+0000 7f5a6a7fc640 10 monclient: _finish_hunting 0 2026-02-22T23:25:48.887 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.885+0000 7f5a6a7fc640 1 monclient: found mon.noname-e 2026-02-22T23:25:48.887 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.885+0000 7f5a6a7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T23:25:48.887 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.885+0000 7f5a6a7fc640 10 monclient: _send_mon_message to mon.noname-e at v1:10.20.193.45:6793/0 2026-02-22T23:25:48.887 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.885+0000 7f5a6a7fc640 1 -- 10.20.193.45:0/1113966556 --> v1:10.20.193.45:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a6c143400 con 0x7f5a6c0a1a60 2026-02-22T23:25:48.887 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.885+0000 7f5a6a7fc640 10 monclient: _finish_auth 0 2026-02-22T23:25:48.887 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.885+0000 7f5a6a7fc640 10 monclient: _check_auth_tickets 2026-02-22T23:25:48.887 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.885+0000 7f5a6a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T23:25:48.887 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.885+0000 7f5a71ca6640 5 monclient: authenticate success, global_id 4409 2026-02-22T23:25:48.887 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.885+0000 7f5a6a7fc640 1 -- 10.20.193.45:0/1113966556 <== mon.8 v1:10.20.193.45:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f5a58003040 con 0x7f5a6c0a1a60 2026-02-22T23:25:48.887 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.885+0000 7f5a71ca6640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-22T23:25:48.887 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.885+0000 7f5a6a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:25:48.887 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.885+0000 7f5a6a7fc640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2026-02-22T23:25:48.887 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.885+0000 7f5a6a7fc640 10 monclient: dump: 2026-02-22T23:25:48.887 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:48.887 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:48.887 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:48.887 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:48.887 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:48.887 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:48.887 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:48.887 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:48.887 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:48.887 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:48.887 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:48.887 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:48.887 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:48.887 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:48.887 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:48.887 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:48.887 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.885+0000 7f5a71ca6640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-22T23:25:48.888 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.885+0000 7f5a6a7fc640 1 -- 10.20.193.45:0/1113966556 <== mon.8 v1:10.20.193.45:6793/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5a58003260 con 0x7f5a6c0a1a60 2026-02-22T23:25:48.888 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.885+0000 7f5a6a7fc640 10 monclient: handle_config config(0 keys) 2026-02-22T23:25:48.888 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.885+0000 7f5a71ca6640 10 monclient: get_monmap_and_config success 2026-02-22T23:25:48.888 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.885+0000 7f5a6a7fc640 1 -- 10.20.193.45:0/1113966556 <== mon.8 v1:10.20.193.45:6793/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f5a58004ce0 con 0x7f5a6c0a1a60 2026-02-22T23:25:48.888 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.885+0000 7f5a71ca6640 4 set_mon_vals no callback set 2026-02-22T23:25:48.888 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.885+0000 7f5a6a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:25:48.888 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.885+0000 7f5a6a7fc640 10 monclient: got monmap 1 from mon.e (according to old e1) 2026-02-22T23:25:48.888 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.885+0000 7f5a6a7fc640 10 monclient: dump: 2026-02-22T23:25:48.888 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:48.888 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:48.888 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:48.888 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:48.888 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:48.888 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:48.888 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:48.888 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:48.888 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:48.888 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:48.888 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:48.888 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:48.888 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:48.888 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:48.888 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:48.888 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:48.888 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.885+0000 7f5a71ca6640 10 monclient: shutdown 2026-02-22T23:25:48.888 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.885+0000 7f5a71ca6640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T23:25:48.888 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.885+0000 7f5a71ca6640 1 -- 10.20.193.45:0/1113966556 >> v1:10.20.193.45:6793/0 conn(0x7f5a6c0a1a60 legacy=0x7f5a6c136840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:48.888 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.885+0000 7f5a71ca6640 1 -- 10.20.193.45:0/1113966556 shutdown_connections 2026-02-22T23:25:48.888 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.885+0000 7f5a71ca6640 1 -- 10.20.193.45:0/1113966556 >> 10.20.193.45:0/1113966556 conn(0x7f5a6c0a7780 msgr2=0x7f5a6c0a3b60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:25:48.888 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.885+0000 7f5a71ca6640 1 -- 10.20.193.45:0/1113966556 shutdown_connections 2026-02-22T23:25:48.888 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.885+0000 7f5a71ca6640 1 -- 10.20.193.45:0/1113966556 wait complete. 2026-02-22T23:25:48.888 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.886+0000 7f5a71ca6640 10 monclient: build_initial_monmap 2026-02-22T23:25:48.888 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.886+0000 7f5a71ca6640 10 monclient: monmap: 2026-02-22T23:25:48.888 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-22T23:25:48.888 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T23:25:48.889 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-22T23:25:48.889 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-22T23:25:48.889 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-22T23:25:48.889 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-22T23:25:48.889 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-22T23:25:48.889 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.noname-f 2026-02-22T23:25:48.889 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.noname-b 2026-02-22T23:25:48.889 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.noname-g 2026-02-22T23:25:48.889 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.noname-c 2026-02-22T23:25:48.889 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.noname-h 2026-02-22T23:25:48.889 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.noname-d 2026-02-22T23:25:48.889 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.noname-i 2026-02-22T23:25:48.889 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.noname-e 2026-02-22T23:25:48.889 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:48.889 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.886+0000 7f5a71ca6640 1 Processor -- start 2026-02-22T23:25:48.889 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.886+0000 7f5a71ca6640 1 -- start start 2026-02-22T23:25:48.889 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.886+0000 7f5a71ca6640 10 monclient: init 2026-02-22T23:25:48.889 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.886+0000 7f5a71ca6640 10 monclient: _reopen_session rank -1 2026-02-22T23:25:48.889 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.886+0000 7f5a71ca6640 10 monclient: _add_conns ranks=[3,7,8,4,2,5,0,1,6] 2026-02-22T23:25:48.889 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.886+0000 7f5a71ca6640 10 monclient(hunting): picked mon.noname-g con 0x7f5a6c0a0980 addr v1:10.20.193.73:6790/0 2026-02-22T23:25:48.889 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.886+0000 7f5a71ca6640 10 monclient(hunting): picked mon.noname-i con 0x7f5a6c0a1a60 addr v1:10.20.193.73:6792/0 2026-02-22T23:25:48.889 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.886+0000 7f5a71ca6640 10 monclient(hunting): picked mon.noname-e con 0x7f5a6c13f7a0 addr v1:10.20.193.45:6793/0 2026-02-22T23:25:48.889 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.886+0000 7f5a71ca6640 1 -- --> v1:10.20.193.73:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5a6c13fc30 con 0x7f5a6c0a0980 2026-02-22T23:25:48.889 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.886+0000 7f5a71ca6640 1 -- --> v1:10.20.193.73:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5a6c1427f0 con 0x7f5a6c0a1a60 2026-02-22T23:25:48.889 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.886+0000 7f5a71ca6640 1 -- --> v1:10.20.193.45:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5a6c0a2900 con 0x7f5a6c13f7a0 2026-02-22T23:25:48.889 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.886+0000 7f5a71ca6640 10 monclient(hunting): _renew_subs 2026-02-22T23:25:48.889 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.886+0000 7f5a71ca6640 10 monclient(hunting): authenticate will time out at 680.502550s 2026-02-22T23:25:48.889 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.886+0000 7f5a6bfff640 1 --1- >> v1:10.20.193.45:6793/0 conn(0x7f5a6c13f7a0 0x7f5a6c1d82d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.45:6793/0 says I am v1:10.20.193.45:36860/0 (socket says 10.20.193.45:36860) 2026-02-22T23:25:48.889 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.886+0000 7f5a6bfff640 1 -- 10.20.193.45:0/4037908864 learned_addr learned my addr 10.20.193.45:0/4037908864 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-22T23:25:48.890 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.886+0000 7f5a47fff640 1 -- 10.20.193.45:0/4037908864 <== mon.8 v1:10.20.193.45:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3798330031 0 0) 0x7f5a6c0a2900 con 0x7f5a6c13f7a0 2026-02-22T23:25:48.890 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.886+0000 7f5a47fff640 10 monclient(hunting): _negotiate 2026-02-22T23:25:48.890 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.886+0000 7f5a47fff640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:48.890 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.886+0000 7f5a47fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:48.891 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.886+0000 7f5a47fff640 10 monclient(hunting): my global_id is 4418 2026-02-22T23:25:48.891 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.886+0000 7f5a47fff640 1 -- 10.20.193.45:0/4037908864 --> v1:10.20.193.45:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5a3c003620 con 0x7f5a6c13f7a0 2026-02-22T23:25:48.891 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.886+0000 7f5a47fff640 1 -- 10.20.193.45:0/4037908864 <== mon.8 v1:10.20.193.45:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3978740735 0 0) 0x7f5a3c003620 con 0x7f5a6c13f7a0 2026-02-22T23:25:48.891 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.886+0000 7f5a47fff640 1 -- 10.20.193.45:0/4037908864 --> v1:10.20.193.45:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5a6c0a2900 con 0x7f5a6c13f7a0 2026-02-22T23:25:48.891 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.886+0000 7f5a47fff640 1 -- 10.20.193.45:0/4037908864 <== mon.8 v1:10.20.193.45:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f5a600037f0 con 0x7f5a6c13f7a0 2026-02-22T23:25:48.891 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.886+0000 7f5a47fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-22T23:25:48.891 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.886+0000 7f5a47fff640 10 monclient(hunting): got monmap 1 from mon.noname-e (according to old e1) 2026-02-22T23:25:48.891 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.886+0000 7f5a47fff640 10 monclient(hunting): dump: 2026-02-22T23:25:48.891 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:48.891 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:48.891 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:48.891 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:48.891 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:48.891 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:48.891 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:48.891 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:48.891 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:48.891 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:48.891 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:48.891 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:48.891 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:48.891 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:48.891 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:48.891 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:48.891 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.886+0000 7f5a47fff640 10 monclient(hunting): _finish_auth 0 2026-02-22T23:25:48.891 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.886+0000 7f5a47fff640 1 -- 10.20.193.45:0/4037908864 <== mon.7 v1:10.20.193.73:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2395310130 0 0) 0x7f5a6c1427f0 con 0x7f5a6c0a1a60 2026-02-22T23:25:48.891 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.886+0000 7f5a47fff640 10 monclient(hunting): _negotiate 2026-02-22T23:25:48.891 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.886+0000 7f5a47fff640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:48.891 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.886+0000 7f5a47fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:48.891 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.886+0000 7f5a47fff640 10 monclient(hunting): my global_id is 4336 2026-02-22T23:25:48.891 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.886+0000 7f5a47fff640 1 -- 10.20.193.45:0/4037908864 --> v1:10.20.193.73:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5a3c003620 con 0x7f5a6c0a1a60 2026-02-22T23:25:48.891 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.886+0000 7f5a47fff640 1 -- 10.20.193.45:0/4037908864 <== mon.8 v1:10.20.193.45:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3269687116 0 0) 0x7f5a6c0a2900 con 0x7f5a6c13f7a0 2026-02-22T23:25:48.891 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.886+0000 7f5a47fff640 1 -- 10.20.193.45:0/4037908864 >> v1:10.20.193.73:6792/0 conn(0x7f5a6c0a1a60 legacy=0x7f5a6c09ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:48.891 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.886+0000 7f5a47fff640 1 -- 10.20.193.45:0/4037908864 >> v1:10.20.193.73:6790/0 conn(0x7f5a6c0a0980 legacy=0x7f5a6c09e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:48.891 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.886+0000 7f5a47fff640 10 monclient: _finish_hunting 0 2026-02-22T23:25:48.891 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.886+0000 7f5a47fff640 1 monclient: found mon.e 2026-02-22T23:25:48.891 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.886+0000 7f5a47fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T23:25:48.891 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.886+0000 7f5a47fff640 10 monclient: _send_mon_message to mon.e at v1:10.20.193.45:6793/0 2026-02-22T23:25:48.891 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.886+0000 7f5a47fff640 1 -- 10.20.193.45:0/4037908864 --> v1:10.20.193.45:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a6c06fae0 con 0x7f5a6c13f7a0 2026-02-22T23:25:48.892 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.886+0000 7f5a47fff640 10 monclient: _finish_auth 0 2026-02-22T23:25:48.892 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.886+0000 7f5a47fff640 10 monclient: _check_auth_tickets 2026-02-22T23:25:48.892 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.886+0000 7f5a47fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T23:25:48.892 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.886+0000 7f5a71ca6640 5 monclient: authenticate success, global_id 4418 2026-02-22T23:25:48.892 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.886+0000 7f5a71ca6640 10 monclient: _renew_subs 2026-02-22T23:25:48.892 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.886+0000 7f5a71ca6640 10 monclient: _send_mon_message to mon.e at v1:10.20.193.45:6793/0 2026-02-22T23:25:48.892 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.886+0000 7f5a71ca6640 1 -- 10.20.193.45:0/4037908864 --> v1:10.20.193.45:6793/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f5a6c09f3f0 con 0x7f5a6c13f7a0 2026-02-22T23:25:48.892 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.887+0000 7f5a71ca6640 10 monclient: _renew_subs 2026-02-22T23:25:48.892 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.887+0000 7f5a71ca6640 10 monclient: _send_mon_message to mon.e at v1:10.20.193.45:6793/0 2026-02-22T23:25:48.892 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.887+0000 7f5a71ca6640 1 -- 10.20.193.45:0/4037908864 --> v1:10.20.193.45:6793/0 -- mon_subscribe({osdmap=0}) -- 0x7f5a6c06ff40 con 0x7f5a6c13f7a0 2026-02-22T23:25:48.892 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.887+0000 7f5a47fff640 1 -- 10.20.193.45:0/4037908864 <== mon.8 v1:10.20.193.45:6793/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5a60003d00 con 0x7f5a6c13f7a0 2026-02-22T23:25:48.892 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.887+0000 7f5a47fff640 10 monclient: handle_config config(0 keys) 2026-02-22T23:25:48.892 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.887+0000 7f5a47fff640 1 -- 10.20.193.45:0/4037908864 <== mon.8 v1:10.20.193.45:6793/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f5a60004270 con 0x7f5a6c13f7a0 2026-02-22T23:25:48.892 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.887+0000 7f5a47fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:25:48.892 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.887+0000 7f5a47fff640 10 monclient: got monmap 1 from mon.e (according to old e1) 2026-02-22T23:25:48.892 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.887+0000 7f5a69ffb640 4 set_mon_vals no callback set 2026-02-22T23:25:48.892 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.887+0000 7f5a47fff640 10 monclient: dump: 2026-02-22T23:25:48.892 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:48.892 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:48.892 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:48.892 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:48.892 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:48.892 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:48.892 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:48.892 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:48.892 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:48.892 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:48.892 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:48.892 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:48.892 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:48.892 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:48.892 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:48.892 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:48.892 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.887+0000 7f5a71ca6640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T23:25:48.892 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.887+0000 7f5a71ca6640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T23:25:48.892 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.887+0000 7f5a71ca6640 10 monclient: _send_mon_message to mon.e at v1:10.20.193.45:6793/0 2026-02-22T23:25:48.892 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.887+0000 7f5a71ca6640 1 -- 10.20.193.45:0/4037908864 --> v1:10.20.193.45:6793/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a6c143220 con 0x7f5a6c13f7a0 2026-02-22T23:25:48.892 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.887+0000 7f5a47fff640 1 -- 10.20.193.45:0/4037908864 <== mon.8 v1:10.20.193.45:6793/0 7 ==== mgrmap(e 5) ==== 50225+0+0 (unknown 2330357642 0 0) 0x7f5a60004410 con 0x7f5a6c13f7a0 2026-02-22T23:25:48.892 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.887+0000 7f5a47fff640 1 -- 10.20.193.45:0/4037908864 <== mon.8 v1:10.20.193.45:6793/0 8 ==== osd_map(19..19 src has 1..19) ==== 3558+0+0 (unknown 1288710973 0 0) 0x7f5a6004e070 con 0x7f5a6c13f7a0 2026-02-22T23:25:48.892 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.887+0000 7f5a6b7fe640 10 monclient: get_auth_request con 0x7f5a3c03f830 auth_method 0 2026-02-22T23:25:48.892 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.890+0000 7f5a47fff640 1 -- 10.20.193.45:0/4037908864 <== mon.8 v1:10.20.193.45:6793/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (unknown 1092875540 0 2568732696) 0x7f5a6c143220 con 0x7f5a6c13f7a0 2026-02-22T23:25:48.892 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.890+0000 7f5a47fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T23:25:48.893 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.890+0000 7f5a47fff640 10 monclient: _finish_command 1 = system:0 2026-02-22T23:25:48.971 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.971+0000 7f5a71ca6640 10 start_mon_command cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}] 2026-02-22T23:25:48.971 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.971+0000 7f5a71ca6640 10 monclient: _send_command 2 [{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}] 2026-02-22T23:25:48.971 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.971+0000 7f5a71ca6640 10 monclient: _send_mon_message to mon.e at v1:10.20.193.45:6793/0 2026-02-22T23:25:48.971 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.971+0000 7f5a71ca6640 1 -- 10.20.193.45:0/4037908864 --> v1:10.20.193.45:6793/0 -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f5a6c069720 con 0x7f5a6c13f7a0 2026-02-22T23:25:48.971 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.971+0000 7f5a47fff640 1 -- 10.20.193.45:0/4037908864 <== mon.8 v1:10.20.193.45:6793/0 10 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v19) ==== 93+0+10 (unknown 4170632370 0 2170607528) 0x7f5a6c09df00 con 0x7f5a6c13f7a0 2026-02-22T23:25:48.971 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.971+0000 7f5a47fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}] 2026-02-22T23:25:48.971 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.971+0000 7f5a47fff640 10 monclient: _finish_command 2 = system:0 2026-02-22T23:25:48.971 INFO:teuthology.orchestra.run.trial045.stdout:pg_num: 1 2026-02-22T23:25:48.972 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.972+0000 7f5a71ca6640 1 -- 10.20.193.45:0/4037908864 >> v1:10.20.193.73:6800/2222410180 conn(0x7f5a3c03f830 legacy=0x7f5a3c041cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:48.972 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.972+0000 7f5a71ca6640 10 monclient: shutdown 2026-02-22T23:25:48.972 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.972+0000 7f5a71ca6640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T23:25:48.972 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.972+0000 7f5a71ca6640 1 -- 10.20.193.45:0/4037908864 >> v1:10.20.193.45:6793/0 conn(0x7f5a6c13f7a0 legacy=0x7f5a6c1d82d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:48.972 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.972+0000 7f5a71ca6640 1 -- 10.20.193.45:0/4037908864 shutdown_connections 2026-02-22T23:25:48.972 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.972+0000 7f5a71ca6640 1 -- 10.20.193.45:0/4037908864 >> 10.20.193.45:0/4037908864 conn(0x7f5a6c0a7780 msgr2=0x7f5a6c0a4f60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:25:48.972 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.972+0000 7f5a71ca6640 1 -- 10.20.193.45:0/4037908864 shutdown_connections 2026-02-22T23:25:48.972 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:48.972+0000 7f5a71ca6640 1 -- 10.20.193.45:0/4037908864 wait complete. 2026-02-22T23:25:48.979 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2026-02-22T23:25:49.046 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.046+0000 7fd869723640 10 monclient: get_monmap_and_config 2026-02-22T23:25:49.046 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.046+0000 7fd869723640 10 monclient: build_initial_monmap 2026-02-22T23:25:49.046 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.046+0000 7fd869723640 10 monclient: monmap: 2026-02-22T23:25:49.046 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-22T23:25:49.046 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:49.046 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:25:49.046468+0000 2026-02-22T23:25:49.046 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:25:49.046468+0000 2026-02-22T23:25:49.046 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-22T23:25:49.047 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:49.047 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-22T23:25:49.047 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.noname-f 2026-02-22T23:25:49.047 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.noname-b 2026-02-22T23:25:49.047 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.noname-g 2026-02-22T23:25:49.047 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.noname-c 2026-02-22T23:25:49.047 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.noname-h 2026-02-22T23:25:49.047 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.noname-d 2026-02-22T23:25:49.047 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.noname-i 2026-02-22T23:25:49.047 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.noname-e 2026-02-22T23:25:49.047 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:49.055 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.046+0000 7fd869723640 1 Processor -- start 2026-02-22T23:25:49.055 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.046+0000 7fd869723640 1 -- start start 2026-02-22T23:25:49.055 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.046+0000 7fd869723640 10 monclient: init 2026-02-22T23:25:49.055 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.047+0000 7fd869723640 10 monclient: _reopen_session rank -1 2026-02-22T23:25:49.055 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.047+0000 7fd869723640 10 monclient: _add_conns ranks=[1,5,6,7,2,3,4,8,0] 2026-02-22T23:25:49.055 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.047+0000 7fd869723640 10 monclient(hunting): picked mon.noname-f con 0x7fd8640a5e00 addr v1:10.20.193.73:6789/0 2026-02-22T23:25:49.056 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.047+0000 7fd869723640 10 monclient(hunting): picked mon.noname-h con 0x7fd8640a68f0 addr v1:10.20.193.73:6791/0 2026-02-22T23:25:49.056 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.047+0000 7fd869723640 10 monclient(hunting): picked mon.noname-d con 0x7fd8640a6d00 addr v1:10.20.193.45:6792/0 2026-02-22T23:25:49.056 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.047+0000 7fd869723640 1 -- --> v1:10.20.193.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd8640a2d00 con 0x7fd8640a5e00 2026-02-22T23:25:49.056 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.047+0000 7fd869723640 1 -- --> v1:10.20.193.73:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd8640a2fe0 con 0x7fd8640a68f0 2026-02-22T23:25:49.056 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.047+0000 7fd869723640 1 -- --> v1:10.20.193.45:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd8640a32c0 con 0x7fd8640a6d00 2026-02-22T23:25:49.056 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.047+0000 7fd869723640 10 monclient(hunting): _renew_subs 2026-02-22T23:25:49.056 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.047+0000 7fd869723640 10 monclient(hunting): authenticate will time out at 680.663190s 2026-02-22T23:25:49.056 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.047+0000 7fd8637fe640 1 --1- >> v1:10.20.193.45:6792/0 conn(0x7fd8640a6d00 0x7fd8641417b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.45:6792/0 says I am v1:10.20.193.45:56938/0 (socket says 10.20.193.45:56938) 2026-02-22T23:25:49.056 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.047+0000 7fd8637fe640 1 -- 10.20.193.45:0/3329779995 learned_addr learned my addr 10.20.193.45:0/3329779995 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-22T23:25:49.056 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.047+0000 7fd861ffb640 1 -- 10.20.193.45:0/3329779995 <== mon.6 v1:10.20.193.45:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3333812811 0 0) 0x7fd8640a32c0 con 0x7fd8640a6d00 2026-02-22T23:25:49.056 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.047+0000 7fd861ffb640 10 monclient(hunting): _negotiate 2026-02-22T23:25:49.056 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.047+0000 7fd861ffb640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:49.056 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.047+0000 7fd861ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:49.057 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.047+0000 7fd861ffb640 10 monclient(hunting): my global_id is 4398 2026-02-22T23:25:49.057 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.047+0000 7fd861ffb640 1 -- 10.20.193.45:0/3329779995 --> v1:10.20.193.45:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd850003620 con 0x7fd8640a6d00 2026-02-22T23:25:49.057 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.047+0000 7fd861ffb640 1 -- 10.20.193.45:0/3329779995 <== mon.6 v1:10.20.193.45:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 93418061 0 0) 0x7fd850003620 con 0x7fd8640a6d00 2026-02-22T23:25:49.057 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.047+0000 7fd861ffb640 1 -- 10.20.193.45:0/3329779995 >> v1:10.20.193.73:6791/0 conn(0x7fd8640a68f0 legacy=0x7fd86413e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:49.057 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.047+0000 7fd861ffb640 1 -- 10.20.193.45:0/3329779995 >> v1:10.20.193.73:6789/0 conn(0x7fd8640a5e00 legacy=0x7fd8640a61e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:49.057 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.047+0000 7fd861ffb640 10 monclient: _finish_hunting 0 2026-02-22T23:25:49.057 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.047+0000 7fd861ffb640 1 monclient: found mon.noname-d 2026-02-22T23:25:49.057 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.047+0000 7fd861ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T23:25:49.057 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.047+0000 7fd861ffb640 10 monclient: _send_mon_message to mon.noname-d at v1:10.20.193.45:6792/0 2026-02-22T23:25:49.057 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.047+0000 7fd861ffb640 1 -- 10.20.193.45:0/3329779995 --> v1:10.20.193.45:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8640a35a0 con 0x7fd8640a6d00 2026-02-22T23:25:49.057 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.047+0000 7fd861ffb640 10 monclient: _finish_auth 0 2026-02-22T23:25:49.057 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.047+0000 7fd861ffb640 10 monclient: _check_auth_tickets 2026-02-22T23:25:49.057 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.047+0000 7fd861ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T23:25:49.057 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.047+0000 7fd861ffb640 1 -- 10.20.193.45:0/3329779995 <== mon.6 v1:10.20.193.45:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7fd8540033c0 con 0x7fd8640a6d00 2026-02-22T23:25:49.058 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.047+0000 7fd869723640 5 monclient: authenticate success, global_id 4398 2026-02-22T23:25:49.058 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.047+0000 7fd869723640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-22T23:25:49.058 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.047+0000 7fd861ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:25:49.058 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.047+0000 7fd861ffb640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2026-02-22T23:25:49.058 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.047+0000 7fd861ffb640 10 monclient: dump: 2026-02-22T23:25:49.058 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:49.058 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:49.058 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:49.058 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:49.058 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:49.058 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:49.058 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:49.058 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:49.058 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:49.058 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:49.059 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:49.059 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:49.059 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:49.059 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:49.059 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:49.059 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:49.059 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.047+0000 7fd869723640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-22T23:25:49.059 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.047+0000 7fd861ffb640 1 -- 10.20.193.45:0/3329779995 <== mon.6 v1:10.20.193.45:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd854003620 con 0x7fd8640a6d00 2026-02-22T23:25:49.059 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.047+0000 7fd861ffb640 10 monclient: handle_config config(0 keys) 2026-02-22T23:25:49.059 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.047+0000 7fd861ffb640 1 -- 10.20.193.45:0/3329779995 <== mon.6 v1:10.20.193.45:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7fd854005060 con 0x7fd8640a6d00 2026-02-22T23:25:49.059 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.047+0000 7fd869723640 10 monclient: get_monmap_and_config success 2026-02-22T23:25:49.059 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.047+0000 7fd869723640 4 set_mon_vals no callback set 2026-02-22T23:25:49.059 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.047+0000 7fd861ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:25:49.059 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.047+0000 7fd861ffb640 10 monclient: got monmap 1 from mon.d (according to old e1) 2026-02-22T23:25:49.059 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.047+0000 7fd861ffb640 10 monclient: dump: 2026-02-22T23:25:49.060 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:49.060 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:49.060 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:49.060 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:49.060 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:49.060 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:49.060 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:49.060 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:49.060 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:49.060 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:49.060 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:49.060 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:49.060 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:49.060 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:49.060 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:49.060 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:49.061 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.047+0000 7fd869723640 10 monclient: shutdown 2026-02-22T23:25:49.061 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.047+0000 7fd869723640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T23:25:49.061 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.047+0000 7fd869723640 1 -- 10.20.193.45:0/3329779995 >> v1:10.20.193.45:6792/0 conn(0x7fd8640a6d00 legacy=0x7fd8641417b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:49.061 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.047+0000 7fd869723640 1 -- 10.20.193.45:0/3329779995 shutdown_connections 2026-02-22T23:25:49.061 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.047+0000 7fd869723640 1 -- 10.20.193.45:0/3329779995 >> 10.20.193.45:0/3329779995 conn(0x7fd8640abb50 msgr2=0x7fd8640a7f00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:25:49.061 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.047+0000 7fd869723640 1 -- 10.20.193.45:0/3329779995 shutdown_connections 2026-02-22T23:25:49.061 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.047+0000 7fd869723640 1 -- 10.20.193.45:0/3329779995 wait complete. 2026-02-22T23:25:49.061 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.048+0000 7fd869723640 10 monclient: build_initial_monmap 2026-02-22T23:25:49.061 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.048+0000 7fd869723640 10 monclient: monmap: 2026-02-22T23:25:49.061 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-22T23:25:49.061 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T23:25:49.061 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-22T23:25:49.061 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-22T23:25:49.061 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-22T23:25:49.061 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-22T23:25:49.061 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-22T23:25:49.062 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.noname-f 2026-02-22T23:25:49.062 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.noname-b 2026-02-22T23:25:49.062 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.noname-g 2026-02-22T23:25:49.062 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.noname-c 2026-02-22T23:25:49.062 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.noname-h 2026-02-22T23:25:49.062 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.noname-d 2026-02-22T23:25:49.062 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.noname-i 2026-02-22T23:25:49.062 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.noname-e 2026-02-22T23:25:49.062 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:49.062 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.048+0000 7fd869723640 1 Processor -- start 2026-02-22T23:25:49.062 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.048+0000 7fd869723640 1 -- start start 2026-02-22T23:25:49.062 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.048+0000 7fd869723640 10 monclient: init 2026-02-22T23:25:49.062 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.048+0000 7fd869723640 10 monclient: _reopen_session rank -1 2026-02-22T23:25:49.062 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.048+0000 7fd869723640 10 monclient: _add_conns ranks=[8,1,2,5,0,4,3,7,6] 2026-02-22T23:25:49.062 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.048+0000 7fd869723640 10 monclient(hunting): picked mon.noname-e con 0x7fd8640a5e00 addr v1:10.20.193.45:6793/0 2026-02-22T23:25:49.062 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.048+0000 7fd869723640 10 monclient(hunting): picked mon.noname-f con 0x7fd8640a68f0 addr v1:10.20.193.73:6789/0 2026-02-22T23:25:49.062 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.048+0000 7fd869723640 10 monclient(hunting): picked mon.noname-b con 0x7fd8640a6d00 addr v1:10.20.193.45:6790/0 2026-02-22T23:25:49.063 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.048+0000 7fd869723640 1 -- --> v1:10.20.193.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd8641369f0 con 0x7fd8640a68f0 2026-02-22T23:25:49.063 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.048+0000 7fd869723640 1 -- --> v1:10.20.193.45:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd8640a9ba0 con 0x7fd8640a6d00 2026-02-22T23:25:49.063 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.048+0000 7fd869723640 1 -- --> v1:10.20.193.45:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd8640a9f60 con 0x7fd8640a5e00 2026-02-22T23:25:49.063 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.048+0000 7fd869723640 10 monclient(hunting): _renew_subs 2026-02-22T23:25:49.063 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.048+0000 7fd869723640 10 monclient(hunting): authenticate will time out at 680.664939s 2026-02-22T23:25:49.063 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.048+0000 7fd862ffd640 1 --1- >> v1:10.20.193.45:6793/0 conn(0x7fd8640a5e00 0x7fd8641cffa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.45:6793/0 says I am v1:10.20.193.45:36874/0 (socket says 10.20.193.45:36874) 2026-02-22T23:25:49.063 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.048+0000 7fd862ffd640 1 -- 10.20.193.45:0/3112434996 learned_addr learned my addr 10.20.193.45:0/3112434996 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-22T23:25:49.063 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.049+0000 7fd8437fe640 1 -- 10.20.193.45:0/3112434996 <== mon.8 v1:10.20.193.45:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1947598000 0 0) 0x7fd8640a9f60 con 0x7fd8640a5e00 2026-02-22T23:25:49.063 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.049+0000 7fd8437fe640 10 monclient(hunting): _negotiate 2026-02-22T23:25:49.063 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.049+0000 7fd8437fe640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:49.063 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.049+0000 7fd8437fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:49.063 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.049+0000 7fd8437fe640 10 monclient(hunting): my global_id is 4427 2026-02-22T23:25:49.063 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.049+0000 7fd8437fe640 1 -- 10.20.193.45:0/3112434996 --> v1:10.20.193.45:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd830003620 con 0x7fd8640a5e00 2026-02-22T23:25:49.063 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.049+0000 7fd8437fe640 1 -- 10.20.193.45:0/3112434996 <== mon.2 v1:10.20.193.45:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2386314722 0 0) 0x7fd8640a9ba0 con 0x7fd8640a6d00 2026-02-22T23:25:49.063 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.049+0000 7fd8437fe640 10 monclient(hunting): _negotiate 2026-02-22T23:25:49.063 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.049+0000 7fd8437fe640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:49.063 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.049+0000 7fd8437fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:49.064 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.049+0000 7fd8437fe640 10 monclient(hunting): my global_id is 4457 2026-02-22T23:25:49.064 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.049+0000 7fd8437fe640 1 -- 10.20.193.45:0/3112434996 --> v1:10.20.193.45:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd8640a9f60 con 0x7fd8640a6d00 2026-02-22T23:25:49.064 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.049+0000 7fd8437fe640 1 -- 10.20.193.45:0/3112434996 <== mon.8 v1:10.20.193.45:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2210428667 0 0) 0x7fd830003620 con 0x7fd8640a5e00 2026-02-22T23:25:49.064 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.049+0000 7fd8437fe640 1 -- 10.20.193.45:0/3112434996 --> v1:10.20.193.45:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd8640a9ba0 con 0x7fd8640a5e00 2026-02-22T23:25:49.064 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.049+0000 7fd8437fe640 1 -- 10.20.193.45:0/3112434996 <== mon.8 v1:10.20.193.45:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7fd858003340 con 0x7fd8640a5e00 2026-02-22T23:25:49.064 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.049+0000 7fd8437fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-22T23:25:49.064 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.049+0000 7fd8437fe640 10 monclient(hunting): got monmap 1 from mon.noname-e (according to old e1) 2026-02-22T23:25:49.064 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.049+0000 7fd8437fe640 10 monclient(hunting): dump: 2026-02-22T23:25:49.064 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:49.064 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:49.064 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:49.064 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:49.064 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:49.064 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:49.064 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:49.064 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:49.064 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:49.064 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:49.065 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:49.065 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:49.065 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:49.065 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:49.065 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:49.065 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:49.065 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.049+0000 7fd8437fe640 10 monclient(hunting): _finish_auth 0 2026-02-22T23:25:49.065 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.049+0000 7fd8437fe640 1 -- 10.20.193.45:0/3112434996 <== mon.1 v1:10.20.193.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2466721524 0 0) 0x7fd8640a2fe0 con 0x7fd8640a68f0 2026-02-22T23:25:49.065 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.049+0000 7fd8437fe640 10 monclient(hunting): _negotiate 2026-02-22T23:25:49.065 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.049+0000 7fd8437fe640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:49.065 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.049+0000 7fd8437fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:49.065 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.049+0000 7fd8437fe640 10 monclient(hunting): my global_id is 4501 2026-02-22T23:25:49.065 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.049+0000 7fd8437fe640 1 -- 10.20.193.45:0/3112434996 --> v1:10.20.193.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd830003620 con 0x7fd8640a68f0 2026-02-22T23:25:49.065 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.049+0000 7fd8437fe640 1 -- 10.20.193.45:0/3112434996 <== mon.2 v1:10.20.193.45:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3652684379 0 0) 0x7fd8640a9f60 con 0x7fd8640a6d00 2026-02-22T23:25:49.065 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.049+0000 7fd8437fe640 1 -- 10.20.193.45:0/3112434996 --> v1:10.20.193.45:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd8640a2fe0 con 0x7fd8640a6d00 2026-02-22T23:25:49.065 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.049+0000 7fd8437fe640 1 -- 10.20.193.45:0/3112434996 <== mon.8 v1:10.20.193.45:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1006956625 0 0) 0x7fd8640a9ba0 con 0x7fd8640a5e00 2026-02-22T23:25:49.065 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.049+0000 7fd8437fe640 1 -- 10.20.193.45:0/3112434996 >> v1:10.20.193.45:6790/0 conn(0x7fd8640a6d00 legacy=0x7fd8641d8670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:49.065 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.049+0000 7fd8437fe640 1 -- 10.20.193.45:0/3112434996 >> v1:10.20.193.73:6789/0 conn(0x7fd8640a68f0 legacy=0x7fd8641d4f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:49.066 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.049+0000 7fd8437fe640 10 monclient: _finish_hunting 0 2026-02-22T23:25:49.066 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.049+0000 7fd8437fe640 1 monclient: found mon.e 2026-02-22T23:25:49.066 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.049+0000 7fd8437fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T23:25:49.066 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.049+0000 7fd8437fe640 10 monclient: _send_mon_message to mon.e at v1:10.20.193.45:6793/0 2026-02-22T23:25:49.066 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.049+0000 7fd8437fe640 1 -- 10.20.193.45:0/3112434996 --> v1:10.20.193.45:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd864138820 con 0x7fd8640a5e00 2026-02-22T23:25:49.066 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.049+0000 7fd8437fe640 10 monclient: _finish_auth 0 2026-02-22T23:25:49.066 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.049+0000 7fd8437fe640 10 monclient: _check_auth_tickets 2026-02-22T23:25:49.066 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.049+0000 7fd8437fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T23:25:49.066 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.049+0000 7fd869723640 5 monclient: authenticate success, global_id 4427 2026-02-22T23:25:49.066 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.049+0000 7fd869723640 10 monclient: _renew_subs 2026-02-22T23:25:49.066 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.049+0000 7fd869723640 10 monclient: _send_mon_message to mon.e at v1:10.20.193.45:6793/0 2026-02-22T23:25:49.066 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.049+0000 7fd869723640 1 -- 10.20.193.45:0/3112434996 --> v1:10.20.193.45:6793/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fd864137f80 con 0x7fd8640a5e00 2026-02-22T23:25:49.066 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.049+0000 7fd869723640 10 monclient: _renew_subs 2026-02-22T23:25:49.066 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.049+0000 7fd869723640 10 monclient: _send_mon_message to mon.e at v1:10.20.193.45:6793/0 2026-02-22T23:25:49.066 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.049+0000 7fd869723640 1 -- 10.20.193.45:0/3112434996 --> v1:10.20.193.45:6793/0 -- mon_subscribe({osdmap=0}) -- 0x7fd864136570 con 0x7fd8640a5e00 2026-02-22T23:25:49.066 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.049+0000 7fd8437fe640 1 -- 10.20.193.45:0/3112434996 <== mon.8 v1:10.20.193.45:6793/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd8580039c0 con 0x7fd8640a5e00 2026-02-22T23:25:49.066 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.049+0000 7fd8437fe640 10 monclient: handle_config config(0 keys) 2026-02-22T23:25:49.066 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.049+0000 7fd8437fe640 1 -- 10.20.193.45:0/3112434996 <== mon.8 v1:10.20.193.45:6793/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7fd858003ef0 con 0x7fd8640a5e00 2026-02-22T23:25:49.067 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.049+0000 7fd8437fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:25:49.067 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.049+0000 7fd8617fa640 4 set_mon_vals no callback set 2026-02-22T23:25:49.067 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.049+0000 7fd8437fe640 10 monclient: got monmap 1 from mon.e (according to old e1) 2026-02-22T23:25:49.067 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.049+0000 7fd8437fe640 10 monclient: dump: 2026-02-22T23:25:49.067 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:49.067 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:49.067 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:49.067 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:49.067 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:49.067 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:49.067 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:49.067 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:49.067 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:49.067 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:49.067 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:49.067 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:49.067 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:49.067 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:49.067 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:49.068 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:49.068 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.049+0000 7fd869723640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T23:25:49.068 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.049+0000 7fd869723640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T23:25:49.068 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.049+0000 7fd869723640 10 monclient: _send_mon_message to mon.e at v1:10.20.193.45:6793/0 2026-02-22T23:25:49.068 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.049+0000 7fd869723640 1 -- 10.20.193.45:0/3112434996 --> v1:10.20.193.45:6793/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd864069720 con 0x7fd8640a5e00 2026-02-22T23:25:49.068 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.049+0000 7fd8437fe640 1 -- 10.20.193.45:0/3112434996 <== mon.8 v1:10.20.193.45:6793/0 7 ==== mgrmap(e 5) ==== 50225+0+0 (unknown 2330357642 0 0) 0x7fd858004090 con 0x7fd8640a5e00 2026-02-22T23:25:49.068 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.050+0000 7fd8437fe640 1 -- 10.20.193.45:0/3112434996 <== mon.8 v1:10.20.193.45:6793/0 8 ==== osd_map(19..19 src has 1..19) ==== 3558+0+0 (unknown 1288710973 0 0) 0x7fd85804dc00 con 0x7fd8640a5e00 2026-02-22T23:25:49.068 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.050+0000 7fd8627fc640 10 monclient: get_auth_request con 0x7fd83003fbf0 auth_method 0 2026-02-22T23:25:49.068 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.052+0000 7fd8437fe640 1 -- 10.20.193.45:0/3112434996 <== mon.8 v1:10.20.193.45:6793/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (unknown 1092875540 0 2568732696) 0x7fd858017700 con 0x7fd8640a5e00 2026-02-22T23:25:49.068 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.052+0000 7fd8437fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T23:25:49.068 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.052+0000 7fd8437fe640 10 monclient: _finish_command 1 = system:0 2026-02-22T23:25:49.135 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.134+0000 7fd869723640 10 start_mon_command cmd=[{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}] 2026-02-22T23:25:49.135 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.134+0000 7fd869723640 10 monclient: _send_command 2 [{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}] 2026-02-22T23:25:49.135 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.134+0000 7fd869723640 10 monclient: _send_mon_message to mon.e at v1:10.20.193.45:6793/0 2026-02-22T23:25:49.135 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.134+0000 7fd869723640 1 -- 10.20.193.45:0/3112434996 --> v1:10.20.193.45:6793/0 -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) -- 0x7fd86406ce10 con 0x7fd8640a5e00 2026-02-22T23:25:49.135 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.134+0000 7fd8437fe640 1 -- 10.20.193.45:0/3112434996 <== mon.8 v1:10.20.193.45:6793/0 10 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v19) ==== 92+0+10 (unknown 1398289234 0 265718887) 0x7fd858017000 con 0x7fd8640a5e00 2026-02-22T23:25:49.135 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.134+0000 7fd8437fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}] 2026-02-22T23:25:49.135 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.134+0000 7fd8437fe640 10 monclient: _finish_command 2 = system:0 2026-02-22T23:25:49.136 INFO:teuthology.orchestra.run.trial045.stdout:pg_num: 8 2026-02-22T23:25:49.136 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.135+0000 7fd869723640 1 -- 10.20.193.45:0/3112434996 >> v1:10.20.193.73:6800/2222410180 conn(0x7fd83003fbf0 legacy=0x7fd8300420b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:49.137 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.135+0000 7fd869723640 10 monclient: shutdown 2026-02-22T23:25:49.137 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.135+0000 7fd869723640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T23:25:49.137 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.135+0000 7fd869723640 1 -- 10.20.193.45:0/3112434996 >> v1:10.20.193.45:6793/0 conn(0x7fd8640a5e00 legacy=0x7fd8641cffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:49.137 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.135+0000 7fd869723640 1 -- 10.20.193.45:0/3112434996 shutdown_connections 2026-02-22T23:25:49.137 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.135+0000 7fd869723640 1 -- 10.20.193.45:0/3112434996 >> 10.20.193.45:0/3112434996 conn(0x7fd8640abb50 msgr2=0x7fd8640a4010 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:25:49.137 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.135+0000 7fd869723640 1 -- 10.20.193.45:0/3112434996 shutdown_connections 2026-02-22T23:25:49.137 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.135+0000 7fd869723640 1 -- 10.20.193.45:0/3112434996 wait complete. 2026-02-22T23:25:49.143 INFO:tasks.mon_thrash.ceph_manager:waiting for clean 2026-02-22T23:25:49.144 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-22T23:25:49.213 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.212+0000 7fd1fc355640 10 monclient: get_monmap_and_config 2026-02-22T23:25:49.213 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.212+0000 7fd1fc355640 10 monclient: build_initial_monmap 2026-02-22T23:25:49.213 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.212+0000 7fd1fc355640 10 monclient: monmap: 2026-02-22T23:25:49.213 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-22T23:25:49.213 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:49.213 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:25:49.213096+0000 2026-02-22T23:25:49.213 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:25:49.213096+0000 2026-02-22T23:25:49.213 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-22T23:25:49.213 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:49.214 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-22T23:25:49.214 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.noname-f 2026-02-22T23:25:49.214 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.noname-b 2026-02-22T23:25:49.214 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.noname-g 2026-02-22T23:25:49.214 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.noname-c 2026-02-22T23:25:49.214 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.noname-h 2026-02-22T23:25:49.214 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.noname-d 2026-02-22T23:25:49.214 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.noname-i 2026-02-22T23:25:49.214 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.noname-e 2026-02-22T23:25:49.214 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:49.223 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.213+0000 7fd1fc355640 1 Processor -- start 2026-02-22T23:25:49.223 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.213+0000 7fd1fc355640 1 -- start start 2026-02-22T23:25:49.223 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.213+0000 7fd1fc355640 10 monclient: init 2026-02-22T23:25:49.223 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.213+0000 7fd1fc355640 10 monclient: _reopen_session rank -1 2026-02-22T23:25:49.223 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.213+0000 7fd1fc355640 10 monclient: _add_conns ranks=[4,2,7,0,3,1,5,6,8] 2026-02-22T23:25:49.223 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.213+0000 7fd1fc355640 10 monclient(hunting): picked mon.noname-c con 0x7fd1f40a5e00 addr v1:10.20.193.45:6791/0 2026-02-22T23:25:49.223 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.213+0000 7fd1fc355640 10 monclient(hunting): picked mon.noname-b con 0x7fd1f40a68f0 addr v1:10.20.193.45:6790/0 2026-02-22T23:25:49.223 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.213+0000 7fd1fc355640 10 monclient(hunting): picked mon.noname-i con 0x7fd1f40a6d00 addr v1:10.20.193.73:6792/0 2026-02-22T23:25:49.223 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.213+0000 7fd1fc355640 1 -- --> v1:10.20.193.45:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd1f40a2d00 con 0x7fd1f40a68f0 2026-02-22T23:25:49.224 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.213+0000 7fd1fc355640 1 -- --> v1:10.20.193.45:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd1f40a2fe0 con 0x7fd1f40a5e00 2026-02-22T23:25:49.224 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.213+0000 7fd1fc355640 1 -- --> v1:10.20.193.73:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd1f40a32c0 con 0x7fd1f40a6d00 2026-02-22T23:25:49.224 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.213+0000 7fd1fc355640 10 monclient(hunting): _renew_subs 2026-02-22T23:25:49.224 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.213+0000 7fd1fc355640 10 monclient(hunting): authenticate will time out at 680.829800s 2026-02-22T23:25:49.224 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.213+0000 7fd1fa0ca640 1 --1- >> v1:10.20.193.45:6791/0 conn(0x7fd1f40a5e00 0x7fd1f40a61e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.45:6791/0 says I am v1:10.20.193.45:38016/0 (socket says 10.20.193.45:38016) 2026-02-22T23:25:49.224 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.213+0000 7fd1fa0ca640 1 -- 10.20.193.45:0/3341791821 learned_addr learned my addr 10.20.193.45:0/3341791821 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-22T23:25:49.224 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.213+0000 7fd1f98c9640 1 --1- 10.20.193.45:0/3341791821 >> v1:10.20.193.45:6790/0 conn(0x7fd1f40a68f0 0x7fd1f413e080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.45:6790/0 says I am v1:10.20.193.45:51068/0 (socket says 10.20.193.45:51068) 2026-02-22T23:25:49.224 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.214+0000 7fd1f90c8640 1 -- 10.20.193.45:0/3341791821 <== mon.2 v1:10.20.193.45:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 812205437 0 0) 0x7fd1f40a2d00 con 0x7fd1f40a68f0 2026-02-22T23:25:49.224 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.214+0000 7fd1f90c8640 10 monclient(hunting): _negotiate 2026-02-22T23:25:49.224 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.214+0000 7fd1f90c8640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:49.224 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.214+0000 7fd1f90c8640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:49.224 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.214+0000 7fd1f90c8640 10 monclient(hunting): my global_id is 4466 2026-02-22T23:25:49.225 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.214+0000 7fd1f90c8640 1 -- 10.20.193.45:0/3341791821 --> v1:10.20.193.45:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd1dc003620 con 0x7fd1f40a68f0 2026-02-22T23:25:49.225 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.214+0000 7fd1f90c8640 1 -- 10.20.193.45:0/3341791821 <== mon.4 v1:10.20.193.45:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4211613287 0 0) 0x7fd1f40a2fe0 con 0x7fd1f40a5e00 2026-02-22T23:25:49.225 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.214+0000 7fd1f90c8640 10 monclient(hunting): _negotiate 2026-02-22T23:25:49.225 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.214+0000 7fd1f90c8640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:49.225 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.214+0000 7fd1f90c8640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:49.225 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.214+0000 7fd1f90c8640 10 monclient(hunting): my global_id is 4414 2026-02-22T23:25:49.225 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.214+0000 7fd1f90c8640 1 -- 10.20.193.45:0/3341791821 --> v1:10.20.193.45:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd1f40a2d00 con 0x7fd1f40a5e00 2026-02-22T23:25:49.225 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.214+0000 7fd1f90c8640 1 -- 10.20.193.45:0/3341791821 <== mon.2 v1:10.20.193.45:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2772150745 0 0) 0x7fd1dc003620 con 0x7fd1f40a68f0 2026-02-22T23:25:49.225 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.214+0000 7fd1f90c8640 1 -- 10.20.193.45:0/3341791821 >> v1:10.20.193.73:6792/0 conn(0x7fd1f40a6d00 legacy=0x7fd1f41417b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:49.225 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.214+0000 7fd1f90c8640 1 -- 10.20.193.45:0/3341791821 >> v1:10.20.193.45:6791/0 conn(0x7fd1f40a5e00 legacy=0x7fd1f40a61e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:49.225 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.214+0000 7fd1f90c8640 10 monclient: _finish_hunting 0 2026-02-22T23:25:49.225 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.214+0000 7fd1f90c8640 1 monclient: found mon.noname-b 2026-02-22T23:25:49.226 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.214+0000 7fd1f90c8640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T23:25:49.226 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.214+0000 7fd1f90c8640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.45:6790/0 2026-02-22T23:25:49.226 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.214+0000 7fd1f90c8640 1 -- 10.20.193.45:0/3341791821 --> v1:10.20.193.45:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1f40a35a0 con 0x7fd1f40a68f0 2026-02-22T23:25:49.226 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.214+0000 7fd1f90c8640 10 monclient: _finish_auth 0 2026-02-22T23:25:49.226 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.214+0000 7fd1f90c8640 10 monclient: _check_auth_tickets 2026-02-22T23:25:49.226 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.214+0000 7fd1f90c8640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T23:25:49.226 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.214+0000 7fd1f90c8640 1 -- 10.20.193.45:0/3341791821 <== mon.2 v1:10.20.193.45:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7fd1e8003040 con 0x7fd1f40a68f0 2026-02-22T23:25:49.226 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.214+0000 7fd1fc355640 5 monclient: authenticate success, global_id 4466 2026-02-22T23:25:49.226 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.214+0000 7fd1fc355640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-22T23:25:49.226 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.214+0000 7fd1f90c8640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:25:49.226 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.214+0000 7fd1f90c8640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-22T23:25:49.226 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.214+0000 7fd1f90c8640 10 monclient: dump: 2026-02-22T23:25:49.226 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:49.227 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:49.227 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:49.227 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:49.227 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:49.227 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:49.227 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:49.227 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:49.227 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:49.227 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:49.227 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:49.227 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:49.227 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:49.228 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:49.228 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:49.228 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:49.228 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.214+0000 7fd1fc355640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-22T23:25:49.228 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.214+0000 7fd1f90c8640 1 -- 10.20.193.45:0/3341791821 <== mon.2 v1:10.20.193.45:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd1e80031e0 con 0x7fd1f40a68f0 2026-02-22T23:25:49.228 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.214+0000 7fd1f90c8640 10 monclient: handle_config config(0 keys) 2026-02-22T23:25:49.228 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.214+0000 7fd1f90c8640 1 -- 10.20.193.45:0/3341791821 <== mon.2 v1:10.20.193.45:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7fd1e8004c20 con 0x7fd1f40a68f0 2026-02-22T23:25:49.228 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.214+0000 7fd1f90c8640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:25:49.228 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.214+0000 7fd1f90c8640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-22T23:25:49.228 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.214+0000 7fd1f90c8640 10 monclient: dump: 2026-02-22T23:25:49.228 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:49.228 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:49.229 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:49.229 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:49.229 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:49.229 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:49.229 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:49.229 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:49.229 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:49.229 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:49.229 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:49.229 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:49.229 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:49.229 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:49.229 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:49.230 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:49.230 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.214+0000 7fd1fc355640 10 monclient: get_monmap_and_config success 2026-02-22T23:25:49.230 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.214+0000 7fd1fc355640 4 set_mon_vals no callback set 2026-02-22T23:25:49.230 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.214+0000 7fd1fc355640 10 monclient: shutdown 2026-02-22T23:25:49.230 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.214+0000 7fd1fc355640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T23:25:49.230 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.214+0000 7fd1fc355640 1 -- 10.20.193.45:0/3341791821 >> v1:10.20.193.45:6790/0 conn(0x7fd1f40a68f0 legacy=0x7fd1f413e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:49.230 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.214+0000 7fd1fc355640 1 -- 10.20.193.45:0/3341791821 shutdown_connections 2026-02-22T23:25:49.230 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.214+0000 7fd1fc355640 1 -- 10.20.193.45:0/3341791821 >> 10.20.193.45:0/3341791821 conn(0x7fd1f40abb50 msgr2=0x7fd1f40a7f00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:25:49.230 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.214+0000 7fd1fc355640 1 -- 10.20.193.45:0/3341791821 shutdown_connections 2026-02-22T23:25:49.230 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.214+0000 7fd1fc355640 1 -- 10.20.193.45:0/3341791821 wait complete. 2026-02-22T23:25:49.230 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.214+0000 7fd1fc355640 10 monclient: build_initial_monmap 2026-02-22T23:25:49.231 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.214+0000 7fd1fc355640 10 monclient: monmap: 2026-02-22T23:25:49.231 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-22T23:25:49.231 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T23:25:49.231 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-22T23:25:49.231 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-22T23:25:49.231 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-22T23:25:49.231 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-22T23:25:49.231 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-22T23:25:49.231 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.noname-f 2026-02-22T23:25:49.231 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.noname-b 2026-02-22T23:25:49.231 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.noname-g 2026-02-22T23:25:49.231 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.noname-c 2026-02-22T23:25:49.231 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.noname-h 2026-02-22T23:25:49.232 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.noname-d 2026-02-22T23:25:49.232 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.noname-i 2026-02-22T23:25:49.232 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.noname-e 2026-02-22T23:25:49.232 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:49.232 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.215+0000 7fd1fc355640 1 Processor -- start 2026-02-22T23:25:49.232 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.215+0000 7fd1fc355640 1 -- start start 2026-02-22T23:25:49.232 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.215+0000 7fd1fc355640 10 monclient: init 2026-02-22T23:25:49.232 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.215+0000 7fd1fc355640 10 monclient: _reopen_session rank -1 2026-02-22T23:25:49.232 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.215+0000 7fd1fc355640 10 monclient: _add_conns ranks=[8,4,2,0,3,7,6,5,1] 2026-02-22T23:25:49.232 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.215+0000 7fd1fc355640 10 monclient(hunting): picked mon.noname-e con 0x7fd1f40a5e00 addr v1:10.20.193.45:6793/0 2026-02-22T23:25:49.232 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.215+0000 7fd1fc355640 10 monclient(hunting): picked mon.noname-c con 0x7fd1f40a68f0 addr v1:10.20.193.45:6791/0 2026-02-22T23:25:49.232 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.215+0000 7fd1fc355640 10 monclient(hunting): picked mon.noname-b con 0x7fd1f40a6d00 addr v1:10.20.193.45:6790/0 2026-02-22T23:25:49.232 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.215+0000 7fd1fc355640 1 -- --> v1:10.20.193.45:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd1f4129020 con 0x7fd1f40a6d00 2026-02-22T23:25:49.233 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.215+0000 7fd1fc355640 1 -- --> v1:10.20.193.45:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd1f4126d30 con 0x7fd1f40a68f0 2026-02-22T23:25:49.233 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.215+0000 7fd1fc355640 1 -- --> v1:10.20.193.45:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd1f40a1c90 con 0x7fd1f40a5e00 2026-02-22T23:25:49.233 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.215+0000 7fd1fc355640 10 monclient(hunting): _renew_subs 2026-02-22T23:25:49.233 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.215+0000 7fd1fc355640 10 monclient(hunting): authenticate will time out at 680.831398s 2026-02-22T23:25:49.233 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.215+0000 7fd1f98c9640 1 --1- >> v1:10.20.193.45:6791/0 conn(0x7fd1f40a68f0 0x7fd1f41d44f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.45:6791/0 says I am v1:10.20.193.45:38026/0 (socket says 10.20.193.45:38026) 2026-02-22T23:25:49.233 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.215+0000 7fd1f98c9640 1 -- 10.20.193.45:0/1895048224 learned_addr learned my addr 10.20.193.45:0/1895048224 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-22T23:25:49.233 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.215+0000 7fd1daffd640 1 -- 10.20.193.45:0/1895048224 <== mon.4 v1:10.20.193.45:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 421615107 0 0) 0x7fd1f4126d30 con 0x7fd1f40a68f0 2026-02-22T23:25:49.233 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.215+0000 7fd1daffd640 10 monclient(hunting): _negotiate 2026-02-22T23:25:49.233 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.215+0000 7fd1daffd640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:49.233 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.215+0000 7fd1daffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:49.233 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.215+0000 7fd1daffd640 10 monclient(hunting): my global_id is 4423 2026-02-22T23:25:49.233 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.215+0000 7fd1daffd640 1 -- 10.20.193.45:0/1895048224 --> v1:10.20.193.45:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd1c4003620 con 0x7fd1f40a68f0 2026-02-22T23:25:49.234 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.215+0000 7fd1daffd640 1 -- 10.20.193.45:0/1895048224 <== mon.2 v1:10.20.193.45:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4147599405 0 0) 0x7fd1f4129020 con 0x7fd1f40a6d00 2026-02-22T23:25:49.234 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.215+0000 7fd1daffd640 10 monclient(hunting): _negotiate 2026-02-22T23:25:49.234 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.215+0000 7fd1daffd640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:49.234 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.215+0000 7fd1daffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:49.234 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.215+0000 7fd1daffd640 10 monclient(hunting): my global_id is 4475 2026-02-22T23:25:49.234 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.215+0000 7fd1daffd640 1 -- 10.20.193.45:0/1895048224 --> v1:10.20.193.45:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd1f4126d30 con 0x7fd1f40a6d00 2026-02-22T23:25:49.234 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.215+0000 7fd1daffd640 1 -- 10.20.193.45:0/1895048224 <== mon.8 v1:10.20.193.45:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1103850049 0 0) 0x7fd1f40a1c90 con 0x7fd1f40a5e00 2026-02-22T23:25:49.234 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.215+0000 7fd1daffd640 10 monclient(hunting): _negotiate 2026-02-22T23:25:49.234 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.215+0000 7fd1daffd640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:49.234 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.215+0000 7fd1daffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:49.234 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.215+0000 7fd1daffd640 10 monclient(hunting): my global_id is 4436 2026-02-22T23:25:49.234 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.215+0000 7fd1daffd640 1 -- 10.20.193.45:0/1895048224 --> v1:10.20.193.45:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd1f4129020 con 0x7fd1f40a5e00 2026-02-22T23:25:49.234 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.215+0000 7fd1daffd640 1 -- 10.20.193.45:0/1895048224 <== mon.4 v1:10.20.193.45:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2564821094 0 0) 0x7fd1c4003620 con 0x7fd1f40a68f0 2026-02-22T23:25:49.235 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.215+0000 7fd1daffd640 1 -- 10.20.193.45:0/1895048224 --> v1:10.20.193.45:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd1f40a1c90 con 0x7fd1f40a68f0 2026-02-22T23:25:49.235 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.215+0000 7fd1daffd640 1 -- 10.20.193.45:0/1895048224 <== mon.4 v1:10.20.193.45:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7fd1e80048e0 con 0x7fd1f40a68f0 2026-02-22T23:25:49.235 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.215+0000 7fd1daffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-22T23:25:49.235 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.215+0000 7fd1daffd640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-22T23:25:49.235 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.215+0000 7fd1daffd640 10 monclient(hunting): dump: 2026-02-22T23:25:49.235 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:49.235 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:49.235 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:49.235 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:49.235 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:49.235 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:49.235 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:49.236 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:49.236 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:49.236 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:49.236 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:49.236 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:49.236 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:49.236 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:49.236 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:49.236 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:49.236 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.215+0000 7fd1daffd640 10 monclient(hunting): _finish_auth 0 2026-02-22T23:25:49.236 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.215+0000 7fd1daffd640 1 -- 10.20.193.45:0/1895048224 <== mon.2 v1:10.20.193.45:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 9589523 0 0) 0x7fd1f4126d30 con 0x7fd1f40a6d00 2026-02-22T23:25:49.236 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.215+0000 7fd1daffd640 1 -- 10.20.193.45:0/1895048224 --> v1:10.20.193.45:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd1c4003620 con 0x7fd1f40a6d00 2026-02-22T23:25:49.236 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.215+0000 7fd1daffd640 1 -- 10.20.193.45:0/1895048224 <== mon.8 v1:10.20.193.45:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3327497594 0 0) 0x7fd1f4129020 con 0x7fd1f40a5e00 2026-02-22T23:25:49.237 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.215+0000 7fd1daffd640 1 -- 10.20.193.45:0/1895048224 --> v1:10.20.193.45:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd1f4126d30 con 0x7fd1f40a5e00 2026-02-22T23:25:49.237 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.215+0000 7fd1daffd640 1 -- 10.20.193.45:0/1895048224 <== mon.2 v1:10.20.193.45:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7fd1f0003660 con 0x7fd1f40a6d00 2026-02-22T23:25:49.237 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.215+0000 7fd1daffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-22T23:25:49.237 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.215+0000 7fd1daffd640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-22T23:25:49.237 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.215+0000 7fd1daffd640 10 monclient(hunting): dump: 2026-02-22T23:25:49.237 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:49.237 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:49.237 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:49.237 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:49.237 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:49.237 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:49.237 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:49.238 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:49.238 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:49.238 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:49.238 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:49.238 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:49.238 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:49.238 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:49.238 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:49.238 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:49.238 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.215+0000 7fd1daffd640 1 -- 10.20.193.45:0/1895048224 <== mon.8 v1:10.20.193.45:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7fd1e4003180 con 0x7fd1f40a5e00 2026-02-22T23:25:49.238 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.215+0000 7fd1daffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-22T23:25:49.238 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.215+0000 7fd1daffd640 10 monclient(hunting): got monmap 1 from mon.e (according to old e1) 2026-02-22T23:25:49.238 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.215+0000 7fd1daffd640 10 monclient(hunting): dump: 2026-02-22T23:25:49.239 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:49.239 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:49.239 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:49.239 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:49.239 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:49.239 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:49.239 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:49.239 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:49.239 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:49.239 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:49.239 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:49.239 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:49.239 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:49.240 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:49.240 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:49.240 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:49.240 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.215+0000 7fd1daffd640 1 -- 10.20.193.45:0/1895048224 <== mon.4 v1:10.20.193.45:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1462340209 0 0) 0x7fd1f40a1c90 con 0x7fd1f40a68f0 2026-02-22T23:25:49.240 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.215+0000 7fd1daffd640 1 -- 10.20.193.45:0/1895048224 >> v1:10.20.193.45:6793/0 conn(0x7fd1f40a5e00 legacy=0x7fd1f41416a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:49.240 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.215+0000 7fd1daffd640 1 -- 10.20.193.45:0/1895048224 >> v1:10.20.193.45:6790/0 conn(0x7fd1f40a6d00 legacy=0x7fd1f41d7c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:49.240 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.215+0000 7fd1daffd640 10 monclient: _finish_hunting 0 2026-02-22T23:25:49.240 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.215+0000 7fd1daffd640 1 monclient: found mon.c 2026-02-22T23:25:49.240 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.215+0000 7fd1daffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T23:25:49.240 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.215+0000 7fd1daffd640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.45:6791/0 2026-02-22T23:25:49.240 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.215+0000 7fd1daffd640 1 -- 10.20.193.45:0/1895048224 --> v1:10.20.193.45:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1f4128d40 con 0x7fd1f40a68f0 2026-02-22T23:25:49.240 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.215+0000 7fd1daffd640 10 monclient: _finish_auth 0 2026-02-22T23:25:49.241 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.215+0000 7fd1daffd640 10 monclient: _check_auth_tickets 2026-02-22T23:25:49.241 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.215+0000 7fd1daffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T23:25:49.241 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.215+0000 7fd1fc355640 5 monclient: authenticate success, global_id 4423 2026-02-22T23:25:49.241 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.215+0000 7fd1fc355640 10 monclient: _renew_subs 2026-02-22T23:25:49.241 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.215+0000 7fd1fc355640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.45:6791/0 2026-02-22T23:25:49.241 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.215+0000 7fd1fc355640 1 -- 10.20.193.45:0/1895048224 --> v1:10.20.193.45:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fd1f4127bd0 con 0x7fd1f40a68f0 2026-02-22T23:25:49.241 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.215+0000 7fd1daffd640 1 -- 10.20.193.45:0/1895048224 <== mon.4 v1:10.20.193.45:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd1e8004f20 con 0x7fd1f40a68f0 2026-02-22T23:25:49.241 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.215+0000 7fd1daffd640 10 monclient: handle_config config(0 keys) 2026-02-22T23:25:49.241 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.215+0000 7fd1fc355640 10 monclient: _renew_subs 2026-02-22T23:25:49.241 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.215+0000 7fd1fc355640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.45:6791/0 2026-02-22T23:25:49.241 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.215+0000 7fd1fc355640 1 -- 10.20.193.45:0/1895048224 --> v1:10.20.193.45:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7fd1f4127890 con 0x7fd1f40a68f0 2026-02-22T23:25:49.241 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.215+0000 7fd1f88c7640 4 set_mon_vals no callback set 2026-02-22T23:25:49.241 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.215+0000 7fd1daffd640 1 -- 10.20.193.45:0/1895048224 <== mon.4 v1:10.20.193.45:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7fd1e8005410 con 0x7fd1f40a68f0 2026-02-22T23:25:49.242 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.215+0000 7fd1daffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:25:49.242 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.215+0000 7fd1daffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T23:25:49.242 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.215+0000 7fd1daffd640 10 monclient: dump: 2026-02-22T23:25:49.242 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:49.242 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:49.242 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:49.242 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:49.242 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:49.242 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:49.242 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:49.242 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:49.242 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:49.242 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:49.243 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:49.243 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:49.243 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:49.243 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:49.243 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:49.243 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:49.243 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.216+0000 7fd1fc355640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T23:25:49.243 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.216+0000 7fd1fc355640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T23:25:49.243 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.216+0000 7fd1fc355640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.45:6791/0 2026-02-22T23:25:49.243 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.216+0000 7fd1fc355640 1 -- 10.20.193.45:0/1895048224 --> v1:10.20.193.45:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd1f40008d0 con 0x7fd1f40a68f0 2026-02-22T23:25:49.243 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.216+0000 7fd1daffd640 1 -- 10.20.193.45:0/1895048224 <== mon.4 v1:10.20.193.45:6791/0 7 ==== mgrmap(e 5) ==== 50225+0+0 (unknown 2330357642 0 0) 0x7fd1e80119f0 con 0x7fd1f40a68f0 2026-02-22T23:25:49.243 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.216+0000 7fd1daffd640 1 -- 10.20.193.45:0/1895048224 <== mon.4 v1:10.20.193.45:6791/0 8 ==== osd_map(19..19 src has 1..19) ==== 3558+0+0 (unknown 1288710973 0 0) 0x7fd1e804dde0 con 0x7fd1f40a68f0 2026-02-22T23:25:49.244 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.216+0000 7fd1fa0ca640 10 monclient: get_auth_request con 0x7fd1c4040210 auth_method 0 2026-02-22T23:25:49.244 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.218+0000 7fd1daffd640 1 -- 10.20.193.45:0/1895048224 <== mon.4 v1:10.20.193.45:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (unknown 1092875540 0 2568732696) 0x7fd1e8017880 con 0x7fd1f40a68f0 2026-02-22T23:25:49.244 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.218+0000 7fd1daffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T23:25:49.244 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.218+0000 7fd1daffd640 10 monclient: _finish_command 1 = system:0 2026-02-22T23:25:49.298 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.298+0000 7fd1fc355640 1 -- 10.20.193.45:0/1895048224 --> v1:10.20.193.73:6800/2222410180 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd1f40a5770 con 0x7fd1c4040210 2026-02-22T23:25:49.299 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.299+0000 7fd1daffd640 1 -- 10.20.193.45:0/1895048224 <== mgr.4111 v1:10.20.193.73:6800/2222410180 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+34176 (unknown 2965378022 0 401395) 0x7fd1f40a5770 con 0x7fd1c4040210 2026-02-22T23:25:49.300 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-22T23:25:49.301 INFO:teuthology.orchestra.run.trial045.stderr:dumped all 2026-02-22T23:25:49.301 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.300+0000 7fd1fc355640 1 -- 10.20.193.45:0/1895048224 >> v1:10.20.193.73:6800/2222410180 conn(0x7fd1c4040210 legacy=0x7fd1c40426d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:49.301 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.300+0000 7fd1fc355640 10 monclient: shutdown 2026-02-22T23:25:49.301 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.300+0000 7fd1fc355640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T23:25:49.301 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.300+0000 7fd1fc355640 1 -- 10.20.193.45:0/1895048224 >> v1:10.20.193.45:6791/0 conn(0x7fd1f40a68f0 legacy=0x7fd1f41d44f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:49.302 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.300+0000 7fd1fc355640 1 -- 10.20.193.45:0/1895048224 shutdown_connections 2026-02-22T23:25:49.302 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.300+0000 7fd1fc355640 1 -- 10.20.193.45:0/1895048224 >> 10.20.193.45:0/1895048224 conn(0x7fd1f40abb50 msgr2=0x7fd1f4142510 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:25:49.302 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.300+0000 7fd1fc355640 1 -- 10.20.193.45:0/1895048224 shutdown_connections 2026-02-22T23:25:49.302 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.300+0000 7fd1fc355640 1 -- 10.20.193.45:0/1895048224 wait complete. 2026-02-22T23:25:49.308 INFO:teuthology.orchestra.run.trial045.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2026-02-22T23:25:49.196812+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":147,"num_write_kb":2674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":115,"ondisk_log_size":115,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":17,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":162876,"kb_used_data":1080,"kb_used_omap":9,"kb_used_meta":161654,"kb_avail":566068164,"statfs":{"total":579820584960,"available":579653799936,"internally_reserved":0,"allocated":1105920,"data_stored":1364270,"data_compressed":22320,"data_compressed_allocated":81920,"data_compressed_original":1024000,"omap_allocated":9561,"internal_metadata":165534375},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.468924"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":19,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-22T23:25:44.735205+0000","last_change":"2026-02-22T23:25:44.735205+0000","last_active":"2026-02-22T23:25:44.735205+0000","last_peered":"2026-02-22T23:25:44.735205+0000","last_clean":"2026-02-22T23:25:44.735205+0000","last_became_active":"2026-02-22T23:25:42.732237+0000","last_became_peered":"2026-02-22T23:25:42.732237+0000","last_unstale":"2026-02-22T23:25:44.735205+0000","last_undegraded":"2026-02-22T23:25:44.735205+0000","last_fullsized":"2026-02-22T23:25:44.735205+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:25:41.723660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:25:41.723660+0000","last_clean_scrub_stamp":"2026-02-22T23:25:41.723660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:02:39.156862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000197314,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":19,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-22T23:25:44.734485+0000","last_change":"2026-02-22T23:25:44.734485+0000","last_active":"2026-02-22T23:25:44.734485+0000","last_peered":"2026-02-22T23:25:44.734485+0000","last_clean":"2026-02-22T23:25:44.734485+0000","last_became_active":"2026-02-22T23:25:42.731608+0000","last_became_peered":"2026-02-22T23:25:42.731608+0000","last_unstale":"2026-02-22T23:25:44.734485+0000","last_undegraded":"2026-02-22T23:25:44.734485+0000","last_fullsized":"2026-02-22T23:25:44.734485+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:25:41.723660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:25:41.723660+0000","last_clean_scrub_stamp":"2026-02-22T23:25:41.723660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:38:27.110138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044396600000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-22T23:25:44.735342+0000","last_change":"2026-02-22T23:25:44.735342+0000","last_active":"2026-02-22T23:25:44.735342+0000","last_peered":"2026-02-22T23:25:44.735342+0000","last_clean":"2026-02-22T23:25:44.735342+0000","last_became_active":"2026-02-22T23:25:42.732947+0000","last_became_peered":"2026-02-22T23:25:42.732947+0000","last_unstale":"2026-02-22T23:25:44.735342+0000","last_undegraded":"2026-02-22T23:25:44.735342+0000","last_fullsized":"2026-02-22T23:25:44.735342+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:25:41.723660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:25:41.723660+0000","last_clean_scrub_stamp":"2026-02-22T23:25:41.723660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T02:33:36.757781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00031882900000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-22T23:25:44.771461+0000","last_change":"2026-02-22T23:25:44.771461+0000","last_active":"2026-02-22T23:25:44.771461+0000","last_peered":"2026-02-22T23:25:44.771461+0000","last_clean":"2026-02-22T23:25:44.771461+0000","last_became_active":"2026-02-22T23:25:42.729582+0000","last_became_peered":"2026-02-22T23:25:42.729582+0000","last_unstale":"2026-02-22T23:25:44.771461+0000","last_undegraded":"2026-02-22T23:25:44.771461+0000","last_fullsized":"2026-02-22T23:25:44.771461+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:25:41.723660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:25:41.723660+0000","last_clean_scrub_stamp":"2026-02-22T23:25:41.723660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T06:30:33.437324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00022341099999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"19'2","reported_seq":21,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-22T23:25:44.736525+0000","last_change":"2026-02-22T23:25:44.735543+0000","last_active":"2026-02-22T23:25:44.736525+0000","last_peered":"2026-02-22T23:25:44.736525+0000","last_clean":"2026-02-22T23:25:44.736525+0000","last_became_active":"2026-02-22T23:25:42.733018+0000","last_became_peered":"2026-02-22T23:25:42.733018+0000","last_unstale":"2026-02-22T23:25:44.736525+0000","last_undegraded":"2026-02-22T23:25:44.736525+0000","last_fullsized":"2026-02-22T23:25:44.736525+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:25:41.723660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:25:41.723660+0000","last_clean_scrub_stamp":"2026-02-22T23:25:41.723660+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T04:28:19.249844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044642500000000002,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":19,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-22T23:25:44.733849+0000","last_change":"2026-02-22T23:25:44.734019+0000","last_active":"2026-02-22T23:25:44.733849+0000","last_peered":"2026-02-22T23:25:44.733849+0000","last_clean":"2026-02-22T23:25:44.733849+0000","last_became_active":"2026-02-22T23:25:42.729332+0000","last_became_peered":"2026-02-22T23:25:42.729332+0000","last_unstale":"2026-02-22T23:25:44.733849+0000","last_undegraded":"2026-02-22T23:25:44.733849+0000","last_fullsized":"2026-02-22T23:25:44.733849+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:25:41.723660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:25:41.723660+0000","last_clean_scrub_stamp":"2026-02-22T23:25:41.723660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T05:15:12.260477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00028113600000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-22T23:25:44.735208+0000","last_change":"2026-02-22T23:25:44.735208+0000","last_active":"2026-02-22T23:25:44.735208+0000","last_peered":"2026-02-22T23:25:44.735208+0000","last_clean":"2026-02-22T23:25:44.735208+0000","last_became_active":"2026-02-22T23:25:42.732106+0000","last_became_peered":"2026-02-22T23:25:42.732106+0000","last_unstale":"2026-02-22T23:25:44.735208+0000","last_undegraded":"2026-02-22T23:25:44.735208+0000","last_fullsized":"2026-02-22T23:25:44.735208+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:25:41.723660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:25:41.723660+0000","last_clean_scrub_stamp":"2026-02-22T23:25:41.723660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:35:08.328395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000186295,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"17'1","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-22T23:25:44.735244+0000","last_change":"2026-02-22T23:25:44.735244+0000","last_active":"2026-02-22T23:25:44.735244+0000","last_peered":"2026-02-22T23:25:44.735244+0000","last_clean":"2026-02-22T23:25:44.735244+0000","last_became_active":"2026-02-22T23:25:42.732702+0000","last_became_peered":"2026-02-22T23:25:42.732702+0000","last_unstale":"2026-02-22T23:25:44.735244+0000","last_undegraded":"2026-02-22T23:25:44.735244+0000","last_fullsized":"2026-02-22T23:25:44.735244+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:25:41.723660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:25:41.723660+0000","last_clean_scrub_stamp":"2026-02-22T23:25:41.723660+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T01:00:00.519442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00023975299999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"14'112","reported_seq":156,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-22T23:25:44.734952+0000","last_change":"2026-02-22T23:25:36.890023+0000","last_active":"2026-02-22T23:25:44.734952+0000","last_peered":"2026-02-22T23:25:44.734952+0000","last_clean":"2026-02-22T23:25:44.734952+0000","last_became_active":"2026-02-22T23:25:36.889147+0000","last_became_peered":"2026-02-22T23:25:36.889147+0000","last_unstale":"2026-02-22T23:25:44.734952+0000","last_undegraded":"2026-02-22T23:25:44.734952+0000","last_fullsized":"2026-02-22T23:25:44.734952+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:25:35.704171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:25:35.704171+0000","last_clean_scrub_stamp":"2026-02-22T23:25:35.704171+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T02:46:45.050923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":1057856,"data_compressed":22320,"data_compressed_allocated":81920,"data_compressed_original":1024000,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":12,"seq":51539607557,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27180,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344660,"statfs":{"total":96636764160,"available":96608931840,"internally_reserved":0,"allocated":217088,"data_stored":576554,"data_compressed":11160,"data_compressed_allocated":40960,"data_compressed_original":512000,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":12,"seq":51539607556,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27132,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344708,"statfs":{"total":96636764160,"available":96608980992,"internally_reserved":0,"allocated":167936,"data_stored":51769,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":12,"seq":51539607556,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27124,"kb_used_data":160,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344716,"statfs":{"total":96636764160,"available":96608989184,"internally_reserved":0,"allocated":163840,"data_stored":51750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":12,"seq":51539607556,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27184,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344656,"statfs":{"total":96636764160,"available":96608927744,"internally_reserved":0,"allocated":225280,"data_stored":580678,"data_compressed":11160,"data_compressed_allocated":40960,"data_compressed_original":512000,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":12,"seq":51539607556,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27128,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344712,"statfs":{"total":96636764160,"available":96608985088,"internally_reserved":0,"allocated":167936,"data_stored":51769,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":11,"seq":47244640261,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27128,"kb_used_data":160,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344712,"statfs":{"total":96636764160,"available":96608985088,"internally_reserved":0,"allocated":163840,"data_stored":51750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27589065},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":528928,"data_compressed":11160,"data_compressed_allocated":40960,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":528928,"data_compressed":11160,"data_compressed_allocated":40960,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-22T23:25:49.309 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-22T23:25:49.377 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.377+0000 7f8df6a43640 10 monclient: get_monmap_and_config 2026-02-22T23:25:49.377 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.377+0000 7f8df6a43640 10 monclient: build_initial_monmap 2026-02-22T23:25:49.377 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.377+0000 7f8df6a43640 10 monclient: monmap: 2026-02-22T23:25:49.377 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-22T23:25:49.377 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:49.378 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:25:49.377570+0000 2026-02-22T23:25:49.378 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:25:49.377570+0000 2026-02-22T23:25:49.378 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-22T23:25:49.378 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:49.378 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-22T23:25:49.378 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.noname-f 2026-02-22T23:25:49.378 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.noname-b 2026-02-22T23:25:49.378 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.noname-g 2026-02-22T23:25:49.378 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.noname-c 2026-02-22T23:25:49.378 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.noname-h 2026-02-22T23:25:49.378 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.noname-d 2026-02-22T23:25:49.378 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.noname-i 2026-02-22T23:25:49.379 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.noname-e 2026-02-22T23:25:49.379 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:49.387 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.377+0000 7f8df6a43640 1 Processor -- start 2026-02-22T23:25:49.387 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.377+0000 7f8df6a43640 1 -- start start 2026-02-22T23:25:49.387 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.377+0000 7f8df6a43640 10 monclient: init 2026-02-22T23:25:49.387 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.378+0000 7f8df6a43640 10 monclient: _reopen_session rank -1 2026-02-22T23:25:49.387 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.378+0000 7f8df6a43640 10 monclient: _add_conns ranks=[5,7,2,6,0,3,4,1,8] 2026-02-22T23:25:49.387 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.378+0000 7f8df6a43640 10 monclient(hunting): picked mon.noname-h con 0x7f8df00a5d90 addr v1:10.20.193.73:6791/0 2026-02-22T23:25:49.388 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.378+0000 7f8df6a43640 10 monclient(hunting): picked mon.noname-i con 0x7f8df00a6880 addr v1:10.20.193.73:6792/0 2026-02-22T23:25:49.388 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.378+0000 7f8df6a43640 10 monclient(hunting): picked mon.noname-b con 0x7f8df00a3d30 addr v1:10.20.193.45:6790/0 2026-02-22T23:25:49.388 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.378+0000 7f8df6a43640 1 -- --> v1:10.20.193.45:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8df00a7200 con 0x7f8df00a3d30 2026-02-22T23:25:49.388 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.378+0000 7f8df6a43640 1 -- --> v1:10.20.193.73:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8df00a8c90 con 0x7f8df00a5d90 2026-02-22T23:25:49.388 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.378+0000 7f8df6a43640 1 -- --> v1:10.20.193.73:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8df00a6ef0 con 0x7f8df00a6880 2026-02-22T23:25:49.388 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.378+0000 7f8df6a43640 10 monclient(hunting): _renew_subs 2026-02-22T23:25:49.388 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.378+0000 7f8df6a43640 10 monclient(hunting): authenticate will time out at 680.994165s 2026-02-22T23:25:49.388 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.378+0000 7f8df4fb9640 1 --1- >> v1:10.20.193.45:6790/0 conn(0x7f8df00a3d30 0x7f8df0141740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.45:6790/0 says I am v1:10.20.193.45:51096/0 (socket says 10.20.193.45:51096) 2026-02-22T23:25:49.388 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.378+0000 7f8df4fb9640 1 -- 10.20.193.45:0/3279310867 learned_addr learned my addr 10.20.193.45:0/3279310867 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-22T23:25:49.388 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.378+0000 7f8deeffd640 1 -- 10.20.193.45:0/3279310867 <== mon.2 v1:10.20.193.45:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 828855032 0 0) 0x7f8df00a7200 con 0x7f8df00a3d30 2026-02-22T23:25:49.388 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.378+0000 7f8deeffd640 10 monclient(hunting): _negotiate 2026-02-22T23:25:49.388 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.378+0000 7f8deeffd640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:49.389 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.378+0000 7f8deeffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:49.389 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.378+0000 7f8deeffd640 10 monclient(hunting): my global_id is 4484 2026-02-22T23:25:49.389 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.378+0000 7f8deeffd640 1 -- 10.20.193.45:0/3279310867 --> v1:10.20.193.45:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8dd4003620 con 0x7f8df00a3d30 2026-02-22T23:25:49.389 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.378+0000 7f8deeffd640 1 -- 10.20.193.45:0/3279310867 <== mon.7 v1:10.20.193.73:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3927104610 0 0) 0x7f8df00a6ef0 con 0x7f8df00a6880 2026-02-22T23:25:49.389 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.378+0000 7f8deeffd640 10 monclient(hunting): _negotiate 2026-02-22T23:25:49.389 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.378+0000 7f8deeffd640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:49.389 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.378+0000 7f8deeffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:49.389 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.378+0000 7f8deeffd640 10 monclient(hunting): my global_id is 4354 2026-02-22T23:25:49.389 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.378+0000 7f8deeffd640 1 -- 10.20.193.45:0/3279310867 --> v1:10.20.193.73:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8df00a7200 con 0x7f8df00a6880 2026-02-22T23:25:49.389 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.378+0000 7f8deeffd640 1 -- 10.20.193.45:0/3279310867 <== mon.2 v1:10.20.193.45:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 867408224 0 0) 0x7f8dd4003620 con 0x7f8df00a3d30 2026-02-22T23:25:49.389 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.378+0000 7f8deeffd640 1 -- 10.20.193.45:0/3279310867 >> v1:10.20.193.73:6792/0 conn(0x7f8df00a6880 legacy=0x7f8df013e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:49.389 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.378+0000 7f8deeffd640 1 -- 10.20.193.45:0/3279310867 >> v1:10.20.193.73:6791/0 conn(0x7f8df00a5d90 legacy=0x7f8df00a6170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:49.389 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.378+0000 7f8deeffd640 10 monclient: _finish_hunting 0 2026-02-22T23:25:49.390 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.378+0000 7f8deeffd640 1 monclient: found mon.noname-b 2026-02-22T23:25:49.390 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.378+0000 7f8deeffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T23:25:49.390 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.378+0000 7f8deeffd640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.45:6790/0 2026-02-22T23:25:49.390 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.378+0000 7f8deeffd640 1 -- 10.20.193.45:0/3279310867 --> v1:10.20.193.45:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8df00a2c20 con 0x7f8df00a3d30 2026-02-22T23:25:49.390 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.378+0000 7f8deeffd640 10 monclient: _finish_auth 0 2026-02-22T23:25:49.390 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.378+0000 7f8deeffd640 10 monclient: _check_auth_tickets 2026-02-22T23:25:49.390 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.378+0000 7f8deeffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T23:25:49.390 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.378+0000 7f8df6a43640 5 monclient: authenticate success, global_id 4484 2026-02-22T23:25:49.390 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.378+0000 7f8deeffd640 1 -- 10.20.193.45:0/3279310867 <== mon.2 v1:10.20.193.45:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f8de40033c0 con 0x7f8df00a3d30 2026-02-22T23:25:49.390 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.378+0000 7f8df6a43640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-22T23:25:49.390 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.378+0000 7f8deeffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:25:49.390 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.378+0000 7f8deeffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-22T23:25:49.391 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.378+0000 7f8deeffd640 10 monclient: dump: 2026-02-22T23:25:49.391 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:49.391 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:49.391 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:49.391 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:49.391 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:49.391 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:49.391 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:49.391 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:49.391 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:49.391 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:49.391 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:49.392 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:49.392 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:49.392 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:49.392 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:49.392 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:49.392 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.378+0000 7f8df6a43640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-22T23:25:49.392 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.378+0000 7f8deeffd640 1 -- 10.20.193.45:0/3279310867 <== mon.2 v1:10.20.193.45:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f8de40035e0 con 0x7f8df00a3d30 2026-02-22T23:25:49.392 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.378+0000 7f8deeffd640 10 monclient: handle_config config(0 keys) 2026-02-22T23:25:49.392 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.378+0000 7f8deeffd640 1 -- 10.20.193.45:0/3279310867 <== mon.2 v1:10.20.193.45:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f8de4005060 con 0x7f8df00a3d30 2026-02-22T23:25:49.392 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.378+0000 7f8df6a43640 10 monclient: get_monmap_and_config success 2026-02-22T23:25:49.392 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.378+0000 7f8deeffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:25:49.392 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.378+0000 7f8df6a43640 4 set_mon_vals no callback set 2026-02-22T23:25:49.392 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.378+0000 7f8deeffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-22T23:25:49.393 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.378+0000 7f8deeffd640 10 monclient: dump: 2026-02-22T23:25:49.393 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:49.393 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:49.393 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:49.393 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:49.393 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:49.393 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:49.393 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:49.393 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:49.393 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:49.393 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:49.393 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:49.393 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:49.394 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:49.394 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:49.394 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:49.394 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:49.394 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.378+0000 7f8df6a43640 10 monclient: shutdown 2026-02-22T23:25:49.394 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.378+0000 7f8df6a43640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T23:25:49.394 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.378+0000 7f8df6a43640 1 -- 10.20.193.45:0/3279310867 >> v1:10.20.193.45:6790/0 conn(0x7f8df00a3d30 legacy=0x7f8df0141740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:49.394 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.378+0000 7f8df6a43640 1 -- 10.20.193.45:0/3279310867 shutdown_connections 2026-02-22T23:25:49.394 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.378+0000 7f8df6a43640 1 -- 10.20.193.45:0/3279310867 >> 10.20.193.45:0/3279310867 conn(0x7f8df00ab9c0 msgr2=0x7f8df00a7e90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:25:49.394 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.379+0000 7f8df6a43640 1 -- 10.20.193.45:0/3279310867 shutdown_connections 2026-02-22T23:25:49.394 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.379+0000 7f8df6a43640 1 -- 10.20.193.45:0/3279310867 wait complete. 2026-02-22T23:25:49.394 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.379+0000 7f8df6a43640 10 monclient: build_initial_monmap 2026-02-22T23:25:49.395 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.379+0000 7f8df6a43640 10 monclient: monmap: 2026-02-22T23:25:49.395 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-22T23:25:49.395 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T23:25:49.395 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-22T23:25:49.395 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-22T23:25:49.395 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-22T23:25:49.395 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-22T23:25:49.395 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-22T23:25:49.395 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.noname-f 2026-02-22T23:25:49.395 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.noname-b 2026-02-22T23:25:49.395 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.noname-g 2026-02-22T23:25:49.395 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.noname-c 2026-02-22T23:25:49.396 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.noname-h 2026-02-22T23:25:49.396 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.noname-d 2026-02-22T23:25:49.396 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.noname-i 2026-02-22T23:25:49.396 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.noname-e 2026-02-22T23:25:49.396 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:49.396 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.379+0000 7f8df6a43640 1 Processor -- start 2026-02-22T23:25:49.396 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.379+0000 7f8df6a43640 1 -- start start 2026-02-22T23:25:49.396 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.379+0000 7f8df6a43640 10 monclient: init 2026-02-22T23:25:49.396 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.379+0000 7f8df6a43640 10 monclient: _reopen_session rank -1 2026-02-22T23:25:49.396 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.379+0000 7f8df6a43640 10 monclient: _add_conns ranks=[2,4,0,6,8,5,3,1,7] 2026-02-22T23:25:49.396 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.379+0000 7f8df6a43640 10 monclient(hunting): picked mon.noname-b con 0x7f8df00a3d30 addr v1:10.20.193.45:6790/0 2026-02-22T23:25:49.396 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.379+0000 7f8df6a43640 10 monclient(hunting): picked mon.noname-c con 0x7f8df00a5d90 addr v1:10.20.193.45:6791/0 2026-02-22T23:25:49.396 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.379+0000 7f8df6a43640 10 monclient(hunting): picked mon.noname-a con 0x7f8df00a6880 addr v1:10.20.193.45:6789/0 2026-02-22T23:25:49.397 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.379+0000 7f8df6a43640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8df00a1c70 con 0x7f8df00a6880 2026-02-22T23:25:49.397 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.379+0000 7f8df6a43640 1 -- --> v1:10.20.193.45:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8df0126690 con 0x7f8df00a3d30 2026-02-22T23:25:49.397 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.379+0000 7f8df6a43640 1 -- --> v1:10.20.193.45:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8df0129170 con 0x7f8df00a5d90 2026-02-22T23:25:49.397 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.379+0000 7f8df6a43640 10 monclient(hunting): _renew_subs 2026-02-22T23:25:49.397 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.379+0000 7f8df6a43640 10 monclient(hunting): authenticate will time out at 680.995817s 2026-02-22T23:25:49.397 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.379+0000 7f8deffff640 1 --1- >> v1:10.20.193.45:6790/0 conn(0x7f8df00a3d30 0x7f8df0141810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.45:6790/0 says I am v1:10.20.193.45:51098/0 (socket says 10.20.193.45:51098) 2026-02-22T23:25:49.397 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.379+0000 7f8deffff640 1 -- 10.20.193.45:0/2494862781 learned_addr learned my addr 10.20.193.45:0/2494862781 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-22T23:25:49.397 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.379+0000 7f8decff9640 1 -- 10.20.193.45:0/2494862781 <== mon.2 v1:10.20.193.45:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4156870216 0 0) 0x7f8df0126690 con 0x7f8df00a3d30 2026-02-22T23:25:49.397 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.379+0000 7f8decff9640 10 monclient(hunting): _negotiate 2026-02-22T23:25:49.397 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.379+0000 7f8decff9640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:49.397 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.379+0000 7f8decff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:49.397 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.379+0000 7f8decff9640 10 monclient(hunting): my global_id is 4493 2026-02-22T23:25:49.398 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.379+0000 7f8decff9640 1 -- 10.20.193.45:0/2494862781 --> v1:10.20.193.45:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8dc0003620 con 0x7f8df00a3d30 2026-02-22T23:25:49.398 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.380+0000 7f8decff9640 1 -- 10.20.193.45:0/2494862781 <== mon.4 v1:10.20.193.45:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3215494731 0 0) 0x7f8df0129170 con 0x7f8df00a5d90 2026-02-22T23:25:49.398 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.380+0000 7f8decff9640 10 monclient(hunting): _negotiate 2026-02-22T23:25:49.398 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.380+0000 7f8decff9640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:49.398 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.380+0000 7f8decff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:49.398 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.380+0000 7f8decff9640 10 monclient(hunting): my global_id is 4432 2026-02-22T23:25:49.398 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.380+0000 7f8decff9640 1 -- 10.20.193.45:0/2494862781 --> v1:10.20.193.45:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8df0126690 con 0x7f8df00a5d90 2026-02-22T23:25:49.398 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.380+0000 7f8decff9640 1 -- 10.20.193.45:0/2494862781 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2674222386 0 0) 0x7f8df00a2c20 con 0x7f8df00a6880 2026-02-22T23:25:49.398 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.380+0000 7f8decff9640 10 monclient(hunting): _negotiate 2026-02-22T23:25:49.398 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.380+0000 7f8decff9640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:49.398 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.380+0000 7f8decff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:49.398 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.380+0000 7f8decff9640 10 monclient(hunting): my global_id is 4392 2026-02-22T23:25:49.398 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.380+0000 7f8decff9640 1 -- 10.20.193.45:0/2494862781 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8df0129170 con 0x7f8df00a6880 2026-02-22T23:25:49.399 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.380+0000 7f8decff9640 1 -- 10.20.193.45:0/2494862781 <== mon.2 v1:10.20.193.45:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3649129254 0 0) 0x7f8dc0003620 con 0x7f8df00a3d30 2026-02-22T23:25:49.399 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.380+0000 7f8decff9640 1 -- 10.20.193.45:0/2494862781 --> v1:10.20.193.45:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f8df00a2c20 con 0x7f8df00a3d30 2026-02-22T23:25:49.399 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.380+0000 7f8decff9640 1 -- 10.20.193.45:0/2494862781 <== mon.2 v1:10.20.193.45:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f8ddc003380 con 0x7f8df00a3d30 2026-02-22T23:25:49.399 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.380+0000 7f8decff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-22T23:25:49.399 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.380+0000 7f8decff9640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-22T23:25:49.399 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.380+0000 7f8decff9640 10 monclient(hunting): dump: 2026-02-22T23:25:49.399 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:49.399 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:49.399 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:49.399 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:49.399 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:49.399 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:49.399 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:49.400 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:49.400 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:49.400 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:49.400 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:49.400 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:49.400 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:49.400 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:49.400 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:49.400 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:49.400 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.380+0000 7f8decff9640 10 monclient(hunting): _finish_auth 0 2026-02-22T23:25:49.400 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.380+0000 7f8decff9640 1 -- 10.20.193.45:0/2494862781 <== mon.4 v1:10.20.193.45:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 129670462 0 0) 0x7f8df0126690 con 0x7f8df00a5d90 2026-02-22T23:25:49.400 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.380+0000 7f8decff9640 1 -- 10.20.193.45:0/2494862781 --> v1:10.20.193.45:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f8dc0003620 con 0x7f8df00a5d90 2026-02-22T23:25:49.400 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.380+0000 7f8decff9640 1 -- 10.20.193.45:0/2494862781 <== mon.4 v1:10.20.193.45:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f8de00031c0 con 0x7f8df00a5d90 2026-02-22T23:25:49.401 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.380+0000 7f8decff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-22T23:25:49.401 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.380+0000 7f8decff9640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-22T23:25:49.401 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.380+0000 7f8decff9640 10 monclient(hunting): dump: 2026-02-22T23:25:49.401 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:49.401 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:49.401 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:49.401 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:49.401 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:49.401 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:49.401 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:49.401 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:49.401 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:49.401 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:49.402 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:49.402 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:49.402 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:49.402 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:49.402 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:49.402 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:49.402 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.380+0000 7f8decff9640 1 -- 10.20.193.45:0/2494862781 <== mon.2 v1:10.20.193.45:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3149593456 0 0) 0x7f8df00a2c20 con 0x7f8df00a3d30 2026-02-22T23:25:49.402 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.380+0000 7f8decff9640 1 -- 10.20.193.45:0/2494862781 >> v1:10.20.193.45:6791/0 conn(0x7f8df00a5d90 legacy=0x7f8df01d4660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:49.402 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.380+0000 7f8decff9640 1 -- 10.20.193.45:0/2494862781 >> v1:10.20.193.45:6789/0 conn(0x7f8df00a6880 legacy=0x7f8df01d7d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:49.402 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.380+0000 7f8decff9640 10 monclient: _finish_hunting 0 2026-02-22T23:25:49.402 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.380+0000 7f8decff9640 1 monclient: found mon.b 2026-02-22T23:25:49.402 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.380+0000 7f8decff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T23:25:49.403 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.380+0000 7f8decff9640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.45:6790/0 2026-02-22T23:25:49.403 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.380+0000 7f8decff9640 1 -- 10.20.193.45:0/2494862781 --> v1:10.20.193.45:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8df0141f20 con 0x7f8df00a3d30 2026-02-22T23:25:49.403 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.380+0000 7f8decff9640 10 monclient: _finish_auth 0 2026-02-22T23:25:49.403 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.380+0000 7f8decff9640 10 monclient: _check_auth_tickets 2026-02-22T23:25:49.403 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.380+0000 7f8decff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T23:25:49.403 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.380+0000 7f8df6a43640 5 monclient: authenticate success, global_id 4493 2026-02-22T23:25:49.403 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.380+0000 7f8df6a43640 10 monclient: _renew_subs 2026-02-22T23:25:49.403 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.380+0000 7f8df6a43640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.45:6790/0 2026-02-22T23:25:49.403 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.380+0000 7f8df6a43640 1 -- 10.20.193.45:0/2494862781 --> v1:10.20.193.45:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f8df0126e80 con 0x7f8df00a3d30 2026-02-22T23:25:49.403 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.380+0000 7f8df6a43640 10 monclient: _renew_subs 2026-02-22T23:25:49.403 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.380+0000 7f8decff9640 1 -- 10.20.193.45:0/2494862781 <== mon.2 v1:10.20.193.45:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f8ddc0039c0 con 0x7f8df00a3d30 2026-02-22T23:25:49.403 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.380+0000 7f8df6a43640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.45:6790/0 2026-02-22T23:25:49.404 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.380+0000 7f8df6a43640 1 -- 10.20.193.45:0/2494862781 --> v1:10.20.193.45:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f8df0127d20 con 0x7f8df00a3d30 2026-02-22T23:25:49.404 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.380+0000 7f8decff9640 10 monclient: handle_config config(0 keys) 2026-02-22T23:25:49.404 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.380+0000 7f8decff9640 1 -- 10.20.193.45:0/2494862781 <== mon.2 v1:10.20.193.45:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f8ddc003f30 con 0x7f8df00a3d30 2026-02-22T23:25:49.404 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.380+0000 7f8decff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:25:49.404 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.380+0000 7f8decff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-22T23:25:49.404 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.380+0000 7f8decff9640 10 monclient: dump: 2026-02-22T23:25:49.404 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:49.404 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:49.404 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:49.404 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:49.404 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:49.404 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:49.404 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:49.405 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:49.405 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:49.405 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:49.405 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:49.405 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:49.405 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:49.405 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:49.405 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:49.405 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:49.405 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.380+0000 7f8dee7fc640 4 set_mon_vals no callback set 2026-02-22T23:25:49.405 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.380+0000 7f8decff9640 1 -- 10.20.193.45:0/2494862781 <== mon.2 v1:10.20.193.45:6790/0 7 ==== mgrmap(e 5) ==== 50225+0+0 (unknown 2330357642 0 0) 0x7f8ddc0040d0 con 0x7f8df00a3d30 2026-02-22T23:25:49.405 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.380+0000 7f8df6a43640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T23:25:49.405 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.380+0000 7f8df6a43640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T23:25:49.406 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.380+0000 7f8df6a43640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.45:6790/0 2026-02-22T23:25:49.406 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.380+0000 7f8df6a43640 1 -- 10.20.193.45:0/2494862781 --> v1:10.20.193.45:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8df00008d0 con 0x7f8df00a3d30 2026-02-22T23:25:49.406 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.380+0000 7f8decff9640 1 -- 10.20.193.45:0/2494862781 <== mon.2 v1:10.20.193.45:6790/0 8 ==== osd_map(19..19 src has 1..19) ==== 3558+0+0 (unknown 1288710973 0 0) 0x7f8ddc04dbd0 con 0x7f8df00a3d30 2026-02-22T23:25:49.406 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.381+0000 7f8def7fe640 10 monclient: get_auth_request con 0x7f8dc003fff0 auth_method 0 2026-02-22T23:25:49.406 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.383+0000 7f8decff9640 1 -- 10.20.193.45:0/2494862781 <== mon.2 v1:10.20.193.45:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (unknown 1092875540 0 2568732696) 0x7f8ddc0177f0 con 0x7f8df00a3d30 2026-02-22T23:25:49.406 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.383+0000 7f8decff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T23:25:49.406 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.383+0000 7f8decff9640 10 monclient: _finish_command 1 = system:0 2026-02-22T23:25:49.465 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.465+0000 7f8df6a43640 1 -- 10.20.193.45:0/2494862781 --> v1:10.20.193.73:6800/2222410180 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f8df0128b10 con 0x7f8dc003fff0 2026-02-22T23:25:49.466 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.466+0000 7f8decff9640 1 -- 10.20.193.45:0/2494862781 <== mgr.4111 v1:10.20.193.73:6800/2222410180 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+34176 (unknown 2965378022 0 401395) 0x7f8de00078c0 con 0x7f8dc003fff0 2026-02-22T23:25:49.466 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-22T23:25:49.467 INFO:teuthology.orchestra.run.trial045.stderr:dumped all 2026-02-22T23:25:49.468 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.467+0000 7f8df6a43640 1 -- 10.20.193.45:0/2494862781 >> v1:10.20.193.73:6800/2222410180 conn(0x7f8dc003fff0 legacy=0x7f8dc00424b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:49.468 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.467+0000 7f8df6a43640 10 monclient: shutdown 2026-02-22T23:25:49.468 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.467+0000 7f8df6a43640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T23:25:49.468 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.467+0000 7f8df6a43640 1 -- 10.20.193.45:0/2494862781 >> v1:10.20.193.45:6790/0 conn(0x7f8df00a3d30 legacy=0x7f8df0141810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:49.468 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.467+0000 7f8df6a43640 1 -- 10.20.193.45:0/2494862781 shutdown_connections 2026-02-22T23:25:49.468 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.467+0000 7f8df6a43640 1 -- 10.20.193.45:0/2494862781 >> 10.20.193.45:0/2494862781 conn(0x7f8df00ab9c0 msgr2=0x7f8df0142480 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:25:49.468 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.467+0000 7f8df6a43640 1 -- 10.20.193.45:0/2494862781 shutdown_connections 2026-02-22T23:25:49.468 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.467+0000 7f8df6a43640 1 -- 10.20.193.45:0/2494862781 wait complete. 2026-02-22T23:25:49.475 INFO:teuthology.orchestra.run.trial045.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2026-02-22T23:25:49.196812+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":147,"num_write_kb":2674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":115,"ondisk_log_size":115,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":17,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":162876,"kb_used_data":1080,"kb_used_omap":9,"kb_used_meta":161654,"kb_avail":566068164,"statfs":{"total":579820584960,"available":579653799936,"internally_reserved":0,"allocated":1105920,"data_stored":1364270,"data_compressed":22320,"data_compressed_allocated":81920,"data_compressed_original":1024000,"omap_allocated":9561,"internal_metadata":165534375},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.468924"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":19,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-22T23:25:44.735205+0000","last_change":"2026-02-22T23:25:44.735205+0000","last_active":"2026-02-22T23:25:44.735205+0000","last_peered":"2026-02-22T23:25:44.735205+0000","last_clean":"2026-02-22T23:25:44.735205+0000","last_became_active":"2026-02-22T23:25:42.732237+0000","last_became_peered":"2026-02-22T23:25:42.732237+0000","last_unstale":"2026-02-22T23:25:44.735205+0000","last_undegraded":"2026-02-22T23:25:44.735205+0000","last_fullsized":"2026-02-22T23:25:44.735205+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:25:41.723660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:25:41.723660+0000","last_clean_scrub_stamp":"2026-02-22T23:25:41.723660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:02:39.156862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000197314,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":19,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-22T23:25:44.734485+0000","last_change":"2026-02-22T23:25:44.734485+0000","last_active":"2026-02-22T23:25:44.734485+0000","last_peered":"2026-02-22T23:25:44.734485+0000","last_clean":"2026-02-22T23:25:44.734485+0000","last_became_active":"2026-02-22T23:25:42.731608+0000","last_became_peered":"2026-02-22T23:25:42.731608+0000","last_unstale":"2026-02-22T23:25:44.734485+0000","last_undegraded":"2026-02-22T23:25:44.734485+0000","last_fullsized":"2026-02-22T23:25:44.734485+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:25:41.723660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:25:41.723660+0000","last_clean_scrub_stamp":"2026-02-22T23:25:41.723660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:38:27.110138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044396600000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-22T23:25:44.735342+0000","last_change":"2026-02-22T23:25:44.735342+0000","last_active":"2026-02-22T23:25:44.735342+0000","last_peered":"2026-02-22T23:25:44.735342+0000","last_clean":"2026-02-22T23:25:44.735342+0000","last_became_active":"2026-02-22T23:25:42.732947+0000","last_became_peered":"2026-02-22T23:25:42.732947+0000","last_unstale":"2026-02-22T23:25:44.735342+0000","last_undegraded":"2026-02-22T23:25:44.735342+0000","last_fullsized":"2026-02-22T23:25:44.735342+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:25:41.723660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:25:41.723660+0000","last_clean_scrub_stamp":"2026-02-22T23:25:41.723660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T02:33:36.757781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00031882900000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-22T23:25:44.771461+0000","last_change":"2026-02-22T23:25:44.771461+0000","last_active":"2026-02-22T23:25:44.771461+0000","last_peered":"2026-02-22T23:25:44.771461+0000","last_clean":"2026-02-22T23:25:44.771461+0000","last_became_active":"2026-02-22T23:25:42.729582+0000","last_became_peered":"2026-02-22T23:25:42.729582+0000","last_unstale":"2026-02-22T23:25:44.771461+0000","last_undegraded":"2026-02-22T23:25:44.771461+0000","last_fullsized":"2026-02-22T23:25:44.771461+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:25:41.723660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:25:41.723660+0000","last_clean_scrub_stamp":"2026-02-22T23:25:41.723660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T06:30:33.437324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00022341099999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"19'2","reported_seq":21,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-22T23:25:44.736525+0000","last_change":"2026-02-22T23:25:44.735543+0000","last_active":"2026-02-22T23:25:44.736525+0000","last_peered":"2026-02-22T23:25:44.736525+0000","last_clean":"2026-02-22T23:25:44.736525+0000","last_became_active":"2026-02-22T23:25:42.733018+0000","last_became_peered":"2026-02-22T23:25:42.733018+0000","last_unstale":"2026-02-22T23:25:44.736525+0000","last_undegraded":"2026-02-22T23:25:44.736525+0000","last_fullsized":"2026-02-22T23:25:44.736525+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:25:41.723660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:25:41.723660+0000","last_clean_scrub_stamp":"2026-02-22T23:25:41.723660+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T04:28:19.249844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044642500000000002,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":19,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-22T23:25:44.733849+0000","last_change":"2026-02-22T23:25:44.734019+0000","last_active":"2026-02-22T23:25:44.733849+0000","last_peered":"2026-02-22T23:25:44.733849+0000","last_clean":"2026-02-22T23:25:44.733849+0000","last_became_active":"2026-02-22T23:25:42.729332+0000","last_became_peered":"2026-02-22T23:25:42.729332+0000","last_unstale":"2026-02-22T23:25:44.733849+0000","last_undegraded":"2026-02-22T23:25:44.733849+0000","last_fullsized":"2026-02-22T23:25:44.733849+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:25:41.723660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:25:41.723660+0000","last_clean_scrub_stamp":"2026-02-22T23:25:41.723660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T05:15:12.260477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00028113600000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-22T23:25:44.735208+0000","last_change":"2026-02-22T23:25:44.735208+0000","last_active":"2026-02-22T23:25:44.735208+0000","last_peered":"2026-02-22T23:25:44.735208+0000","last_clean":"2026-02-22T23:25:44.735208+0000","last_became_active":"2026-02-22T23:25:42.732106+0000","last_became_peered":"2026-02-22T23:25:42.732106+0000","last_unstale":"2026-02-22T23:25:44.735208+0000","last_undegraded":"2026-02-22T23:25:44.735208+0000","last_fullsized":"2026-02-22T23:25:44.735208+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:25:41.723660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:25:41.723660+0000","last_clean_scrub_stamp":"2026-02-22T23:25:41.723660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:35:08.328395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000186295,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"17'1","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-22T23:25:44.735244+0000","last_change":"2026-02-22T23:25:44.735244+0000","last_active":"2026-02-22T23:25:44.735244+0000","last_peered":"2026-02-22T23:25:44.735244+0000","last_clean":"2026-02-22T23:25:44.735244+0000","last_became_active":"2026-02-22T23:25:42.732702+0000","last_became_peered":"2026-02-22T23:25:42.732702+0000","last_unstale":"2026-02-22T23:25:44.735244+0000","last_undegraded":"2026-02-22T23:25:44.735244+0000","last_fullsized":"2026-02-22T23:25:44.735244+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:25:41.723660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:25:41.723660+0000","last_clean_scrub_stamp":"2026-02-22T23:25:41.723660+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T01:00:00.519442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00023975299999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"14'112","reported_seq":156,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-22T23:25:44.734952+0000","last_change":"2026-02-22T23:25:36.890023+0000","last_active":"2026-02-22T23:25:44.734952+0000","last_peered":"2026-02-22T23:25:44.734952+0000","last_clean":"2026-02-22T23:25:44.734952+0000","last_became_active":"2026-02-22T23:25:36.889147+0000","last_became_peered":"2026-02-22T23:25:36.889147+0000","last_unstale":"2026-02-22T23:25:44.734952+0000","last_undegraded":"2026-02-22T23:25:44.734952+0000","last_fullsized":"2026-02-22T23:25:44.734952+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:25:35.704171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:25:35.704171+0000","last_clean_scrub_stamp":"2026-02-22T23:25:35.704171+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T02:46:45.050923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":1057856,"data_compressed":22320,"data_compressed_allocated":81920,"data_compressed_original":1024000,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":12,"seq":51539607557,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27180,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344660,"statfs":{"total":96636764160,"available":96608931840,"internally_reserved":0,"allocated":217088,"data_stored":576554,"data_compressed":11160,"data_compressed_allocated":40960,"data_compressed_original":512000,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":12,"seq":51539607556,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27132,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344708,"statfs":{"total":96636764160,"available":96608980992,"internally_reserved":0,"allocated":167936,"data_stored":51769,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":12,"seq":51539607556,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27124,"kb_used_data":160,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344716,"statfs":{"total":96636764160,"available":96608989184,"internally_reserved":0,"allocated":163840,"data_stored":51750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":12,"seq":51539607556,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27184,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344656,"statfs":{"total":96636764160,"available":96608927744,"internally_reserved":0,"allocated":225280,"data_stored":580678,"data_compressed":11160,"data_compressed_allocated":40960,"data_compressed_original":512000,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":12,"seq":51539607556,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27128,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344712,"statfs":{"total":96636764160,"available":96608985088,"internally_reserved":0,"allocated":167936,"data_stored":51769,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":11,"seq":47244640261,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27128,"kb_used_data":160,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344712,"statfs":{"total":96636764160,"available":96608985088,"internally_reserved":0,"allocated":163840,"data_stored":51750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27589065},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":528928,"data_compressed":11160,"data_compressed_allocated":40960,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":528928,"data_compressed":11160,"data_compressed_allocated":40960,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-22T23:25:49.476 INFO:tasks.mon_thrash.ceph_manager:clean! 2026-02-22T23:25:49.477 DEBUG:tasks.mon_thrash:Yielding 2026-02-22T23:25:49.477 INFO:teuthology.run_tasks:Running task exec... 2026-02-22T23:25:49.495 INFO:teuthology.task.exec:Executing custom commands... 2026-02-22T23:25:49.496 INFO:teuthology.task.exec:Running commands on role client.0 host ubuntu@trial073.front.sepia.ceph.com 2026-02-22T23:25:49.496 DEBUG:teuthology.orchestra.run.trial073:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph_test_rados_delete_pools_parallel --debug_objecter 20 --debug_ms 1 --debug_rados 20 --debug_monc 20' 2026-02-22T23:25:49.496 INFO:tasks.mon_thrash.mon_thrasher:start thrashing 2026-02-22T23:25:49.497 INFO:tasks.mon_thrash.mon_thrasher:seed: 1771802749, revive delay: 90.0, thrash delay: 1.0 thrash many: False, maintain quorum: True store thrash: False, probability: 50 freeze mon: prob 10.0 duration 15.0 2026-02-22T23:25:49.497 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 9 2026-02-22T23:25:49.497 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-22T23:25:49.565 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.565+0000 7fef74ac4640 10 monclient: get_monmap_and_config 2026-02-22T23:25:49.566 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.565+0000 7fef74ac4640 10 monclient: build_initial_monmap 2026-02-22T23:25:49.566 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.565+0000 7fef74ac4640 10 monclient: monmap: 2026-02-22T23:25:49.566 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-22T23:25:49.566 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:49.566 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:25:49.565942+0000 2026-02-22T23:25:49.566 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:25:49.565942+0000 2026-02-22T23:25:49.566 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-22T23:25:49.566 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:49.566 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-22T23:25:49.567 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.noname-f 2026-02-22T23:25:49.567 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.noname-b 2026-02-22T23:25:49.567 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.noname-g 2026-02-22T23:25:49.567 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.noname-c 2026-02-22T23:25:49.567 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.noname-h 2026-02-22T23:25:49.567 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.noname-d 2026-02-22T23:25:49.567 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.noname-i 2026-02-22T23:25:49.567 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.noname-e 2026-02-22T23:25:49.567 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:49.575 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.566+0000 7fef74ac4640 1 Processor -- start 2026-02-22T23:25:49.575 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.566+0000 7fef74ac4640 1 -- start start 2026-02-22T23:25:49.575 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.566+0000 7fef74ac4640 10 monclient: init 2026-02-22T23:25:49.575 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.566+0000 7fef74ac4640 10 monclient: _reopen_session rank -1 2026-02-22T23:25:49.575 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.566+0000 7fef74ac4640 10 monclient: _add_conns ranks=[4,1,8,2,3,5,6,7,0] 2026-02-22T23:25:49.575 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.566+0000 7fef74ac4640 10 monclient(hunting): picked mon.noname-c con 0x7fef700a5e00 addr v1:10.20.193.45:6791/0 2026-02-22T23:25:49.575 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.566+0000 7fef74ac4640 10 monclient(hunting): picked mon.noname-f con 0x7fef700a68f0 addr v1:10.20.193.73:6789/0 2026-02-22T23:25:49.576 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.566+0000 7fef74ac4640 10 monclient(hunting): picked mon.noname-e con 0x7fef700a6d00 addr v1:10.20.193.45:6793/0 2026-02-22T23:25:49.576 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.566+0000 7fef74ac4640 1 -- --> v1:10.20.193.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fef700a2d00 con 0x7fef700a68f0 2026-02-22T23:25:49.576 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.566+0000 7fef74ac4640 1 -- --> v1:10.20.193.45:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fef700a2fe0 con 0x7fef700a5e00 2026-02-22T23:25:49.576 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.566+0000 7fef74ac4640 1 -- --> v1:10.20.193.45:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fef700a32c0 con 0x7fef700a6d00 2026-02-22T23:25:49.576 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.566+0000 7fef74ac4640 10 monclient(hunting): _renew_subs 2026-02-22T23:25:49.576 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.566+0000 7fef74ac4640 10 monclient(hunting): authenticate will time out at 681.182650s 2026-02-22T23:25:49.576 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.566+0000 7fef6e575640 1 --1- >> v1:10.20.193.45:6791/0 conn(0x7fef700a5e00 0x7fef700a61e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.45:6791/0 says I am v1:10.20.193.45:38038/0 (socket says 10.20.193.45:38038) 2026-02-22T23:25:49.576 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.566+0000 7fef6e575640 1 -- 10.20.193.45:0/2263137713 learned_addr learned my addr 10.20.193.45:0/2263137713 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-22T23:25:49.576 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.566+0000 7fef6d573640 1 -- 10.20.193.45:0/2263137713 <== mon.8 v1:10.20.193.45:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3287747262 0 0) 0x7fef700a32c0 con 0x7fef700a6d00 2026-02-22T23:25:49.576 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.566+0000 7fef6d573640 10 monclient(hunting): _negotiate 2026-02-22T23:25:49.576 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.566+0000 7fef6d573640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:49.577 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.566+0000 7fef6d573640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:49.577 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.566+0000 7fef6d573640 10 monclient(hunting): my global_id is 4472 2026-02-22T23:25:49.577 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.566+0000 7fef6d573640 1 -- 10.20.193.45:0/2263137713 --> v1:10.20.193.45:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fef5c003620 con 0x7fef700a6d00 2026-02-22T23:25:49.577 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.566+0000 7fef6d573640 1 -- 10.20.193.45:0/2263137713 <== mon.4 v1:10.20.193.45:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1518884594 0 0) 0x7fef700a2fe0 con 0x7fef700a5e00 2026-02-22T23:25:49.577 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.566+0000 7fef6d573640 10 monclient(hunting): _negotiate 2026-02-22T23:25:49.577 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.566+0000 7fef6d573640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:49.577 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.566+0000 7fef6d573640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:49.577 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.566+0000 7fef6d573640 10 monclient(hunting): my global_id is 4450 2026-02-22T23:25:49.577 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.566+0000 7fef6d573640 1 -- 10.20.193.45:0/2263137713 --> v1:10.20.193.45:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fef700a32c0 con 0x7fef700a5e00 2026-02-22T23:25:49.577 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.567+0000 7fef6d573640 1 -- 10.20.193.45:0/2263137713 <== mon.8 v1:10.20.193.45:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1826281839 0 0) 0x7fef5c003620 con 0x7fef700a6d00 2026-02-22T23:25:49.577 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.567+0000 7fef6d573640 1 -- 10.20.193.45:0/2263137713 >> v1:10.20.193.45:6791/0 conn(0x7fef700a5e00 legacy=0x7fef700a61e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:49.577 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.567+0000 7fef6d573640 1 -- 10.20.193.45:0/2263137713 >> v1:10.20.193.73:6789/0 conn(0x7fef700a68f0 legacy=0x7fef7013e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T23:25:49.578 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.567+0000 7fef6d573640 10 monclient: _finish_hunting 0 2026-02-22T23:25:49.578 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.567+0000 7fef6d573640 1 monclient: found mon.noname-e 2026-02-22T23:25:49.578 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.567+0000 7fef6d573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T23:25:49.578 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.567+0000 7fef6d573640 10 monclient: _send_mon_message to mon.noname-e at v1:10.20.193.45:6793/0 2026-02-22T23:25:49.578 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.567+0000 7fef6d573640 1 -- 10.20.193.45:0/2263137713 --> v1:10.20.193.45:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef700a35a0 con 0x7fef700a6d00 2026-02-22T23:25:49.578 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.567+0000 7fef6d573640 10 monclient: _finish_auth 0 2026-02-22T23:25:49.578 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.567+0000 7fef6d573640 10 monclient: _check_auth_tickets 2026-02-22T23:25:49.578 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.567+0000 7fef6d573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T23:25:49.578 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.567+0000 7fef6d573640 1 -- 10.20.193.45:0/2263137713 <== mon.8 v1:10.20.193.45:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7fef600033c0 con 0x7fef700a6d00 2026-02-22T23:25:49.578 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.567+0000 7fef74ac4640 5 monclient: authenticate success, global_id 4472 2026-02-22T23:25:49.578 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.567+0000 7fef74ac4640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-22T23:25:49.578 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.567+0000 7fef6d573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:25:49.579 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.567+0000 7fef6d573640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2026-02-22T23:25:49.579 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.567+0000 7fef6d573640 10 monclient: dump: 2026-02-22T23:25:49.579 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:49.579 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:49.579 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:49.579 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:49.579 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:49.579 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:49.579 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:49.579 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:49.579 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:49.579 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:49.579 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:49.580 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:49.580 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:49.580 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:49.580 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:49.580 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:49.580 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.567+0000 7fef74ac4640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-22T23:25:49.580 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.567+0000 7fef6d573640 1 -- 10.20.193.45:0/2263137713 <== mon.8 v1:10.20.193.45:6793/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fef600035e0 con 0x7fef700a6d00 2026-02-22T23:25:49.580 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.567+0000 7fef6d573640 10 monclient: handle_config config(0 keys) 2026-02-22T23:25:49.580 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.567+0000 7fef6d573640 1 -- 10.20.193.45:0/2263137713 <== mon.8 v1:10.20.193.45:6793/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7fef60003dd0 con 0x7fef700a6d00 2026-02-22T23:25:49.580 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.567+0000 7fef74ac4640 10 monclient: get_monmap_and_config success 2026-02-22T23:25:49.580 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.567+0000 7fef74ac4640 4 set_mon_vals no callback set 2026-02-22T23:25:49.580 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.567+0000 7fef6d573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:25:49.581 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.567+0000 7fef6d573640 10 monclient: got monmap 1 from mon.e (according to old e1) 2026-02-22T23:25:49.581 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.567+0000 7fef6d573640 10 monclient: dump: 2026-02-22T23:25:49.581 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:49.581 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:49.581 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:49.581 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:49.581 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:49.581 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:49.581 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:49.581 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:49.581 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:49.581 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:49.582 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:49.582 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:49.582 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:49.582 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:49.582 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:49.582 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:49.582 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.567+0000 7fef74ac4640 10 monclient: shutdown 2026-02-22T23:25:49.582 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.567+0000 7fef74ac4640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T23:25:49.582 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.567+0000 7fef74ac4640 1 -- 10.20.193.45:0/2263137713 >> v1:10.20.193.45:6793/0 conn(0x7fef700a6d00 legacy=0x7fef701417b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:49.582 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.567+0000 7fef74ac4640 1 -- 10.20.193.45:0/2263137713 shutdown_connections 2026-02-22T23:25:49.582 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.567+0000 7fef74ac4640 1 -- 10.20.193.45:0/2263137713 >> 10.20.193.45:0/2263137713 conn(0x7fef700abb50 msgr2=0x7fef700a7f00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:25:49.582 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.567+0000 7fef74ac4640 1 -- 10.20.193.45:0/2263137713 shutdown_connections 2026-02-22T23:25:49.583 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.567+0000 7fef74ac4640 1 -- 10.20.193.45:0/2263137713 wait complete. 2026-02-22T23:25:49.583 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.567+0000 7fef74ac4640 10 monclient: build_initial_monmap 2026-02-22T23:25:49.583 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.567+0000 7fef74ac4640 10 monclient: monmap: 2026-02-22T23:25:49.583 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-22T23:25:49.583 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T23:25:49.583 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-22T23:25:49.583 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-22T23:25:49.583 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-22T23:25:49.583 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-22T23:25:49.583 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-22T23:25:49.583 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.noname-f 2026-02-22T23:25:49.583 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.noname-b 2026-02-22T23:25:49.584 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.noname-g 2026-02-22T23:25:49.584 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.noname-c 2026-02-22T23:25:49.584 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.noname-h 2026-02-22T23:25:49.584 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.noname-d 2026-02-22T23:25:49.584 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.noname-i 2026-02-22T23:25:49.584 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.noname-e 2026-02-22T23:25:49.584 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:49.584 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.567+0000 7fef74ac4640 1 Processor -- start 2026-02-22T23:25:49.584 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.567+0000 7fef74ac4640 1 -- start start 2026-02-22T23:25:49.584 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.567+0000 7fef74ac4640 10 monclient: init 2026-02-22T23:25:49.584 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.568+0000 7fef74ac4640 10 monclient: _reopen_session rank -1 2026-02-22T23:25:49.584 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.568+0000 7fef74ac4640 10 monclient: _add_conns ranks=[7,4,5,1,8,3,6,0,2] 2026-02-22T23:25:49.584 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.568+0000 7fef74ac4640 10 monclient(hunting): picked mon.noname-i con 0x7fef700a5e00 addr v1:10.20.193.73:6792/0 2026-02-22T23:25:49.585 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.568+0000 7fef74ac4640 10 monclient(hunting): picked mon.noname-c con 0x7fef700a68f0 addr v1:10.20.193.45:6791/0 2026-02-22T23:25:49.585 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.568+0000 7fef74ac4640 10 monclient(hunting): picked mon.noname-h con 0x7fef700a6d00 addr v1:10.20.193.73:6791/0 2026-02-22T23:25:49.585 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.568+0000 7fef74ac4640 1 -- --> v1:10.20.193.45:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fef70128eb0 con 0x7fef700a68f0 2026-02-22T23:25:49.585 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.568+0000 7fef74ac4640 1 -- --> v1:10.20.193.73:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fef700aa0d0 con 0x7fef700a6d00 2026-02-22T23:25:49.585 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.568+0000 7fef74ac4640 1 -- --> v1:10.20.193.73:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fef700a9ba0 con 0x7fef700a5e00 2026-02-22T23:25:49.585 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.568+0000 7fef74ac4640 10 monclient(hunting): _renew_subs 2026-02-22T23:25:49.585 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.568+0000 7fef74ac4640 10 monclient(hunting): authenticate will time out at 681.184195s 2026-02-22T23:25:49.585 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.568+0000 7fef6dd74640 1 --1- >> v1:10.20.193.45:6791/0 conn(0x7fef700a68f0 0x7fef701258e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.45:6791/0 says I am v1:10.20.193.45:38040/0 (socket says 10.20.193.45:38040) 2026-02-22T23:25:49.585 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.568+0000 7fef6dd74640 1 -- 10.20.193.45:0/3521879578 learned_addr learned my addr 10.20.193.45:0/3521879578 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-22T23:25:49.585 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.568+0000 7fef56ffd640 1 -- 10.20.193.45:0/3521879578 <== mon.4 v1:10.20.193.45:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1863089047 0 0) 0x7fef70128eb0 con 0x7fef700a68f0 2026-02-22T23:25:49.586 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.568+0000 7fef56ffd640 10 monclient(hunting): _negotiate 2026-02-22T23:25:49.586 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.568+0000 7fef56ffd640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:49.586 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.568+0000 7fef56ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:49.586 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.568+0000 7fef56ffd640 10 monclient(hunting): my global_id is 4459 2026-02-22T23:25:49.586 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.568+0000 7fef56ffd640 1 -- 10.20.193.45:0/3521879578 --> v1:10.20.193.45:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fef3c003620 con 0x7fef700a68f0 2026-02-22T23:25:49.586 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.568+0000 7fef56ffd640 1 -- 10.20.193.45:0/3521879578 <== mon.4 v1:10.20.193.45:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 292463480 0 0) 0x7fef3c003620 con 0x7fef700a68f0 2026-02-22T23:25:49.586 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.568+0000 7fef56ffd640 1 -- 10.20.193.45:0/3521879578 --> v1:10.20.193.45:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fef70128eb0 con 0x7fef700a68f0 2026-02-22T23:25:49.586 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.568+0000 7fef56ffd640 1 -- 10.20.193.45:0/3521879578 <== mon.4 v1:10.20.193.45:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7fef58004320 con 0x7fef700a68f0 2026-02-22T23:25:49.586 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.568+0000 7fef56ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-22T23:25:49.586 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.568+0000 7fef56ffd640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-22T23:25:49.586 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.568+0000 7fef56ffd640 10 monclient(hunting): dump: 2026-02-22T23:25:49.586 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:49.587 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:49.587 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:49.587 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:49.587 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:49.587 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:49.587 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:49.587 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:49.587 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:49.587 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:49.587 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:49.587 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:49.587 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:49.588 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:49.588 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:49.588 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:49.588 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.568+0000 7fef56ffd640 10 monclient(hunting): _finish_auth 0 2026-02-22T23:25:49.588 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.568+0000 7fef56ffd640 1 -- 10.20.193.45:0/3521879578 <== mon.4 v1:10.20.193.45:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 862910775 0 0) 0x7fef70128eb0 con 0x7fef700a68f0 2026-02-22T23:25:49.588 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.568+0000 7fef56ffd640 1 -- 10.20.193.45:0/3521879578 >> v1:10.20.193.73:6792/0 conn(0x7fef700a5e00 legacy=0x7fef701251d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:49.588 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.568+0000 7fef56ffd640 1 -- 10.20.193.45:0/3521879578 >> v1:10.20.193.73:6791/0 conn(0x7fef700a6d00 legacy=0x7fef701d7d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:49.588 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.568+0000 7fef56ffd640 10 monclient: _finish_hunting 0 2026-02-22T23:25:49.588 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.568+0000 7fef56ffd640 1 monclient: found mon.c 2026-02-22T23:25:49.588 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.568+0000 7fef56ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T23:25:49.588 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.568+0000 7fef56ffd640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.45:6791/0 2026-02-22T23:25:49.589 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.568+0000 7fef56ffd640 1 -- 10.20.193.45:0/3521879578 --> v1:10.20.193.45:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef70127750 con 0x7fef700a68f0 2026-02-22T23:25:49.589 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.568+0000 7fef56ffd640 10 monclient: _finish_auth 0 2026-02-22T23:25:49.589 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.568+0000 7fef56ffd640 10 monclient: _check_auth_tickets 2026-02-22T23:25:49.589 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.568+0000 7fef56ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T23:25:49.589 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.568+0000 7fef74ac4640 5 monclient: authenticate success, global_id 4459 2026-02-22T23:25:49.589 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.568+0000 7fef74ac4640 10 monclient: _renew_subs 2026-02-22T23:25:49.589 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.568+0000 7fef74ac4640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.45:6791/0 2026-02-22T23:25:49.589 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.568+0000 7fef74ac4640 1 -- 10.20.193.45:0/3521879578 --> v1:10.20.193.45:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fef70125ff0 con 0x7fef700a68f0 2026-02-22T23:25:49.589 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.568+0000 7fef74ac4640 10 monclient: _renew_subs 2026-02-22T23:25:49.589 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.568+0000 7fef74ac4640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.45:6791/0 2026-02-22T23:25:49.589 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.568+0000 7fef74ac4640 1 -- 10.20.193.45:0/3521879578 --> v1:10.20.193.45:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7fef70141af0 con 0x7fef700a68f0 2026-02-22T23:25:49.589 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.568+0000 7fef56ffd640 1 -- 10.20.193.45:0/3521879578 <== mon.4 v1:10.20.193.45:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fef58002990 con 0x7fef700a68f0 2026-02-22T23:25:49.589 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.568+0000 7fef56ffd640 10 monclient: handle_config config(0 keys) 2026-02-22T23:25:49.590 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.568+0000 7fef56ffd640 1 -- 10.20.193.45:0/3521879578 <== mon.4 v1:10.20.193.45:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7fef58002f40 con 0x7fef700a68f0 2026-02-22T23:25:49.590 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.568+0000 7fef56ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:25:49.590 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.568+0000 7fef56ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T23:25:49.590 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.568+0000 7fef6cd72640 4 set_mon_vals no callback set 2026-02-22T23:25:49.590 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.568+0000 7fef56ffd640 10 monclient: dump: 2026-02-22T23:25:49.590 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:49.590 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:49.590 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:49.590 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:49.590 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:49.590 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:49.590 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:49.591 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:49.591 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:49.591 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:49.591 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:49.591 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:49.591 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:49.591 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:49.591 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:49.591 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:49.591 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.568+0000 7fef74ac4640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T23:25:49.591 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.568+0000 7fef74ac4640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T23:25:49.591 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.568+0000 7fef74ac4640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.45:6791/0 2026-02-22T23:25:49.591 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.568+0000 7fef74ac4640 1 -- 10.20.193.45:0/3521879578 --> v1:10.20.193.45:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef700a2fe0 con 0x7fef700a68f0 2026-02-22T23:25:49.592 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.569+0000 7fef56ffd640 1 -- 10.20.193.45:0/3521879578 <== mon.4 v1:10.20.193.45:6791/0 7 ==== mgrmap(e 5) ==== 50225+0+0 (unknown 2330357642 0 0) 0x7fef580030e0 con 0x7fef700a68f0 2026-02-22T23:25:49.592 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.569+0000 7fef56ffd640 1 -- 10.20.193.45:0/3521879578 <== mon.4 v1:10.20.193.45:6791/0 8 ==== osd_map(19..19 src has 1..19) ==== 3558+0+0 (unknown 1288710973 0 0) 0x7fef5804dd40 con 0x7fef700a68f0 2026-02-22T23:25:49.592 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.569+0000 7fef6e575640 10 monclient: get_auth_request con 0x7fef3c03f730 auth_method 0 2026-02-22T23:25:49.592 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.571+0000 7fef56ffd640 1 -- 10.20.193.45:0/3521879578 <== mon.4 v1:10.20.193.45:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (unknown 1092875540 0 2568732696) 0x7fef700a2fe0 con 0x7fef700a68f0 2026-02-22T23:25:49.592 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.571+0000 7fef56ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T23:25:49.592 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.571+0000 7fef56ffd640 10 monclient: _finish_command 1 = system:0 2026-02-22T23:25:49.685 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.684+0000 7fef74ac4640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-22T23:25:49.685 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.684+0000 7fef74ac4640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-22T23:25:49.685 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.684+0000 7fef74ac4640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.45:6791/0 2026-02-22T23:25:49.685 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.684+0000 7fef74ac4640 1 -- 10.20.193.45:0/3521879578 --> v1:10.20.193.45:6791/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fef70141e20 con 0x7fef700a68f0 2026-02-22T23:25:49.685 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.684+0000 7fef56ffd640 1 -- 10.20.193.45:0/3521879578 <== mon.4 v1:10.20.193.45:6791/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+2713 (unknown 254746657 0 2494469815) 0x7fef580178a0 con 0x7fef700a68f0 2026-02-22T23:25:49.685 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.684+0000 7fef56ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-22T23:25:49.686 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.684+0000 7fef56ffd640 10 monclient: _finish_command 2 = system:0 2026-02-22T23:25:49.686 INFO:teuthology.orchestra.run.trial045.stdout:{"election_epoch":8,"quorum":[0,1,2,3,4,5,6,7,8],"quorum_names":["a","f","b","g","c","h","d","i","e"],"quorum_leader_name":"a","quorum_age":24,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"4b60f18f-6660-4731-b731-dc85c4078413","modified":"2026-02-22T23:24:52.393472Z","created":"2026-02-22T23:24:52.393472Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":3,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.45:6789","nonce":0}]},"addr":"10.20.193.45:6789/0","public_addr":"10.20.193.45:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.73:6789","nonce":0}]},"addr":"10.20.193.73:6789/0","public_addr":"10.20.193.73:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.45:6790","nonce":0}]},"addr":"10.20.193.45:6790/0","public_addr":"10.20.193.45:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.73:6790","nonce":0}]},"addr":"10.20.193.73:6790/0","public_addr":"10.20.193.73:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.45:6791","nonce":0}]},"addr":"10.20.193.45:6791/0","public_addr":"10.20.193.45:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.73:6791","nonce":0}]},"addr":"10.20.193.73:6791/0","public_addr":"10.20.193.73:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.45:6792","nonce":0}]},"addr":"10.20.193.45:6792/0","public_addr":"10.20.193.45:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.73:6792","nonce":0}]},"addr":"10.20.193.73:6792/0","public_addr":"10.20.193.73:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.45:6793","nonce":0}]},"addr":"10.20.193.45:6793/0","public_addr":"10.20.193.45:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-22T23:25:49.687 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.685+0000 7fef74ac4640 1 -- 10.20.193.45:0/3521879578 >> v1:10.20.193.73:6800/2222410180 conn(0x7fef3c03f730 legacy=0x7fef3c041bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:49.687 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.685+0000 7fef74ac4640 10 monclient: shutdown 2026-02-22T23:25:49.687 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.685+0000 7fef74ac4640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T23:25:49.687 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.685+0000 7fef74ac4640 1 -- 10.20.193.45:0/3521879578 >> v1:10.20.193.45:6791/0 conn(0x7fef700a68f0 legacy=0x7fef701258e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:49.687 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.685+0000 7fef74ac4640 1 -- 10.20.193.45:0/3521879578 shutdown_connections 2026-02-22T23:25:49.687 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.685+0000 7fef74ac4640 1 -- 10.20.193.45:0/3521879578 >> 10.20.193.45:0/3521879578 conn(0x7fef700abb50 msgr2=0x7fef701422f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:25:49.688 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.685+0000 7fef74ac4640 1 -- 10.20.193.45:0/3521879578 shutdown_connections 2026-02-22T23:25:49.688 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.685+0000 7fef74ac4640 1 -- 10.20.193.45:0/3521879578 wait complete. 2026-02-22T23:25:49.693 INFO:tasks.mon_thrash.ceph_manager:quorum is size 9 2026-02-22T23:25:49.693 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2026-02-22T23:25:49.694 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon a 2026-02-22T23:25:49.694 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-22T23:25:49.762 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.762+0000 7f06083bc640 10 monclient: get_monmap_and_config 2026-02-22T23:25:49.763 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.762+0000 7f06083bc640 10 monclient: build_initial_monmap 2026-02-22T23:25:49.763 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.762+0000 7f06083bc640 10 monclient: monmap: 2026-02-22T23:25:49.763 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-22T23:25:49.763 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:49.763 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:25:49.763005+0000 2026-02-22T23:25:49.763 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:25:49.763005+0000 2026-02-22T23:25:49.763 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-22T23:25:49.763 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:49.763 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-22T23:25:49.764 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.noname-f 2026-02-22T23:25:49.764 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.noname-b 2026-02-22T23:25:49.764 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.noname-g 2026-02-22T23:25:49.764 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.noname-c 2026-02-22T23:25:49.764 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.noname-h 2026-02-22T23:25:49.764 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.noname-d 2026-02-22T23:25:49.764 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.noname-i 2026-02-22T23:25:49.764 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.noname-e 2026-02-22T23:25:49.764 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:49.775 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.763+0000 7f06083bc640 1 Processor -- start 2026-02-22T23:25:49.775 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.763+0000 7f06083bc640 1 -- start start 2026-02-22T23:25:49.775 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.763+0000 7f06083bc640 10 monclient: init 2026-02-22T23:25:49.775 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.763+0000 7f06083bc640 10 monclient: _reopen_session rank -1 2026-02-22T23:25:49.775 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.763+0000 7f06083bc640 10 monclient: _add_conns ranks=[3,1,4,8,0,7,2,5,6] 2026-02-22T23:25:49.775 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.763+0000 7f06083bc640 10 monclient(hunting): picked mon.noname-g con 0x7f06000a4610 addr v1:10.20.193.73:6790/0 2026-02-22T23:25:49.776 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.763+0000 7f06083bc640 10 monclient(hunting): picked mon.noname-f con 0x7f06000a5100 addr v1:10.20.193.73:6789/0 2026-02-22T23:25:49.776 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.763+0000 7f06083bc640 10 monclient(hunting): picked mon.noname-c con 0x7f06000a3f10 addr v1:10.20.193.45:6791/0 2026-02-22T23:25:49.776 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.763+0000 7f06083bc640 1 -- --> v1:10.20.193.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f060006f720 con 0x7f06000a5100 2026-02-22T23:25:49.776 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.763+0000 7f06083bc640 1 -- --> v1:10.20.193.73:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f06000a7250 con 0x7f06000a4610 2026-02-22T23:25:49.776 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.763+0000 7f06083bc640 1 -- --> v1:10.20.193.45:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f06000a2c90 con 0x7f06000a3f10 2026-02-22T23:25:49.776 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.763+0000 7f06083bc640 10 monclient(hunting): _renew_subs 2026-02-22T23:25:49.776 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.763+0000 7f06083bc640 10 monclient(hunting): authenticate will time out at 681.379863s 2026-02-22T23:25:49.776 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.763+0000 7f0606932640 1 --1- >> v1:10.20.193.45:6791/0 conn(0x7f06000a3f10 0x7f06001415a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.45:6791/0 says I am v1:10.20.193.45:38054/0 (socket says 10.20.193.45:38054) 2026-02-22T23:25:49.776 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.763+0000 7f0606932640 1 -- 10.20.193.45:0/3288314547 learned_addr learned my addr 10.20.193.45:0/3288314547 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-22T23:25:49.776 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.764+0000 7f060512f640 1 -- 10.20.193.45:0/3288314547 <== mon.4 v1:10.20.193.45:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4258840727 0 0) 0x7f06000a2c90 con 0x7f06000a3f10 2026-02-22T23:25:49.776 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.764+0000 7f060512f640 10 monclient(hunting): _negotiate 2026-02-22T23:25:49.776 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.764+0000 7f060512f640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:49.777 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.764+0000 7f060512f640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:49.777 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.764+0000 7f060512f640 10 monclient(hunting): my global_id is 4468 2026-02-22T23:25:49.777 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.764+0000 7f060512f640 1 -- 10.20.193.45:0/3288314547 --> v1:10.20.193.45:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f05e8003620 con 0x7f06000a3f10 2026-02-22T23:25:49.777 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.764+0000 7f060512f640 1 -- 10.20.193.45:0/3288314547 <== mon.3 v1:10.20.193.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 560557997 0 0) 0x7f06000a7250 con 0x7f06000a4610 2026-02-22T23:25:49.777 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.764+0000 7f060512f640 10 monclient(hunting): _negotiate 2026-02-22T23:25:49.777 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.764+0000 7f060512f640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:49.777 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.764+0000 7f060512f640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:49.777 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.764+0000 7f060512f640 10 monclient(hunting): my global_id is 4422 2026-02-22T23:25:49.777 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.764+0000 7f060512f640 1 -- 10.20.193.45:0/3288314547 --> v1:10.20.193.73:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f06000a2c90 con 0x7f06000a4610 2026-02-22T23:25:49.777 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.764+0000 7f060512f640 1 -- 10.20.193.45:0/3288314547 <== mon.4 v1:10.20.193.45:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 590569632 0 0) 0x7f05e8003620 con 0x7f06000a3f10 2026-02-22T23:25:49.777 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.764+0000 7f060512f640 1 -- 10.20.193.45:0/3288314547 >> v1:10.20.193.73:6790/0 conn(0x7f06000a4610 legacy=0x7f06000a49f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:49.777 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.764+0000 7f060512f640 1 -- 10.20.193.45:0/3288314547 >> v1:10.20.193.73:6789/0 conn(0x7f06000a5100 legacy=0x7f060013de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:49.778 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.764+0000 7f060512f640 10 monclient: _finish_hunting 0 2026-02-22T23:25:49.778 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.764+0000 7f060512f640 1 monclient: found mon.noname-c 2026-02-22T23:25:49.778 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.764+0000 7f060512f640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T23:25:49.778 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.764+0000 7f060512f640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.45:6791/0 2026-02-22T23:25:49.778 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.764+0000 7f060512f640 1 -- 10.20.193.45:0/3288314547 --> v1:10.20.193.45:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06000a3250 con 0x7f06000a3f10 2026-02-22T23:25:49.778 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.764+0000 7f060512f640 10 monclient: _finish_auth 0 2026-02-22T23:25:49.778 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.764+0000 7f060512f640 10 monclient: _check_auth_tickets 2026-02-22T23:25:49.778 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.764+0000 7f060512f640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T23:25:49.778 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.764+0000 7f060512f640 1 -- 10.20.193.45:0/3288314547 <== mon.4 v1:10.20.193.45:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f05fc0033c0 con 0x7f06000a3f10 2026-02-22T23:25:49.778 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.764+0000 7f060512f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:25:49.778 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.764+0000 7f060512f640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-22T23:25:49.778 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.764+0000 7f060512f640 10 monclient: dump: 2026-02-22T23:25:49.778 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:49.779 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:49.779 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:49.779 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:49.779 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:49.779 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:49.779 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:49.779 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:49.779 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:49.779 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:49.779 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:49.779 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:49.779 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:49.780 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:49.780 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:49.780 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:49.780 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.764+0000 7f06083bc640 5 monclient: authenticate success, global_id 4468 2026-02-22T23:25:49.780 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.764+0000 7f06083bc640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-22T23:25:49.780 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.764+0000 7f060512f640 1 -- 10.20.193.45:0/3288314547 <== mon.4 v1:10.20.193.45:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f05fc0035e0 con 0x7f06000a3f10 2026-02-22T23:25:49.780 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.764+0000 7f060512f640 10 monclient: handle_config config(0 keys) 2026-02-22T23:25:49.780 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.764+0000 7f06083bc640 10 monclient: get_monmap_and_config success 2026-02-22T23:25:49.780 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.764+0000 7f06083bc640 4 set_mon_vals no callback set 2026-02-22T23:25:49.780 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.764+0000 7f060512f640 1 -- 10.20.193.45:0/3288314547 <== mon.4 v1:10.20.193.45:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f05fc005060 con 0x7f06000a3f10 2026-02-22T23:25:49.780 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.764+0000 7f060512f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:25:49.780 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.764+0000 7f060512f640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T23:25:49.781 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.764+0000 7f060512f640 10 monclient: dump: 2026-02-22T23:25:49.781 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:49.781 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:49.781 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:49.781 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:49.781 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:49.781 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:49.781 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:49.781 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:49.781 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:49.781 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:49.781 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:49.781 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:49.782 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:49.782 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:49.782 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:49.782 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:49.782 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.764+0000 7f06083bc640 10 monclient: shutdown 2026-02-22T23:25:49.782 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.764+0000 7f06083bc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T23:25:49.782 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.764+0000 7f06083bc640 1 -- 10.20.193.45:0/3288314547 >> v1:10.20.193.45:6791/0 conn(0x7f06000a3f10 legacy=0x7f06001415a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:49.782 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.764+0000 7f06083bc640 1 -- 10.20.193.45:0/3288314547 shutdown_connections 2026-02-22T23:25:49.782 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.764+0000 7f06083bc640 1 -- 10.20.193.45:0/3288314547 >> 10.20.193.45:0/3288314547 conn(0x7f06000a7f70 msgr2=0x7f06000a8380 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:25:49.782 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.764+0000 7f06083bc640 1 -- 10.20.193.45:0/3288314547 shutdown_connections 2026-02-22T23:25:49.782 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.764+0000 7f06083bc640 1 -- 10.20.193.45:0/3288314547 wait complete. 2026-02-22T23:25:49.782 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.765+0000 7f06083bc640 10 monclient: build_initial_monmap 2026-02-22T23:25:49.782 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.765+0000 7f06083bc640 10 monclient: monmap: 2026-02-22T23:25:49.783 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-22T23:25:49.783 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T23:25:49.783 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-22T23:25:49.783 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-22T23:25:49.783 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-22T23:25:49.783 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-22T23:25:49.783 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-22T23:25:49.783 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.noname-f 2026-02-22T23:25:49.783 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.noname-b 2026-02-22T23:25:49.783 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.noname-g 2026-02-22T23:25:49.783 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.noname-c 2026-02-22T23:25:49.783 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.noname-h 2026-02-22T23:25:49.784 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.noname-d 2026-02-22T23:25:49.784 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.noname-i 2026-02-22T23:25:49.784 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.noname-e 2026-02-22T23:25:49.784 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:49.784 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.765+0000 7f06083bc640 1 Processor -- start 2026-02-22T23:25:49.784 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.765+0000 7f06083bc640 1 -- start start 2026-02-22T23:25:49.784 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.765+0000 7f06083bc640 10 monclient: init 2026-02-22T23:25:49.784 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.765+0000 7f06083bc640 10 monclient: _reopen_session rank -1 2026-02-22T23:25:49.784 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.765+0000 7f06083bc640 10 monclient: _add_conns ranks=[0,4,7,5,3,1,2,8,6] 2026-02-22T23:25:49.784 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.765+0000 7f06083bc640 10 monclient(hunting): picked mon.noname-a con 0x7f06000a3f10 addr v1:10.20.193.45:6789/0 2026-02-22T23:25:49.784 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.765+0000 7f06083bc640 10 monclient(hunting): picked mon.noname-c con 0x7f06000a4610 addr v1:10.20.193.45:6791/0 2026-02-22T23:25:49.785 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.765+0000 7f06083bc640 10 monclient(hunting): picked mon.noname-i con 0x7f06000a5100 addr v1:10.20.193.73:6792/0 2026-02-22T23:25:49.785 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.765+0000 7f06083bc640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0600142070 con 0x7f06000a3f10 2026-02-22T23:25:49.785 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.765+0000 7f06083bc640 1 -- --> v1:10.20.193.45:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f06000a16f0 con 0x7f06000a4610 2026-02-22T23:25:49.785 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.765+0000 7f06083bc640 1 -- --> v1:10.20.193.73:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f06000a85a0 con 0x7f06000a5100 2026-02-22T23:25:49.785 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.765+0000 7f06083bc640 10 monclient(hunting): _renew_subs 2026-02-22T23:25:49.785 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.765+0000 7f06083bc640 10 monclient(hunting): authenticate will time out at 681.381611s 2026-02-22T23:25:49.785 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.765+0000 7f0605930640 1 --1- >> v1:10.20.193.45:6791/0 conn(0x7f06000a4610 0x7f060013e810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.45:6791/0 says I am v1:10.20.193.45:38064/0 (socket says 10.20.193.45:38064) 2026-02-22T23:25:49.785 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.765+0000 7f0605930640 1 -- 10.20.193.45:0/447742859 learned_addr learned my addr 10.20.193.45:0/447742859 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-22T23:25:49.785 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.765+0000 7f0606131640 1 --1- 10.20.193.45:0/447742859 >> v1:10.20.193.45:6789/0 conn(0x7f06000a3f10 0x7f060013e100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.45:6789/0 says I am v1:10.20.193.45:58308/0 (socket says 10.20.193.45:58308) 2026-02-22T23:25:49.785 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.765+0000 7f05e6ffd640 1 -- 10.20.193.45:0/447742859 <== mon.4 v1:10.20.193.45:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 85860937 0 0) 0x7f06000a16f0 con 0x7f06000a4610 2026-02-22T23:25:49.785 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.765+0000 7f05e6ffd640 10 monclient(hunting): _negotiate 2026-02-22T23:25:49.785 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.765+0000 7f05e6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:49.785 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.765+0000 7f05e6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:49.786 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.765+0000 7f05e6ffd640 10 monclient(hunting): my global_id is 4477 2026-02-22T23:25:49.786 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.765+0000 7f05e6ffd640 1 -- 10.20.193.45:0/447742859 --> v1:10.20.193.45:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f05d0003620 con 0x7f06000a4610 2026-02-22T23:25:49.786 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.765+0000 7f05e6ffd640 1 -- 10.20.193.45:0/447742859 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3547457922 0 0) 0x7f0600142070 con 0x7f06000a3f10 2026-02-22T23:25:49.786 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.765+0000 7f05e6ffd640 10 monclient(hunting): _negotiate 2026-02-22T23:25:49.786 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.765+0000 7f05e6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:49.786 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.765+0000 7f05e6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:49.786 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.765+0000 7f05e6ffd640 10 monclient(hunting): my global_id is 4401 2026-02-22T23:25:49.786 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.765+0000 7f05e6ffd640 1 -- 10.20.193.45:0/447742859 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f06000a16f0 con 0x7f06000a3f10 2026-02-22T23:25:49.786 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.765+0000 7f05e6ffd640 1 -- 10.20.193.45:0/447742859 <== mon.4 v1:10.20.193.45:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 59553982 0 0) 0x7f05d0003620 con 0x7f06000a4610 2026-02-22T23:25:49.786 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.765+0000 7f05e6ffd640 1 -- 10.20.193.45:0/447742859 --> v1:10.20.193.45:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0600142070 con 0x7f06000a4610 2026-02-22T23:25:49.786 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.765+0000 7f05e6ffd640 1 -- 10.20.193.45:0/447742859 <== mon.4 v1:10.20.193.45:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f05f4003260 con 0x7f06000a4610 2026-02-22T23:25:49.786 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.765+0000 7f05e6ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-22T23:25:49.786 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.765+0000 7f05e6ffd640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-22T23:25:49.787 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.765+0000 7f05e6ffd640 10 monclient(hunting): dump: 2026-02-22T23:25:49.787 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:49.787 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:49.787 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:49.787 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:49.787 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:49.787 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:49.787 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:49.787 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:49.787 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:49.787 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:49.787 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:49.788 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:49.788 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:49.788 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:49.788 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:49.788 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:49.788 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.765+0000 7f05e6ffd640 10 monclient(hunting): _finish_auth 0 2026-02-22T23:25:49.788 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.765+0000 7f05e6ffd640 1 -- 10.20.193.45:0/447742859 <== mon.0 v1:10.20.193.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1788223893 0 0) 0x7f06000a16f0 con 0x7f06000a3f10 2026-02-22T23:25:49.788 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.765+0000 7f05e6ffd640 1 -- 10.20.193.45:0/447742859 --> v1:10.20.193.45:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f05d0003620 con 0x7f06000a3f10 2026-02-22T23:25:49.788 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.765+0000 7f05e6ffd640 1 -- 10.20.193.45:0/447742859 <== mon.7 v1:10.20.193.73:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2858415606 0 0) 0x7f06000a85a0 con 0x7f06000a5100 2026-02-22T23:25:49.788 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.765+0000 7f05e6ffd640 10 monclient(hunting): _negotiate 2026-02-22T23:25:49.788 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.765+0000 7f05e6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:49.788 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.765+0000 7f05e6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:49.789 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.765+0000 7f05e6ffd640 10 monclient(hunting): my global_id is 4372 2026-02-22T23:25:49.789 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.765+0000 7f05e6ffd640 1 -- 10.20.193.45:0/447742859 --> v1:10.20.193.73:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f06000a16f0 con 0x7f06000a5100 2026-02-22T23:25:49.789 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.765+0000 7f05e6ffd640 1 -- 10.20.193.45:0/447742859 <== mon.0 v1:10.20.193.45:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f05f00032e0 con 0x7f06000a3f10 2026-02-22T23:25:49.789 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.765+0000 7f05e6ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-22T23:25:49.789 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.766+0000 7f05e6ffd640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-22T23:25:49.789 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.766+0000 7f05e6ffd640 10 monclient(hunting): dump: 2026-02-22T23:25:49.789 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:49.789 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:49.789 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:49.789 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:49.789 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:49.789 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:49.789 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:49.790 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:49.790 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:49.790 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:49.790 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:49.790 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:49.790 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:49.790 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:49.790 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:49.790 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:49.790 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.766+0000 7f05e6ffd640 1 -- 10.20.193.45:0/447742859 <== mon.4 v1:10.20.193.45:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4979322 0 0) 0x7f0600142070 con 0x7f06000a4610 2026-02-22T23:25:49.790 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.766+0000 7f05e6ffd640 1 -- 10.20.193.45:0/447742859 >> v1:10.20.193.73:6792/0 conn(0x7f06000a5100 legacy=0x7f06001d7b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:49.790 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.766+0000 7f05e6ffd640 1 -- 10.20.193.45:0/447742859 >> v1:10.20.193.45:6789/0 conn(0x7f06000a3f10 legacy=0x7f060013e100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:49.790 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.766+0000 7f05e6ffd640 10 monclient: _finish_hunting 0 2026-02-22T23:25:49.791 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.766+0000 7f05e6ffd640 1 monclient: found mon.c 2026-02-22T23:25:49.791 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.766+0000 7f05e6ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T23:25:49.791 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.766+0000 7f05e6ffd640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.45:6791/0 2026-02-22T23:25:49.791 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.766+0000 7f05e6ffd640 1 -- 10.20.193.45:0/447742859 --> v1:10.20.193.45:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f060013ef20 con 0x7f06000a4610 2026-02-22T23:25:49.791 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.766+0000 7f05e6ffd640 10 monclient: _finish_auth 0 2026-02-22T23:25:49.791 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.766+0000 7f05e6ffd640 10 monclient: _check_auth_tickets 2026-02-22T23:25:49.791 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.766+0000 7f05e6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T23:25:49.791 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.766+0000 7f06083bc640 5 monclient: authenticate success, global_id 4477 2026-02-22T23:25:49.791 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.766+0000 7f06083bc640 10 monclient: _renew_subs 2026-02-22T23:25:49.791 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.766+0000 7f06083bc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.45:6791/0 2026-02-22T23:25:49.791 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.766+0000 7f06083bc640 1 -- 10.20.193.45:0/447742859 --> v1:10.20.193.45:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f0600141ab0 con 0x7f06000a4610 2026-02-22T23:25:49.791 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.766+0000 7f06083bc640 10 monclient: _renew_subs 2026-02-22T23:25:49.792 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.766+0000 7f06083bc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.45:6791/0 2026-02-22T23:25:49.792 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.766+0000 7f06083bc640 1 -- 10.20.193.45:0/447742859 --> v1:10.20.193.45:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7f0600140660 con 0x7f06000a4610 2026-02-22T23:25:49.792 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.766+0000 7f05e6ffd640 1 -- 10.20.193.45:0/447742859 <== mon.4 v1:10.20.193.45:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f05f40039c0 con 0x7f06000a4610 2026-02-22T23:25:49.792 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.766+0000 7f05e6ffd640 10 monclient: handle_config config(0 keys) 2026-02-22T23:25:49.792 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.766+0000 7f05e6ffd640 1 -- 10.20.193.45:0/447742859 <== mon.4 v1:10.20.193.45:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f05f4003fb0 con 0x7f06000a4610 2026-02-22T23:25:49.792 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.766+0000 7f05e6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:25:49.792 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.766+0000 7f060492e640 4 set_mon_vals no callback set 2026-02-22T23:25:49.792 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.766+0000 7f05e6ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T23:25:49.792 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.766+0000 7f05e6ffd640 10 monclient: dump: 2026-02-22T23:25:49.792 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:49.793 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:49.793 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:49.793 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:49.793 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:49.793 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:49.793 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:49.793 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:49.793 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:49.793 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:49.793 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:49.793 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:49.794 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:49.794 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:49.794 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:49.794 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:49.794 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.766+0000 7f06083bc640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T23:25:49.794 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.766+0000 7f06083bc640 1 -- 10.20.193.45:0/447742859 --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f06000008d0 con 0x7f060009de50 2026-02-22T23:25:49.794 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.766+0000 7f05e6ffd640 1 -- 10.20.193.45:0/447742859 <== mon.4 v1:10.20.193.45:6791/0 7 ==== mgrmap(e 5) ==== 50225+0+0 (unknown 2330357642 0 0) 0x7f05f4004150 con 0x7f06000a4610 2026-02-22T23:25:49.794 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.766+0000 7f05e6ffd640 1 -- 10.20.193.45:0/447742859 <== mon.4 v1:10.20.193.45:6791/0 8 ==== osd_map(20..20 src has 1..20) ==== 3921+0+0 (unknown 2486796672 0 0) 0x7f05f404dcd0 con 0x7f06000a4610 2026-02-22T23:25:49.794 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.766+0000 7f05e6ffd640 1 -- 10.20.193.45:0/447742859 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2820352464 0 0) 0x7f06000008d0 con 0x7f060009de50 2026-02-22T23:25:49.794 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.766+0000 7f05e6ffd640 10 monclient(hunting): _negotiate 2026-02-22T23:25:49.794 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.766+0000 7f05e6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:49.794 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.766+0000 7f05e6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:49.795 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.766+0000 7f05e6ffd640 10 monclient(hunting): my global_id is 4410 2026-02-22T23:25:49.795 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.766+0000 7f05e6ffd640 1 -- 10.20.193.45:0/447742859 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0600142070 con 0x7f060009de50 2026-02-22T23:25:49.795 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.766+0000 7f0606932640 10 monclient: get_auth_request con 0x7f05d0040020 auth_method 0 2026-02-22T23:25:49.795 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.766+0000 7f05e6ffd640 1 -- 10.20.193.45:0/447742859 <== mon.0 v1:10.20.193.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3887747399 0 0) 0x7f0600142070 con 0x7f060009de50 2026-02-22T23:25:49.795 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.766+0000 7f05e6ffd640 1 -- 10.20.193.45:0/447742859 --> v1:10.20.193.45:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f06000008d0 con 0x7f060009de50 2026-02-22T23:25:49.795 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.766+0000 7f05e6ffd640 1 -- 10.20.193.45:0/447742859 <== mon.0 v1:10.20.193.45:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f05f00034c0 con 0x7f060009de50 2026-02-22T23:25:49.795 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.766+0000 7f05e6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:25:49.795 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.766+0000 7f05e6ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T23:25:49.795 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.766+0000 7f05e6ffd640 10 monclient: dump: 2026-02-22T23:25:49.795 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:49.795 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:49.795 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:49.795 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:49.796 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:49.796 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:49.796 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:49.796 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:49.796 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:49.796 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:49.796 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:49.796 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:49.796 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:49.796 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:49.796 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:49.796 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:49.796 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.767+0000 7f05e6ffd640 1 -- 10.20.193.45:0/447742859 <== mon.0 v1:10.20.193.45:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 4125523313 0 0) 0x7f06000008d0 con 0x7f060009de50 2026-02-22T23:25:49.797 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.767+0000 7f05e6ffd640 1 -- 10.20.193.45:0/447742859 --> v1:10.20.193.45:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0600142ba0 con 0x7f060009de50 2026-02-22T23:25:49.797 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.767+0000 7f05e6ffd640 1 -- 10.20.193.45:0/447742859 <== mon.0 v1:10.20.193.45:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (unknown 0 0 2024835662) 0x7f05f00058c0 con 0x7f060009de50 2026-02-22T23:25:49.797 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.767+0000 7f05e6ffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T23:25:49.797 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.767+0000 7f05e6ffd640 10 monclient: _finish_command 1 = system:0 2026-02-22T23:25:49.797 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.767+0000 7f05e6ffd640 1 -- 10.20.193.45:0/447742859 >> v1:10.20.193.45:6789/0 conn(0x7f060009de50 legacy=0x7f060009e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:49.797 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.767+0000 7f05e6ffd640 1 -- 10.20.193.45:0/447742859 >> v1:10.20.193.45:6789/0 conn(0x7f060009de50 legacy=0x7f060009e230 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T23:25:49.797 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.770+0000 7f06083bc640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-22T23:25:49.797 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.770+0000 7f06083bc640 1 -- 10.20.193.45:0/447742859 --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f060009ed20 con 0x7f060009e940 2026-02-22T23:25:49.797 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.770+0000 7f05e6ffd640 1 -- 10.20.193.45:0/447742859 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 929263496 0 0) 0x7f060009ed20 con 0x7f060009e940 2026-02-22T23:25:49.797 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.770+0000 7f05e6ffd640 10 monclient(hunting): _negotiate 2026-02-22T23:25:49.797 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.770+0000 7f05e6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:49.797 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.770+0000 7f05e6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:49.797 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.770+0000 7f05e6ffd640 10 monclient(hunting): my global_id is 4419 2026-02-22T23:25:49.797 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.770+0000 7f05e6ffd640 1 -- 10.20.193.45:0/447742859 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f06000008d0 con 0x7f060009e940 2026-02-22T23:25:49.798 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.770+0000 7f05e6ffd640 1 -- 10.20.193.45:0/447742859 <== mon.0 v1:10.20.193.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1714292817 0 0) 0x7f06000008d0 con 0x7f060009e940 2026-02-22T23:25:49.798 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.770+0000 7f05e6ffd640 1 -- 10.20.193.45:0/447742859 --> v1:10.20.193.45:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f060009ed20 con 0x7f060009e940 2026-02-22T23:25:49.798 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.770+0000 7f05e6ffd640 1 -- 10.20.193.45:0/447742859 <== mon.0 v1:10.20.193.45:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f05f00044d0 con 0x7f060009e940 2026-02-22T23:25:49.798 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.770+0000 7f05e6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:25:49.798 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.770+0000 7f05e6ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T23:25:49.798 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.770+0000 7f05e6ffd640 10 monclient: dump: 2026-02-22T23:25:49.798 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:49.798 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:49.798 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:49.798 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:49.798 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:49.798 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:49.798 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:49.798 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:49.799 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:49.799 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:49.799 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:49.799 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:49.799 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:49.799 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:49.799 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:49.799 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:49.799 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.770+0000 7f05e6ffd640 1 -- 10.20.193.45:0/447742859 <== mon.0 v1:10.20.193.45:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1903996838 0 0) 0x7f060009ed20 con 0x7f060009e940 2026-02-22T23:25:49.799 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.770+0000 7f05e6ffd640 1 -- 10.20.193.45:0/447742859 --> v1:10.20.193.45:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f0600139a00 con 0x7f060009e940 2026-02-22T23:25:49.799 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.770+0000 7f05e6ffd640 1 -- 10.20.193.45:0/447742859 <== mon.0 v1:10.20.193.45:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7529 (unknown 0 0 2008070521) 0x7f05f0007ab0 con 0x7f060009e940 2026-02-22T23:25:49.799 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.770+0000 7f05e6ffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-22T23:25:49.799 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.770+0000 7f05e6ffd640 10 monclient: _finish_command 2 = system:0 2026-02-22T23:25:49.799 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.770+0000 7f05e6ffd640 1 -- 10.20.193.45:0/447742859 >> v1:10.20.193.45:6789/0 conn(0x7f060009e940 legacy=0x7f06001de290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:49.799 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.770+0000 7f05e6ffd640 1 -- 10.20.193.45:0/447742859 >> v1:10.20.193.45:6789/0 conn(0x7f060009e940 legacy=0x7f06001de290 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T23:25:49.800 INFO:teuthology.orchestra.run.trial045.stdout:{ 2026-02-22T23:25:49.800 INFO:teuthology.orchestra.run.trial045.stdout: "name": "a", 2026-02-22T23:25:49.800 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 0, 2026-02-22T23:25:49.800 INFO:teuthology.orchestra.run.trial045.stdout: "state": "leader", 2026-02-22T23:25:49.800 INFO:teuthology.orchestra.run.trial045.stdout: "election_epoch": 8, 2026-02-22T23:25:49.800 INFO:teuthology.orchestra.run.trial045.stdout: "uptime": 29927, 2026-02-22T23:25:49.800 INFO:teuthology.orchestra.run.trial045.stdout: "quorum": [ 2026-02-22T23:25:49.800 INFO:teuthology.orchestra.run.trial045.stdout: 0, 2026-02-22T23:25:49.801 INFO:teuthology.orchestra.run.trial045.stdout: 1, 2026-02-22T23:25:49.801 INFO:teuthology.orchestra.run.trial045.stdout: 2, 2026-02-22T23:25:49.801 INFO:teuthology.orchestra.run.trial045.stdout: 3, 2026-02-22T23:25:49.801 INFO:teuthology.orchestra.run.trial045.stdout: 4, 2026-02-22T23:25:49.801 INFO:teuthology.orchestra.run.trial045.stdout: 5, 2026-02-22T23:25:49.801 INFO:teuthology.orchestra.run.trial045.stdout: 6, 2026-02-22T23:25:49.801 INFO:teuthology.orchestra.run.trial045.stdout: 7, 2026-02-22T23:25:49.801 INFO:teuthology.orchestra.run.trial045.stdout: 8 2026-02-22T23:25:49.801 INFO:teuthology.orchestra.run.trial045.stdout: ], 2026-02-22T23:25:49.801 INFO:teuthology.orchestra.run.trial045.stdout: "quorum_age": 24, 2026-02-22T23:25:49.801 INFO:teuthology.orchestra.run.trial045.stdout: "features": { 2026-02-22T23:25:49.801 INFO:teuthology.orchestra.run.trial045.stdout: "required_con": "2450521708007866372", 2026-02-22T23:25:49.801 INFO:teuthology.orchestra.run.trial045.stdout: "required_mon": [ 2026-02-22T23:25:49.801 INFO:teuthology.orchestra.run.trial045.stdout: "kraken", 2026-02-22T23:25:49.801 INFO:teuthology.orchestra.run.trial045.stdout: "luminous", 2026-02-22T23:25:49.802 INFO:teuthology.orchestra.run.trial045.stdout: "mimic", 2026-02-22T23:25:49.802 INFO:teuthology.orchestra.run.trial045.stdout: "osdmap-prune", 2026-02-22T23:25:49.802 INFO:teuthology.orchestra.run.trial045.stdout: "nautilus", 2026-02-22T23:25:49.802 INFO:teuthology.orchestra.run.trial045.stdout: "octopus", 2026-02-22T23:25:49.802 INFO:teuthology.orchestra.run.trial045.stdout: "pacific", 2026-02-22T23:25:49.802 INFO:teuthology.orchestra.run.trial045.stdout: "elector-pinging", 2026-02-22T23:25:49.802 INFO:teuthology.orchestra.run.trial045.stdout: "quincy", 2026-02-22T23:25:49.802 INFO:teuthology.orchestra.run.trial045.stdout: "reef", 2026-02-22T23:25:49.802 INFO:teuthology.orchestra.run.trial045.stdout: "squid" 2026-02-22T23:25:49.802 INFO:teuthology.orchestra.run.trial045.stdout: ], 2026-02-22T23:25:49.802 INFO:teuthology.orchestra.run.trial045.stdout: "quorum_con": "4540701547738038271", 2026-02-22T23:25:49.802 INFO:teuthology.orchestra.run.trial045.stdout: "quorum_mon": [ 2026-02-22T23:25:49.802 INFO:teuthology.orchestra.run.trial045.stdout: "kraken", 2026-02-22T23:25:49.802 INFO:teuthology.orchestra.run.trial045.stdout: "luminous", 2026-02-22T23:25:49.802 INFO:teuthology.orchestra.run.trial045.stdout: "mimic", 2026-02-22T23:25:49.802 INFO:teuthology.orchestra.run.trial045.stdout: "osdmap-prune", 2026-02-22T23:25:49.803 INFO:teuthology.orchestra.run.trial045.stdout: "nautilus", 2026-02-22T23:25:49.803 INFO:teuthology.orchestra.run.trial045.stdout: "octopus", 2026-02-22T23:25:49.803 INFO:teuthology.orchestra.run.trial045.stdout: "pacific", 2026-02-22T23:25:49.803 INFO:teuthology.orchestra.run.trial045.stdout: "elector-pinging", 2026-02-22T23:25:49.803 INFO:teuthology.orchestra.run.trial045.stdout: "quincy", 2026-02-22T23:25:49.803 INFO:teuthology.orchestra.run.trial045.stdout: "reef", 2026-02-22T23:25:49.803 INFO:teuthology.orchestra.run.trial045.stdout: "squid" 2026-02-22T23:25:49.803 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:25:49.803 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:25:49.803 INFO:teuthology.orchestra.run.trial045.stdout: "outside_quorum": [], 2026-02-22T23:25:49.803 INFO:teuthology.orchestra.run.trial045.stdout: "extra_probe_peers": [], 2026-02-22T23:25:49.803 INFO:teuthology.orchestra.run.trial045.stdout: "sync_provider": [], 2026-02-22T23:25:49.803 INFO:teuthology.orchestra.run.trial045.stdout: "monmap": { 2026-02-22T23:25:49.803 INFO:teuthology.orchestra.run.trial045.stdout: "epoch": 1, 2026-02-22T23:25:49.803 INFO:teuthology.orchestra.run.trial045.stdout: "fsid": "4b60f18f-6660-4731-b731-dc85c4078413", 2026-02-22T23:25:49.804 INFO:teuthology.orchestra.run.trial045.stdout: "modified": "2026-02-22T23:24:52.393472Z", 2026-02-22T23:25:49.804 INFO:teuthology.orchestra.run.trial045.stdout: "created": "2026-02-22T23:24:52.393472Z", 2026-02-22T23:25:49.804 INFO:teuthology.orchestra.run.trial045.stdout: "min_mon_release": 19, 2026-02-22T23:25:49.804 INFO:teuthology.orchestra.run.trial045.stdout: "min_mon_release_name": "squid", 2026-02-22T23:25:49.804 INFO:teuthology.orchestra.run.trial045.stdout: "election_strategy": 3, 2026-02-22T23:25:49.804 INFO:teuthology.orchestra.run.trial045.stdout: "disallowed_leaders": "", 2026-02-22T23:25:49.804 INFO:teuthology.orchestra.run.trial045.stdout: "stretch_mode": false, 2026-02-22T23:25:49.804 INFO:teuthology.orchestra.run.trial045.stdout: "tiebreaker_mon": "", 2026-02-22T23:25:49.804 INFO:teuthology.orchestra.run.trial045.stdout: "removed_ranks": "", 2026-02-22T23:25:49.804 INFO:teuthology.orchestra.run.trial045.stdout: "features": { 2026-02-22T23:25:49.804 INFO:teuthology.orchestra.run.trial045.stdout: "persistent": [ 2026-02-22T23:25:49.804 INFO:teuthology.orchestra.run.trial045.stdout: "kraken", 2026-02-22T23:25:49.804 INFO:teuthology.orchestra.run.trial045.stdout: "luminous", 2026-02-22T23:25:49.804 INFO:teuthology.orchestra.run.trial045.stdout: "mimic", 2026-02-22T23:25:49.804 INFO:teuthology.orchestra.run.trial045.stdout: "osdmap-prune", 2026-02-22T23:25:49.804 INFO:teuthology.orchestra.run.trial045.stdout: "nautilus", 2026-02-22T23:25:49.805 INFO:teuthology.orchestra.run.trial045.stdout: "octopus", 2026-02-22T23:25:49.805 INFO:teuthology.orchestra.run.trial045.stdout: "pacific", 2026-02-22T23:25:49.805 INFO:teuthology.orchestra.run.trial045.stdout: "elector-pinging", 2026-02-22T23:25:49.805 INFO:teuthology.orchestra.run.trial045.stdout: "quincy", 2026-02-22T23:25:49.805 INFO:teuthology.orchestra.run.trial045.stdout: "reef", 2026-02-22T23:25:49.805 INFO:teuthology.orchestra.run.trial045.stdout: "squid" 2026-02-22T23:25:49.805 INFO:teuthology.orchestra.run.trial045.stdout: ], 2026-02-22T23:25:49.805 INFO:teuthology.orchestra.run.trial045.stdout: "optional": [] 2026-02-22T23:25:49.805 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:25:49.805 INFO:teuthology.orchestra.run.trial045.stdout: "mons": [ 2026-02-22T23:25:49.805 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:25:49.805 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 0, 2026-02-22T23:25:49.805 INFO:teuthology.orchestra.run.trial045.stdout: "name": "a", 2026-02-22T23:25:49.805 INFO:teuthology.orchestra.run.trial045.stdout: "public_addrs": { 2026-02-22T23:25:49.805 INFO:teuthology.orchestra.run.trial045.stdout: "addrvec": [ 2026-02-22T23:25:49.805 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:25:49.806 INFO:teuthology.orchestra.run.trial045.stdout: "type": "v1", 2026-02-22T23:25:49.806 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6789", 2026-02-22T23:25:49.806 INFO:teuthology.orchestra.run.trial045.stdout: "nonce": 0 2026-02-22T23:25:49.806 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:25:49.806 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:25:49.806 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:25:49.806 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6789/0", 2026-02-22T23:25:49.806 INFO:teuthology.orchestra.run.trial045.stdout: "public_addr": "10.20.193.45:6789/0", 2026-02-22T23:25:49.806 INFO:teuthology.orchestra.run.trial045.stdout: "priority": 0, 2026-02-22T23:25:49.806 INFO:teuthology.orchestra.run.trial045.stdout: "weight": 0, 2026-02-22T23:25:49.806 INFO:teuthology.orchestra.run.trial045.stdout: "crush_location": "{}" 2026-02-22T23:25:49.806 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:25:49.806 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:25:49.806 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 1, 2026-02-22T23:25:49.806 INFO:teuthology.orchestra.run.trial045.stdout: "name": "f", 2026-02-22T23:25:49.807 INFO:teuthology.orchestra.run.trial045.stdout: "public_addrs": { 2026-02-22T23:25:49.807 INFO:teuthology.orchestra.run.trial045.stdout: "addrvec": [ 2026-02-22T23:25:49.807 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:25:49.807 INFO:teuthology.orchestra.run.trial045.stdout: "type": "v1", 2026-02-22T23:25:49.807 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.73:6789", 2026-02-22T23:25:49.807 INFO:teuthology.orchestra.run.trial045.stdout: "nonce": 0 2026-02-22T23:25:49.807 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:25:49.807 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:25:49.807 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:25:49.807 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.73:6789/0", 2026-02-22T23:25:49.807 INFO:teuthology.orchestra.run.trial045.stdout: "public_addr": "10.20.193.73:6789/0", 2026-02-22T23:25:49.807 INFO:teuthology.orchestra.run.trial045.stdout: "priority": 0, 2026-02-22T23:25:49.807 INFO:teuthology.orchestra.run.trial045.stdout: "weight": 0, 2026-02-22T23:25:49.807 INFO:teuthology.orchestra.run.trial045.stdout: "crush_location": "{}" 2026-02-22T23:25:49.807 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:25:49.808 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:25:49.808 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 2, 2026-02-22T23:25:49.808 INFO:teuthology.orchestra.run.trial045.stdout: "name": "b", 2026-02-22T23:25:49.808 INFO:teuthology.orchestra.run.trial045.stdout: "public_addrs": { 2026-02-22T23:25:49.808 INFO:teuthology.orchestra.run.trial045.stdout: "addrvec": [ 2026-02-22T23:25:49.808 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:25:49.808 INFO:teuthology.orchestra.run.trial045.stdout: "type": "v1", 2026-02-22T23:25:49.808 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6790", 2026-02-22T23:25:49.808 INFO:teuthology.orchestra.run.trial045.stdout: "nonce": 0 2026-02-22T23:25:49.808 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:25:49.808 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:25:49.808 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:25:49.808 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6790/0", 2026-02-22T23:25:49.808 INFO:teuthology.orchestra.run.trial045.stdout: "public_addr": "10.20.193.45:6790/0", 2026-02-22T23:25:49.808 INFO:teuthology.orchestra.run.trial045.stdout: "priority": 0, 2026-02-22T23:25:49.808 INFO:teuthology.orchestra.run.trial045.stdout: "weight": 0, 2026-02-22T23:25:49.808 INFO:teuthology.orchestra.run.trial045.stdout: "crush_location": "{}" 2026-02-22T23:25:49.808 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:25:49.809 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:25:49.809 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 3, 2026-02-22T23:25:49.809 INFO:teuthology.orchestra.run.trial045.stdout: "name": "g", 2026-02-22T23:25:49.809 INFO:teuthology.orchestra.run.trial045.stdout: "public_addrs": { 2026-02-22T23:25:49.809 INFO:teuthology.orchestra.run.trial045.stdout: "addrvec": [ 2026-02-22T23:25:49.809 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:25:49.809 INFO:teuthology.orchestra.run.trial045.stdout: "type": "v1", 2026-02-22T23:25:49.809 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.73:6790", 2026-02-22T23:25:49.809 INFO:teuthology.orchestra.run.trial045.stdout: "nonce": 0 2026-02-22T23:25:49.809 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:25:49.809 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:25:49.809 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:25:49.809 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.73:6790/0", 2026-02-22T23:25:49.809 INFO:teuthology.orchestra.run.trial045.stdout: "public_addr": "10.20.193.73:6790/0", 2026-02-22T23:25:49.809 INFO:teuthology.orchestra.run.trial045.stdout: "priority": 0, 2026-02-22T23:25:49.809 INFO:teuthology.orchestra.run.trial045.stdout: "weight": 0, 2026-02-22T23:25:49.809 INFO:teuthology.orchestra.run.trial045.stdout: "crush_location": "{}" 2026-02-22T23:25:49.809 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:25:49.809 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:25:49.809 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 4, 2026-02-22T23:25:49.810 INFO:teuthology.orchestra.run.trial045.stdout: "name": "c", 2026-02-22T23:25:49.810 INFO:teuthology.orchestra.run.trial045.stdout: "public_addrs": { 2026-02-22T23:25:49.810 INFO:teuthology.orchestra.run.trial045.stdout: "addrvec": [ 2026-02-22T23:25:49.810 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:25:49.810 INFO:teuthology.orchestra.run.trial045.stdout: "type": "v1", 2026-02-22T23:25:49.810 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6791", 2026-02-22T23:25:49.810 INFO:teuthology.orchestra.run.trial045.stdout: "nonce": 0 2026-02-22T23:25:49.810 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:25:49.810 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:25:49.810 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:25:49.810 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6791/0", 2026-02-22T23:25:49.810 INFO:teuthology.orchestra.run.trial045.stdout: "public_addr": "10.20.193.45:6791/0", 2026-02-22T23:25:49.810 INFO:teuthology.orchestra.run.trial045.stdout: "priority": 0, 2026-02-22T23:25:49.810 INFO:teuthology.orchestra.run.trial045.stdout: "weight": 0, 2026-02-22T23:25:49.810 INFO:teuthology.orchestra.run.trial045.stdout: "crush_location": "{}" 2026-02-22T23:25:49.810 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:25:49.810 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:25:49.810 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 5, 2026-02-22T23:25:49.810 INFO:teuthology.orchestra.run.trial045.stdout: "name": "h", 2026-02-22T23:25:49.811 INFO:teuthology.orchestra.run.trial045.stdout: "public_addrs": { 2026-02-22T23:25:49.811 INFO:teuthology.orchestra.run.trial045.stdout: "addrvec": [ 2026-02-22T23:25:49.811 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:25:49.811 INFO:teuthology.orchestra.run.trial045.stdout: "type": "v1", 2026-02-22T23:25:49.811 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.73:6791", 2026-02-22T23:25:49.811 INFO:teuthology.orchestra.run.trial045.stdout: "nonce": 0 2026-02-22T23:25:49.811 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:25:49.811 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:25:49.811 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:25:49.811 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.73:6791/0", 2026-02-22T23:25:49.811 INFO:teuthology.orchestra.run.trial045.stdout: "public_addr": "10.20.193.73:6791/0", 2026-02-22T23:25:49.811 INFO:teuthology.orchestra.run.trial045.stdout: "priority": 0, 2026-02-22T23:25:49.811 INFO:teuthology.orchestra.run.trial045.stdout: "weight": 0, 2026-02-22T23:25:49.811 INFO:teuthology.orchestra.run.trial045.stdout: "crush_location": "{}" 2026-02-22T23:25:49.811 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:25:49.811 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:25:49.811 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 6, 2026-02-22T23:25:49.811 INFO:teuthology.orchestra.run.trial045.stdout: "name": "d", 2026-02-22T23:25:49.812 INFO:teuthology.orchestra.run.trial045.stdout: "public_addrs": { 2026-02-22T23:25:49.812 INFO:teuthology.orchestra.run.trial045.stdout: "addrvec": [ 2026-02-22T23:25:49.812 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:25:49.812 INFO:teuthology.orchestra.run.trial045.stdout: "type": "v1", 2026-02-22T23:25:49.812 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6792", 2026-02-22T23:25:49.812 INFO:teuthology.orchestra.run.trial045.stdout: "nonce": 0 2026-02-22T23:25:49.812 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:25:49.812 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:25:49.812 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:25:49.812 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6792/0", 2026-02-22T23:25:49.812 INFO:teuthology.orchestra.run.trial045.stdout: "public_addr": "10.20.193.45:6792/0", 2026-02-22T23:25:49.812 INFO:teuthology.orchestra.run.trial045.stdout: "priority": 0, 2026-02-22T23:25:49.812 INFO:teuthology.orchestra.run.trial045.stdout: "weight": 0, 2026-02-22T23:25:49.812 INFO:teuthology.orchestra.run.trial045.stdout: "crush_location": "{}" 2026-02-22T23:25:49.812 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:25:49.812 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:25:49.812 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 7, 2026-02-22T23:25:49.812 INFO:teuthology.orchestra.run.trial045.stdout: "name": "i", 2026-02-22T23:25:49.812 INFO:teuthology.orchestra.run.trial045.stdout: "public_addrs": { 2026-02-22T23:25:49.812 INFO:teuthology.orchestra.run.trial045.stdout: "addrvec": [ 2026-02-22T23:25:49.812 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:25:49.813 INFO:teuthology.orchestra.run.trial045.stdout: "type": "v1", 2026-02-22T23:25:49.813 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.73:6792", 2026-02-22T23:25:49.813 INFO:teuthology.orchestra.run.trial045.stdout: "nonce": 0 2026-02-22T23:25:49.813 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:25:49.813 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:25:49.813 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:25:49.813 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.73:6792/0", 2026-02-22T23:25:49.813 INFO:teuthology.orchestra.run.trial045.stdout: "public_addr": "10.20.193.73:6792/0", 2026-02-22T23:25:49.813 INFO:teuthology.orchestra.run.trial045.stdout: "priority": 0, 2026-02-22T23:25:49.813 INFO:teuthology.orchestra.run.trial045.stdout: "weight": 0, 2026-02-22T23:25:49.813 INFO:teuthology.orchestra.run.trial045.stdout: "crush_location": "{}" 2026-02-22T23:25:49.813 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:25:49.813 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:25:49.813 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 8, 2026-02-22T23:25:49.813 INFO:teuthology.orchestra.run.trial045.stdout: "name": "e", 2026-02-22T23:25:49.813 INFO:teuthology.orchestra.run.trial045.stdout: "public_addrs": { 2026-02-22T23:25:49.813 INFO:teuthology.orchestra.run.trial045.stdout: "addrvec": [ 2026-02-22T23:25:49.813 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:25:49.813 INFO:teuthology.orchestra.run.trial045.stdout: "type": "v1", 2026-02-22T23:25:49.813 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6793", 2026-02-22T23:25:49.814 INFO:teuthology.orchestra.run.trial045.stdout: "nonce": 0 2026-02-22T23:25:49.814 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:25:49.814 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:25:49.814 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:25:49.814 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6793/0", 2026-02-22T23:25:49.814 INFO:teuthology.orchestra.run.trial045.stdout: "public_addr": "10.20.193.45:6793/0", 2026-02-22T23:25:49.814 INFO:teuthology.orchestra.run.trial045.stdout: "priority": 0, 2026-02-22T23:25:49.814 INFO:teuthology.orchestra.run.trial045.stdout: "weight": 0, 2026-02-22T23:25:49.814 INFO:teuthology.orchestra.run.trial045.stdout: "crush_location": "{}" 2026-02-22T23:25:49.814 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:25:49.814 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:25:49.814 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:25:49.814 INFO:teuthology.orchestra.run.trial045.stdout: "feature_map": { 2026-02-22T23:25:49.814 INFO:teuthology.orchestra.run.trial045.stdout: "mon": [ 2026-02-22T23:25:49.814 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:25:49.814 INFO:teuthology.orchestra.run.trial045.stdout: "features": "0x3f03cffffffdffff", 2026-02-22T23:25:49.814 INFO:teuthology.orchestra.run.trial045.stdout: "release": "squid", 2026-02-22T23:25:49.814 INFO:teuthology.orchestra.run.trial045.stdout: "num": 1 2026-02-22T23:25:49.814 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:25:49.814 INFO:teuthology.orchestra.run.trial045.stdout: ], 2026-02-22T23:25:49.814 INFO:teuthology.orchestra.run.trial045.stdout: "client": [ 2026-02-22T23:25:49.815 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:25:49.815 INFO:teuthology.orchestra.run.trial045.stdout: "features": "0x3f03cffffffdffff", 2026-02-22T23:25:49.815 INFO:teuthology.orchestra.run.trial045.stdout: "release": "squid", 2026-02-22T23:25:49.815 INFO:teuthology.orchestra.run.trial045.stdout: "num": 1 2026-02-22T23:25:49.815 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:25:49.815 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:25:49.815 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:25:49.815 INFO:teuthology.orchestra.run.trial045.stdout: "stretch_mode": false 2026-02-22T23:25:49.815 INFO:teuthology.orchestra.run.trial045.stdout:} 2026-02-22T23:25:49.816 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.770+0000 7f06083bc640 1 -- 10.20.193.45:0/447742859 >> v1:10.20.193.73:6800/2222410180 conn(0x7f05d0040020 legacy=0x7f05d00424e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:49.816 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.770+0000 7f06083bc640 10 monclient: shutdown 2026-02-22T23:25:49.816 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.770+0000 7f06083bc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T23:25:49.816 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.770+0000 7f06083bc640 1 -- 10.20.193.45:0/447742859 >> v1:10.20.193.45:6791/0 conn(0x7f06000a4610 legacy=0x7f060013e810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:49.816 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.770+0000 7f0606932640 1 -- 10.20.193.45:0/447742859 reap_dead start 2026-02-22T23:25:49.816 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.770+0000 7f0606932640 1 -- 10.20.193.45:0/447742859 reap_dead start 2026-02-22T23:25:49.816 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.770+0000 7f06083bc640 1 -- 10.20.193.45:0/447742859 shutdown_connections 2026-02-22T23:25:49.816 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.771+0000 7f06083bc640 1 -- 10.20.193.45:0/447742859 >> 10.20.193.45:0/447742859 conn(0x7f06000a7f70 msgr2=0x7f060013bdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:25:49.816 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.771+0000 7f06083bc640 1 -- 10.20.193.45:0/447742859 shutdown_connections 2026-02-22T23:25:49.816 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.771+0000 7f06083bc640 1 -- 10.20.193.45:0/447742859 wait complete. 2026-02-22T23:25:49.817 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2026-02-22T23:25:49.817 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon b 2026-02-22T23:25:49.817 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-22T23:25:49.886 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.886+0000 7f0871ef3640 10 monclient: get_monmap_and_config 2026-02-22T23:25:49.886 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.886+0000 7f0871ef3640 10 monclient: build_initial_monmap 2026-02-22T23:25:49.886 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.886+0000 7f0871ef3640 10 monclient: monmap: 2026-02-22T23:25:49.887 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-22T23:25:49.887 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:49.887 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:25:49.886774+0000 2026-02-22T23:25:49.887 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:25:49.886774+0000 2026-02-22T23:25:49.887 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-22T23:25:49.887 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:49.887 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-22T23:25:49.887 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.noname-f 2026-02-22T23:25:49.887 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.noname-b 2026-02-22T23:25:49.887 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.noname-g 2026-02-22T23:25:49.887 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.noname-c 2026-02-22T23:25:49.887 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.noname-h 2026-02-22T23:25:49.887 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.noname-d 2026-02-22T23:25:49.887 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.noname-i 2026-02-22T23:25:49.887 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.noname-e 2026-02-22T23:25:49.887 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:49.894 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.886+0000 7f0871ef3640 1 Processor -- start 2026-02-22T23:25:49.894 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.887+0000 7f0871ef3640 1 -- start start 2026-02-22T23:25:49.894 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.887+0000 7f0871ef3640 10 monclient: init 2026-02-22T23:25:49.894 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.887+0000 7f0871ef3640 10 monclient: _reopen_session rank -1 2026-02-22T23:25:49.894 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.887+0000 7f0871ef3640 10 monclient: _add_conns ranks=[4,7,6,3,2,5,8,0,1] 2026-02-22T23:25:49.894 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.887+0000 7f0871ef3640 10 monclient(hunting): picked mon.noname-c con 0x7f086c0a5d90 addr v1:10.20.193.45:6791/0 2026-02-22T23:25:49.894 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.887+0000 7f0871ef3640 10 monclient(hunting): picked mon.noname-i con 0x7f086c0a2150 addr v1:10.20.193.73:6792/0 2026-02-22T23:25:49.894 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.887+0000 7f0871ef3640 10 monclient(hunting): picked mon.noname-d con 0x7f086c0a6880 addr v1:10.20.193.45:6792/0 2026-02-22T23:25:49.894 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.887+0000 7f0871ef3640 1 -- --> v1:10.20.193.45:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f086c0a8cb0 con 0x7f086c0a5d90 2026-02-22T23:25:49.894 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.887+0000 7f0871ef3640 1 -- --> v1:10.20.193.45:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f086c0a3f50 con 0x7f086c0a6880 2026-02-22T23:25:49.894 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.887+0000 7f0871ef3640 1 -- --> v1:10.20.193.73:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f086c0a3570 con 0x7f086c0a2150 2026-02-22T23:25:49.894 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.887+0000 7f0871ef3640 10 monclient(hunting): _renew_subs 2026-02-22T23:25:49.894 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.887+0000 7f0871ef3640 10 monclient(hunting): authenticate will time out at 681.503365s 2026-02-22T23:25:49.895 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.887+0000 7f086b7fe640 1 --1- >> v1:10.20.193.45:6791/0 conn(0x7f086c0a5d90 0x7f086c0a6170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.45:6791/0 says I am v1:10.20.193.45:38076/0 (socket says 10.20.193.45:38076) 2026-02-22T23:25:49.895 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.887+0000 7f086b7fe640 1 -- 10.20.193.45:0/2925921643 learned_addr learned my addr 10.20.193.45:0/2925921643 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-22T23:25:49.895 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.887+0000 7f086a7fc640 1 -- 10.20.193.45:0/2925921643 <== mon.4 v1:10.20.193.45:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3879410123 0 0) 0x7f086c0a8cb0 con 0x7f086c0a5d90 2026-02-22T23:25:49.895 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.887+0000 7f086a7fc640 10 monclient(hunting): _negotiate 2026-02-22T23:25:49.895 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.887+0000 7f086a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:49.895 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.887+0000 7f086a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:49.895 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.887+0000 7f086a7fc640 10 monclient(hunting): my global_id is 4486 2026-02-22T23:25:49.895 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.887+0000 7f086a7fc640 1 -- 10.20.193.45:0/2925921643 --> v1:10.20.193.45:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0850003620 con 0x7f086c0a5d90 2026-02-22T23:25:49.895 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.887+0000 7f086a7fc640 1 -- 10.20.193.45:0/2925921643 <== mon.6 v1:10.20.193.45:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 433684503 0 0) 0x7f0860002ca0 con 0x7f086c0a6880 2026-02-22T23:25:49.895 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.887+0000 7f086a7fc640 10 monclient(hunting): _negotiate 2026-02-22T23:25:49.895 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.887+0000 7f086a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:49.895 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.887+0000 7f086a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:49.895 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.887+0000 7f086a7fc640 10 monclient(hunting): my global_id is 4416 2026-02-22T23:25:49.895 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.887+0000 7f086a7fc640 1 -- 10.20.193.45:0/2925921643 --> v1:10.20.193.45:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f086c0a8cb0 con 0x7f086c0a6880 2026-02-22T23:25:49.895 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.887+0000 7f086a7fc640 1 -- 10.20.193.45:0/2925921643 <== mon.4 v1:10.20.193.45:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 726053895 0 0) 0x7f0850003620 con 0x7f086c0a5d90 2026-02-22T23:25:49.895 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.887+0000 7f086a7fc640 1 -- 10.20.193.45:0/2925921643 >> v1:10.20.193.73:6792/0 conn(0x7f086c0a2150 legacy=0x7f086c13e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:49.895 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.887+0000 7f086a7fc640 1 -- 10.20.193.45:0/2925921643 >> v1:10.20.193.45:6792/0 conn(0x7f086c0a6880 legacy=0x7f086c141740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:49.895 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.887+0000 7f086a7fc640 10 monclient: _finish_hunting 0 2026-02-22T23:25:49.896 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.887+0000 7f086a7fc640 1 monclient: found mon.noname-c 2026-02-22T23:25:49.896 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.887+0000 7f086a7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T23:25:49.896 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.887+0000 7f086a7fc640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.45:6791/0 2026-02-22T23:25:49.896 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.887+0000 7f086a7fc640 1 -- 10.20.193.45:0/2925921643 --> v1:10.20.193.45:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f086c0a6f60 con 0x7f086c0a5d90 2026-02-22T23:25:49.896 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.887+0000 7f086a7fc640 10 monclient: _finish_auth 0 2026-02-22T23:25:49.896 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.887+0000 7f086a7fc640 10 monclient: _check_auth_tickets 2026-02-22T23:25:49.896 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.887+0000 7f086a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T23:25:49.896 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.887+0000 7f086a7fc640 1 -- 10.20.193.45:0/2925921643 <== mon.4 v1:10.20.193.45:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f0858003040 con 0x7f086c0a5d90 2026-02-22T23:25:49.896 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.887+0000 7f086a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:25:49.896 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.887+0000 7f086a7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-22T23:25:49.896 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.887+0000 7f086a7fc640 10 monclient: dump: 2026-02-22T23:25:49.896 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:49.896 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:49.896 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:49.896 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:49.896 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:49.896 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:49.896 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:49.896 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:49.896 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:49.896 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:49.897 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:49.897 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:49.897 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:49.897 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:49.897 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:49.897 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:49.897 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.887+0000 7f0871ef3640 5 monclient: authenticate success, global_id 4486 2026-02-22T23:25:49.897 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.887+0000 7f0871ef3640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-22T23:25:49.897 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.887+0000 7f086a7fc640 1 -- 10.20.193.45:0/2925921643 <== mon.4 v1:10.20.193.45:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0858003260 con 0x7f086c0a5d90 2026-02-22T23:25:49.897 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.887+0000 7f086a7fc640 10 monclient: handle_config config(0 keys) 2026-02-22T23:25:49.897 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.887+0000 7f086a7fc640 1 -- 10.20.193.45:0/2925921643 <== mon.4 v1:10.20.193.45:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f0858004ce0 con 0x7f086c0a5d90 2026-02-22T23:25:49.897 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.887+0000 7f086a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:25:49.897 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.887+0000 7f086a7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T23:25:49.897 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.887+0000 7f086a7fc640 10 monclient: dump: 2026-02-22T23:25:49.897 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:49.897 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:49.897 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:49.898 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:49.898 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:49.898 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:49.898 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:49.898 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:49.898 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:49.898 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:49.898 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:49.898 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:49.898 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:49.898 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:49.898 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:49.898 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:49.898 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.887+0000 7f0871ef3640 10 monclient: get_monmap_and_config success 2026-02-22T23:25:49.898 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.887+0000 7f0871ef3640 4 set_mon_vals no callback set 2026-02-22T23:25:49.898 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.888+0000 7f0871ef3640 10 monclient: shutdown 2026-02-22T23:25:49.898 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.888+0000 7f0871ef3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T23:25:49.898 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.888+0000 7f0871ef3640 1 -- 10.20.193.45:0/2925921643 >> v1:10.20.193.45:6791/0 conn(0x7f086c0a5d90 legacy=0x7f086c0a6170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:49.898 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.888+0000 7f0871ef3640 1 -- 10.20.193.45:0/2925921643 shutdown_connections 2026-02-22T23:25:49.898 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.888+0000 7f0871ef3640 1 -- 10.20.193.45:0/2925921643 >> 10.20.193.45:0/2925921643 conn(0x7f086c0ab9c0 msgr2=0x7f086c0a7e90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:25:49.899 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.888+0000 7f0871ef3640 1 -- 10.20.193.45:0/2925921643 shutdown_connections 2026-02-22T23:25:49.899 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.888+0000 7f0871ef3640 1 -- 10.20.193.45:0/2925921643 wait complete. 2026-02-22T23:25:49.899 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.888+0000 7f0871ef3640 10 monclient: build_initial_monmap 2026-02-22T23:25:49.899 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.888+0000 7f0871ef3640 10 monclient: monmap: 2026-02-22T23:25:49.899 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-22T23:25:49.899 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T23:25:49.899 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-22T23:25:49.899 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-22T23:25:49.899 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-22T23:25:49.899 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-22T23:25:49.899 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-22T23:25:49.899 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.noname-f 2026-02-22T23:25:49.899 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.noname-b 2026-02-22T23:25:49.899 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.noname-g 2026-02-22T23:25:49.899 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.noname-c 2026-02-22T23:25:49.899 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.noname-h 2026-02-22T23:25:49.899 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.noname-d 2026-02-22T23:25:49.899 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.noname-i 2026-02-22T23:25:49.899 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.noname-e 2026-02-22T23:25:49.900 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:49.900 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.888+0000 7f0871ef3640 1 Processor -- start 2026-02-22T23:25:49.900 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.888+0000 7f0871ef3640 1 -- start start 2026-02-22T23:25:49.900 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.888+0000 7f0871ef3640 10 monclient: init 2026-02-22T23:25:49.900 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.889+0000 7f0871ef3640 10 monclient: _reopen_session rank -1 2026-02-22T23:25:49.900 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.889+0000 7f0871ef3640 10 monclient: _add_conns ranks=[3,0,7,6,4,1,2,5,8] 2026-02-22T23:25:49.900 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.889+0000 7f0871ef3640 10 monclient(hunting): picked mon.noname-g con 0x7f086c0a2150 addr v1:10.20.193.73:6790/0 2026-02-22T23:25:49.900 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.889+0000 7f0871ef3640 10 monclient(hunting): picked mon.noname-a con 0x7f086c0a5d90 addr v1:10.20.193.45:6789/0 2026-02-22T23:25:49.900 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.889+0000 7f0871ef3640 10 monclient(hunting): picked mon.noname-i con 0x7f086c0a6880 addr v1:10.20.193.73:6792/0 2026-02-22T23:25:49.900 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.889+0000 7f0871ef3640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f086c129200 con 0x7f086c0a5d90 2026-02-22T23:25:49.900 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.889+0000 7f0871ef3640 1 -- --> v1:10.20.193.73:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f086c0a1610 con 0x7f086c0a2150 2026-02-22T23:25:49.900 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.889+0000 7f0871ef3640 1 -- --> v1:10.20.193.73:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f086c128c40 con 0x7f086c0a6880 2026-02-22T23:25:49.900 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.889+0000 7f0871ef3640 10 monclient(hunting): _renew_subs 2026-02-22T23:25:49.900 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.889+0000 7f0871ef3640 10 monclient(hunting): authenticate will time out at 681.505086s 2026-02-22T23:25:49.900 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.889+0000 7f086affd640 1 --1- >> v1:10.20.193.45:6789/0 conn(0x7f086c0a5d90 0x7f086c125c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.45:6789/0 says I am v1:10.20.193.45:58326/0 (socket says 10.20.193.45:58326) 2026-02-22T23:25:49.900 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.889+0000 7f086affd640 1 -- 10.20.193.45:0/1094400670 learned_addr learned my addr 10.20.193.45:0/1094400670 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-22T23:25:49.900 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.889+0000 7f0847fff640 1 -- 10.20.193.45:0/1094400670 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3015644826 0 0) 0x7f086c129200 con 0x7f086c0a5d90 2026-02-22T23:25:49.900 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.889+0000 7f0847fff640 10 monclient(hunting): _negotiate 2026-02-22T23:25:49.900 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.889+0000 7f0847fff640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:49.900 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.889+0000 7f0847fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:49.901 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.889+0000 7f0847fff640 10 monclient(hunting): my global_id is 4428 2026-02-22T23:25:49.901 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.889+0000 7f0847fff640 1 -- 10.20.193.45:0/1094400670 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f083c003620 con 0x7f086c0a5d90 2026-02-22T23:25:49.901 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.889+0000 7f0847fff640 1 -- 10.20.193.45:0/1094400670 <== mon.0 v1:10.20.193.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1446332440 0 0) 0x7f083c003620 con 0x7f086c0a5d90 2026-02-22T23:25:49.901 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.889+0000 7f0847fff640 1 -- 10.20.193.45:0/1094400670 --> v1:10.20.193.45:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f086c129200 con 0x7f086c0a5d90 2026-02-22T23:25:49.901 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.889+0000 7f0847fff640 1 -- 10.20.193.45:0/1094400670 <== mon.0 v1:10.20.193.45:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f085c0033e0 con 0x7f086c0a5d90 2026-02-22T23:25:49.901 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.889+0000 7f0847fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-22T23:25:49.901 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.889+0000 7f0847fff640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T23:25:49.901 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.889+0000 7f0847fff640 10 monclient(hunting): dump: 2026-02-22T23:25:49.901 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:49.901 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:49.901 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:49.901 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:49.901 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:49.901 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:49.901 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:49.901 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:49.901 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:49.901 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:49.901 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:49.901 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:49.901 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:49.902 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:49.902 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:49.902 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:49.902 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.889+0000 7f0847fff640 10 monclient(hunting): _finish_auth 0 2026-02-22T23:25:49.902 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.889+0000 7f0847fff640 1 -- 10.20.193.45:0/1094400670 <== mon.0 v1:10.20.193.45:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4135289955 0 0) 0x7f086c129200 con 0x7f086c0a5d90 2026-02-22T23:25:49.902 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.889+0000 7f0847fff640 1 -- 10.20.193.45:0/1094400670 >> v1:10.20.193.73:6792/0 conn(0x7f086c0a6880 legacy=0x7f086c1d7fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:49.902 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.889+0000 7f0847fff640 1 -- 10.20.193.45:0/1094400670 >> v1:10.20.193.73:6790/0 conn(0x7f086c0a2150 legacy=0x7f086c125520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:49.902 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.889+0000 7f0847fff640 10 monclient: _finish_hunting 0 2026-02-22T23:25:49.902 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.889+0000 7f0847fff640 1 monclient: found mon.a 2026-02-22T23:25:49.902 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.889+0000 7f0847fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T23:25:49.902 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.889+0000 7f0847fff640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-22T23:25:49.902 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.889+0000 7f0847fff640 1 -- 10.20.193.45:0/1094400670 --> v1:10.20.193.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f086c128f20 con 0x7f086c0a5d90 2026-02-22T23:25:49.902 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.889+0000 7f0847fff640 10 monclient: _finish_auth 0 2026-02-22T23:25:49.902 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.889+0000 7f0847fff640 10 monclient: _check_auth_tickets 2026-02-22T23:25:49.902 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.889+0000 7f0847fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T23:25:49.902 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.889+0000 7f0871ef3640 5 monclient: authenticate success, global_id 4428 2026-02-22T23:25:49.902 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.889+0000 7f0871ef3640 10 monclient: _renew_subs 2026-02-22T23:25:49.902 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.889+0000 7f0871ef3640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-22T23:25:49.902 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.889+0000 7f0871ef3640 1 -- 10.20.193.45:0/1094400670 --> v1:10.20.193.45:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f086c127db0 con 0x7f086c0a5d90 2026-02-22T23:25:49.902 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.889+0000 7f0871ef3640 10 monclient: _renew_subs 2026-02-22T23:25:49.902 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.889+0000 7f0871ef3640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-22T23:25:49.903 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.889+0000 7f0871ef3640 1 -- 10.20.193.45:0/1094400670 --> v1:10.20.193.45:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f086c126520 con 0x7f086c0a5d90 2026-02-22T23:25:49.903 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.889+0000 7f0847fff640 1 -- 10.20.193.45:0/1094400670 <== mon.0 v1:10.20.193.45:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f085c0039c0 con 0x7f086c0a5d90 2026-02-22T23:25:49.903 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.889+0000 7f0847fff640 10 monclient: handle_config config(0 keys) 2026-02-22T23:25:49.903 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.889+0000 7f0847fff640 1 -- 10.20.193.45:0/1094400670 <== mon.0 v1:10.20.193.45:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f085c003eb0 con 0x7f086c0a5d90 2026-02-22T23:25:49.903 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.889+0000 7f0847fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:25:49.903 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.889+0000 7f0847fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T23:25:49.903 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.889+0000 7f0869ffb640 4 set_mon_vals no callback set 2026-02-22T23:25:49.903 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.889+0000 7f0847fff640 10 monclient: dump: 2026-02-22T23:25:49.903 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:49.903 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:49.903 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:49.903 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:49.903 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:49.903 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:49.903 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:49.903 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:49.903 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:49.903 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:49.903 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:49.903 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:49.903 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:49.904 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:49.904 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:49.904 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:49.904 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.889+0000 7f0871ef3640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T23:25:49.904 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.889+0000 7f0871ef3640 1 -- 10.20.193.45:0/1094400670 --> v1:10.20.193.45:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f086c0008d0 con 0x7f086c142e60 2026-02-22T23:25:49.904 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.890+0000 7f0847fff640 1 -- 10.20.193.45:0/1094400670 <== mon.0 v1:10.20.193.45:6789/0 7 ==== mgrmap(e 5) ==== 50225+0+0 (unknown 2330357642 0 0) 0x7f085c0040d0 con 0x7f086c0a5d90 2026-02-22T23:25:49.904 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.890+0000 7f0847fff640 1 -- 10.20.193.45:0/1094400670 <== mon.0 v1:10.20.193.45:6789/0 8 ==== osd_map(21..21 src has 1..21) ==== 3921+0+0 (unknown 4068336701 0 0) 0x7f085c04e000 con 0x7f086c0a5d90 2026-02-22T23:25:49.904 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.890+0000 7f0847fff640 1 -- 10.20.193.45:0/1094400670 <== mon.2 v1:10.20.193.45:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2710603807 0 0) 0x7f086c0008d0 con 0x7f086c142e60 2026-02-22T23:25:49.904 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.890+0000 7f0847fff640 10 monclient(hunting): _negotiate 2026-02-22T23:25:49.904 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.890+0000 7f0847fff640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:49.904 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.890+0000 7f0847fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:49.904 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.890+0000 7f0847fff640 10 monclient(hunting): my global_id is 4520 2026-02-22T23:25:49.904 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.890+0000 7f0847fff640 1 -- 10.20.193.45:0/1094400670 --> v1:10.20.193.45:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f086c129200 con 0x7f086c142e60 2026-02-22T23:25:49.904 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.890+0000 7f086bfff640 10 monclient: get_auth_request con 0x7f083c03f780 auth_method 0 2026-02-22T23:25:49.904 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.890+0000 7f0847fff640 1 -- 10.20.193.45:0/1094400670 <== mon.2 v1:10.20.193.45:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1597254941 0 0) 0x7f086c129200 con 0x7f086c142e60 2026-02-22T23:25:49.904 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.890+0000 7f0847fff640 1 -- 10.20.193.45:0/1094400670 --> v1:10.20.193.45:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f086c0008d0 con 0x7f086c142e60 2026-02-22T23:25:49.904 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.890+0000 7f0847fff640 1 -- 10.20.193.45:0/1094400670 <== mon.2 v1:10.20.193.45:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f0858004c20 con 0x7f086c142e60 2026-02-22T23:25:49.904 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.890+0000 7f0847fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:25:49.904 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.890+0000 7f0847fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-22T23:25:49.905 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.890+0000 7f0847fff640 10 monclient: dump: 2026-02-22T23:25:49.905 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:49.905 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:49.905 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:49.905 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:49.905 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:49.905 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:49.905 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:49.905 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:49.905 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:49.905 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:49.905 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:49.905 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:49.905 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:49.905 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:49.905 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:49.905 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:49.905 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.890+0000 7f0847fff640 1 -- 10.20.193.45:0/1094400670 <== mon.2 v1:10.20.193.45:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3473010277 0 0) 0x7f086c0008d0 con 0x7f086c142e60 2026-02-22T23:25:49.905 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.890+0000 7f0847fff640 1 -- 10.20.193.45:0/1094400670 --> v1:10.20.193.45:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f086c1220f0 con 0x7f086c142e60 2026-02-22T23:25:49.905 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.891+0000 7f0847fff640 1 -- 10.20.193.45:0/1094400670 <== mon.2 v1:10.20.193.45:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (unknown 0 0 2024835662) 0x7f0858002cc0 con 0x7f086c142e60 2026-02-22T23:25:49.905 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.891+0000 7f0847fff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T23:25:49.906 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.891+0000 7f0847fff640 10 monclient: _finish_command 1 = system:0 2026-02-22T23:25:49.906 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.891+0000 7f0847fff640 1 -- 10.20.193.45:0/1094400670 >> v1:10.20.193.45:6790/0 conn(0x7f086c142e60 legacy=0x7f086c1219e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:49.906 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.891+0000 7f0847fff640 1 -- 10.20.193.45:0/1094400670 >> v1:10.20.193.45:6790/0 conn(0x7f086c142e60 legacy=0x7f086c1219e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T23:25:49.906 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.894+0000 7f0871ef3640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-22T23:25:49.906 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.894+0000 7f0871ef3640 1 -- 10.20.193.45:0/1094400670 --> v1:10.20.193.45:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f086c122680 con 0x7f086c1222a0 2026-02-22T23:25:49.906 INFO:teuthology.orchestra.run.trial073.stdout:process_1_[46024]: starting. 2026-02-22T23:25:49.906 INFO:teuthology.orchestra.run.trial073.stdout:process_1_[46024]: creating pool ceph_test_rados_delete_pools_parallel.trial073-46023 2026-02-22T23:25:49.907 INFO:teuthology.orchestra.run.trial073.stdout:process_1_[46024]: created object 0... 2026-02-22T23:25:49.907 INFO:teuthology.orchestra.run.trial073.stdout:process_1_[46024]: created object 25... 2026-02-22T23:25:49.907 INFO:teuthology.orchestra.run.trial073.stdout:process_1_[46024]: created object 49... 2026-02-22T23:25:49.907 INFO:teuthology.orchestra.run.trial073.stdout:process_1_[46024]: finishing. 2026-02-22T23:25:49.907 INFO:teuthology.orchestra.run.trial073.stdout:process_1_[46024]: shutting down. 2026-02-22T23:25:49.907 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.894+0000 7f0847fff640 1 -- 10.20.193.45:0/1094400670 <== mon.2 v1:10.20.193.45:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 436653043 0 0) 0x7f086c122680 con 0x7f086c1222a0 2026-02-22T23:25:49.907 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.894+0000 7f0847fff640 10 monclient(hunting): _negotiate 2026-02-22T23:25:49.908 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.894+0000 7f0847fff640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:49.908 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.894+0000 7f0847fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:49.908 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.894+0000 7f0847fff640 10 monclient(hunting): my global_id is 4529 2026-02-22T23:25:49.908 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.894+0000 7f0847fff640 1 -- 10.20.193.45:0/1094400670 --> v1:10.20.193.45:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f086c0008d0 con 0x7f086c1222a0 2026-02-22T23:25:49.908 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.894+0000 7f0847fff640 1 -- 10.20.193.45:0/1094400670 <== mon.2 v1:10.20.193.45:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3723244530 0 0) 0x7f086c0008d0 con 0x7f086c1222a0 2026-02-22T23:25:49.908 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.894+0000 7f0847fff640 1 -- 10.20.193.45:0/1094400670 --> v1:10.20.193.45:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f086c122680 con 0x7f086c1222a0 2026-02-22T23:25:49.908 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.894+0000 7f0847fff640 1 -- 10.20.193.45:0/1094400670 <== mon.2 v1:10.20.193.45:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f0858003500 con 0x7f086c1222a0 2026-02-22T23:25:49.908 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.894+0000 7f0847fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:25:49.908 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.894+0000 7f0847fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-22T23:25:49.908 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.894+0000 7f0847fff640 10 monclient: dump: 2026-02-22T23:25:49.908 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:49.908 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:49.908 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:49.908 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:49.908 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:49.908 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:49.908 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:49.908 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:49.908 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:49.909 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:49.909 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:49.909 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:49.909 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:49.909 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:49.909 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:49.909 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:49.909 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.894+0000 7f0847fff640 1 -- 10.20.193.45:0/1094400670 <== mon.2 v1:10.20.193.45:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3298808610 0 0) 0x7f086c122680 con 0x7f086c1222a0 2026-02-22T23:25:49.909 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.894+0000 7f0847fff640 1 -- 10.20.193.45:0/1094400670 --> v1:10.20.193.45:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f086c122850 con 0x7f086c1222a0 2026-02-22T23:25:49.909 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.894+0000 7f0847fff640 1 -- 10.20.193.45:0/1094400670 <== mon.2 v1:10.20.193.45:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7527 (unknown 0 0 1871666359) 0x7f08580070c0 con 0x7f086c1222a0 2026-02-22T23:25:49.909 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.894+0000 7f0847fff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-22T23:25:49.909 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.894+0000 7f0847fff640 10 monclient: _finish_command 2 = system:0 2026-02-22T23:25:49.909 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.894+0000 7f0847fff640 1 -- 10.20.193.45:0/1094400670 >> v1:10.20.193.45:6790/0 conn(0x7f086c1222a0 legacy=0x7f086c1de730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:49.909 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.894+0000 7f0847fff640 1 -- 10.20.193.45:0/1094400670 >> v1:10.20.193.45:6790/0 conn(0x7f086c1222a0 legacy=0x7f086c1de730 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T23:25:49.909 INFO:teuthology.orchestra.run.trial045.stdout:{ 2026-02-22T23:25:49.909 INFO:teuthology.orchestra.run.trial045.stdout: "name": "b", 2026-02-22T23:25:49.910 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 2, 2026-02-22T23:25:49.910 INFO:teuthology.orchestra.run.trial045.stdout: "state": "peon", 2026-02-22T23:25:49.910 INFO:teuthology.orchestra.run.trial045.stdout: "election_epoch": 8, 2026-02-22T23:25:49.910 INFO:teuthology.orchestra.run.trial045.stdout: "uptime": 30047, 2026-02-22T23:25:49.910 INFO:teuthology.orchestra.run.trial045.stdout: "quorum": [ 2026-02-22T23:25:49.910 INFO:teuthology.orchestra.run.trial045.stdout: 0, 2026-02-22T23:25:49.910 INFO:teuthology.orchestra.run.trial045.stdout: 1, 2026-02-22T23:25:49.910 INFO:teuthology.orchestra.run.trial045.stdout: 2, 2026-02-22T23:25:49.910 INFO:teuthology.orchestra.run.trial045.stdout: 3, 2026-02-22T23:25:49.910 INFO:teuthology.orchestra.run.trial045.stdout: 4, 2026-02-22T23:25:49.910 INFO:teuthology.orchestra.run.trial045.stdout: 5, 2026-02-22T23:25:49.910 INFO:teuthology.orchestra.run.trial045.stdout: 6, 2026-02-22T23:25:49.910 INFO:teuthology.orchestra.run.trial045.stdout: 7, 2026-02-22T23:25:49.910 INFO:teuthology.orchestra.run.trial045.stdout: 8 2026-02-22T23:25:49.910 INFO:teuthology.orchestra.run.trial045.stdout: ], 2026-02-22T23:25:49.910 INFO:teuthology.orchestra.run.trial045.stdout: "quorum_age": 24, 2026-02-22T23:25:49.910 INFO:teuthology.orchestra.run.trial045.stdout: "features": { 2026-02-22T23:25:49.910 INFO:teuthology.orchestra.run.trial045.stdout: "required_con": "2450521708007866372", 2026-02-22T23:25:49.910 INFO:teuthology.orchestra.run.trial045.stdout: "required_mon": [ 2026-02-22T23:25:49.911 INFO:teuthology.orchestra.run.trial045.stdout: "kraken", 2026-02-22T23:25:49.911 INFO:teuthology.orchestra.run.trial045.stdout: "luminous", 2026-02-22T23:25:49.911 INFO:teuthology.orchestra.run.trial045.stdout: "mimic", 2026-02-22T23:25:49.911 INFO:teuthology.orchestra.run.trial045.stdout: "osdmap-prune", 2026-02-22T23:25:49.911 INFO:teuthology.orchestra.run.trial045.stdout: "nautilus", 2026-02-22T23:25:49.911 INFO:teuthology.orchestra.run.trial045.stdout: "octopus", 2026-02-22T23:25:49.911 INFO:teuthology.orchestra.run.trial045.stdout: "pacific", 2026-02-22T23:25:49.911 INFO:teuthology.orchestra.run.trial045.stdout: "elector-pinging", 2026-02-22T23:25:49.911 INFO:teuthology.orchestra.run.trial045.stdout: "quincy", 2026-02-22T23:25:49.911 INFO:teuthology.orchestra.run.trial045.stdout: "reef", 2026-02-22T23:25:49.911 INFO:teuthology.orchestra.run.trial045.stdout: "squid" 2026-02-22T23:25:49.911 INFO:teuthology.orchestra.run.trial045.stdout: ], 2026-02-22T23:25:49.911 INFO:teuthology.orchestra.run.trial045.stdout: "quorum_con": "4540701547738038271", 2026-02-22T23:25:49.911 INFO:teuthology.orchestra.run.trial045.stdout: "quorum_mon": [ 2026-02-22T23:25:49.911 INFO:teuthology.orchestra.run.trial045.stdout: "kraken", 2026-02-22T23:25:49.911 INFO:teuthology.orchestra.run.trial045.stdout: "luminous", 2026-02-22T23:25:49.911 INFO:teuthology.orchestra.run.trial045.stdout: "mimic", 2026-02-22T23:25:49.911 INFO:teuthology.orchestra.run.trial045.stdout: "osdmap-prune", 2026-02-22T23:25:49.911 INFO:teuthology.orchestra.run.trial045.stdout: "nautilus", 2026-02-22T23:25:49.911 INFO:teuthology.orchestra.run.trial045.stdout: "octopus", 2026-02-22T23:25:49.912 INFO:teuthology.orchestra.run.trial045.stdout: "pacific", 2026-02-22T23:25:49.912 INFO:teuthology.orchestra.run.trial045.stdout: "elector-pinging", 2026-02-22T23:25:49.912 INFO:teuthology.orchestra.run.trial045.stdout: "quincy", 2026-02-22T23:25:49.912 INFO:teuthology.orchestra.run.trial045.stdout: "reef", 2026-02-22T23:25:49.912 INFO:teuthology.orchestra.run.trial045.stdout: "squid" 2026-02-22T23:25:49.912 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:25:49.912 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:25:49.912 INFO:teuthology.orchestra.run.trial045.stdout: "outside_quorum": [], 2026-02-22T23:25:49.912 INFO:teuthology.orchestra.run.trial045.stdout: "extra_probe_peers": [], 2026-02-22T23:25:49.912 INFO:teuthology.orchestra.run.trial045.stdout: "sync_provider": [], 2026-02-22T23:25:49.912 INFO:teuthology.orchestra.run.trial045.stdout: "monmap": { 2026-02-22T23:25:49.912 INFO:teuthology.orchestra.run.trial045.stdout: "epoch": 1, 2026-02-22T23:25:49.912 INFO:teuthology.orchestra.run.trial045.stdout: "fsid": "4b60f18f-6660-4731-b731-dc85c4078413", 2026-02-22T23:25:49.912 INFO:teuthology.orchestra.run.trial045.stdout: "modified": "2026-02-22T23:24:52.393472Z", 2026-02-22T23:25:49.912 INFO:teuthology.orchestra.run.trial045.stdout: "created": "2026-02-22T23:24:52.393472Z", 2026-02-22T23:25:49.912 INFO:teuthology.orchestra.run.trial045.stdout: "min_mon_release": 19, 2026-02-22T23:25:49.912 INFO:teuthology.orchestra.run.trial045.stdout: "min_mon_release_name": "squid", 2026-02-22T23:25:49.912 INFO:teuthology.orchestra.run.trial045.stdout: "election_strategy": 3, 2026-02-22T23:25:49.913 INFO:teuthology.orchestra.run.trial045.stdout: "disallowed_leaders": "", 2026-02-22T23:25:49.913 INFO:teuthology.orchestra.run.trial045.stdout: "stretch_mode": false, 2026-02-22T23:25:49.913 INFO:teuthology.orchestra.run.trial045.stdout: "tiebreaker_mon": "", 2026-02-22T23:25:49.913 INFO:teuthology.orchestra.run.trial045.stdout: "removed_ranks": "", 2026-02-22T23:25:49.913 INFO:teuthology.orchestra.run.trial045.stdout: "features": { 2026-02-22T23:25:49.913 INFO:teuthology.orchestra.run.trial045.stdout: "persistent": [ 2026-02-22T23:25:49.913 INFO:teuthology.orchestra.run.trial045.stdout: "kraken", 2026-02-22T23:25:49.913 INFO:teuthology.orchestra.run.trial045.stdout: "luminous", 2026-02-22T23:25:49.913 INFO:teuthology.orchestra.run.trial045.stdout: "mimic", 2026-02-22T23:25:49.913 INFO:teuthology.orchestra.run.trial045.stdout: "osdmap-prune", 2026-02-22T23:25:49.913 INFO:teuthology.orchestra.run.trial045.stdout: "nautilus", 2026-02-22T23:25:49.913 INFO:teuthology.orchestra.run.trial045.stdout: "octopus", 2026-02-22T23:25:49.913 INFO:teuthology.orchestra.run.trial045.stdout: "pacific", 2026-02-22T23:25:49.913 INFO:teuthology.orchestra.run.trial045.stdout: "elector-pinging", 2026-02-22T23:25:49.913 INFO:teuthology.orchestra.run.trial045.stdout: "quincy", 2026-02-22T23:25:49.913 INFO:teuthology.orchestra.run.trial045.stdout: "reef", 2026-02-22T23:25:49.913 INFO:teuthology.orchestra.run.trial045.stdout: "squid" 2026-02-22T23:25:49.913 INFO:teuthology.orchestra.run.trial045.stdout: ], 2026-02-22T23:25:49.913 INFO:teuthology.orchestra.run.trial045.stdout: "optional": [] 2026-02-22T23:25:49.913 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:25:49.913 INFO:teuthology.orchestra.run.trial045.stdout: "mons": [ 2026-02-22T23:25:49.914 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:25:49.914 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 0, 2026-02-22T23:25:49.914 INFO:teuthology.orchestra.run.trial045.stdout: "name": "a", 2026-02-22T23:25:49.914 INFO:teuthology.orchestra.run.trial045.stdout: "public_addrs": { 2026-02-22T23:25:49.914 INFO:teuthology.orchestra.run.trial045.stdout: "addrvec": [ 2026-02-22T23:25:49.914 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:25:49.914 INFO:teuthology.orchestra.run.trial045.stdout: "type": "v1", 2026-02-22T23:25:49.914 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6789", 2026-02-22T23:25:49.914 INFO:teuthology.orchestra.run.trial045.stdout: "nonce": 0 2026-02-22T23:25:49.914 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:25:49.914 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:25:49.914 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:25:49.914 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6789/0", 2026-02-22T23:25:49.914 INFO:teuthology.orchestra.run.trial045.stdout: "public_addr": "10.20.193.45:6789/0", 2026-02-22T23:25:49.914 INFO:teuthology.orchestra.run.trial045.stdout: "priority": 0, 2026-02-22T23:25:49.914 INFO:teuthology.orchestra.run.trial045.stdout: "weight": 0, 2026-02-22T23:25:49.914 INFO:teuthology.orchestra.run.trial045.stdout: "crush_location": "{}" 2026-02-22T23:25:49.914 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:25:49.914 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:25:49.915 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 1, 2026-02-22T23:25:49.915 INFO:teuthology.orchestra.run.trial045.stdout: "name": "f", 2026-02-22T23:25:49.915 INFO:teuthology.orchestra.run.trial045.stdout: "public_addrs": { 2026-02-22T23:25:49.915 INFO:teuthology.orchestra.run.trial045.stdout: "addrvec": [ 2026-02-22T23:25:49.915 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:25:49.915 INFO:teuthology.orchestra.run.trial045.stdout: "type": "v1", 2026-02-22T23:25:49.915 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.73:6789", 2026-02-22T23:25:49.915 INFO:teuthology.orchestra.run.trial045.stdout: "nonce": 0 2026-02-22T23:25:49.915 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:25:49.915 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:25:49.915 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:25:49.915 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.73:6789/0", 2026-02-22T23:25:49.915 INFO:teuthology.orchestra.run.trial045.stdout: "public_addr": "10.20.193.73:6789/0", 2026-02-22T23:25:49.915 INFO:teuthology.orchestra.run.trial045.stdout: "priority": 0, 2026-02-22T23:25:49.915 INFO:teuthology.orchestra.run.trial045.stdout: "weight": 0, 2026-02-22T23:25:49.915 INFO:teuthology.orchestra.run.trial045.stdout: "crush_location": "{}" 2026-02-22T23:25:49.915 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:25:49.915 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:25:49.915 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 2, 2026-02-22T23:25:49.915 INFO:teuthology.orchestra.run.trial045.stdout: "name": "b", 2026-02-22T23:25:49.915 INFO:teuthology.orchestra.run.trial045.stdout: "public_addrs": { 2026-02-22T23:25:49.915 INFO:teuthology.orchestra.run.trial045.stdout: "addrvec": [ 2026-02-22T23:25:49.915 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:25:49.916 INFO:teuthology.orchestra.run.trial045.stdout: "type": "v1", 2026-02-22T23:25:49.916 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6790", 2026-02-22T23:25:49.916 INFO:teuthology.orchestra.run.trial045.stdout: "nonce": 0 2026-02-22T23:25:49.916 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:25:49.916 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:25:49.916 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:25:49.916 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6790/0", 2026-02-22T23:25:49.916 INFO:teuthology.orchestra.run.trial045.stdout: "public_addr": "10.20.193.45:6790/0", 2026-02-22T23:25:49.916 INFO:teuthology.orchestra.run.trial045.stdout: "priority": 0, 2026-02-22T23:25:49.916 INFO:teuthology.orchestra.run.trial045.stdout: "weight": 0, 2026-02-22T23:25:49.916 INFO:teuthology.orchestra.run.trial045.stdout: "crush_location": "{}" 2026-02-22T23:25:49.916 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:25:49.916 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:25:49.916 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 3, 2026-02-22T23:25:49.916 INFO:teuthology.orchestra.run.trial045.stdout: "name": "g", 2026-02-22T23:25:49.916 INFO:teuthology.orchestra.run.trial045.stdout: "public_addrs": { 2026-02-22T23:25:49.916 INFO:teuthology.orchestra.run.trial045.stdout: "addrvec": [ 2026-02-22T23:25:49.916 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:25:49.916 INFO:teuthology.orchestra.run.trial045.stdout: "type": "v1", 2026-02-22T23:25:49.916 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.73:6790", 2026-02-22T23:25:49.916 INFO:teuthology.orchestra.run.trial045.stdout: "nonce": 0 2026-02-22T23:25:49.917 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:25:49.917 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:25:49.917 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:25:49.917 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.73:6790/0", 2026-02-22T23:25:49.917 INFO:teuthology.orchestra.run.trial045.stdout: "public_addr": "10.20.193.73:6790/0", 2026-02-22T23:25:49.917 INFO:teuthology.orchestra.run.trial045.stdout: "priority": 0, 2026-02-22T23:25:49.917 INFO:teuthology.orchestra.run.trial045.stdout: "weight": 0, 2026-02-22T23:25:49.917 INFO:teuthology.orchestra.run.trial045.stdout: "crush_location": "{}" 2026-02-22T23:25:49.917 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:25:49.917 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:25:49.917 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 4, 2026-02-22T23:25:49.917 INFO:teuthology.orchestra.run.trial045.stdout: "name": "c", 2026-02-22T23:25:49.917 INFO:teuthology.orchestra.run.trial045.stdout: "public_addrs": { 2026-02-22T23:25:49.917 INFO:teuthology.orchestra.run.trial045.stdout: "addrvec": [ 2026-02-22T23:25:49.917 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:25:49.917 INFO:teuthology.orchestra.run.trial045.stdout: "type": "v1", 2026-02-22T23:25:49.917 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6791", 2026-02-22T23:25:49.917 INFO:teuthology.orchestra.run.trial045.stdout: "nonce": 0 2026-02-22T23:25:49.917 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:25:49.917 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:25:49.917 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:25:49.917 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6791/0", 2026-02-22T23:25:49.918 INFO:teuthology.orchestra.run.trial045.stdout: "public_addr": "10.20.193.45:6791/0", 2026-02-22T23:25:49.918 INFO:teuthology.orchestra.run.trial045.stdout: "priority": 0, 2026-02-22T23:25:49.918 INFO:teuthology.orchestra.run.trial045.stdout: "weight": 0, 2026-02-22T23:25:49.918 INFO:teuthology.orchestra.run.trial045.stdout: "crush_location": "{}" 2026-02-22T23:25:49.918 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:25:49.918 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:25:49.918 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 5, 2026-02-22T23:25:49.918 INFO:teuthology.orchestra.run.trial045.stdout: "name": "h", 2026-02-22T23:25:49.918 INFO:teuthology.orchestra.run.trial045.stdout: "public_addrs": { 2026-02-22T23:25:49.918 INFO:teuthology.orchestra.run.trial045.stdout: "addrvec": [ 2026-02-22T23:25:49.918 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:25:49.918 INFO:teuthology.orchestra.run.trial045.stdout: "type": "v1", 2026-02-22T23:25:49.918 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.73:6791", 2026-02-22T23:25:49.918 INFO:teuthology.orchestra.run.trial045.stdout: "nonce": 0 2026-02-22T23:25:49.918 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:25:49.918 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:25:49.918 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:25:49.918 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.73:6791/0", 2026-02-22T23:25:49.918 INFO:teuthology.orchestra.run.trial045.stdout: "public_addr": "10.20.193.73:6791/0", 2026-02-22T23:25:49.918 INFO:teuthology.orchestra.run.trial045.stdout: "priority": 0, 2026-02-22T23:25:49.918 INFO:teuthology.orchestra.run.trial045.stdout: "weight": 0, 2026-02-22T23:25:49.919 INFO:teuthology.orchestra.run.trial045.stdout: "crush_location": "{}" 2026-02-22T23:25:49.919 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:25:49.919 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:25:49.919 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 6, 2026-02-22T23:25:49.919 INFO:teuthology.orchestra.run.trial045.stdout: "name": "d", 2026-02-22T23:25:49.919 INFO:teuthology.orchestra.run.trial045.stdout: "public_addrs": { 2026-02-22T23:25:49.919 INFO:teuthology.orchestra.run.trial045.stdout: "addrvec": [ 2026-02-22T23:25:49.919 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:25:49.919 INFO:teuthology.orchestra.run.trial045.stdout: "type": "v1", 2026-02-22T23:25:49.919 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6792", 2026-02-22T23:25:49.919 INFO:teuthology.orchestra.run.trial045.stdout: "nonce": 0 2026-02-22T23:25:49.919 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:25:49.919 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:25:49.919 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:25:49.919 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6792/0", 2026-02-22T23:25:49.919 INFO:teuthology.orchestra.run.trial045.stdout: "public_addr": "10.20.193.45:6792/0", 2026-02-22T23:25:49.919 INFO:teuthology.orchestra.run.trial045.stdout: "priority": 0, 2026-02-22T23:25:49.919 INFO:teuthology.orchestra.run.trial045.stdout: "weight": 0, 2026-02-22T23:25:49.919 INFO:teuthology.orchestra.run.trial045.stdout: "crush_location": "{}" 2026-02-22T23:25:49.919 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:25:49.919 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:25:49.919 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 7, 2026-02-22T23:25:49.919 INFO:teuthology.orchestra.run.trial045.stdout: "name": "i", 2026-02-22T23:25:49.920 INFO:teuthology.orchestra.run.trial045.stdout: "public_addrs": { 2026-02-22T23:25:49.920 INFO:teuthology.orchestra.run.trial045.stdout: "addrvec": [ 2026-02-22T23:25:49.920 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:25:49.920 INFO:teuthology.orchestra.run.trial045.stdout: "type": "v1", 2026-02-22T23:25:49.920 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.73:6792", 2026-02-22T23:25:49.920 INFO:teuthology.orchestra.run.trial045.stdout: "nonce": 0 2026-02-22T23:25:49.920 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:25:49.920 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:25:49.920 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:25:49.920 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.73:6792/0", 2026-02-22T23:25:49.920 INFO:teuthology.orchestra.run.trial045.stdout: "public_addr": "10.20.193.73:6792/0", 2026-02-22T23:25:49.920 INFO:teuthology.orchestra.run.trial045.stdout: "priority": 0, 2026-02-22T23:25:49.920 INFO:teuthology.orchestra.run.trial045.stdout: "weight": 0, 2026-02-22T23:25:49.920 INFO:teuthology.orchestra.run.trial045.stdout: "crush_location": "{}" 2026-02-22T23:25:49.920 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:25:49.920 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:25:49.920 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 8, 2026-02-22T23:25:49.920 INFO:teuthology.orchestra.run.trial045.stdout: "name": "e", 2026-02-22T23:25:49.920 INFO:teuthology.orchestra.run.trial045.stdout: "public_addrs": { 2026-02-22T23:25:49.920 INFO:teuthology.orchestra.run.trial045.stdout: "addrvec": [ 2026-02-22T23:25:49.920 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:25:49.920 INFO:teuthology.orchestra.run.trial045.stdout: "type": "v1", 2026-02-22T23:25:49.920 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6793", 2026-02-22T23:25:49.920 INFO:teuthology.orchestra.run.trial045.stdout: "nonce": 0 2026-02-22T23:25:49.921 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:25:49.921 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:25:49.921 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:25:49.921 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6793/0", 2026-02-22T23:25:49.921 INFO:teuthology.orchestra.run.trial045.stdout: "public_addr": "10.20.193.45:6793/0", 2026-02-22T23:25:49.921 INFO:teuthology.orchestra.run.trial045.stdout: "priority": 0, 2026-02-22T23:25:49.921 INFO:teuthology.orchestra.run.trial045.stdout: "weight": 0, 2026-02-22T23:25:49.921 INFO:teuthology.orchestra.run.trial045.stdout: "crush_location": "{}" 2026-02-22T23:25:49.921 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:25:49.921 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:25:49.921 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:25:49.921 INFO:teuthology.orchestra.run.trial045.stdout: "feature_map": { 2026-02-22T23:25:49.921 INFO:teuthology.orchestra.run.trial045.stdout: "mon": [ 2026-02-22T23:25:49.921 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:25:49.921 INFO:teuthology.orchestra.run.trial045.stdout: "features": "0x3f03cffffffdffff", 2026-02-22T23:25:49.921 INFO:teuthology.orchestra.run.trial045.stdout: "release": "squid", 2026-02-22T23:25:49.921 INFO:teuthology.orchestra.run.trial045.stdout: "num": 1 2026-02-22T23:25:49.921 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:25:49.921 INFO:teuthology.orchestra.run.trial045.stdout: ], 2026-02-22T23:25:49.921 INFO:teuthology.orchestra.run.trial045.stdout: "client": [ 2026-02-22T23:25:49.921 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:25:49.921 INFO:teuthology.orchestra.run.trial045.stdout: "features": "0x3f03cffffffdffff", 2026-02-22T23:25:49.921 INFO:teuthology.orchestra.run.trial045.stdout: "release": "squid", 2026-02-22T23:25:49.921 INFO:teuthology.orchestra.run.trial045.stdout: "num": 1 2026-02-22T23:25:49.921 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:25:49.922 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:25:49.922 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:25:49.922 INFO:teuthology.orchestra.run.trial045.stdout: "stretch_mode": false 2026-02-22T23:25:49.922 INFO:teuthology.orchestra.run.trial045.stdout:} 2026-02-22T23:25:49.923 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.894+0000 7f0871ef3640 1 -- 10.20.193.45:0/1094400670 >> v1:10.20.193.73:6800/2222410180 conn(0x7f083c03f780 legacy=0x7f083c041c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:49.923 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.894+0000 7f0871ef3640 10 monclient: shutdown 2026-02-22T23:25:49.923 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.894+0000 7f0871ef3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T23:25:49.923 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.894+0000 7f0871ef3640 1 -- 10.20.193.45:0/1094400670 >> v1:10.20.193.45:6789/0 conn(0x7f086c0a5d90 legacy=0x7f086c125c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:49.923 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.894+0000 7f086bfff640 1 -- 10.20.193.45:0/1094400670 reap_dead start 2026-02-22T23:25:49.923 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.894+0000 7f086bfff640 1 -- 10.20.193.45:0/1094400670 reap_dead start 2026-02-22T23:25:49.923 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.894+0000 7f0871ef3640 1 -- 10.20.193.45:0/1094400670 shutdown_connections 2026-02-22T23:25:49.923 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.894+0000 7f0871ef3640 1 -- 10.20.193.45:0/1094400670 >> 10.20.193.45:0/1094400670 conn(0x7f086c0ab9c0 msgr2=0x7f086c142430 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:25:49.923 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.895+0000 7f0871ef3640 1 -- 10.20.193.45:0/1094400670 shutdown_connections 2026-02-22T23:25:49.923 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.895+0000 7f0871ef3640 1 -- 10.20.193.45:0/1094400670 wait complete. 2026-02-22T23:25:49.923 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2026-02-22T23:25:49.923 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon c 2026-02-22T23:25:49.924 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-22T23:25:49.997 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.991+0000 7f3b8b955640 10 monclient: get_monmap_and_config 2026-02-22T23:25:49.997 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.991+0000 7f3b8b955640 10 monclient: build_initial_monmap 2026-02-22T23:25:49.997 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.991+0000 7f3b8b955640 10 monclient: monmap: 2026-02-22T23:25:49.997 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-22T23:25:49.997 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:49.997 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:25:49.991504+0000 2026-02-22T23:25:49.997 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:25:49.991504+0000 2026-02-22T23:25:49.997 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-22T23:25:49.998 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:49.998 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-22T23:25:49.998 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.noname-f 2026-02-22T23:25:49.998 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.noname-b 2026-02-22T23:25:49.998 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.noname-g 2026-02-22T23:25:49.998 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.noname-c 2026-02-22T23:25:49.998 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.noname-h 2026-02-22T23:25:49.998 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.noname-d 2026-02-22T23:25:49.998 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.noname-i 2026-02-22T23:25:49.998 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.noname-e 2026-02-22T23:25:49.998 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:49.998 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.991+0000 7f3b8b955640 1 Processor -- start 2026-02-22T23:25:49.998 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.991+0000 7f3b8b955640 1 -- start start 2026-02-22T23:25:49.998 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.991+0000 7f3b8b955640 10 monclient: init 2026-02-22T23:25:49.998 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.991+0000 7f3b8b955640 10 monclient: _reopen_session rank -1 2026-02-22T23:25:49.998 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.991+0000 7f3b8b955640 10 monclient: _add_conns ranks=[0,7,2,8,5,4,1,6,3] 2026-02-22T23:25:49.998 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.992+0000 7f3b8b955640 10 monclient(hunting): picked mon.noname-a con 0x7f3b84139240 addr v1:10.20.193.45:6789/0 2026-02-22T23:25:49.998 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.992+0000 7f3b8b955640 10 monclient(hunting): picked mon.noname-i con 0x7f3b840a51e0 addr v1:10.20.193.73:6792/0 2026-02-22T23:25:49.998 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.992+0000 7f3b8b955640 10 monclient(hunting): picked mon.noname-b con 0x7f3b8413f8a0 addr v1:10.20.193.45:6790/0 2026-02-22T23:25:49.998 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.992+0000 7f3b8b955640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3b8406cde0 con 0x7f3b84139240 2026-02-22T23:25:49.998 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.992+0000 7f3b8b955640 1 -- --> v1:10.20.193.45:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3b840a55c0 con 0x7f3b8413f8a0 2026-02-22T23:25:49.998 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.992+0000 7f3b8b955640 1 -- --> v1:10.20.193.73:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3b8406e850 con 0x7f3b840a51e0 2026-02-22T23:25:49.998 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.992+0000 7f3b8b955640 10 monclient(hunting): _renew_subs 2026-02-22T23:25:49.999 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.992+0000 7f3b8b955640 10 monclient(hunting): authenticate will time out at 681.608057s 2026-02-22T23:25:49.999 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.992+0000 7f3b896ca640 1 --1- >> v1:10.20.193.45:6789/0 conn(0x7f3b84139240 0x7f3b84139620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.45:6789/0 says I am v1:10.20.193.45:58336/0 (socket says 10.20.193.45:58336) 2026-02-22T23:25:49.999 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.992+0000 7f3b896ca640 1 -- 10.20.193.45:0/452227574 learned_addr learned my addr 10.20.193.45:0/452227574 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-22T23:25:49.999 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.992+0000 7f3b73fff640 1 -- 10.20.193.45:0/452227574 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4073473189 0 0) 0x7f3b8406cde0 con 0x7f3b84139240 2026-02-22T23:25:49.999 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.992+0000 7f3b73fff640 10 monclient(hunting): _negotiate 2026-02-22T23:25:49.999 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.992+0000 7f3b73fff640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:49.999 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.992+0000 7f3b73fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:49.999 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.992+0000 7f3b73fff640 10 monclient(hunting): my global_id is 4437 2026-02-22T23:25:49.999 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.992+0000 7f3b73fff640 1 -- 10.20.193.45:0/452227574 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3b6c003620 con 0x7f3b84139240 2026-02-22T23:25:49.999 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.992+0000 7f3b73fff640 1 -- 10.20.193.45:0/452227574 <== mon.2 v1:10.20.193.45:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 837243067 0 0) 0x7f3b840a55c0 con 0x7f3b8413f8a0 2026-02-22T23:25:49.999 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.992+0000 7f3b73fff640 10 monclient(hunting): _negotiate 2026-02-22T23:25:49.999 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.992+0000 7f3b73fff640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:49.999 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.992+0000 7f3b73fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:49.999 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.992+0000 7f3b73fff640 10 monclient(hunting): my global_id is 4538 2026-02-22T23:25:49.999 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.992+0000 7f3b73fff640 1 -- 10.20.193.45:0/452227574 --> v1:10.20.193.45:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3b8406cde0 con 0x7f3b8413f8a0 2026-02-22T23:25:49.999 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.992+0000 7f3b73fff640 1 -- 10.20.193.45:0/452227574 <== mon.0 v1:10.20.193.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3954200083 0 0) 0x7f3b6c003620 con 0x7f3b84139240 2026-02-22T23:25:49.999 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.992+0000 7f3b73fff640 1 -- 10.20.193.45:0/452227574 >> v1:10.20.193.73:6792/0 conn(0x7f3b840a51e0 legacy=0x7f3b8413e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:49.999 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.992+0000 7f3b73fff640 1 -- 10.20.193.45:0/452227574 >> v1:10.20.193.45:6790/0 conn(0x7f3b8413f8a0 legacy=0x7f3b84141c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:49.999 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.992+0000 7f3b73fff640 10 monclient: _finish_hunting 0 2026-02-22T23:25:49.999 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.992+0000 7f3b73fff640 1 monclient: found mon.noname-a 2026-02-22T23:25:49.999 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.992+0000 7f3b73fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T23:25:49.999 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.992+0000 7f3b73fff640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.45:6789/0 2026-02-22T23:25:49.999 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.992+0000 7f3b73fff640 1 -- 10.20.193.45:0/452227574 --> v1:10.20.193.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b8406cba0 con 0x7f3b84139240 2026-02-22T23:25:49.999 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.992+0000 7f3b73fff640 10 monclient: _finish_auth 0 2026-02-22T23:25:50.000 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.992+0000 7f3b73fff640 10 monclient: _check_auth_tickets 2026-02-22T23:25:50.000 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.992+0000 7f3b73fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T23:25:50.000 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.992+0000 7f3b73fff640 1 -- 10.20.193.45:0/452227574 <== mon.0 v1:10.20.193.45:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f3b74003040 con 0x7f3b84139240 2026-02-22T23:25:50.000 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.992+0000 7f3b73fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:25:50.000 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.992+0000 7f3b73fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T23:25:50.000 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.992+0000 7f3b73fff640 10 monclient: dump: 2026-02-22T23:25:50.000 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:50.000 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:50.000 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:50.000 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:50.000 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:50.000 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:50.000 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:50.000 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:50.000 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:50.000 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:50.000 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:50.000 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:50.000 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:50.000 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:50.000 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:50.000 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:50.000 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.992+0000 7f3b8b955640 5 monclient: authenticate success, global_id 4437 2026-02-22T23:25:50.000 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.992+0000 7f3b8b955640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-22T23:25:50.000 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.992+0000 7f3b73fff640 1 -- 10.20.193.45:0/452227574 <== mon.0 v1:10.20.193.45:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3b74003260 con 0x7f3b84139240 2026-02-22T23:25:50.001 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.992+0000 7f3b73fff640 10 monclient: handle_config config(0 keys) 2026-02-22T23:25:50.001 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.992+0000 7f3b73fff640 1 -- 10.20.193.45:0/452227574 <== mon.0 v1:10.20.193.45:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f3b74004ce0 con 0x7f3b84139240 2026-02-22T23:25:50.001 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.992+0000 7f3b73fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:25:50.001 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.992+0000 7f3b73fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T23:25:50.001 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.992+0000 7f3b73fff640 10 monclient: dump: 2026-02-22T23:25:50.001 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:50.001 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:50.001 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:50.001 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:50.001 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:50.001 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:50.001 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:50.001 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:50.001 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:50.001 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:50.001 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:50.001 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:50.001 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:50.001 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:50.001 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:50.001 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:50.001 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.992+0000 7f3b8b955640 10 monclient: get_monmap_and_config success 2026-02-22T23:25:50.001 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.992+0000 7f3b8b955640 4 set_mon_vals no callback set 2026-02-22T23:25:50.001 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.992+0000 7f3b8b955640 10 monclient: shutdown 2026-02-22T23:25:50.001 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.992+0000 7f3b8b955640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T23:25:50.002 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.992+0000 7f3b8b955640 1 -- 10.20.193.45:0/452227574 >> v1:10.20.193.45:6789/0 conn(0x7f3b84139240 legacy=0x7f3b84139620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:50.002 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.992+0000 7f3b8b955640 1 -- 10.20.193.45:0/452227574 shutdown_connections 2026-02-22T23:25:50.002 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.992+0000 7f3b8b955640 1 -- 10.20.193.45:0/452227574 >> 10.20.193.45:0/452227574 conn(0x7f3b840a96b0 msgr2=0x7f3b840a9ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:25:50.002 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.992+0000 7f3b8b955640 1 -- 10.20.193.45:0/452227574 shutdown_connections 2026-02-22T23:25:50.002 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.992+0000 7f3b8b955640 1 -- 10.20.193.45:0/452227574 wait complete. 2026-02-22T23:25:50.002 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.993+0000 7f3b8b955640 10 monclient: build_initial_monmap 2026-02-22T23:25:50.002 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.993+0000 7f3b8b955640 10 monclient: monmap: 2026-02-22T23:25:50.002 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-22T23:25:50.002 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T23:25:50.002 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-22T23:25:50.002 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-22T23:25:50.002 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-22T23:25:50.002 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-22T23:25:50.002 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-22T23:25:50.002 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.noname-f 2026-02-22T23:25:50.002 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.noname-b 2026-02-22T23:25:50.002 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.noname-g 2026-02-22T23:25:50.002 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.noname-c 2026-02-22T23:25:50.002 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.noname-h 2026-02-22T23:25:50.002 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.noname-d 2026-02-22T23:25:50.002 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.noname-i 2026-02-22T23:25:50.002 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.noname-e 2026-02-22T23:25:50.002 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:50.002 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.993+0000 7f3b8b955640 1 Processor -- start 2026-02-22T23:25:50.002 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.993+0000 7f3b8b955640 1 -- start start 2026-02-22T23:25:50.002 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.993+0000 7f3b8b955640 10 monclient: init 2026-02-22T23:25:50.003 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.993+0000 7f3b8b955640 10 monclient: _reopen_session rank -1 2026-02-22T23:25:50.003 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.993+0000 7f3b8b955640 10 monclient: _add_conns ranks=[1,0,6,3,5,8,7,2,4] 2026-02-22T23:25:50.003 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.993+0000 7f3b8b955640 10 monclient(hunting): picked mon.noname-f con 0x7f3b840a51e0 addr v1:10.20.193.73:6789/0 2026-02-22T23:25:50.003 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.993+0000 7f3b8b955640 10 monclient(hunting): picked mon.noname-a con 0x7f3b84139240 addr v1:10.20.193.45:6789/0 2026-02-22T23:25:50.003 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.993+0000 7f3b8b955640 10 monclient(hunting): picked mon.noname-d con 0x7f3b8413f8a0 addr v1:10.20.193.45:6792/0 2026-02-22T23:25:50.003 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.993+0000 7f3b8b955640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3b840727f0 con 0x7f3b84139240 2026-02-22T23:25:50.003 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.993+0000 7f3b8b955640 1 -- --> v1:10.20.193.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3b8409ecb0 con 0x7f3b840a51e0 2026-02-22T23:25:50.003 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.993+0000 7f3b8b955640 1 -- --> v1:10.20.193.45:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3b84072ad0 con 0x7f3b8413f8a0 2026-02-22T23:25:50.003 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.993+0000 7f3b8b955640 10 monclient(hunting): _renew_subs 2026-02-22T23:25:50.003 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.993+0000 7f3b8b955640 10 monclient(hunting): authenticate will time out at 681.609856s 2026-02-22T23:25:50.003 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.993+0000 7f3b88ec9640 1 --1- >> v1:10.20.193.45:6789/0 conn(0x7f3b84139240 0x7f3b8409e5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.45:6789/0 says I am v1:10.20.193.45:58344/0 (socket says 10.20.193.45:58344) 2026-02-22T23:25:50.003 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.993+0000 7f3b88ec9640 1 -- 10.20.193.45:0/2055786822 learned_addr learned my addr 10.20.193.45:0/2055786822 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-22T23:25:50.003 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.994+0000 7f3b71ffb640 1 -- 10.20.193.45:0/2055786822 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 740051304 0 0) 0x7f3b840727f0 con 0x7f3b84139240 2026-02-22T23:25:50.003 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.994+0000 7f3b71ffb640 10 monclient(hunting): _negotiate 2026-02-22T23:25:50.003 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.994+0000 7f3b71ffb640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:50.003 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.994+0000 7f3b71ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:50.003 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.994+0000 7f3b71ffb640 10 monclient(hunting): my global_id is 4446 2026-02-22T23:25:50.003 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.994+0000 7f3b71ffb640 1 -- 10.20.193.45:0/2055786822 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3b54003620 con 0x7f3b84139240 2026-02-22T23:25:50.003 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.994+0000 7f3b71ffb640 1 -- 10.20.193.45:0/2055786822 <== mon.6 v1:10.20.193.45:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3743240344 0 0) 0x7f3b84072ad0 con 0x7f3b8413f8a0 2026-02-22T23:25:50.003 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.994+0000 7f3b71ffb640 10 monclient(hunting): _negotiate 2026-02-22T23:25:50.003 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.994+0000 7f3b71ffb640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:50.003 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.994+0000 7f3b71ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:50.003 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.994+0000 7f3b71ffb640 10 monclient(hunting): my global_id is 4425 2026-02-22T23:25:50.003 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.994+0000 7f3b71ffb640 1 -- 10.20.193.45:0/2055786822 --> v1:10.20.193.45:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3b840727f0 con 0x7f3b8413f8a0 2026-02-22T23:25:50.003 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.994+0000 7f3b71ffb640 1 -- 10.20.193.45:0/2055786822 <== mon.1 v1:10.20.193.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 762504713 0 0) 0x7f3b8409ecb0 con 0x7f3b840a51e0 2026-02-22T23:25:50.004 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.994+0000 7f3b71ffb640 10 monclient(hunting): _negotiate 2026-02-22T23:25:50.004 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.994+0000 7f3b71ffb640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:50.004 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.994+0000 7f3b71ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:50.004 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.994+0000 7f3b71ffb640 10 monclient(hunting): my global_id is 4528 2026-02-22T23:25:50.004 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.994+0000 7f3b71ffb640 1 -- 10.20.193.45:0/2055786822 --> v1:10.20.193.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3b84072ad0 con 0x7f3b840a51e0 2026-02-22T23:25:50.004 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.994+0000 7f3b71ffb640 1 -- 10.20.193.45:0/2055786822 <== mon.0 v1:10.20.193.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4291051405 0 0) 0x7f3b54003620 con 0x7f3b84139240 2026-02-22T23:25:50.004 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.994+0000 7f3b71ffb640 1 -- 10.20.193.45:0/2055786822 --> v1:10.20.193.45:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3b8409ecb0 con 0x7f3b84139240 2026-02-22T23:25:50.004 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.994+0000 7f3b71ffb640 1 -- 10.20.193.45:0/2055786822 <== mon.0 v1:10.20.193.45:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f3b780033e0 con 0x7f3b84139240 2026-02-22T23:25:50.004 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.994+0000 7f3b71ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-22T23:25:50.004 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.994+0000 7f3b71ffb640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T23:25:50.004 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.994+0000 7f3b71ffb640 10 monclient(hunting): dump: 2026-02-22T23:25:50.004 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:50.004 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:50.004 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:50.004 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:50.004 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:50.004 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:50.004 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:50.004 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:50.004 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:50.004 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:50.004 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:50.004 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:50.004 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:50.004 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:50.004 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:50.004 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:50.005 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.994+0000 7f3b71ffb640 10 monclient(hunting): _finish_auth 0 2026-02-22T23:25:50.005 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.994+0000 7f3b71ffb640 1 -- 10.20.193.45:0/2055786822 <== mon.6 v1:10.20.193.45:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 242163174 0 0) 0x7f3b840727f0 con 0x7f3b8413f8a0 2026-02-22T23:25:50.005 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.994+0000 7f3b71ffb640 1 -- 10.20.193.45:0/2055786822 --> v1:10.20.193.45:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3b54003620 con 0x7f3b8413f8a0 2026-02-22T23:25:50.005 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.994+0000 7f3b71ffb640 1 -- 10.20.193.45:0/2055786822 <== mon.6 v1:10.20.193.45:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f3b80003420 con 0x7f3b8413f8a0 2026-02-22T23:25:50.005 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.994+0000 7f3b71ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-22T23:25:50.005 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.994+0000 7f3b71ffb640 10 monclient(hunting): got monmap 1 from mon.d (according to old e1) 2026-02-22T23:25:50.005 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.994+0000 7f3b71ffb640 10 monclient(hunting): dump: 2026-02-22T23:25:50.005 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:50.005 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:50.005 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:50.005 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:50.005 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:50.005 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:50.005 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:50.005 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:50.005 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:50.005 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:50.005 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:50.005 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:50.005 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:50.005 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:50.005 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:50.005 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:50.005 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.994+0000 7f3b71ffb640 1 -- 10.20.193.45:0/2055786822 <== mon.0 v1:10.20.193.45:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1788695602 0 0) 0x7f3b8409ecb0 con 0x7f3b84139240 2026-02-22T23:25:50.005 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.994+0000 7f3b71ffb640 1 -- 10.20.193.45:0/2055786822 >> v1:10.20.193.45:6792/0 conn(0x7f3b8413f8a0 legacy=0x7f3b841d7bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:50.006 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.994+0000 7f3b71ffb640 1 -- 10.20.193.45:0/2055786822 >> v1:10.20.193.73:6789/0 conn(0x7f3b840a51e0 legacy=0x7f3b8409de90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:50.006 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.994+0000 7f3b71ffb640 10 monclient: _finish_hunting 0 2026-02-22T23:25:50.006 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.994+0000 7f3b71ffb640 1 monclient: found mon.a 2026-02-22T23:25:50.006 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.994+0000 7f3b71ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T23:25:50.006 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.994+0000 7f3b71ffb640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-22T23:25:50.006 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.994+0000 7f3b71ffb640 1 -- 10.20.193.45:0/2055786822 --> v1:10.20.193.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b840a1f80 con 0x7f3b84139240 2026-02-22T23:25:50.006 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.994+0000 7f3b71ffb640 10 monclient: _finish_auth 0 2026-02-22T23:25:50.006 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.994+0000 7f3b71ffb640 10 monclient: _check_auth_tickets 2026-02-22T23:25:50.006 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.994+0000 7f3b71ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T23:25:50.006 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.994+0000 7f3b8b955640 5 monclient: authenticate success, global_id 4446 2026-02-22T23:25:50.006 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.994+0000 7f3b8b955640 10 monclient: _renew_subs 2026-02-22T23:25:50.006 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.994+0000 7f3b8b955640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-22T23:25:50.006 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.994+0000 7f3b8b955640 1 -- 10.20.193.45:0/2055786822 --> v1:10.20.193.45:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f3b840a6670 con 0x7f3b84139240 2026-02-22T23:25:50.006 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.994+0000 7f3b8b955640 10 monclient: _renew_subs 2026-02-22T23:25:50.006 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.994+0000 7f3b8b955640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-22T23:25:50.006 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.994+0000 7f3b8b955640 1 -- 10.20.193.45:0/2055786822 --> v1:10.20.193.45:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f3b840711a0 con 0x7f3b84139240 2026-02-22T23:25:50.006 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.994+0000 7f3b71ffb640 1 -- 10.20.193.45:0/2055786822 <== mon.0 v1:10.20.193.45:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3b780039c0 con 0x7f3b84139240 2026-02-22T23:25:50.006 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.994+0000 7f3b71ffb640 10 monclient: handle_config config(0 keys) 2026-02-22T23:25:50.006 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.994+0000 7f3b71ffb640 1 -- 10.20.193.45:0/2055786822 <== mon.0 v1:10.20.193.45:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f3b78003f70 con 0x7f3b84139240 2026-02-22T23:25:50.006 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.994+0000 7f3b737fe640 4 set_mon_vals no callback set 2026-02-22T23:25:50.006 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.994+0000 7f3b71ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:25:50.006 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.994+0000 7f3b71ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T23:25:50.006 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.994+0000 7f3b71ffb640 10 monclient: dump: 2026-02-22T23:25:50.006 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:50.006 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:50.006 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:50.007 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:50.007 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:50.007 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:50.007 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:50.007 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:50.007 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:50.007 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:50.007 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:50.007 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:50.007 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:50.007 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:50.007 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:50.007 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:50.007 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.994+0000 7f3b8b955640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T23:25:50.007 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.994+0000 7f3b8b955640 1 -- 10.20.193.45:0/2055786822 --> v1:10.20.193.45:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f3b48007dd0 con 0x7f3b48004070 2026-02-22T23:25:50.007 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.994+0000 7f3b71ffb640 1 -- 10.20.193.45:0/2055786822 <== mon.4 v1:10.20.193.45:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 366268327 0 0) 0x7f3b48007dd0 con 0x7f3b48004070 2026-02-22T23:25:50.007 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.994+0000 7f3b71ffb640 10 monclient(hunting): _negotiate 2026-02-22T23:25:50.007 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.994+0000 7f3b71ffb640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:50.007 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.994+0000 7f3b71ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:50.007 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.994+0000 7f3b71ffb640 10 monclient(hunting): my global_id is 4495 2026-02-22T23:25:50.007 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.994+0000 7f3b71ffb640 1 -- 10.20.193.45:0/2055786822 --> v1:10.20.193.45:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3b8409ecb0 con 0x7f3b48004070 2026-02-22T23:25:50.007 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.995+0000 7f3b71ffb640 1 -- 10.20.193.45:0/2055786822 <== mon.4 v1:10.20.193.45:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2363340377 0 0) 0x7f3b8409ecb0 con 0x7f3b48004070 2026-02-22T23:25:50.007 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.995+0000 7f3b71ffb640 1 -- 10.20.193.45:0/2055786822 --> v1:10.20.193.45:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3b48007dd0 con 0x7f3b48004070 2026-02-22T23:25:50.007 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.995+0000 7f3b71ffb640 1 -- 10.20.193.45:0/2055786822 <== mon.4 v1:10.20.193.45:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f3b74004d20 con 0x7f3b48004070 2026-02-22T23:25:50.007 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.995+0000 7f3b71ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:25:50.008 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.995+0000 7f3b71ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T23:25:50.008 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.995+0000 7f3b71ffb640 10 monclient: dump: 2026-02-22T23:25:50.008 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:50.008 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:50.008 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:50.008 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:50.008 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:50.008 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:50.008 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:50.008 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:50.008 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:50.008 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:50.008 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:50.008 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:50.008 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:50.008 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:50.008 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:50.008 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:50.008 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.995+0000 7f3b71ffb640 1 -- 10.20.193.45:0/2055786822 <== mon.0 v1:10.20.193.45:6789/0 7 ==== mgrmap(e 5) ==== 50225+0+0 (unknown 2330357642 0 0) 0x7f3b78004190 con 0x7f3b84139240 2026-02-22T23:25:50.008 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.995+0000 7f3b71ffb640 1 -- 10.20.193.45:0/2055786822 <== mon.0 v1:10.20.193.45:6789/0 8 ==== osd_map(21..21 src has 1..21) ==== 3921+0+0 (unknown 4068336701 0 0) 0x7f3b7804df70 con 0x7f3b84139240 2026-02-22T23:25:50.008 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.995+0000 7f3b71ffb640 1 -- 10.20.193.45:0/2055786822 <== mon.4 v1:10.20.193.45:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 436161628 0 0) 0x7f3b48007dd0 con 0x7f3b48004070 2026-02-22T23:25:50.008 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.995+0000 7f3b71ffb640 1 -- 10.20.193.45:0/2055786822 --> v1:10.20.193.45:6791/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3b4800a260 con 0x7f3b48004070 2026-02-22T23:25:50.008 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.995+0000 7f3b89ecb640 10 monclient: get_auth_request con 0x7f3b540400b0 auth_method 0 2026-02-22T23:25:50.008 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.995+0000 7f3b71ffb640 1 -- 10.20.193.45:0/2055786822 <== mon.4 v1:10.20.193.45:6791/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (unknown 0 0 2024835662) 0x7f3b74002fb0 con 0x7f3b48004070 2026-02-22T23:25:50.008 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.995+0000 7f3b71ffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T23:25:50.008 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.995+0000 7f3b71ffb640 10 monclient: _finish_command 1 = system:0 2026-02-22T23:25:50.009 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.995+0000 7f3b71ffb640 1 -- 10.20.193.45:0/2055786822 >> v1:10.20.193.45:6791/0 conn(0x7f3b48004070 legacy=0x7f3b48006510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:50.009 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.995+0000 7f3b71ffb640 1 -- 10.20.193.45:0/2055786822 >> v1:10.20.193.45:6791/0 conn(0x7f3b48004070 legacy=0x7f3b48006510 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T23:25:50.010 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.998+0000 7f3b8b955640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-22T23:25:50.010 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.998+0000 7f3b8b955640 1 -- 10.20.193.45:0/2055786822 --> v1:10.20.193.45:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f3b4800c450 con 0x7f3b480081c0 2026-02-22T23:25:50.010 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.998+0000 7f3b71ffb640 1 -- 10.20.193.45:0/2055786822 <== mon.4 v1:10.20.193.45:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3753955613 0 0) 0x7f3b4800c450 con 0x7f3b480081c0 2026-02-22T23:25:50.010 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.998+0000 7f3b71ffb640 10 monclient(hunting): _negotiate 2026-02-22T23:25:50.010 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.998+0000 7f3b71ffb640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:50.010 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.998+0000 7f3b71ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:50.010 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.998+0000 7f3b71ffb640 10 monclient(hunting): my global_id is 4504 2026-02-22T23:25:50.010 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.998+0000 7f3b71ffb640 1 -- 10.20.193.45:0/2055786822 --> v1:10.20.193.45:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3b48007dd0 con 0x7f3b480081c0 2026-02-22T23:25:50.010 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.998+0000 7f3b71ffb640 1 -- 10.20.193.45:0/2055786822 <== mon.4 v1:10.20.193.45:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 315506339 0 0) 0x7f3b48007dd0 con 0x7f3b480081c0 2026-02-22T23:25:50.010 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.998+0000 7f3b71ffb640 1 -- 10.20.193.45:0/2055786822 --> v1:10.20.193.45:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3b4800c450 con 0x7f3b480081c0 2026-02-22T23:25:50.010 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.998+0000 7f3b71ffb640 1 -- 10.20.193.45:0/2055786822 <== mon.4 v1:10.20.193.45:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f3b74003490 con 0x7f3b480081c0 2026-02-22T23:25:50.010 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.998+0000 7f3b71ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:25:50.010 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.998+0000 7f3b71ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T23:25:50.010 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.998+0000 7f3b71ffb640 10 monclient: dump: 2026-02-22T23:25:50.010 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:50.010 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:50.010 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:50.010 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:50.010 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:50.011 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:50.011 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:50.011 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:50.011 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:50.011 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:50.011 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:50.011 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:50.011 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:50.011 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:50.011 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:50.011 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:50.011 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.998+0000 7f3b71ffb640 1 -- 10.20.193.45:0/2055786822 <== mon.4 v1:10.20.193.45:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1891167497 0 0) 0x7f3b4800c450 con 0x7f3b480081c0 2026-02-22T23:25:50.011 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.999+0000 7f3b71ffb640 1 -- 10.20.193.45:0/2055786822 --> v1:10.20.193.45:6791/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f3b4800c620 con 0x7f3b480081c0 2026-02-22T23:25:50.011 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.999+0000 7f3b71ffb640 1 -- 10.20.193.45:0/2055786822 <== mon.4 v1:10.20.193.45:6791/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7694 (unknown 0 0 1450226470) 0x7f3b74007380 con 0x7f3b480081c0 2026-02-22T23:25:50.011 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.999+0000 7f3b71ffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-22T23:25:50.011 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.999+0000 7f3b71ffb640 10 monclient: _finish_command 2 = system:0 2026-02-22T23:25:50.011 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.999+0000 7f3b71ffb640 1 -- 10.20.193.45:0/2055786822 >> v1:10.20.193.45:6791/0 conn(0x7f3b480081c0 legacy=0x7f3b48008650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:50.011 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.999+0000 7f3b71ffb640 1 -- 10.20.193.45:0/2055786822 >> v1:10.20.193.45:6791/0 conn(0x7f3b480081c0 legacy=0x7f3b48008650 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T23:25:50.011 INFO:teuthology.orchestra.run.trial045.stdout:{ 2026-02-22T23:25:50.011 INFO:teuthology.orchestra.run.trial045.stdout: "name": "c", 2026-02-22T23:25:50.012 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 4, 2026-02-22T23:25:50.012 INFO:teuthology.orchestra.run.trial045.stdout: "state": "peon", 2026-02-22T23:25:50.012 INFO:teuthology.orchestra.run.trial045.stdout: "election_epoch": 8, 2026-02-22T23:25:50.012 INFO:teuthology.orchestra.run.trial045.stdout: "uptime": 30151, 2026-02-22T23:25:50.012 INFO:teuthology.orchestra.run.trial045.stdout: "quorum": [ 2026-02-22T23:25:50.012 INFO:teuthology.orchestra.run.trial045.stdout: 0, 2026-02-22T23:25:50.012 INFO:teuthology.orchestra.run.trial045.stdout: 1, 2026-02-22T23:25:50.012 INFO:teuthology.orchestra.run.trial045.stdout: 2, 2026-02-22T23:25:50.012 INFO:teuthology.orchestra.run.trial045.stdout: 3, 2026-02-22T23:25:50.012 INFO:teuthology.orchestra.run.trial045.stdout: 4, 2026-02-22T23:25:50.012 INFO:teuthology.orchestra.run.trial045.stdout: 5, 2026-02-22T23:25:50.012 INFO:teuthology.orchestra.run.trial045.stdout: 6, 2026-02-22T23:25:50.012 INFO:teuthology.orchestra.run.trial045.stdout: 7, 2026-02-22T23:25:50.012 INFO:teuthology.orchestra.run.trial045.stdout: 8 2026-02-22T23:25:50.012 INFO:teuthology.orchestra.run.trial045.stdout: ], 2026-02-22T23:25:50.012 INFO:teuthology.orchestra.run.trial045.stdout: "quorum_age": 24, 2026-02-22T23:25:50.012 INFO:teuthology.orchestra.run.trial045.stdout: "features": { 2026-02-22T23:25:50.012 INFO:teuthology.orchestra.run.trial045.stdout: "required_con": "2450521708007866372", 2026-02-22T23:25:50.012 INFO:teuthology.orchestra.run.trial045.stdout: "required_mon": [ 2026-02-22T23:25:50.012 INFO:teuthology.orchestra.run.trial045.stdout: "kraken", 2026-02-22T23:25:50.012 INFO:teuthology.orchestra.run.trial045.stdout: "luminous", 2026-02-22T23:25:50.012 INFO:teuthology.orchestra.run.trial045.stdout: "mimic", 2026-02-22T23:25:50.012 INFO:teuthology.orchestra.run.trial045.stdout: "osdmap-prune", 2026-02-22T23:25:50.012 INFO:teuthology.orchestra.run.trial045.stdout: "nautilus", 2026-02-22T23:25:50.013 INFO:teuthology.orchestra.run.trial045.stdout: "octopus", 2026-02-22T23:25:50.013 INFO:teuthology.orchestra.run.trial045.stdout: "pacific", 2026-02-22T23:25:50.013 INFO:teuthology.orchestra.run.trial045.stdout: "elector-pinging", 2026-02-22T23:25:50.013 INFO:teuthology.orchestra.run.trial045.stdout: "quincy", 2026-02-22T23:25:50.013 INFO:teuthology.orchestra.run.trial045.stdout: "reef", 2026-02-22T23:25:50.013 INFO:teuthology.orchestra.run.trial045.stdout: "squid" 2026-02-22T23:25:50.013 INFO:teuthology.orchestra.run.trial045.stdout: ], 2026-02-22T23:25:50.013 INFO:teuthology.orchestra.run.trial045.stdout: "quorum_con": "4540701547738038271", 2026-02-22T23:25:50.013 INFO:teuthology.orchestra.run.trial045.stdout: "quorum_mon": [ 2026-02-22T23:25:50.013 INFO:teuthology.orchestra.run.trial045.stdout: "kraken", 2026-02-22T23:25:50.013 INFO:teuthology.orchestra.run.trial045.stdout: "luminous", 2026-02-22T23:25:50.013 INFO:teuthology.orchestra.run.trial045.stdout: "mimic", 2026-02-22T23:25:50.013 INFO:teuthology.orchestra.run.trial045.stdout: "osdmap-prune", 2026-02-22T23:25:50.013 INFO:teuthology.orchestra.run.trial045.stdout: "nautilus", 2026-02-22T23:25:50.013 INFO:teuthology.orchestra.run.trial045.stdout: "octopus", 2026-02-22T23:25:50.013 INFO:teuthology.orchestra.run.trial045.stdout: "pacific", 2026-02-22T23:25:50.013 INFO:teuthology.orchestra.run.trial045.stdout: "elector-pinging", 2026-02-22T23:25:50.013 INFO:teuthology.orchestra.run.trial045.stdout: "quincy", 2026-02-22T23:25:50.013 INFO:teuthology.orchestra.run.trial045.stdout: "reef", 2026-02-22T23:25:50.013 INFO:teuthology.orchestra.run.trial045.stdout: "squid" 2026-02-22T23:25:50.013 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:25:50.013 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:25:50.013 INFO:teuthology.orchestra.run.trial045.stdout: "outside_quorum": [], 2026-02-22T23:25:50.013 INFO:teuthology.orchestra.run.trial045.stdout: "extra_probe_peers": [], 2026-02-22T23:25:50.014 INFO:teuthology.orchestra.run.trial045.stdout: "sync_provider": [], 2026-02-22T23:25:50.014 INFO:teuthology.orchestra.run.trial045.stdout: "monmap": { 2026-02-22T23:25:50.014 INFO:teuthology.orchestra.run.trial045.stdout: "epoch": 1, 2026-02-22T23:25:50.014 INFO:teuthology.orchestra.run.trial045.stdout: "fsid": "4b60f18f-6660-4731-b731-dc85c4078413", 2026-02-22T23:25:50.014 INFO:teuthology.orchestra.run.trial045.stdout: "modified": "2026-02-22T23:24:52.393472Z", 2026-02-22T23:25:50.014 INFO:teuthology.orchestra.run.trial045.stdout: "created": "2026-02-22T23:24:52.393472Z", 2026-02-22T23:25:50.014 INFO:teuthology.orchestra.run.trial045.stdout: "min_mon_release": 19, 2026-02-22T23:25:50.014 INFO:teuthology.orchestra.run.trial045.stdout: "min_mon_release_name": "squid", 2026-02-22T23:25:50.014 INFO:teuthology.orchestra.run.trial045.stdout: "election_strategy": 3, 2026-02-22T23:25:50.014 INFO:teuthology.orchestra.run.trial045.stdout: "disallowed_leaders": "", 2026-02-22T23:25:50.014 INFO:teuthology.orchestra.run.trial045.stdout: "stretch_mode": false, 2026-02-22T23:25:50.014 INFO:teuthology.orchestra.run.trial045.stdout: "tiebreaker_mon": "", 2026-02-22T23:25:50.014 INFO:teuthology.orchestra.run.trial045.stdout: "removed_ranks": "", 2026-02-22T23:25:50.014 INFO:teuthology.orchestra.run.trial045.stdout: "features": { 2026-02-22T23:25:50.014 INFO:teuthology.orchestra.run.trial045.stdout: "persistent": [ 2026-02-22T23:25:50.014 INFO:teuthology.orchestra.run.trial045.stdout: "kraken", 2026-02-22T23:25:50.014 INFO:teuthology.orchestra.run.trial045.stdout: "luminous", 2026-02-22T23:25:50.014 INFO:teuthology.orchestra.run.trial045.stdout: "mimic", 2026-02-22T23:25:50.014 INFO:teuthology.orchestra.run.trial045.stdout: "osdmap-prune", 2026-02-22T23:25:50.014 INFO:teuthology.orchestra.run.trial045.stdout: "nautilus", 2026-02-22T23:25:50.014 INFO:teuthology.orchestra.run.trial045.stdout: "octopus", 2026-02-22T23:25:50.014 INFO:teuthology.orchestra.run.trial045.stdout: "pacific", 2026-02-22T23:25:50.014 INFO:teuthology.orchestra.run.trial045.stdout: "elector-pinging", 2026-02-22T23:25:50.014 INFO:teuthology.orchestra.run.trial045.stdout: "quincy", 2026-02-22T23:25:50.014 INFO:teuthology.orchestra.run.trial045.stdout: "reef", 2026-02-22T23:25:50.015 INFO:teuthology.orchestra.run.trial045.stdout: "squid" 2026-02-22T23:25:50.015 INFO:teuthology.orchestra.run.trial045.stdout: ], 2026-02-22T23:25:50.015 INFO:teuthology.orchestra.run.trial045.stdout: "optional": [] 2026-02-22T23:25:50.015 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:25:50.015 INFO:teuthology.orchestra.run.trial045.stdout: "mons": [ 2026-02-22T23:25:50.015 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:25:50.015 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 0, 2026-02-22T23:25:50.015 INFO:teuthology.orchestra.run.trial045.stdout: "name": "a", 2026-02-22T23:25:50.015 INFO:teuthology.orchestra.run.trial045.stdout: "public_addrs": { 2026-02-22T23:25:50.015 INFO:teuthology.orchestra.run.trial045.stdout: "addrvec": [ 2026-02-22T23:25:50.015 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:25:50.015 INFO:teuthology.orchestra.run.trial045.stdout: "type": "v1", 2026-02-22T23:25:50.015 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6789", 2026-02-22T23:25:50.015 INFO:teuthology.orchestra.run.trial045.stdout: "nonce": 0 2026-02-22T23:25:50.015 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:25:50.015 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:25:50.015 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:25:50.015 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6789/0", 2026-02-22T23:25:50.015 INFO:teuthology.orchestra.run.trial045.stdout: "public_addr": "10.20.193.45:6789/0", 2026-02-22T23:25:50.015 INFO:teuthology.orchestra.run.trial045.stdout: "priority": 0, 2026-02-22T23:25:50.015 INFO:teuthology.orchestra.run.trial045.stdout: "weight": 0, 2026-02-22T23:25:50.015 INFO:teuthology.orchestra.run.trial045.stdout: "crush_location": "{}" 2026-02-22T23:25:50.015 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:25:50.016 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:25:50.016 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 1, 2026-02-22T23:25:50.016 INFO:teuthology.orchestra.run.trial045.stdout: "name": "f", 2026-02-22T23:25:50.016 INFO:teuthology.orchestra.run.trial045.stdout: "public_addrs": { 2026-02-22T23:25:50.016 INFO:teuthology.orchestra.run.trial045.stdout: "addrvec": [ 2026-02-22T23:25:50.016 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:25:50.016 INFO:teuthology.orchestra.run.trial045.stdout: "type": "v1", 2026-02-22T23:25:50.016 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.73:6789", 2026-02-22T23:25:50.016 INFO:teuthology.orchestra.run.trial045.stdout: "nonce": 0 2026-02-22T23:25:50.016 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:25:50.016 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:25:50.016 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:25:50.016 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.73:6789/0", 2026-02-22T23:25:50.016 INFO:teuthology.orchestra.run.trial045.stdout: "public_addr": "10.20.193.73:6789/0", 2026-02-22T23:25:50.016 INFO:teuthology.orchestra.run.trial045.stdout: "priority": 0, 2026-02-22T23:25:50.016 INFO:teuthology.orchestra.run.trial045.stdout: "weight": 0, 2026-02-22T23:25:50.016 INFO:teuthology.orchestra.run.trial045.stdout: "crush_location": "{}" 2026-02-22T23:25:50.016 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:25:50.016 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:25:50.016 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 2, 2026-02-22T23:25:50.016 INFO:teuthology.orchestra.run.trial045.stdout: "name": "b", 2026-02-22T23:25:50.016 INFO:teuthology.orchestra.run.trial045.stdout: "public_addrs": { 2026-02-22T23:25:50.016 INFO:teuthology.orchestra.run.trial045.stdout: "addrvec": [ 2026-02-22T23:25:50.016 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:25:50.016 INFO:teuthology.orchestra.run.trial045.stdout: "type": "v1", 2026-02-22T23:25:50.017 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6790", 2026-02-22T23:25:50.017 INFO:teuthology.orchestra.run.trial045.stdout: "nonce": 0 2026-02-22T23:25:50.017 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:25:50.017 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:25:50.017 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:25:50.017 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6790/0", 2026-02-22T23:25:50.017 INFO:teuthology.orchestra.run.trial045.stdout: "public_addr": "10.20.193.45:6790/0", 2026-02-22T23:25:50.017 INFO:teuthology.orchestra.run.trial045.stdout: "priority": 0, 2026-02-22T23:25:50.017 INFO:teuthology.orchestra.run.trial045.stdout: "weight": 0, 2026-02-22T23:25:50.017 INFO:teuthology.orchestra.run.trial045.stdout: "crush_location": "{}" 2026-02-22T23:25:50.017 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:25:50.017 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:25:50.017 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 3, 2026-02-22T23:25:50.017 INFO:teuthology.orchestra.run.trial045.stdout: "name": "g", 2026-02-22T23:25:50.017 INFO:teuthology.orchestra.run.trial045.stdout: "public_addrs": { 2026-02-22T23:25:50.017 INFO:teuthology.orchestra.run.trial045.stdout: "addrvec": [ 2026-02-22T23:25:50.017 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:25:50.017 INFO:teuthology.orchestra.run.trial045.stdout: "type": "v1", 2026-02-22T23:25:50.017 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.73:6790", 2026-02-22T23:25:50.017 INFO:teuthology.orchestra.run.trial045.stdout: "nonce": 0 2026-02-22T23:25:50.017 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:25:50.017 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:25:50.017 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:25:50.017 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.73:6790/0", 2026-02-22T23:25:50.017 INFO:teuthology.orchestra.run.trial045.stdout: "public_addr": "10.20.193.73:6790/0", 2026-02-22T23:25:50.017 INFO:teuthology.orchestra.run.trial045.stdout: "priority": 0, 2026-02-22T23:25:50.018 INFO:teuthology.orchestra.run.trial045.stdout: "weight": 0, 2026-02-22T23:25:50.018 INFO:teuthology.orchestra.run.trial045.stdout: "crush_location": "{}" 2026-02-22T23:25:50.018 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:25:50.018 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:25:50.018 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 4, 2026-02-22T23:25:50.018 INFO:teuthology.orchestra.run.trial045.stdout: "name": "c", 2026-02-22T23:25:50.018 INFO:teuthology.orchestra.run.trial045.stdout: "public_addrs": { 2026-02-22T23:25:50.018 INFO:teuthology.orchestra.run.trial045.stdout: "addrvec": [ 2026-02-22T23:25:50.018 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:25:50.018 INFO:teuthology.orchestra.run.trial045.stdout: "type": "v1", 2026-02-22T23:25:50.018 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6791", 2026-02-22T23:25:50.018 INFO:teuthology.orchestra.run.trial045.stdout: "nonce": 0 2026-02-22T23:25:50.018 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:25:50.018 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:25:50.018 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:25:50.018 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6791/0", 2026-02-22T23:25:50.018 INFO:teuthology.orchestra.run.trial045.stdout: "public_addr": "10.20.193.45:6791/0", 2026-02-22T23:25:50.018 INFO:teuthology.orchestra.run.trial045.stdout: "priority": 0, 2026-02-22T23:25:50.018 INFO:teuthology.orchestra.run.trial045.stdout: "weight": 0, 2026-02-22T23:25:50.018 INFO:teuthology.orchestra.run.trial045.stdout: "crush_location": "{}" 2026-02-22T23:25:50.018 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:25:50.018 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:25:50.018 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 5, 2026-02-22T23:25:50.018 INFO:teuthology.orchestra.run.trial045.stdout: "name": "h", 2026-02-22T23:25:50.018 INFO:teuthology.orchestra.run.trial045.stdout: "public_addrs": { 2026-02-22T23:25:50.019 INFO:teuthology.orchestra.run.trial045.stdout: "addrvec": [ 2026-02-22T23:25:50.019 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:25:50.019 INFO:teuthology.orchestra.run.trial045.stdout: "type": "v1", 2026-02-22T23:25:50.019 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.73:6791", 2026-02-22T23:25:50.019 INFO:teuthology.orchestra.run.trial045.stdout: "nonce": 0 2026-02-22T23:25:50.019 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:25:50.019 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:25:50.019 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:25:50.019 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.73:6791/0", 2026-02-22T23:25:50.019 INFO:teuthology.orchestra.run.trial045.stdout: "public_addr": "10.20.193.73:6791/0", 2026-02-22T23:25:50.019 INFO:teuthology.orchestra.run.trial045.stdout: "priority": 0, 2026-02-22T23:25:50.019 INFO:teuthology.orchestra.run.trial045.stdout: "weight": 0, 2026-02-22T23:25:50.019 INFO:teuthology.orchestra.run.trial045.stdout: "crush_location": "{}" 2026-02-22T23:25:50.019 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:25:50.019 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:25:50.019 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 6, 2026-02-22T23:25:50.019 INFO:teuthology.orchestra.run.trial045.stdout: "name": "d", 2026-02-22T23:25:50.019 INFO:teuthology.orchestra.run.trial045.stdout: "public_addrs": { 2026-02-22T23:25:50.019 INFO:teuthology.orchestra.run.trial045.stdout: "addrvec": [ 2026-02-22T23:25:50.019 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:25:50.019 INFO:teuthology.orchestra.run.trial045.stdout: "type": "v1", 2026-02-22T23:25:50.019 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6792", 2026-02-22T23:25:50.019 INFO:teuthology.orchestra.run.trial045.stdout: "nonce": 0 2026-02-22T23:25:50.019 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:25:50.019 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:25:50.020 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:25:50.020 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6792/0", 2026-02-22T23:25:50.020 INFO:teuthology.orchestra.run.trial045.stdout: "public_addr": "10.20.193.45:6792/0", 2026-02-22T23:25:50.020 INFO:teuthology.orchestra.run.trial045.stdout: "priority": 0, 2026-02-22T23:25:50.020 INFO:teuthology.orchestra.run.trial045.stdout: "weight": 0, 2026-02-22T23:25:50.020 INFO:teuthology.orchestra.run.trial045.stdout: "crush_location": "{}" 2026-02-22T23:25:50.020 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:25:50.020 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:25:50.020 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 7, 2026-02-22T23:25:50.020 INFO:teuthology.orchestra.run.trial045.stdout: "name": "i", 2026-02-22T23:25:50.020 INFO:teuthology.orchestra.run.trial045.stdout: "public_addrs": { 2026-02-22T23:25:50.020 INFO:teuthology.orchestra.run.trial045.stdout: "addrvec": [ 2026-02-22T23:25:50.020 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:25:50.020 INFO:teuthology.orchestra.run.trial045.stdout: "type": "v1", 2026-02-22T23:25:50.020 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.73:6792", 2026-02-22T23:25:50.020 INFO:teuthology.orchestra.run.trial045.stdout: "nonce": 0 2026-02-22T23:25:50.020 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:25:50.020 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:25:50.020 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:25:50.020 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.73:6792/0", 2026-02-22T23:25:50.020 INFO:teuthology.orchestra.run.trial045.stdout: "public_addr": "10.20.193.73:6792/0", 2026-02-22T23:25:50.020 INFO:teuthology.orchestra.run.trial045.stdout: "priority": 0, 2026-02-22T23:25:50.021 INFO:teuthology.orchestra.run.trial045.stdout: "weight": 0, 2026-02-22T23:25:50.021 INFO:teuthology.orchestra.run.trial045.stdout: "crush_location": "{}" 2026-02-22T23:25:50.021 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:25:50.021 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:25:50.021 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 8, 2026-02-22T23:25:50.021 INFO:teuthology.orchestra.run.trial045.stdout: "name": "e", 2026-02-22T23:25:50.021 INFO:teuthology.orchestra.run.trial045.stdout: "public_addrs": { 2026-02-22T23:25:50.021 INFO:teuthology.orchestra.run.trial045.stdout: "addrvec": [ 2026-02-22T23:25:50.021 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:25:50.021 INFO:teuthology.orchestra.run.trial045.stdout: "type": "v1", 2026-02-22T23:25:50.021 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6793", 2026-02-22T23:25:50.021 INFO:teuthology.orchestra.run.trial045.stdout: "nonce": 0 2026-02-22T23:25:50.021 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:25:50.021 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:25:50.021 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:25:50.021 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6793/0", 2026-02-22T23:25:50.021 INFO:teuthology.orchestra.run.trial045.stdout: "public_addr": "10.20.193.45:6793/0", 2026-02-22T23:25:50.021 INFO:teuthology.orchestra.run.trial045.stdout: "priority": 0, 2026-02-22T23:25:50.021 INFO:teuthology.orchestra.run.trial045.stdout: "weight": 0, 2026-02-22T23:25:50.021 INFO:teuthology.orchestra.run.trial045.stdout: "crush_location": "{}" 2026-02-22T23:25:50.021 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:25:50.021 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:25:50.021 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:25:50.021 INFO:teuthology.orchestra.run.trial045.stdout: "feature_map": { 2026-02-22T23:25:50.021 INFO:teuthology.orchestra.run.trial045.stdout: "mon": [ 2026-02-22T23:25:50.021 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:25:50.022 INFO:teuthology.orchestra.run.trial045.stdout: "features": "0x3f03cffffffdffff", 2026-02-22T23:25:50.022 INFO:teuthology.orchestra.run.trial045.stdout: "release": "squid", 2026-02-22T23:25:50.022 INFO:teuthology.orchestra.run.trial045.stdout: "num": 1 2026-02-22T23:25:50.022 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:25:50.022 INFO:teuthology.orchestra.run.trial045.stdout: ], 2026-02-22T23:25:50.022 INFO:teuthology.orchestra.run.trial045.stdout: "osd": [ 2026-02-22T23:25:50.022 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:25:50.022 INFO:teuthology.orchestra.run.trial045.stdout: "features": "0x3f03cffffffdffff", 2026-02-22T23:25:50.022 INFO:teuthology.orchestra.run.trial045.stdout: "release": "squid", 2026-02-22T23:25:50.022 INFO:teuthology.orchestra.run.trial045.stdout: "num": 1 2026-02-22T23:25:50.022 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:25:50.022 INFO:teuthology.orchestra.run.trial045.stdout: ], 2026-02-22T23:25:50.022 INFO:teuthology.orchestra.run.trial045.stdout: "client": [ 2026-02-22T23:25:50.022 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:25:50.022 INFO:teuthology.orchestra.run.trial045.stdout: "features": "0x3f03cffffffdffff", 2026-02-22T23:25:50.022 INFO:teuthology.orchestra.run.trial045.stdout: "release": "squid", 2026-02-22T23:25:50.022 INFO:teuthology.orchestra.run.trial045.stdout: "num": 5 2026-02-22T23:25:50.022 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:25:50.022 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:25:50.022 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:25:50.022 INFO:teuthology.orchestra.run.trial045.stdout: "stretch_mode": false 2026-02-22T23:25:50.022 INFO:teuthology.orchestra.run.trial045.stdout:} 2026-02-22T23:25:50.023 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.999+0000 7f3b8b955640 1 -- 10.20.193.45:0/2055786822 >> v1:10.20.193.73:6800/2222410180 conn(0x7f3b540400b0 legacy=0x7f3b54042570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:50.023 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.999+0000 7f3b8b955640 10 monclient: shutdown 2026-02-22T23:25:50.023 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.999+0000 7f3b8b955640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T23:25:50.023 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.999+0000 7f3b8b955640 1 -- 10.20.193.45:0/2055786822 >> v1:10.20.193.45:6789/0 conn(0x7f3b84139240 legacy=0x7f3b8409e5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:50.023 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.999+0000 7f3b89ecb640 1 -- 10.20.193.45:0/2055786822 reap_dead start 2026-02-22T23:25:50.024 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.999+0000 7f3b8b955640 1 -- 10.20.193.45:0/2055786822 shutdown_connections 2026-02-22T23:25:50.024 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.999+0000 7f3b8b955640 1 -- 10.20.193.45:0/2055786822 >> 10.20.193.45:0/2055786822 conn(0x7f3b840a96b0 msgr2=0x7f3b841353a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:25:50.024 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.999+0000 7f3b8b955640 1 -- 10.20.193.45:0/2055786822 shutdown_connections 2026-02-22T23:25:50.024 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:49.999+0000 7f3b8b955640 1 -- 10.20.193.45:0/2055786822 wait complete. 2026-02-22T23:25:50.024 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2026-02-22T23:25:50.024 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon d 2026-02-22T23:25:50.024 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.d mon_status 2026-02-22T23:25:50.091 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.091+0000 7fa0bf17e640 10 monclient: get_monmap_and_config 2026-02-22T23:25:50.091 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.091+0000 7fa0bf17e640 10 monclient: build_initial_monmap 2026-02-22T23:25:50.091 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.091+0000 7fa0bf17e640 10 monclient: monmap: 2026-02-22T23:25:50.091 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-22T23:25:50.091 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:50.091 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:25:50.091581+0000 2026-02-22T23:25:50.091 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:25:50.091581+0000 2026-02-22T23:25:50.091 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-22T23:25:50.091 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:50.091 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-22T23:25:50.091 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.noname-f 2026-02-22T23:25:50.091 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.noname-b 2026-02-22T23:25:50.091 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.noname-g 2026-02-22T23:25:50.091 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.noname-c 2026-02-22T23:25:50.091 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.noname-h 2026-02-22T23:25:50.091 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.noname-d 2026-02-22T23:25:50.091 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.noname-i 2026-02-22T23:25:50.091 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.noname-e 2026-02-22T23:25:50.091 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:50.096 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.091+0000 7fa0bf17e640 1 Processor -- start 2026-02-22T23:25:50.096 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.091+0000 7fa0bf17e640 1 -- start start 2026-02-22T23:25:50.096 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.091+0000 7fa0bf17e640 10 monclient: init 2026-02-22T23:25:50.096 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.092+0000 7fa0bf17e640 10 monclient: _reopen_session rank -1 2026-02-22T23:25:50.096 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.092+0000 7fa0bf17e640 10 monclient: _add_conns ranks=[0,8,3,7,1,5,4,2,6] 2026-02-22T23:25:50.096 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.092+0000 7fa0bf17e640 10 monclient(hunting): picked mon.noname-a con 0x7fa0b80a1a60 addr v1:10.20.193.45:6789/0 2026-02-22T23:25:50.096 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.092+0000 7fa0bf17e640 10 monclient(hunting): picked mon.noname-e con 0x7fa0b806f1e0 addr v1:10.20.193.45:6793/0 2026-02-22T23:25:50.097 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.092+0000 7fa0bf17e640 10 monclient(hunting): picked mon.noname-g con 0x7fa0b80a0980 addr v1:10.20.193.73:6790/0 2026-02-22T23:25:50.097 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.092+0000 7fa0bf17e640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa0b809df00 con 0x7fa0b80a1a60 2026-02-22T23:25:50.097 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.092+0000 7fa0bf17e640 1 -- --> v1:10.20.193.73:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa0b8137660 con 0x7fa0b80a0980 2026-02-22T23:25:50.097 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.092+0000 7fa0bf17e640 1 -- --> v1:10.20.193.45:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa0b80a4510 con 0x7fa0b806f1e0 2026-02-22T23:25:50.097 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.092+0000 7fa0bf17e640 10 monclient(hunting): _renew_subs 2026-02-22T23:25:50.097 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.092+0000 7fa0bf17e640 10 monclient(hunting): authenticate will time out at 681.708134s 2026-02-22T23:25:50.097 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.092+0000 7fa0bcef3640 1 --1- >> v1:10.20.193.45:6789/0 conn(0x7fa0b80a1a60 0x7fa0b8136840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.45:6789/0 says I am v1:10.20.193.45:58348/0 (socket says 10.20.193.45:58348) 2026-02-22T23:25:50.097 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.092+0000 7fa0bcef3640 1 -- 10.20.193.45:0/219801485 learned_addr learned my addr 10.20.193.45:0/219801485 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-22T23:25:50.097 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.092+0000 7fa0affff640 1 --1- 10.20.193.45:0/219801485 >> v1:10.20.193.45:6793/0 conn(0x7fa0b806f1e0 0x7fa0b8136f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.45:6793/0 says I am v1:10.20.193.45:36904/0 (socket says 10.20.193.45:36904) 2026-02-22T23:25:50.097 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.092+0000 7fa0af7fe640 1 -- 10.20.193.45:0/219801485 <== mon.8 v1:10.20.193.45:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3339336016 0 0) 0x7fa0b80a4510 con 0x7fa0b806f1e0 2026-02-22T23:25:50.097 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.092+0000 7fa0af7fe640 10 monclient(hunting): _negotiate 2026-02-22T23:25:50.097 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.092+0000 7fa0af7fe640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:50.097 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.092+0000 7fa0af7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:50.097 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.092+0000 7fa0af7fe640 10 monclient(hunting): my global_id is 4481 2026-02-22T23:25:50.097 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.092+0000 7fa0af7fe640 1 -- 10.20.193.45:0/219801485 --> v1:10.20.193.45:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa0a4003620 con 0x7fa0b806f1e0 2026-02-22T23:25:50.097 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.092+0000 7fa0af7fe640 1 -- 10.20.193.45:0/219801485 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2394202316 0 0) 0x7fa0a8002920 con 0x7fa0b80a1a60 2026-02-22T23:25:50.097 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.092+0000 7fa0af7fe640 10 monclient(hunting): _negotiate 2026-02-22T23:25:50.097 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.092+0000 7fa0af7fe640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:50.097 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.092+0000 7fa0af7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:50.097 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.092+0000 7fa0af7fe640 10 monclient(hunting): my global_id is 4455 2026-02-22T23:25:50.097 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.092+0000 7fa0af7fe640 1 -- 10.20.193.45:0/219801485 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa0b80a4510 con 0x7fa0b80a1a60 2026-02-22T23:25:50.098 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.092+0000 7fa0af7fe640 1 -- 10.20.193.45:0/219801485 <== mon.8 v1:10.20.193.45:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 751456241 0 0) 0x7fa0a4003620 con 0x7fa0b806f1e0 2026-02-22T23:25:50.098 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.092+0000 7fa0af7fe640 1 -- 10.20.193.45:0/219801485 >> v1:10.20.193.73:6790/0 conn(0x7fa0b80a0980 legacy=0x7fa0b813ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T23:25:50.098 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.092+0000 7fa0af7fe640 1 -- 10.20.193.45:0/219801485 >> v1:10.20.193.45:6789/0 conn(0x7fa0b80a1a60 legacy=0x7fa0b8136840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:50.098 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.092+0000 7fa0af7fe640 10 monclient: _finish_hunting 0 2026-02-22T23:25:50.098 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.092+0000 7fa0af7fe640 1 monclient: found mon.noname-e 2026-02-22T23:25:50.098 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.092+0000 7fa0af7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T23:25:50.098 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.092+0000 7fa0af7fe640 10 monclient: _send_mon_message to mon.noname-e at v1:10.20.193.45:6793/0 2026-02-22T23:25:50.098 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.092+0000 7fa0af7fe640 1 -- 10.20.193.45:0/219801485 --> v1:10.20.193.45:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0b8143400 con 0x7fa0b806f1e0 2026-02-22T23:25:50.098 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.092+0000 7fa0af7fe640 10 monclient: _finish_auth 0 2026-02-22T23:25:50.098 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.092+0000 7fa0af7fe640 10 monclient: _check_auth_tickets 2026-02-22T23:25:50.098 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.092+0000 7fa0af7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T23:25:50.098 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.092+0000 7fa0af7fe640 1 -- 10.20.193.45:0/219801485 <== mon.8 v1:10.20.193.45:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7fa0a0003040 con 0x7fa0b806f1e0 2026-02-22T23:25:50.098 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.092+0000 7fa0af7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:25:50.098 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.092+0000 7fa0af7fe640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2026-02-22T23:25:50.098 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.092+0000 7fa0af7fe640 10 monclient: dump: 2026-02-22T23:25:50.098 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:50.098 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:50.098 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:50.098 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:50.098 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:50.098 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:50.098 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:50.098 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:50.099 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:50.099 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:50.099 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:50.099 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:50.099 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:50.099 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:50.099 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:50.099 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:50.099 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.092+0000 7fa0bf17e640 5 monclient: authenticate success, global_id 4481 2026-02-22T23:25:50.099 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.092+0000 7fa0bf17e640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-22T23:25:50.099 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.092+0000 7fa0af7fe640 1 -- 10.20.193.45:0/219801485 <== mon.8 v1:10.20.193.45:6793/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa0a0003260 con 0x7fa0b806f1e0 2026-02-22T23:25:50.099 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.092+0000 7fa0af7fe640 10 monclient: handle_config config(0 keys) 2026-02-22T23:25:50.099 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.092+0000 7fa0af7fe640 1 -- 10.20.193.45:0/219801485 <== mon.8 v1:10.20.193.45:6793/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7fa0a0004c20 con 0x7fa0b806f1e0 2026-02-22T23:25:50.099 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.092+0000 7fa0af7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:25:50.099 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.092+0000 7fa0af7fe640 10 monclient: got monmap 1 from mon.e (according to old e1) 2026-02-22T23:25:50.099 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.092+0000 7fa0af7fe640 10 monclient: dump: 2026-02-22T23:25:50.099 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:50.099 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:50.099 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:50.099 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:50.099 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:50.099 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:50.099 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:50.099 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:50.100 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:50.100 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:50.100 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:50.100 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:50.100 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:50.100 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:50.100 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:50.100 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:50.100 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.092+0000 7fa0bf17e640 10 monclient: get_monmap_and_config success 2026-02-22T23:25:50.100 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.092+0000 7fa0bf17e640 4 set_mon_vals no callback set 2026-02-22T23:25:50.100 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.092+0000 7fa0bf17e640 10 monclient: shutdown 2026-02-22T23:25:50.100 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.092+0000 7fa0bf17e640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T23:25:50.100 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.092+0000 7fa0bf17e640 1 -- 10.20.193.45:0/219801485 >> v1:10.20.193.45:6793/0 conn(0x7fa0b806f1e0 legacy=0x7fa0b8136f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:50.100 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.092+0000 7fa0bf17e640 1 -- 10.20.193.45:0/219801485 shutdown_connections 2026-02-22T23:25:50.100 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.092+0000 7fa0bf17e640 1 -- 10.20.193.45:0/219801485 >> 10.20.193.45:0/219801485 conn(0x7fa0b80a7780 msgr2=0x7fa0b80a3b60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:25:50.100 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.092+0000 7fa0bf17e640 1 -- 10.20.193.45:0/219801485 shutdown_connections 2026-02-22T23:25:50.100 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.092+0000 7fa0bf17e640 1 -- 10.20.193.45:0/219801485 wait complete. 2026-02-22T23:25:50.100 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.093+0000 7fa0bf17e640 10 monclient: build_initial_monmap 2026-02-22T23:25:50.100 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.093+0000 7fa0bf17e640 10 monclient: monmap: 2026-02-22T23:25:50.100 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-22T23:25:50.100 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T23:25:50.100 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-22T23:25:50.100 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-22T23:25:50.100 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-22T23:25:50.101 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-22T23:25:50.101 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-22T23:25:50.101 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.noname-f 2026-02-22T23:25:50.101 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.noname-b 2026-02-22T23:25:50.101 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.noname-g 2026-02-22T23:25:50.101 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.noname-c 2026-02-22T23:25:50.101 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.noname-h 2026-02-22T23:25:50.101 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.noname-d 2026-02-22T23:25:50.101 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.noname-i 2026-02-22T23:25:50.101 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.noname-e 2026-02-22T23:25:50.101 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:50.101 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.093+0000 7fa0bf17e640 1 Processor -- start 2026-02-22T23:25:50.101 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.093+0000 7fa0bf17e640 1 -- start start 2026-02-22T23:25:50.101 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.093+0000 7fa0bf17e640 10 monclient: init 2026-02-22T23:25:50.101 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.093+0000 7fa0bf17e640 10 monclient: _reopen_session rank -1 2026-02-22T23:25:50.101 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.093+0000 7fa0bf17e640 10 monclient: _add_conns ranks=[6,3,4,1,5,2,7,0,8] 2026-02-22T23:25:50.101 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.093+0000 7fa0bf17e640 10 monclient(hunting): picked mon.noname-d con 0x7fa0b80a0980 addr v1:10.20.193.45:6792/0 2026-02-22T23:25:50.101 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.093+0000 7fa0bf17e640 10 monclient(hunting): picked mon.noname-g con 0x7fa0b80a1a60 addr v1:10.20.193.73:6790/0 2026-02-22T23:25:50.101 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.093+0000 7fa0bf17e640 10 monclient(hunting): picked mon.noname-c con 0x7fa0b8121720 addr v1:10.20.193.45:6791/0 2026-02-22T23:25:50.101 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.093+0000 7fa0bf17e640 1 -- --> v1:10.20.193.73:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa0b8122f40 con 0x7fa0b80a1a60 2026-02-22T23:25:50.101 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.093+0000 7fa0bf17e640 1 -- --> v1:10.20.193.45:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa0b81243f0 con 0x7fa0b8121720 2026-02-22T23:25:50.101 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.093+0000 7fa0bf17e640 1 -- --> v1:10.20.193.45:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa0b8143110 con 0x7fa0b80a0980 2026-02-22T23:25:50.101 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.093+0000 7fa0bf17e640 10 monclient(hunting): _renew_subs 2026-02-22T23:25:50.102 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.093+0000 7fa0bf17e640 10 monclient(hunting): authenticate will time out at 681.709754s 2026-02-22T23:25:50.102 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.093+0000 7fa0bcef3640 1 --1- >> v1:10.20.193.45:6792/0 conn(0x7fa0b80a0980 0x7fa0b813cca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.45:6792/0 says I am v1:10.20.193.45:56960/0 (socket says 10.20.193.45:56960) 2026-02-22T23:25:50.102 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.093+0000 7fa0bcef3640 1 -- 10.20.193.45:0/293703696 learned_addr learned my addr 10.20.193.45:0/293703696 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-22T23:25:50.102 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.093+0000 7fa0ad7fa640 1 -- 10.20.193.45:0/293703696 <== mon.6 v1:10.20.193.45:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2820683102 0 0) 0x7fa0b8143110 con 0x7fa0b80a0980 2026-02-22T23:25:50.102 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.093+0000 7fa0ad7fa640 10 monclient(hunting): _negotiate 2026-02-22T23:25:50.102 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.093+0000 7fa0ad7fa640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:50.102 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.093+0000 7fa0ad7fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:50.102 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.093+0000 7fa0ad7fa640 10 monclient(hunting): my global_id is 4434 2026-02-22T23:25:50.102 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.093+0000 7fa0ad7fa640 1 -- 10.20.193.45:0/293703696 --> v1:10.20.193.45:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa088003620 con 0x7fa0b80a0980 2026-02-22T23:25:50.102 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.093+0000 7fa0ad7fa640 1 -- 10.20.193.45:0/293703696 <== mon.4 v1:10.20.193.45:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3516789225 0 0) 0x7fa0b81243f0 con 0x7fa0b8121720 2026-02-22T23:25:50.102 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.093+0000 7fa0ad7fa640 10 monclient(hunting): _negotiate 2026-02-22T23:25:50.102 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.093+0000 7fa0ad7fa640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:50.102 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.093+0000 7fa0ad7fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:50.102 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.093+0000 7fa0ad7fa640 10 monclient(hunting): my global_id is 4513 2026-02-22T23:25:50.102 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.093+0000 7fa0ad7fa640 1 -- 10.20.193.45:0/293703696 --> v1:10.20.193.45:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa0b8143110 con 0x7fa0b8121720 2026-02-22T23:25:50.102 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.094+0000 7fa0ad7fa640 1 -- 10.20.193.45:0/293703696 <== mon.6 v1:10.20.193.45:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1198919186 0 0) 0x7fa088003620 con 0x7fa0b80a0980 2026-02-22T23:25:50.102 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.094+0000 7fa0ad7fa640 1 -- 10.20.193.45:0/293703696 --> v1:10.20.193.45:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa0b81243f0 con 0x7fa0b80a0980 2026-02-22T23:25:50.102 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.094+0000 7fa0ad7fa640 1 -- 10.20.193.45:0/293703696 <== mon.6 v1:10.20.193.45:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7fa0a80033d0 con 0x7fa0b80a0980 2026-02-22T23:25:50.102 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.094+0000 7fa0ad7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-22T23:25:50.102 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.094+0000 7fa0ad7fa640 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2026-02-22T23:25:50.102 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.094+0000 7fa0ad7fa640 10 monclient(hunting): dump: 2026-02-22T23:25:50.102 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:50.102 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:50.102 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:50.103 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:50.103 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:50.103 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:50.103 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:50.103 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:50.103 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:50.103 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:50.103 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:50.103 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:50.103 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:50.103 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:50.103 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:50.103 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:50.103 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.094+0000 7fa0ad7fa640 10 monclient(hunting): _finish_auth 0 2026-02-22T23:25:50.103 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.094+0000 7fa0ad7fa640 1 -- 10.20.193.45:0/293703696 <== mon.4 v1:10.20.193.45:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1904260279 0 0) 0x7fa0b8143110 con 0x7fa0b8121720 2026-02-22T23:25:50.103 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.094+0000 7fa0ad7fa640 1 -- 10.20.193.45:0/293703696 --> v1:10.20.193.45:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa088003620 con 0x7fa0b8121720 2026-02-22T23:25:50.103 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.094+0000 7fa0ad7fa640 1 -- 10.20.193.45:0/293703696 <== mon.3 v1:10.20.193.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 932002067 0 0) 0x7fa0b8122f40 con 0x7fa0b80a1a60 2026-02-22T23:25:50.103 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.094+0000 7fa0ad7fa640 10 monclient(hunting): _negotiate 2026-02-22T23:25:50.103 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.094+0000 7fa0ad7fa640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:50.103 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.094+0000 7fa0ad7fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:50.103 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.094+0000 7fa0ad7fa640 10 monclient(hunting): my global_id is 4440 2026-02-22T23:25:50.103 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.094+0000 7fa0ad7fa640 1 -- 10.20.193.45:0/293703696 --> v1:10.20.193.73:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa0b8143110 con 0x7fa0b80a1a60 2026-02-22T23:25:50.103 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.094+0000 7fa0ad7fa640 1 -- 10.20.193.45:0/293703696 <== mon.4 v1:10.20.193.45:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7fa0b4003240 con 0x7fa0b8121720 2026-02-22T23:25:50.103 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.094+0000 7fa0ad7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-22T23:25:50.104 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.094+0000 7fa0ad7fa640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-22T23:25:50.104 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.094+0000 7fa0ad7fa640 10 monclient(hunting): dump: 2026-02-22T23:25:50.104 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:50.104 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:50.104 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:50.104 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:50.104 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:50.104 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:50.104 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:50.104 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:50.104 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:50.104 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:50.104 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:50.104 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:50.104 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:50.104 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:50.104 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:50.104 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:50.104 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.094+0000 7fa0ad7fa640 1 -- 10.20.193.45:0/293703696 <== mon.6 v1:10.20.193.45:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2731969625 0 0) 0x7fa0b81243f0 con 0x7fa0b80a0980 2026-02-22T23:25:50.104 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.094+0000 7fa0ad7fa640 1 -- 10.20.193.45:0/293703696 >> v1:10.20.193.45:6791/0 conn(0x7fa0b8121720 legacy=0x7fa0b81d5bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:50.104 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.094+0000 7fa0ad7fa640 1 -- 10.20.193.45:0/293703696 >> v1:10.20.193.73:6790/0 conn(0x7fa0b80a1a60 legacy=0x7fa0b81d2490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:50.104 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.094+0000 7fa0ad7fa640 10 monclient: _finish_hunting 0 2026-02-22T23:25:50.104 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.094+0000 7fa0ad7fa640 1 monclient: found mon.d 2026-02-22T23:25:50.104 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.094+0000 7fa0ad7fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T23:25:50.105 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.094+0000 7fa0ad7fa640 10 monclient: _send_mon_message to mon.d at v1:10.20.193.45:6792/0 2026-02-22T23:25:50.105 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.094+0000 7fa0ad7fa640 1 -- 10.20.193.45:0/293703696 --> v1:10.20.193.45:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0b8123e30 con 0x7fa0b80a0980 2026-02-22T23:25:50.105 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.094+0000 7fa0ad7fa640 10 monclient: _finish_auth 0 2026-02-22T23:25:50.105 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.094+0000 7fa0ad7fa640 10 monclient: _check_auth_tickets 2026-02-22T23:25:50.105 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.094+0000 7fa0ad7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T23:25:50.105 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.094+0000 7fa0bf17e640 5 monclient: authenticate success, global_id 4434 2026-02-22T23:25:50.105 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.094+0000 7fa0bf17e640 10 monclient: _renew_subs 2026-02-22T23:25:50.105 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.094+0000 7fa0bf17e640 10 monclient: _send_mon_message to mon.d at v1:10.20.193.45:6792/0 2026-02-22T23:25:50.105 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.094+0000 7fa0bf17e640 1 -- 10.20.193.45:0/293703696 --> v1:10.20.193.45:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fa0b8124110 con 0x7fa0b80a0980 2026-02-22T23:25:50.105 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.094+0000 7fa0ad7fa640 1 -- 10.20.193.45:0/293703696 <== mon.6 v1:10.20.193.45:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa0a8004b90 con 0x7fa0b80a0980 2026-02-22T23:25:50.105 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.094+0000 7fa0ad7fa640 10 monclient: handle_config config(0 keys) 2026-02-22T23:25:50.105 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.094+0000 7fa0bf17e640 10 monclient: _renew_subs 2026-02-22T23:25:50.105 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.094+0000 7fa0aeffd640 4 set_mon_vals no callback set 2026-02-22T23:25:50.105 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.094+0000 7fa0bf17e640 10 monclient: _send_mon_message to mon.d at v1:10.20.193.45:6792/0 2026-02-22T23:25:50.105 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.094+0000 7fa0bf17e640 1 -- 10.20.193.45:0/293703696 --> v1:10.20.193.45:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7fa0b813d3b0 con 0x7fa0b80a0980 2026-02-22T23:25:50.105 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.094+0000 7fa0ad7fa640 1 -- 10.20.193.45:0/293703696 <== mon.6 v1:10.20.193.45:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7fa0a8005080 con 0x7fa0b80a0980 2026-02-22T23:25:50.105 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.094+0000 7fa0ad7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:25:50.105 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.094+0000 7fa0ad7fa640 10 monclient: got monmap 1 from mon.d (according to old e1) 2026-02-22T23:25:50.105 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.094+0000 7fa0ad7fa640 10 monclient: dump: 2026-02-22T23:25:50.105 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:50.105 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:50.105 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:50.105 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:50.105 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:50.106 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:50.106 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:50.106 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:50.106 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:50.106 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:50.106 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:50.106 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:50.106 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:50.106 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:50.106 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:50.106 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:50.106 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.094+0000 7fa0bf17e640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T23:25:50.106 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.094+0000 7fa0bf17e640 1 -- 10.20.193.45:0/293703696 --> v1:10.20.193.45:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fa0b8142b80 con 0x7fa0b806f1e0 2026-02-22T23:25:50.106 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.094+0000 7fa0ad7fa640 1 -- 10.20.193.45:0/293703696 <== mon.6 v1:10.20.193.45:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3185812010 0 0) 0x7fa0b8142b80 con 0x7fa0b806f1e0 2026-02-22T23:25:50.106 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.094+0000 7fa0ad7fa640 10 monclient(hunting): _negotiate 2026-02-22T23:25:50.106 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.094+0000 7fa0ad7fa640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:50.106 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.094+0000 7fa0ad7fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:50.106 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.094+0000 7fa0ad7fa640 10 monclient(hunting): my global_id is 4443 2026-02-22T23:25:50.106 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.094+0000 7fa0ad7fa640 1 -- 10.20.193.45:0/293703696 --> v1:10.20.193.45:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa0b81243f0 con 0x7fa0b806f1e0 2026-02-22T23:25:50.106 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.094+0000 7fa0ad7fa640 1 -- 10.20.193.45:0/293703696 <== mon.6 v1:10.20.193.45:6792/0 7 ==== mgrmap(e 5) ==== 50225+0+0 (unknown 2330357642 0 0) 0x7fa0a8011660 con 0x7fa0b80a0980 2026-02-22T23:25:50.106 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.095+0000 7fa0ad7fa640 1 -- 10.20.193.45:0/293703696 <== mon.6 v1:10.20.193.45:6792/0 8 ==== osd_map(21..21 src has 1..21) ==== 3921+0+0 (unknown 4068336701 0 0) 0x7fa0a804ddb0 con 0x7fa0b80a0980 2026-02-22T23:25:50.106 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.095+0000 7fa0ad7fa640 1 -- 10.20.193.45:0/293703696 <== mon.6 v1:10.20.193.45:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1406529186 0 0) 0x7fa0b81243f0 con 0x7fa0b806f1e0 2026-02-22T23:25:50.106 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.095+0000 7fa0ad7fa640 1 -- 10.20.193.45:0/293703696 --> v1:10.20.193.45:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa0b8142b80 con 0x7fa0b806f1e0 2026-02-22T23:25:50.106 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.095+0000 7fa0ad7fa640 1 -- 10.20.193.45:0/293703696 <== mon.6 v1:10.20.193.45:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7fa0a0004c20 con 0x7fa0b806f1e0 2026-02-22T23:25:50.107 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.095+0000 7fa0ad7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:25:50.107 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.095+0000 7fa0ad7fa640 10 monclient: got monmap 1 from mon.d (according to old e1) 2026-02-22T23:25:50.107 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.095+0000 7fa0ad7fa640 10 monclient: dump: 2026-02-22T23:25:50.107 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:50.107 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:50.107 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:50.107 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:50.107 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:50.107 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:50.107 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:50.107 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:50.107 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:50.107 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:50.107 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:50.107 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:50.107 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:50.107 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:50.107 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:50.107 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:50.107 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.095+0000 7fa0bd6f4640 10 monclient: get_auth_request con 0x7fa0880443d0 auth_method 0 2026-02-22T23:25:50.107 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.095+0000 7fa0ad7fa640 1 -- 10.20.193.45:0/293703696 <== mon.6 v1:10.20.193.45:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 349975059 0 0) 0x7fa0b8142b80 con 0x7fa0b806f1e0 2026-02-22T23:25:50.107 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.095+0000 7fa0ad7fa640 1 -- 10.20.193.45:0/293703696 --> v1:10.20.193.45:6792/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa0b80a05e0 con 0x7fa0b806f1e0 2026-02-22T23:25:50.107 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.095+0000 7fa0ad7fa640 1 -- 10.20.193.45:0/293703696 <== mon.6 v1:10.20.193.45:6792/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (unknown 0 0 2024835662) 0x7fa0a0002e00 con 0x7fa0b806f1e0 2026-02-22T23:25:50.107 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.095+0000 7fa0ad7fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T23:25:50.108 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.095+0000 7fa0ad7fa640 10 monclient: _finish_command 1 = system:0 2026-02-22T23:25:50.108 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.095+0000 7fa0ad7fa640 1 -- 10.20.193.45:0/293703696 >> v1:10.20.193.45:6792/0 conn(0x7fa0b806f1e0 legacy=0x7fa0b8072760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:50.108 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.095+0000 7fa0ad7fa640 1 -- 10.20.193.45:0/293703696 >> v1:10.20.193.45:6792/0 conn(0x7fa0b806f1e0 legacy=0x7fa0b8072760 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T23:25:50.109 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.098+0000 7fa0bf17e640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-22T23:25:50.109 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.098+0000 7fa0bf17e640 1 -- 10.20.193.45:0/293703696 --> v1:10.20.193.45:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fa0b806ce10 con 0x7fa0b8140620 2026-02-22T23:25:50.109 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.098+0000 7fa0ad7fa640 1 -- 10.20.193.45:0/293703696 <== mon.6 v1:10.20.193.45:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1747325555 0 0) 0x7fa0b806ce10 con 0x7fa0b8140620 2026-02-22T23:25:50.109 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.098+0000 7fa0ad7fa640 10 monclient(hunting): _negotiate 2026-02-22T23:25:50.109 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.098+0000 7fa0ad7fa640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:50.109 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.098+0000 7fa0ad7fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:50.109 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.098+0000 7fa0ad7fa640 10 monclient(hunting): my global_id is 4452 2026-02-22T23:25:50.109 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.098+0000 7fa0ad7fa640 1 -- 10.20.193.45:0/293703696 --> v1:10.20.193.45:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa0b8142b80 con 0x7fa0b8140620 2026-02-22T23:25:50.109 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.098+0000 7fa0ad7fa640 1 -- 10.20.193.45:0/293703696 <== mon.6 v1:10.20.193.45:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2900566773 0 0) 0x7fa0b8142b80 con 0x7fa0b8140620 2026-02-22T23:25:50.109 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.098+0000 7fa0ad7fa640 1 -- 10.20.193.45:0/293703696 --> v1:10.20.193.45:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa0b806ce10 con 0x7fa0b8140620 2026-02-22T23:25:50.109 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.098+0000 7fa0ad7fa640 1 -- 10.20.193.45:0/293703696 <== mon.6 v1:10.20.193.45:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7fa0a0005000 con 0x7fa0b8140620 2026-02-22T23:25:50.109 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.098+0000 7fa0ad7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:25:50.109 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.098+0000 7fa0ad7fa640 10 monclient: got monmap 1 from mon.d (according to old e1) 2026-02-22T23:25:50.109 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.098+0000 7fa0ad7fa640 10 monclient: dump: 2026-02-22T23:25:50.109 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:50.109 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:50.109 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:50.109 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:50.109 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:50.109 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:50.109 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:50.110 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:50.110 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:50.110 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:50.110 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:50.110 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:50.110 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:50.110 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:50.110 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:50.110 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:50.110 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.098+0000 7fa0ad7fa640 1 -- 10.20.193.45:0/293703696 <== mon.6 v1:10.20.193.45:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 482434184 0 0) 0x7fa0b806ce10 con 0x7fa0b8140620 2026-02-22T23:25:50.110 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.098+0000 7fa0ad7fa640 1 -- 10.20.193.45:0/293703696 --> v1:10.20.193.45:6792/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fa0b8063f90 con 0x7fa0b8140620 2026-02-22T23:25:50.110 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.099+0000 7fa0ad7fa640 1 -- 10.20.193.45:0/293703696 <== mon.6 v1:10.20.193.45:6792/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7861 (unknown 0 0 3791900991) 0x7fa0a00051a0 con 0x7fa0b8140620 2026-02-22T23:25:50.110 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.099+0000 7fa0ad7fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-22T23:25:50.110 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.099+0000 7fa0ad7fa640 10 monclient: _finish_command 2 = system:0 2026-02-22T23:25:50.110 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.099+0000 7fa0ad7fa640 1 -- 10.20.193.45:0/293703696 >> v1:10.20.193.45:6792/0 conn(0x7fa0b8140620 legacy=0x7fa0b8063880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:50.110 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.099+0000 7fa0ad7fa640 1 -- 10.20.193.45:0/293703696 >> v1:10.20.193.45:6792/0 conn(0x7fa0b8140620 legacy=0x7fa0b8063880 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T23:25:50.110 INFO:teuthology.orchestra.run.trial045.stdout:{ 2026-02-22T23:25:50.110 INFO:teuthology.orchestra.run.trial045.stdout: "name": "d", 2026-02-22T23:25:50.111 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 6, 2026-02-22T23:25:50.111 INFO:teuthology.orchestra.run.trial045.stdout: "state": "peon", 2026-02-22T23:25:50.111 INFO:teuthology.orchestra.run.trial045.stdout: "election_epoch": 8, 2026-02-22T23:25:50.111 INFO:teuthology.orchestra.run.trial045.stdout: "uptime": 30247, 2026-02-22T23:25:50.111 INFO:teuthology.orchestra.run.trial045.stdout: "quorum": [ 2026-02-22T23:25:50.111 INFO:teuthology.orchestra.run.trial045.stdout: 0, 2026-02-22T23:25:50.111 INFO:teuthology.orchestra.run.trial045.stdout: 1, 2026-02-22T23:25:50.111 INFO:teuthology.orchestra.run.trial045.stdout: 2, 2026-02-22T23:25:50.111 INFO:teuthology.orchestra.run.trial045.stdout: 3, 2026-02-22T23:25:50.111 INFO:teuthology.orchestra.run.trial045.stdout: 4, 2026-02-22T23:25:50.111 INFO:teuthology.orchestra.run.trial045.stdout: 5, 2026-02-22T23:25:50.111 INFO:teuthology.orchestra.run.trial045.stdout: 6, 2026-02-22T23:25:50.111 INFO:teuthology.orchestra.run.trial045.stdout: 7, 2026-02-22T23:25:50.111 INFO:teuthology.orchestra.run.trial045.stdout: 8 2026-02-22T23:25:50.111 INFO:teuthology.orchestra.run.trial045.stdout: ], 2026-02-22T23:25:50.111 INFO:teuthology.orchestra.run.trial045.stdout: "quorum_age": 25, 2026-02-22T23:25:50.111 INFO:teuthology.orchestra.run.trial045.stdout: "features": { 2026-02-22T23:25:50.111 INFO:teuthology.orchestra.run.trial045.stdout: "required_con": "2450521708007866372", 2026-02-22T23:25:50.111 INFO:teuthology.orchestra.run.trial045.stdout: "required_mon": [ 2026-02-22T23:25:50.111 INFO:teuthology.orchestra.run.trial045.stdout: "kraken", 2026-02-22T23:25:50.111 INFO:teuthology.orchestra.run.trial045.stdout: "luminous", 2026-02-22T23:25:50.111 INFO:teuthology.orchestra.run.trial045.stdout: "mimic", 2026-02-22T23:25:50.111 INFO:teuthology.orchestra.run.trial045.stdout: "osdmap-prune", 2026-02-22T23:25:50.112 INFO:teuthology.orchestra.run.trial045.stdout: "nautilus", 2026-02-22T23:25:50.112 INFO:teuthology.orchestra.run.trial045.stdout: "octopus", 2026-02-22T23:25:50.112 INFO:teuthology.orchestra.run.trial045.stdout: "pacific", 2026-02-22T23:25:50.112 INFO:teuthology.orchestra.run.trial045.stdout: "elector-pinging", 2026-02-22T23:25:50.112 INFO:teuthology.orchestra.run.trial045.stdout: "quincy", 2026-02-22T23:25:50.112 INFO:teuthology.orchestra.run.trial045.stdout: "reef", 2026-02-22T23:25:50.112 INFO:teuthology.orchestra.run.trial045.stdout: "squid" 2026-02-22T23:25:50.112 INFO:teuthology.orchestra.run.trial045.stdout: ], 2026-02-22T23:25:50.112 INFO:teuthology.orchestra.run.trial045.stdout: "quorum_con": "4540701547738038271", 2026-02-22T23:25:50.112 INFO:teuthology.orchestra.run.trial045.stdout: "quorum_mon": [ 2026-02-22T23:25:50.112 INFO:teuthology.orchestra.run.trial045.stdout: "kraken", 2026-02-22T23:25:50.112 INFO:teuthology.orchestra.run.trial045.stdout: "luminous", 2026-02-22T23:25:50.112 INFO:teuthology.orchestra.run.trial045.stdout: "mimic", 2026-02-22T23:25:50.112 INFO:teuthology.orchestra.run.trial045.stdout: "osdmap-prune", 2026-02-22T23:25:50.112 INFO:teuthology.orchestra.run.trial045.stdout: "nautilus", 2026-02-22T23:25:50.112 INFO:teuthology.orchestra.run.trial045.stdout: "octopus", 2026-02-22T23:25:50.112 INFO:teuthology.orchestra.run.trial045.stdout: "pacific", 2026-02-22T23:25:50.112 INFO:teuthology.orchestra.run.trial045.stdout: "elector-pinging", 2026-02-22T23:25:50.112 INFO:teuthology.orchestra.run.trial045.stdout: "quincy", 2026-02-22T23:25:50.112 INFO:teuthology.orchestra.run.trial045.stdout: "reef", 2026-02-22T23:25:50.112 INFO:teuthology.orchestra.run.trial045.stdout: "squid" 2026-02-22T23:25:50.112 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:25:50.112 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:25:50.112 INFO:teuthology.orchestra.run.trial045.stdout: "outside_quorum": [], 2026-02-22T23:25:50.113 INFO:teuthology.orchestra.run.trial045.stdout: "extra_probe_peers": [], 2026-02-22T23:25:50.113 INFO:teuthology.orchestra.run.trial045.stdout: "sync_provider": [], 2026-02-22T23:25:50.113 INFO:teuthology.orchestra.run.trial045.stdout: "monmap": { 2026-02-22T23:25:50.113 INFO:teuthology.orchestra.run.trial045.stdout: "epoch": 1, 2026-02-22T23:25:50.113 INFO:teuthology.orchestra.run.trial045.stdout: "fsid": "4b60f18f-6660-4731-b731-dc85c4078413", 2026-02-22T23:25:50.113 INFO:teuthology.orchestra.run.trial045.stdout: "modified": "2026-02-22T23:24:52.393472Z", 2026-02-22T23:25:50.113 INFO:teuthology.orchestra.run.trial045.stdout: "created": "2026-02-22T23:24:52.393472Z", 2026-02-22T23:25:50.113 INFO:teuthology.orchestra.run.trial045.stdout: "min_mon_release": 19, 2026-02-22T23:25:50.113 INFO:teuthology.orchestra.run.trial045.stdout: "min_mon_release_name": "squid", 2026-02-22T23:25:50.113 INFO:teuthology.orchestra.run.trial045.stdout: "election_strategy": 3, 2026-02-22T23:25:50.113 INFO:teuthology.orchestra.run.trial045.stdout: "disallowed_leaders": "", 2026-02-22T23:25:50.113 INFO:teuthology.orchestra.run.trial045.stdout: "stretch_mode": false, 2026-02-22T23:25:50.113 INFO:teuthology.orchestra.run.trial045.stdout: "tiebreaker_mon": "", 2026-02-22T23:25:50.113 INFO:teuthology.orchestra.run.trial045.stdout: "removed_ranks": "", 2026-02-22T23:25:50.113 INFO:teuthology.orchestra.run.trial045.stdout: "features": { 2026-02-22T23:25:50.113 INFO:teuthology.orchestra.run.trial045.stdout: "persistent": [ 2026-02-22T23:25:50.113 INFO:teuthology.orchestra.run.trial045.stdout: "kraken", 2026-02-22T23:25:50.113 INFO:teuthology.orchestra.run.trial045.stdout: "luminous", 2026-02-22T23:25:50.113 INFO:teuthology.orchestra.run.trial045.stdout: "mimic", 2026-02-22T23:25:50.113 INFO:teuthology.orchestra.run.trial045.stdout: "osdmap-prune", 2026-02-22T23:25:50.113 INFO:teuthology.orchestra.run.trial045.stdout: "nautilus", 2026-02-22T23:25:50.113 INFO:teuthology.orchestra.run.trial045.stdout: "octopus", 2026-02-22T23:25:50.114 INFO:teuthology.orchestra.run.trial045.stdout: "pacific", 2026-02-22T23:25:50.114 INFO:teuthology.orchestra.run.trial045.stdout: "elector-pinging", 2026-02-22T23:25:50.114 INFO:teuthology.orchestra.run.trial045.stdout: "quincy", 2026-02-22T23:25:50.114 INFO:teuthology.orchestra.run.trial045.stdout: "reef", 2026-02-22T23:25:50.114 INFO:teuthology.orchestra.run.trial045.stdout: "squid" 2026-02-22T23:25:50.114 INFO:teuthology.orchestra.run.trial045.stdout: ], 2026-02-22T23:25:50.114 INFO:teuthology.orchestra.run.trial045.stdout: "optional": [] 2026-02-22T23:25:50.114 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:25:50.114 INFO:teuthology.orchestra.run.trial045.stdout: "mons": [ 2026-02-22T23:25:50.114 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:25:50.114 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 0, 2026-02-22T23:25:50.114 INFO:teuthology.orchestra.run.trial045.stdout: "name": "a", 2026-02-22T23:25:50.114 INFO:teuthology.orchestra.run.trial045.stdout: "public_addrs": { 2026-02-22T23:25:50.114 INFO:teuthology.orchestra.run.trial045.stdout: "addrvec": [ 2026-02-22T23:25:50.114 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:25:50.114 INFO:teuthology.orchestra.run.trial045.stdout: "type": "v1", 2026-02-22T23:25:50.114 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6789", 2026-02-22T23:25:50.114 INFO:teuthology.orchestra.run.trial045.stdout: "nonce": 0 2026-02-22T23:25:50.114 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:25:50.114 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:25:50.114 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:25:50.114 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6789/0", 2026-02-22T23:25:50.114 INFO:teuthology.orchestra.run.trial045.stdout: "public_addr": "10.20.193.45:6789/0", 2026-02-22T23:25:50.114 INFO:teuthology.orchestra.run.trial045.stdout: "priority": 0, 2026-02-22T23:25:50.115 INFO:teuthology.orchestra.run.trial045.stdout: "weight": 0, 2026-02-22T23:25:50.115 INFO:teuthology.orchestra.run.trial045.stdout: "crush_location": "{}" 2026-02-22T23:25:50.115 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:25:50.115 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:25:50.115 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 1, 2026-02-22T23:25:50.115 INFO:teuthology.orchestra.run.trial045.stdout: "name": "f", 2026-02-22T23:25:50.115 INFO:teuthology.orchestra.run.trial045.stdout: "public_addrs": { 2026-02-22T23:25:50.115 INFO:teuthology.orchestra.run.trial045.stdout: "addrvec": [ 2026-02-22T23:25:50.115 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:25:50.115 INFO:teuthology.orchestra.run.trial045.stdout: "type": "v1", 2026-02-22T23:25:50.115 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.73:6789", 2026-02-22T23:25:50.115 INFO:teuthology.orchestra.run.trial045.stdout: "nonce": 0 2026-02-22T23:25:50.115 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:25:50.115 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:25:50.115 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:25:50.115 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.73:6789/0", 2026-02-22T23:25:50.115 INFO:teuthology.orchestra.run.trial045.stdout: "public_addr": "10.20.193.73:6789/0", 2026-02-22T23:25:50.115 INFO:teuthology.orchestra.run.trial045.stdout: "priority": 0, 2026-02-22T23:25:50.115 INFO:teuthology.orchestra.run.trial045.stdout: "weight": 0, 2026-02-22T23:25:50.115 INFO:teuthology.orchestra.run.trial045.stdout: "crush_location": "{}" 2026-02-22T23:25:50.115 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:25:50.115 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:25:50.115 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 2, 2026-02-22T23:25:50.116 INFO:teuthology.orchestra.run.trial045.stdout: "name": "b", 2026-02-22T23:25:50.116 INFO:teuthology.orchestra.run.trial045.stdout: "public_addrs": { 2026-02-22T23:25:50.116 INFO:teuthology.orchestra.run.trial045.stdout: "addrvec": [ 2026-02-22T23:25:50.116 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:25:50.116 INFO:teuthology.orchestra.run.trial045.stdout: "type": "v1", 2026-02-22T23:25:50.116 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6790", 2026-02-22T23:25:50.116 INFO:teuthology.orchestra.run.trial045.stdout: "nonce": 0 2026-02-22T23:25:50.116 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:25:50.116 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:25:50.116 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:25:50.116 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6790/0", 2026-02-22T23:25:50.116 INFO:teuthology.orchestra.run.trial045.stdout: "public_addr": "10.20.193.45:6790/0", 2026-02-22T23:25:50.116 INFO:teuthology.orchestra.run.trial045.stdout: "priority": 0, 2026-02-22T23:25:50.116 INFO:teuthology.orchestra.run.trial045.stdout: "weight": 0, 2026-02-22T23:25:50.116 INFO:teuthology.orchestra.run.trial045.stdout: "crush_location": "{}" 2026-02-22T23:25:50.116 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:25:50.116 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:25:50.116 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 3, 2026-02-22T23:25:50.116 INFO:teuthology.orchestra.run.trial045.stdout: "name": "g", 2026-02-22T23:25:50.116 INFO:teuthology.orchestra.run.trial045.stdout: "public_addrs": { 2026-02-22T23:25:50.116 INFO:teuthology.orchestra.run.trial045.stdout: "addrvec": [ 2026-02-22T23:25:50.116 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:25:50.116 INFO:teuthology.orchestra.run.trial045.stdout: "type": "v1", 2026-02-22T23:25:50.116 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.73:6790", 2026-02-22T23:25:50.117 INFO:teuthology.orchestra.run.trial045.stdout: "nonce": 0 2026-02-22T23:25:50.117 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:25:50.117 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:25:50.117 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:25:50.117 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.73:6790/0", 2026-02-22T23:25:50.117 INFO:teuthology.orchestra.run.trial045.stdout: "public_addr": "10.20.193.73:6790/0", 2026-02-22T23:25:50.117 INFO:teuthology.orchestra.run.trial045.stdout: "priority": 0, 2026-02-22T23:25:50.117 INFO:teuthology.orchestra.run.trial045.stdout: "weight": 0, 2026-02-22T23:25:50.117 INFO:teuthology.orchestra.run.trial045.stdout: "crush_location": "{}" 2026-02-22T23:25:50.117 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:25:50.117 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:25:50.117 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 4, 2026-02-22T23:25:50.117 INFO:teuthology.orchestra.run.trial045.stdout: "name": "c", 2026-02-22T23:25:50.117 INFO:teuthology.orchestra.run.trial045.stdout: "public_addrs": { 2026-02-22T23:25:50.117 INFO:teuthology.orchestra.run.trial045.stdout: "addrvec": [ 2026-02-22T23:25:50.117 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:25:50.117 INFO:teuthology.orchestra.run.trial045.stdout: "type": "v1", 2026-02-22T23:25:50.117 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6791", 2026-02-22T23:25:50.117 INFO:teuthology.orchestra.run.trial045.stdout: "nonce": 0 2026-02-22T23:25:50.117 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:25:50.117 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:25:50.117 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:25:50.117 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6791/0", 2026-02-22T23:25:50.118 INFO:teuthology.orchestra.run.trial045.stdout: "public_addr": "10.20.193.45:6791/0", 2026-02-22T23:25:50.118 INFO:teuthology.orchestra.run.trial045.stdout: "priority": 0, 2026-02-22T23:25:50.118 INFO:teuthology.orchestra.run.trial045.stdout: "weight": 0, 2026-02-22T23:25:50.118 INFO:teuthology.orchestra.run.trial045.stdout: "crush_location": "{}" 2026-02-22T23:25:50.118 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:25:50.118 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:25:50.118 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 5, 2026-02-22T23:25:50.118 INFO:teuthology.orchestra.run.trial045.stdout: "name": "h", 2026-02-22T23:25:50.118 INFO:teuthology.orchestra.run.trial045.stdout: "public_addrs": { 2026-02-22T23:25:50.118 INFO:teuthology.orchestra.run.trial045.stdout: "addrvec": [ 2026-02-22T23:25:50.118 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:25:50.118 INFO:teuthology.orchestra.run.trial045.stdout: "type": "v1", 2026-02-22T23:25:50.118 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.73:6791", 2026-02-22T23:25:50.118 INFO:teuthology.orchestra.run.trial045.stdout: "nonce": 0 2026-02-22T23:25:50.118 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:25:50.118 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:25:50.118 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:25:50.118 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.73:6791/0", 2026-02-22T23:25:50.118 INFO:teuthology.orchestra.run.trial045.stdout: "public_addr": "10.20.193.73:6791/0", 2026-02-22T23:25:50.118 INFO:teuthology.orchestra.run.trial045.stdout: "priority": 0, 2026-02-22T23:25:50.118 INFO:teuthology.orchestra.run.trial045.stdout: "weight": 0, 2026-02-22T23:25:50.118 INFO:teuthology.orchestra.run.trial045.stdout: "crush_location": "{}" 2026-02-22T23:25:50.118 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:25:50.118 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:25:50.119 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 6, 2026-02-22T23:25:50.119 INFO:teuthology.orchestra.run.trial045.stdout: "name": "d", 2026-02-22T23:25:50.119 INFO:teuthology.orchestra.run.trial045.stdout: "public_addrs": { 2026-02-22T23:25:50.119 INFO:teuthology.orchestra.run.trial045.stdout: "addrvec": [ 2026-02-22T23:25:50.119 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:25:50.119 INFO:teuthology.orchestra.run.trial045.stdout: "type": "v1", 2026-02-22T23:25:50.119 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6792", 2026-02-22T23:25:50.119 INFO:teuthology.orchestra.run.trial045.stdout: "nonce": 0 2026-02-22T23:25:50.119 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:25:50.119 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:25:50.119 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:25:50.119 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6792/0", 2026-02-22T23:25:50.119 INFO:teuthology.orchestra.run.trial045.stdout: "public_addr": "10.20.193.45:6792/0", 2026-02-22T23:25:50.119 INFO:teuthology.orchestra.run.trial045.stdout: "priority": 0, 2026-02-22T23:25:50.119 INFO:teuthology.orchestra.run.trial045.stdout: "weight": 0, 2026-02-22T23:25:50.119 INFO:teuthology.orchestra.run.trial045.stdout: "crush_location": "{}" 2026-02-22T23:25:50.119 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:25:50.119 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:25:50.119 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 7, 2026-02-22T23:25:50.119 INFO:teuthology.orchestra.run.trial045.stdout: "name": "i", 2026-02-22T23:25:50.119 INFO:teuthology.orchestra.run.trial045.stdout: "public_addrs": { 2026-02-22T23:25:50.119 INFO:teuthology.orchestra.run.trial045.stdout: "addrvec": [ 2026-02-22T23:25:50.119 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:25:50.119 INFO:teuthology.orchestra.run.trial045.stdout: "type": "v1", 2026-02-22T23:25:50.120 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.73:6792", 2026-02-22T23:25:50.120 INFO:teuthology.orchestra.run.trial045.stdout: "nonce": 0 2026-02-22T23:25:50.120 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:25:50.120 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:25:50.120 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:25:50.120 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.73:6792/0", 2026-02-22T23:25:50.120 INFO:teuthology.orchestra.run.trial045.stdout: "public_addr": "10.20.193.73:6792/0", 2026-02-22T23:25:50.120 INFO:teuthology.orchestra.run.trial045.stdout: "priority": 0, 2026-02-22T23:25:50.120 INFO:teuthology.orchestra.run.trial045.stdout: "weight": 0, 2026-02-22T23:25:50.120 INFO:teuthology.orchestra.run.trial045.stdout: "crush_location": "{}" 2026-02-22T23:25:50.120 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:25:50.120 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:25:50.120 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 8, 2026-02-22T23:25:50.120 INFO:teuthology.orchestra.run.trial045.stdout: "name": "e", 2026-02-22T23:25:50.120 INFO:teuthology.orchestra.run.trial045.stdout: "public_addrs": { 2026-02-22T23:25:50.120 INFO:teuthology.orchestra.run.trial045.stdout: "addrvec": [ 2026-02-22T23:25:50.120 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:25:50.120 INFO:teuthology.orchestra.run.trial045.stdout: "type": "v1", 2026-02-22T23:25:50.120 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6793", 2026-02-22T23:25:50.120 INFO:teuthology.orchestra.run.trial045.stdout: "nonce": 0 2026-02-22T23:25:50.120 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:25:50.121 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:25:50.121 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:25:50.121 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6793/0", 2026-02-22T23:25:50.121 INFO:teuthology.orchestra.run.trial045.stdout: "public_addr": "10.20.193.45:6793/0", 2026-02-22T23:25:50.121 INFO:teuthology.orchestra.run.trial045.stdout: "priority": 0, 2026-02-22T23:25:50.121 INFO:teuthology.orchestra.run.trial045.stdout: "weight": 0, 2026-02-22T23:25:50.121 INFO:teuthology.orchestra.run.trial045.stdout: "crush_location": "{}" 2026-02-22T23:25:50.121 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:25:50.121 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:25:50.121 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:25:50.121 INFO:teuthology.orchestra.run.trial045.stdout: "feature_map": { 2026-02-22T23:25:50.121 INFO:teuthology.orchestra.run.trial045.stdout: "mon": [ 2026-02-22T23:25:50.121 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:25:50.121 INFO:teuthology.orchestra.run.trial045.stdout: "features": "0x3f03cffffffdffff", 2026-02-22T23:25:50.121 INFO:teuthology.orchestra.run.trial045.stdout: "release": "squid", 2026-02-22T23:25:50.121 INFO:teuthology.orchestra.run.trial045.stdout: "num": 1 2026-02-22T23:25:50.121 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:25:50.121 INFO:teuthology.orchestra.run.trial045.stdout: ], 2026-02-22T23:25:50.121 INFO:teuthology.orchestra.run.trial045.stdout: "osd": [ 2026-02-22T23:25:50.121 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:25:50.121 INFO:teuthology.orchestra.run.trial045.stdout: "features": "0x3f03cffffffdffff", 2026-02-22T23:25:50.121 INFO:teuthology.orchestra.run.trial045.stdout: "release": "squid", 2026-02-22T23:25:50.122 INFO:teuthology.orchestra.run.trial045.stdout: "num": 1 2026-02-22T23:25:50.122 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:25:50.122 INFO:teuthology.orchestra.run.trial045.stdout: ], 2026-02-22T23:25:50.122 INFO:teuthology.orchestra.run.trial045.stdout: "client": [ 2026-02-22T23:25:50.122 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:25:50.122 INFO:teuthology.orchestra.run.trial045.stdout: "features": "0x3f03cffffffdffff", 2026-02-22T23:25:50.122 INFO:teuthology.orchestra.run.trial045.stdout: "release": "squid", 2026-02-22T23:25:50.122 INFO:teuthology.orchestra.run.trial045.stdout: "num": 2 2026-02-22T23:25:50.122 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:25:50.122 INFO:teuthology.orchestra.run.trial045.stdout: ], 2026-02-22T23:25:50.122 INFO:teuthology.orchestra.run.trial045.stdout: "mgr": [ 2026-02-22T23:25:50.122 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:25:50.122 INFO:teuthology.orchestra.run.trial045.stdout: "features": "0x3f03cffffffdffff", 2026-02-22T23:25:50.122 INFO:teuthology.orchestra.run.trial045.stdout: "release": "squid", 2026-02-22T23:25:50.122 INFO:teuthology.orchestra.run.trial045.stdout: "num": 1 2026-02-22T23:25:50.122 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:25:50.122 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:25:50.122 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:25:50.122 INFO:teuthology.orchestra.run.trial045.stdout: "stretch_mode": false 2026-02-22T23:25:50.122 INFO:teuthology.orchestra.run.trial045.stdout:} 2026-02-22T23:25:50.123 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.099+0000 7fa0bf17e640 1 -- 10.20.193.45:0/293703696 >> v1:10.20.193.73:6800/2222410180 conn(0x7fa0880443d0 legacy=0x7fa088046890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:50.123 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.099+0000 7fa0bf17e640 10 monclient: shutdown 2026-02-22T23:25:50.123 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.099+0000 7fa0bf17e640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T23:25:50.123 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.099+0000 7fa0bf17e640 1 -- 10.20.193.45:0/293703696 >> v1:10.20.193.45:6792/0 conn(0x7fa0b80a0980 legacy=0x7fa0b813cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:50.124 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.099+0000 7fa0bd6f4640 1 -- 10.20.193.45:0/293703696 reap_dead start 2026-02-22T23:25:50.124 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.099+0000 7fa0bd6f4640 1 -- 10.20.193.45:0/293703696 reap_dead start 2026-02-22T23:25:50.124 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.099+0000 7fa0bf17e640 1 -- 10.20.193.45:0/293703696 shutdown_connections 2026-02-22T23:25:50.124 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.099+0000 7fa0bf17e640 1 -- 10.20.193.45:0/293703696 >> 10.20.193.45:0/293703696 conn(0x7fa0b80a7780 msgr2=0x7fa0b80a5aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:25:50.124 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.099+0000 7fa0bf17e640 1 -- 10.20.193.45:0/293703696 shutdown_connections 2026-02-22T23:25:50.124 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.099+0000 7fa0bf17e640 1 -- 10.20.193.45:0/293703696 wait complete. 2026-02-22T23:25:50.124 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2026-02-22T23:25:50.124 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon e 2026-02-22T23:25:50.124 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.e mon_status 2026-02-22T23:25:50.196 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.192+0000 7effb428f640 10 monclient: get_monmap_and_config 2026-02-22T23:25:50.197 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.192+0000 7effb428f640 10 monclient: build_initial_monmap 2026-02-22T23:25:50.197 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.192+0000 7effb428f640 10 monclient: monmap: 2026-02-22T23:25:50.197 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-22T23:25:50.197 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:50.197 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:25:50.192562+0000 2026-02-22T23:25:50.197 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:25:50.192562+0000 2026-02-22T23:25:50.197 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-22T23:25:50.197 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:50.197 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-22T23:25:50.197 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.noname-f 2026-02-22T23:25:50.197 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.noname-b 2026-02-22T23:25:50.197 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.noname-g 2026-02-22T23:25:50.197 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.noname-c 2026-02-22T23:25:50.197 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.noname-h 2026-02-22T23:25:50.197 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.noname-d 2026-02-22T23:25:50.197 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.noname-i 2026-02-22T23:25:50.197 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.noname-e 2026-02-22T23:25:50.197 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:50.197 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.192+0000 7effb428f640 1 Processor -- start 2026-02-22T23:25:50.197 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.192+0000 7effb428f640 1 -- start start 2026-02-22T23:25:50.198 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.192+0000 7effb428f640 10 monclient: init 2026-02-22T23:25:50.198 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.193+0000 7effb428f640 10 monclient: _reopen_session rank -1 2026-02-22T23:25:50.198 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.193+0000 7effb428f640 10 monclient: _add_conns ranks=[6,5,2,4,1,8,7,0,3] 2026-02-22T23:25:50.198 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.193+0000 7effb428f640 10 monclient(hunting): picked mon.noname-d con 0x7effac0a1a60 addr v1:10.20.193.45:6792/0 2026-02-22T23:25:50.198 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.193+0000 7effb428f640 10 monclient(hunting): picked mon.noname-h con 0x7effac06f1e0 addr v1:10.20.193.73:6791/0 2026-02-22T23:25:50.198 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.193+0000 7effb428f640 10 monclient(hunting): picked mon.noname-b con 0x7effac0a0980 addr v1:10.20.193.45:6790/0 2026-02-22T23:25:50.198 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.193+0000 7effb428f640 1 -- --> v1:10.20.193.45:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7effac09df00 con 0x7effac0a0980 2026-02-22T23:25:50.198 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.193+0000 7effb428f640 1 -- --> v1:10.20.193.73:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7effac137660 con 0x7effac06f1e0 2026-02-22T23:25:50.198 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.193+0000 7effb428f640 1 -- --> v1:10.20.193.45:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7effac0a4510 con 0x7effac0a1a60 2026-02-22T23:25:50.198 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.193+0000 7effb428f640 10 monclient(hunting): _renew_subs 2026-02-22T23:25:50.198 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.193+0000 7effb428f640 10 monclient(hunting): authenticate will time out at 681.809132s 2026-02-22T23:25:50.198 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.193+0000 7effb2004640 1 --1- >> v1:10.20.193.45:6792/0 conn(0x7effac0a1a60 0x7effac136840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.45:6792/0 says I am v1:10.20.193.45:56976/0 (socket says 10.20.193.45:56976) 2026-02-22T23:25:50.198 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.193+0000 7effb2004640 1 -- 10.20.193.45:0/2919687892 learned_addr learned my addr 10.20.193.45:0/2919687892 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-22T23:25:50.198 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.193+0000 7effb1002640 1 -- 10.20.193.45:0/2919687892 <== mon.2 v1:10.20.193.45:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3732989178 0 0) 0x7effa8002ca0 con 0x7effac0a0980 2026-02-22T23:25:50.198 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.193+0000 7effb1002640 10 monclient(hunting): _negotiate 2026-02-22T23:25:50.198 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.193+0000 7effb1002640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:50.198 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.193+0000 7effb1002640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:50.198 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.193+0000 7effb1002640 10 monclient(hunting): my global_id is 4547 2026-02-22T23:25:50.198 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.193+0000 7effb1002640 1 -- 10.20.193.45:0/2919687892 --> v1:10.20.193.45:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7eff94003620 con 0x7effac0a0980 2026-02-22T23:25:50.198 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.193+0000 7effb1002640 1 -- 10.20.193.45:0/2919687892 <== mon.6 v1:10.20.193.45:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 272780265 0 0) 0x7effac0a4510 con 0x7effac0a1a60 2026-02-22T23:25:50.198 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.193+0000 7effb1002640 10 monclient(hunting): _negotiate 2026-02-22T23:25:50.199 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.193+0000 7effb1002640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:50.199 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.193+0000 7effb1002640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:50.199 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.193+0000 7effb1002640 10 monclient(hunting): my global_id is 4461 2026-02-22T23:25:50.199 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.193+0000 7effb1002640 1 -- 10.20.193.45:0/2919687892 --> v1:10.20.193.45:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7effa8002ca0 con 0x7effac0a1a60 2026-02-22T23:25:50.199 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.193+0000 7effb1002640 1 -- 10.20.193.45:0/2919687892 <== mon.2 v1:10.20.193.45:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 622200396 0 0) 0x7eff94003620 con 0x7effac0a0980 2026-02-22T23:25:50.199 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.193+0000 7effb1002640 1 -- 10.20.193.45:0/2919687892 >> v1:10.20.193.45:6792/0 conn(0x7effac0a1a60 legacy=0x7effac136840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:50.199 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.193+0000 7effb1002640 1 -- 10.20.193.45:0/2919687892 >> v1:10.20.193.73:6791/0 conn(0x7effac06f1e0 legacy=0x7effac136f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:50.199 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.193+0000 7effb1002640 10 monclient: _finish_hunting 0 2026-02-22T23:25:50.199 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.193+0000 7effb1002640 1 monclient: found mon.noname-b 2026-02-22T23:25:50.199 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.193+0000 7effb1002640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T23:25:50.199 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.193+0000 7effb1002640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.45:6790/0 2026-02-22T23:25:50.199 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.193+0000 7effb1002640 1 -- 10.20.193.45:0/2919687892 --> v1:10.20.193.45:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effac143400 con 0x7effac0a0980 2026-02-22T23:25:50.199 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.193+0000 7effb1002640 10 monclient: _finish_auth 0 2026-02-22T23:25:50.199 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.193+0000 7effb1002640 10 monclient: _check_auth_tickets 2026-02-22T23:25:50.199 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.193+0000 7effb1002640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T23:25:50.199 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.193+0000 7effb1002640 1 -- 10.20.193.45:0/2919687892 <== mon.2 v1:10.20.193.45:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7effa8003590 con 0x7effac0a0980 2026-02-22T23:25:50.199 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.193+0000 7effb428f640 5 monclient: authenticate success, global_id 4547 2026-02-22T23:25:50.199 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.193+0000 7effb1002640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:25:50.199 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.193+0000 7effb1002640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-22T23:25:50.199 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.193+0000 7effb1002640 10 monclient: dump: 2026-02-22T23:25:50.199 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:50.199 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:50.199 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:50.199 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:50.200 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:50.200 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:50.200 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:50.200 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:50.200 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:50.200 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:50.200 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:50.200 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:50.200 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:50.200 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:50.200 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:50.200 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:50.200 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.193+0000 7effb428f640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-22T23:25:50.200 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.193+0000 7effb1002640 1 -- 10.20.193.45:0/2919687892 <== mon.2 v1:10.20.193.45:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7effa80037b0 con 0x7effac0a0980 2026-02-22T23:25:50.200 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.193+0000 7effb1002640 10 monclient: handle_config config(0 keys) 2026-02-22T23:25:50.200 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.193+0000 7effb1002640 1 -- 10.20.193.45:0/2919687892 <== mon.2 v1:10.20.193.45:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7effa8003dd0 con 0x7effac0a0980 2026-02-22T23:25:50.200 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.193+0000 7effb428f640 10 monclient: get_monmap_and_config success 2026-02-22T23:25:50.200 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.193+0000 7effb428f640 4 set_mon_vals no callback set 2026-02-22T23:25:50.200 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.193+0000 7effb1002640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:25:50.200 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.193+0000 7effb1002640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-22T23:25:50.200 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.193+0000 7effb1002640 10 monclient: dump: 2026-02-22T23:25:50.200 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:50.200 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:50.201 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:50.201 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:50.201 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:50.201 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:50.201 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:50.201 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:50.201 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:50.201 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:50.201 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:50.201 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:50.201 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:50.201 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:50.201 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:50.201 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:50.201 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.193+0000 7effb428f640 10 monclient: shutdown 2026-02-22T23:25:50.201 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.193+0000 7effb428f640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T23:25:50.201 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.193+0000 7effb428f640 1 -- 10.20.193.45:0/2919687892 >> v1:10.20.193.45:6790/0 conn(0x7effac0a0980 legacy=0x7effac13ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:50.201 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.193+0000 7effb428f640 1 -- 10.20.193.45:0/2919687892 shutdown_connections 2026-02-22T23:25:50.201 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.193+0000 7effb428f640 1 -- 10.20.193.45:0/2919687892 >> 10.20.193.45:0/2919687892 conn(0x7effac0a7780 msgr2=0x7effac0a3b60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:25:50.201 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.193+0000 7effb428f640 1 -- 10.20.193.45:0/2919687892 shutdown_connections 2026-02-22T23:25:50.201 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.193+0000 7effb428f640 1 -- 10.20.193.45:0/2919687892 wait complete. 2026-02-22T23:25:50.201 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.194+0000 7effb428f640 10 monclient: build_initial_monmap 2026-02-22T23:25:50.201 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.194+0000 7effb428f640 10 monclient: monmap: 2026-02-22T23:25:50.202 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-22T23:25:50.202 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T23:25:50.202 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-22T23:25:50.202 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-22T23:25:50.202 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-22T23:25:50.202 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-22T23:25:50.202 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-22T23:25:50.202 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.noname-f 2026-02-22T23:25:50.202 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.noname-b 2026-02-22T23:25:50.202 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.noname-g 2026-02-22T23:25:50.202 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.noname-c 2026-02-22T23:25:50.202 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.noname-h 2026-02-22T23:25:50.202 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.noname-d 2026-02-22T23:25:50.202 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.noname-i 2026-02-22T23:25:50.202 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.noname-e 2026-02-22T23:25:50.202 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:50.202 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.194+0000 7effb428f640 1 Processor -- start 2026-02-22T23:25:50.202 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.194+0000 7effb428f640 1 -- start start 2026-02-22T23:25:50.202 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.194+0000 7effb428f640 10 monclient: init 2026-02-22T23:25:50.202 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.194+0000 7effb428f640 10 monclient: _reopen_session rank -1 2026-02-22T23:25:50.202 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.194+0000 7effb428f640 10 monclient: _add_conns ranks=[4,3,6,7,5,2,1,8,0] 2026-02-22T23:25:50.202 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.194+0000 7effb428f640 10 monclient(hunting): picked mon.noname-c con 0x7effac0a0980 addr v1:10.20.193.45:6791/0 2026-02-22T23:25:50.202 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.194+0000 7effb428f640 10 monclient(hunting): picked mon.noname-g con 0x7effac0a1a60 addr v1:10.20.193.73:6790/0 2026-02-22T23:25:50.202 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.194+0000 7effb428f640 10 monclient(hunting): picked mon.noname-d con 0x7effac1cf740 addr v1:10.20.193.45:6792/0 2026-02-22T23:25:50.202 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.194+0000 7effb428f640 1 -- --> v1:10.20.193.73:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7effac11e220 con 0x7effac0a1a60 2026-02-22T23:25:50.203 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.194+0000 7effb428f640 1 -- --> v1:10.20.193.45:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7effac142920 con 0x7effac0a0980 2026-02-22T23:25:50.203 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.194+0000 7effb428f640 1 -- --> v1:10.20.193.45:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7effac13fe10 con 0x7effac1cf740 2026-02-22T23:25:50.203 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.194+0000 7effb428f640 10 monclient(hunting): _renew_subs 2026-02-22T23:25:50.203 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.194+0000 7effb428f640 10 monclient(hunting): authenticate will time out at 681.810730s 2026-02-22T23:25:50.203 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.194+0000 7effb2004640 1 --1- >> v1:10.20.193.45:6791/0 conn(0x7effac0a0980 0x7effac136ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.45:6791/0 says I am v1:10.20.193.45:38118/0 (socket says 10.20.193.45:38118) 2026-02-22T23:25:50.203 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.194+0000 7effb2805640 1 --1- >> v1:10.20.193.45:6792/0 conn(0x7effac1cf740 0x7effac1d8190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.45:6792/0 says I am v1:10.20.193.45:56988/0 (socket says 10.20.193.45:56988) 2026-02-22T23:25:50.203 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.194+0000 7effb2004640 1 -- 10.20.193.45:0/3935020551 learned_addr learned my addr 10.20.193.45:0/3935020551 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-22T23:25:50.203 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.194+0000 7eff92ffd640 1 -- 10.20.193.45:0/3935020551 <== mon.4 v1:10.20.193.45:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3540737905 0 0) 0x7effac142920 con 0x7effac0a0980 2026-02-22T23:25:50.203 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.194+0000 7eff92ffd640 10 monclient(hunting): _negotiate 2026-02-22T23:25:50.203 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.194+0000 7eff92ffd640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:50.203 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.194+0000 7eff92ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:50.203 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.194+0000 7eff92ffd640 10 monclient(hunting): my global_id is 4522 2026-02-22T23:25:50.203 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.194+0000 7eff92ffd640 1 -- 10.20.193.45:0/3935020551 --> v1:10.20.193.45:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7eff7c003620 con 0x7effac0a0980 2026-02-22T23:25:50.203 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.194+0000 7eff92ffd640 1 -- 10.20.193.45:0/3935020551 <== mon.6 v1:10.20.193.45:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3194240985 0 0) 0x7effac13fe10 con 0x7effac1cf740 2026-02-22T23:25:50.203 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.194+0000 7eff92ffd640 10 monclient(hunting): _negotiate 2026-02-22T23:25:50.203 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.194+0000 7eff92ffd640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:50.203 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.194+0000 7eff92ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:50.203 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.194+0000 7eff92ffd640 10 monclient(hunting): my global_id is 4470 2026-02-22T23:25:50.203 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.194+0000 7eff92ffd640 1 -- 10.20.193.45:0/3935020551 --> v1:10.20.193.45:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7effac142920 con 0x7effac1cf740 2026-02-22T23:25:50.203 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.195+0000 7eff92ffd640 1 -- 10.20.193.45:0/3935020551 <== mon.4 v1:10.20.193.45:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 246856546 0 0) 0x7eff7c003620 con 0x7effac0a0980 2026-02-22T23:25:50.203 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.195+0000 7eff92ffd640 1 -- 10.20.193.45:0/3935020551 --> v1:10.20.193.45:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7effac13fe10 con 0x7effac0a0980 2026-02-22T23:25:50.203 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.195+0000 7eff92ffd640 1 -- 10.20.193.45:0/3935020551 <== mon.4 v1:10.20.193.45:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7eff9c003220 con 0x7effac0a0980 2026-02-22T23:25:50.203 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.195+0000 7eff92ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-22T23:25:50.204 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.195+0000 7eff92ffd640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-22T23:25:50.204 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.195+0000 7eff92ffd640 10 monclient(hunting): dump: 2026-02-22T23:25:50.204 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:50.204 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:50.204 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:50.204 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:50.204 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:50.204 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:50.204 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:50.204 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:50.204 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:50.204 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:50.204 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:50.204 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:50.204 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:50.204 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:50.204 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:50.204 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:50.204 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.195+0000 7eff92ffd640 10 monclient(hunting): _finish_auth 0 2026-02-22T23:25:50.204 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.195+0000 7eff92ffd640 1 -- 10.20.193.45:0/3935020551 <== mon.6 v1:10.20.193.45:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 949798072 0 0) 0x7effac142920 con 0x7effac1cf740 2026-02-22T23:25:50.204 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.195+0000 7eff92ffd640 1 -- 10.20.193.45:0/3935020551 --> v1:10.20.193.45:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7eff7c003620 con 0x7effac1cf740 2026-02-22T23:25:50.204 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.195+0000 7eff92ffd640 1 -- 10.20.193.45:0/3935020551 <== mon.6 v1:10.20.193.45:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7effa8003ca0 con 0x7effac1cf740 2026-02-22T23:25:50.204 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.195+0000 7eff92ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-22T23:25:50.204 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.195+0000 7eff92ffd640 10 monclient(hunting): got monmap 1 from mon.d (according to old e1) 2026-02-22T23:25:50.205 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.195+0000 7eff92ffd640 10 monclient(hunting): dump: 2026-02-22T23:25:50.205 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:50.205 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:50.205 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:50.205 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:50.205 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:50.205 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:50.205 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:50.205 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:50.205 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:50.205 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:50.205 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:50.205 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:50.205 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:50.205 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:50.205 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:50.205 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:50.205 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.195+0000 7eff92ffd640 1 -- 10.20.193.45:0/3935020551 <== mon.4 v1:10.20.193.45:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2452607231 0 0) 0x7effac13fe10 con 0x7effac0a0980 2026-02-22T23:25:50.205 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.195+0000 7eff92ffd640 1 -- 10.20.193.45:0/3935020551 >> v1:10.20.193.45:6792/0 conn(0x7effac1cf740 legacy=0x7effac1d8190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:50.205 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.195+0000 7eff92ffd640 1 -- 10.20.193.45:0/3935020551 >> v1:10.20.193.73:6790/0 conn(0x7effac0a1a60 legacy=0x7effac1d4a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:50.205 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.195+0000 7eff92ffd640 10 monclient: _finish_hunting 0 2026-02-22T23:25:50.205 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.195+0000 7eff92ffd640 1 monclient: found mon.c 2026-02-22T23:25:50.205 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.195+0000 7eff92ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T23:25:50.206 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.195+0000 7eff92ffd640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.45:6791/0 2026-02-22T23:25:50.206 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.195+0000 7eff92ffd640 1 -- 10.20.193.45:0/3935020551 --> v1:10.20.193.45:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effac0a6090 con 0x7effac0a0980 2026-02-22T23:25:50.206 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.195+0000 7eff92ffd640 10 monclient: _finish_auth 0 2026-02-22T23:25:50.206 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.195+0000 7eff92ffd640 10 monclient: _check_auth_tickets 2026-02-22T23:25:50.206 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.195+0000 7eff92ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T23:25:50.206 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.195+0000 7effb428f640 5 monclient: authenticate success, global_id 4522 2026-02-22T23:25:50.206 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.195+0000 7effb428f640 10 monclient: _renew_subs 2026-02-22T23:25:50.206 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.195+0000 7effb428f640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.45:6791/0 2026-02-22T23:25:50.206 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.195+0000 7effb428f640 1 -- 10.20.193.45:0/3935020551 --> v1:10.20.193.45:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7effac11d740 con 0x7effac0a0980 2026-02-22T23:25:50.206 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.195+0000 7effb428f640 10 monclient: _renew_subs 2026-02-22T23:25:50.206 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.195+0000 7effb428f640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.45:6791/0 2026-02-22T23:25:50.206 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.195+0000 7effb428f640 1 -- 10.20.193.45:0/3935020551 --> v1:10.20.193.45:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7effac11df40 con 0x7effac0a0980 2026-02-22T23:25:50.206 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.195+0000 7eff92ffd640 1 -- 10.20.193.45:0/3935020551 <== mon.4 v1:10.20.193.45:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7eff9c0034a0 con 0x7effac0a0980 2026-02-22T23:25:50.206 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.195+0000 7eff92ffd640 10 monclient: handle_config config(0 keys) 2026-02-22T23:25:50.206 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.195+0000 7eff92ffd640 1 -- 10.20.193.45:0/3935020551 <== mon.4 v1:10.20.193.45:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7eff9c004ed0 con 0x7effac0a0980 2026-02-22T23:25:50.206 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.195+0000 7eff92ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:25:50.206 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.195+0000 7eff92ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T23:25:50.206 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.195+0000 7effb0801640 4 set_mon_vals no callback set 2026-02-22T23:25:50.206 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.195+0000 7eff92ffd640 10 monclient: dump: 2026-02-22T23:25:50.206 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:50.206 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:50.206 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:50.206 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:50.206 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:50.207 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:50.207 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:50.207 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:50.207 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:50.207 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:50.207 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:50.207 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:50.207 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:50.207 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:50.207 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:50.207 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:50.207 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.195+0000 7effb428f640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T23:25:50.207 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.195+0000 7effb428f640 1 -- 10.20.193.45:0/3935020551 --> v1:10.20.193.45:6793/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7effac0a2a00 con 0x7effac06f1e0 2026-02-22T23:25:50.207 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.195+0000 7eff92ffd640 1 -- 10.20.193.45:0/3935020551 <== mon.8 v1:10.20.193.45:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3891214166 0 0) 0x7effac11e220 con 0x7effac06f1e0 2026-02-22T23:25:50.207 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.195+0000 7eff92ffd640 10 monclient(hunting): _negotiate 2026-02-22T23:25:50.207 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.195+0000 7eff92ffd640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:50.207 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.195+0000 7eff92ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:50.207 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.195+0000 7eff92ffd640 10 monclient(hunting): my global_id is 4490 2026-02-22T23:25:50.207 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.195+0000 7eff92ffd640 1 -- 10.20.193.45:0/3935020551 --> v1:10.20.193.45:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7effac13fe10 con 0x7effac06f1e0 2026-02-22T23:25:50.207 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.195+0000 7eff92ffd640 1 -- 10.20.193.45:0/3935020551 <== mon.4 v1:10.20.193.45:6791/0 7 ==== mgrmap(e 5) ==== 50225+0+0 (unknown 2330357642 0 0) 0x7eff9c005070 con 0x7effac0a0980 2026-02-22T23:25:50.207 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.195+0000 7eff92ffd640 1 -- 10.20.193.45:0/3935020551 <== mon.4 v1:10.20.193.45:6791/0 8 ==== osd_map(21..21 src has 1..21) ==== 3921+0+0 (unknown 4068336701 0 0) 0x7eff9c04dde0 con 0x7effac0a0980 2026-02-22T23:25:50.207 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.196+0000 7eff92ffd640 1 -- 10.20.193.45:0/3935020551 <== mon.8 v1:10.20.193.45:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2738869522 0 0) 0x7effac13fe10 con 0x7effac06f1e0 2026-02-22T23:25:50.207 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.196+0000 7eff92ffd640 1 -- 10.20.193.45:0/3935020551 --> v1:10.20.193.45:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7effac11e220 con 0x7effac06f1e0 2026-02-22T23:25:50.208 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.196+0000 7eff92ffd640 1 -- 10.20.193.45:0/3935020551 <== mon.8 v1:10.20.193.45:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7effa0002f70 con 0x7effac06f1e0 2026-02-22T23:25:50.208 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.196+0000 7eff92ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:25:50.208 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.196+0000 7eff92ffd640 10 monclient: got monmap 1 from mon.e (according to old e1) 2026-02-22T23:25:50.208 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.196+0000 7eff92ffd640 10 monclient: dump: 2026-02-22T23:25:50.208 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:50.208 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:50.208 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:50.208 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:50.208 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:50.208 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:50.208 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:50.208 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:50.208 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:50.208 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:50.208 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:50.208 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:50.208 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:50.208 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:50.208 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:50.208 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:50.208 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.196+0000 7effb2805640 10 monclient: get_auth_request con 0x7eff7c03feb0 auth_method 0 2026-02-22T23:25:50.208 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.196+0000 7eff92ffd640 1 -- 10.20.193.45:0/3935020551 <== mon.8 v1:10.20.193.45:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 254233168 0 0) 0x7effac11e220 con 0x7effac06f1e0 2026-02-22T23:25:50.208 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.196+0000 7eff92ffd640 1 -- 10.20.193.45:0/3935020551 --> v1:10.20.193.45:6793/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7effac1372b0 con 0x7effac06f1e0 2026-02-22T23:25:50.208 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.196+0000 7eff92ffd640 1 -- 10.20.193.45:0/3935020551 <== mon.8 v1:10.20.193.45:6793/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (unknown 0 0 2024835662) 0x7effa0003370 con 0x7effac06f1e0 2026-02-22T23:25:50.208 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.196+0000 7eff92ffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T23:25:50.209 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.196+0000 7eff92ffd640 10 monclient: _finish_command 1 = system:0 2026-02-22T23:25:50.209 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.196+0000 7eff92ffd640 1 -- 10.20.193.45:0/3935020551 >> v1:10.20.193.45:6793/0 conn(0x7effac06f1e0 legacy=0x7effac13c180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:50.209 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.196+0000 7eff92ffd640 1 -- 10.20.193.45:0/3935020551 >> v1:10.20.193.45:6793/0 conn(0x7effac06f1e0 legacy=0x7effac13c180 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T23:25:50.210 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.199+0000 7effb428f640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-22T23:25:50.210 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.199+0000 7effb428f640 1 -- 10.20.193.45:0/3935020551 --> v1:10.20.193.45:6793/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7effac072dc0 con 0x7effac140620 2026-02-22T23:25:50.210 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.199+0000 7eff92ffd640 1 -- 10.20.193.45:0/3935020551 <== mon.8 v1:10.20.193.45:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1898727965 0 0) 0x7effac072dc0 con 0x7effac140620 2026-02-22T23:25:50.210 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.199+0000 7eff92ffd640 10 monclient(hunting): _negotiate 2026-02-22T23:25:50.210 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.199+0000 7eff92ffd640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:50.210 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.199+0000 7eff92ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:50.210 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.199+0000 7eff92ffd640 10 monclient(hunting): my global_id is 4499 2026-02-22T23:25:50.210 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.199+0000 7eff92ffd640 1 -- 10.20.193.45:0/3935020551 --> v1:10.20.193.45:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7effac11e220 con 0x7effac140620 2026-02-22T23:25:50.210 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.199+0000 7eff92ffd640 1 -- 10.20.193.45:0/3935020551 <== mon.8 v1:10.20.193.45:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 32045083 0 0) 0x7effac11e220 con 0x7effac140620 2026-02-22T23:25:50.210 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.199+0000 7eff92ffd640 1 -- 10.20.193.45:0/3935020551 --> v1:10.20.193.45:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7effac072dc0 con 0x7effac140620 2026-02-22T23:25:50.210 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.199+0000 7eff92ffd640 1 -- 10.20.193.45:0/3935020551 <== mon.8 v1:10.20.193.45:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7effa0003d80 con 0x7effac140620 2026-02-22T23:25:50.210 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.199+0000 7eff92ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:25:50.210 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.199+0000 7eff92ffd640 10 monclient: got monmap 1 from mon.e (according to old e1) 2026-02-22T23:25:50.210 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.199+0000 7eff92ffd640 10 monclient: dump: 2026-02-22T23:25:50.210 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:50.210 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:50.210 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:50.210 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:50.211 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:50.211 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:50.211 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:50.211 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:50.211 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:50.211 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:50.211 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:50.211 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:50.211 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:50.211 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:50.211 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:50.211 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:50.211 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.199+0000 7eff92ffd640 1 -- 10.20.193.45:0/3935020551 <== mon.8 v1:10.20.193.45:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 482694554 0 0) 0x7effac072dc0 con 0x7effac140620 2026-02-22T23:25:50.211 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.199+0000 7eff92ffd640 1 -- 10.20.193.45:0/3935020551 --> v1:10.20.193.45:6793/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7effac06ce10 con 0x7effac140620 2026-02-22T23:25:50.211 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.199+0000 7eff92ffd640 1 -- 10.20.193.45:0/3935020551 <== mon.8 v1:10.20.193.45:6793/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7527 (unknown 0 0 3720915424) 0x7effa0004740 con 0x7effac140620 2026-02-22T23:25:50.211 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.199+0000 7eff92ffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-22T23:25:50.211 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.199+0000 7eff92ffd640 10 monclient: _finish_command 2 = system:0 2026-02-22T23:25:50.211 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.199+0000 7eff92ffd640 1 -- 10.20.193.45:0/3935020551 >> v1:10.20.193.45:6793/0 conn(0x7effac140620 legacy=0x7effac13c890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:50.211 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.199+0000 7eff92ffd640 1 -- 10.20.193.45:0/3935020551 >> v1:10.20.193.45:6793/0 conn(0x7effac140620 legacy=0x7effac13c890 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T23:25:50.212 INFO:teuthology.orchestra.run.trial045.stdout:{ 2026-02-22T23:25:50.212 INFO:teuthology.orchestra.run.trial045.stdout: "name": "e", 2026-02-22T23:25:50.212 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 8, 2026-02-22T23:25:50.212 INFO:teuthology.orchestra.run.trial045.stdout: "state": "peon", 2026-02-22T23:25:50.212 INFO:teuthology.orchestra.run.trial045.stdout: "election_epoch": 8, 2026-02-22T23:25:50.212 INFO:teuthology.orchestra.run.trial045.stdout: "uptime": 30346, 2026-02-22T23:25:50.212 INFO:teuthology.orchestra.run.trial045.stdout: "quorum": [ 2026-02-22T23:25:50.212 INFO:teuthology.orchestra.run.trial045.stdout: 0, 2026-02-22T23:25:50.212 INFO:teuthology.orchestra.run.trial045.stdout: 1, 2026-02-22T23:25:50.212 INFO:teuthology.orchestra.run.trial045.stdout: 2, 2026-02-22T23:25:50.212 INFO:teuthology.orchestra.run.trial045.stdout: 3, 2026-02-22T23:25:50.212 INFO:teuthology.orchestra.run.trial045.stdout: 4, 2026-02-22T23:25:50.212 INFO:teuthology.orchestra.run.trial045.stdout: 5, 2026-02-22T23:25:50.212 INFO:teuthology.orchestra.run.trial045.stdout: 6, 2026-02-22T23:25:50.212 INFO:teuthology.orchestra.run.trial045.stdout: 7, 2026-02-22T23:25:50.212 INFO:teuthology.orchestra.run.trial045.stdout: 8 2026-02-22T23:25:50.212 INFO:teuthology.orchestra.run.trial045.stdout: ], 2026-02-22T23:25:50.212 INFO:teuthology.orchestra.run.trial045.stdout: "quorum_age": 25, 2026-02-22T23:25:50.212 INFO:teuthology.orchestra.run.trial045.stdout: "features": { 2026-02-22T23:25:50.212 INFO:teuthology.orchestra.run.trial045.stdout: "required_con": "2450521708007866372", 2026-02-22T23:25:50.212 INFO:teuthology.orchestra.run.trial045.stdout: "required_mon": [ 2026-02-22T23:25:50.213 INFO:teuthology.orchestra.run.trial045.stdout: "kraken", 2026-02-22T23:25:50.213 INFO:teuthology.orchestra.run.trial045.stdout: "luminous", 2026-02-22T23:25:50.213 INFO:teuthology.orchestra.run.trial045.stdout: "mimic", 2026-02-22T23:25:50.213 INFO:teuthology.orchestra.run.trial045.stdout: "osdmap-prune", 2026-02-22T23:25:50.213 INFO:teuthology.orchestra.run.trial045.stdout: "nautilus", 2026-02-22T23:25:50.213 INFO:teuthology.orchestra.run.trial045.stdout: "octopus", 2026-02-22T23:25:50.213 INFO:teuthology.orchestra.run.trial045.stdout: "pacific", 2026-02-22T23:25:50.213 INFO:teuthology.orchestra.run.trial045.stdout: "elector-pinging", 2026-02-22T23:25:50.213 INFO:teuthology.orchestra.run.trial045.stdout: "quincy", 2026-02-22T23:25:50.213 INFO:teuthology.orchestra.run.trial045.stdout: "reef", 2026-02-22T23:25:50.213 INFO:teuthology.orchestra.run.trial045.stdout: "squid" 2026-02-22T23:25:50.213 INFO:teuthology.orchestra.run.trial045.stdout: ], 2026-02-22T23:25:50.213 INFO:teuthology.orchestra.run.trial045.stdout: "quorum_con": "4540701547738038271", 2026-02-22T23:25:50.213 INFO:teuthology.orchestra.run.trial045.stdout: "quorum_mon": [ 2026-02-22T23:25:50.213 INFO:teuthology.orchestra.run.trial045.stdout: "kraken", 2026-02-22T23:25:50.213 INFO:teuthology.orchestra.run.trial045.stdout: "luminous", 2026-02-22T23:25:50.213 INFO:teuthology.orchestra.run.trial045.stdout: "mimic", 2026-02-22T23:25:50.213 INFO:teuthology.orchestra.run.trial045.stdout: "osdmap-prune", 2026-02-22T23:25:50.213 INFO:teuthology.orchestra.run.trial045.stdout: "nautilus", 2026-02-22T23:25:50.213 INFO:teuthology.orchestra.run.trial045.stdout: "octopus", 2026-02-22T23:25:50.213 INFO:teuthology.orchestra.run.trial045.stdout: "pacific", 2026-02-22T23:25:50.213 INFO:teuthology.orchestra.run.trial045.stdout: "elector-pinging", 2026-02-22T23:25:50.213 INFO:teuthology.orchestra.run.trial045.stdout: "quincy", 2026-02-22T23:25:50.214 INFO:teuthology.orchestra.run.trial045.stdout: "reef", 2026-02-22T23:25:50.214 INFO:teuthology.orchestra.run.trial045.stdout: "squid" 2026-02-22T23:25:50.214 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:25:50.214 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:25:50.214 INFO:teuthology.orchestra.run.trial045.stdout: "outside_quorum": [], 2026-02-22T23:25:50.214 INFO:teuthology.orchestra.run.trial045.stdout: "extra_probe_peers": [], 2026-02-22T23:25:50.214 INFO:teuthology.orchestra.run.trial045.stdout: "sync_provider": [], 2026-02-22T23:25:50.214 INFO:teuthology.orchestra.run.trial045.stdout: "monmap": { 2026-02-22T23:25:50.214 INFO:teuthology.orchestra.run.trial045.stdout: "epoch": 1, 2026-02-22T23:25:50.214 INFO:teuthology.orchestra.run.trial045.stdout: "fsid": "4b60f18f-6660-4731-b731-dc85c4078413", 2026-02-22T23:25:50.214 INFO:teuthology.orchestra.run.trial045.stdout: "modified": "2026-02-22T23:24:52.393472Z", 2026-02-22T23:25:50.214 INFO:teuthology.orchestra.run.trial045.stdout: "created": "2026-02-22T23:24:52.393472Z", 2026-02-22T23:25:50.214 INFO:teuthology.orchestra.run.trial045.stdout: "min_mon_release": 19, 2026-02-22T23:25:50.214 INFO:teuthology.orchestra.run.trial045.stdout: "min_mon_release_name": "squid", 2026-02-22T23:25:50.214 INFO:teuthology.orchestra.run.trial045.stdout: "election_strategy": 3, 2026-02-22T23:25:50.214 INFO:teuthology.orchestra.run.trial045.stdout: "disallowed_leaders": "", 2026-02-22T23:25:50.214 INFO:teuthology.orchestra.run.trial045.stdout: "stretch_mode": false, 2026-02-22T23:25:50.214 INFO:teuthology.orchestra.run.trial045.stdout: "tiebreaker_mon": "", 2026-02-22T23:25:50.214 INFO:teuthology.orchestra.run.trial045.stdout: "removed_ranks": "", 2026-02-22T23:25:50.214 INFO:teuthology.orchestra.run.trial045.stdout: "features": { 2026-02-22T23:25:50.214 INFO:teuthology.orchestra.run.trial045.stdout: "persistent": [ 2026-02-22T23:25:50.214 INFO:teuthology.orchestra.run.trial045.stdout: "kraken", 2026-02-22T23:25:50.214 INFO:teuthology.orchestra.run.trial045.stdout: "luminous", 2026-02-22T23:25:50.215 INFO:teuthology.orchestra.run.trial045.stdout: "mimic", 2026-02-22T23:25:50.215 INFO:teuthology.orchestra.run.trial045.stdout: "osdmap-prune", 2026-02-22T23:25:50.215 INFO:teuthology.orchestra.run.trial045.stdout: "nautilus", 2026-02-22T23:25:50.215 INFO:teuthology.orchestra.run.trial045.stdout: "octopus", 2026-02-22T23:25:50.215 INFO:teuthology.orchestra.run.trial045.stdout: "pacific", 2026-02-22T23:25:50.215 INFO:teuthology.orchestra.run.trial045.stdout: "elector-pinging", 2026-02-22T23:25:50.215 INFO:teuthology.orchestra.run.trial045.stdout: "quincy", 2026-02-22T23:25:50.215 INFO:teuthology.orchestra.run.trial045.stdout: "reef", 2026-02-22T23:25:50.215 INFO:teuthology.orchestra.run.trial045.stdout: "squid" 2026-02-22T23:25:50.215 INFO:teuthology.orchestra.run.trial045.stdout: ], 2026-02-22T23:25:50.215 INFO:teuthology.orchestra.run.trial045.stdout: "optional": [] 2026-02-22T23:25:50.215 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:25:50.215 INFO:teuthology.orchestra.run.trial045.stdout: "mons": [ 2026-02-22T23:25:50.215 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:25:50.215 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 0, 2026-02-22T23:25:50.215 INFO:teuthology.orchestra.run.trial045.stdout: "name": "a", 2026-02-22T23:25:50.215 INFO:teuthology.orchestra.run.trial045.stdout: "public_addrs": { 2026-02-22T23:25:50.215 INFO:teuthology.orchestra.run.trial045.stdout: "addrvec": [ 2026-02-22T23:25:50.215 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:25:50.215 INFO:teuthology.orchestra.run.trial045.stdout: "type": "v1", 2026-02-22T23:25:50.215 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6789", 2026-02-22T23:25:50.215 INFO:teuthology.orchestra.run.trial045.stdout: "nonce": 0 2026-02-22T23:25:50.215 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:25:50.215 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:25:50.216 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:25:50.216 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6789/0", 2026-02-22T23:25:50.216 INFO:teuthology.orchestra.run.trial045.stdout: "public_addr": "10.20.193.45:6789/0", 2026-02-22T23:25:50.216 INFO:teuthology.orchestra.run.trial045.stdout: "priority": 0, 2026-02-22T23:25:50.216 INFO:teuthology.orchestra.run.trial045.stdout: "weight": 0, 2026-02-22T23:25:50.216 INFO:teuthology.orchestra.run.trial045.stdout: "crush_location": "{}" 2026-02-22T23:25:50.216 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:25:50.216 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:25:50.216 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 1, 2026-02-22T23:25:50.216 INFO:teuthology.orchestra.run.trial045.stdout: "name": "f", 2026-02-22T23:25:50.216 INFO:teuthology.orchestra.run.trial045.stdout: "public_addrs": { 2026-02-22T23:25:50.216 INFO:teuthology.orchestra.run.trial045.stdout: "addrvec": [ 2026-02-22T23:25:50.216 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:25:50.216 INFO:teuthology.orchestra.run.trial045.stdout: "type": "v1", 2026-02-22T23:25:50.216 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.73:6789", 2026-02-22T23:25:50.216 INFO:teuthology.orchestra.run.trial045.stdout: "nonce": 0 2026-02-22T23:25:50.216 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:25:50.216 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:25:50.216 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:25:50.216 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.73:6789/0", 2026-02-22T23:25:50.216 INFO:teuthology.orchestra.run.trial045.stdout: "public_addr": "10.20.193.73:6789/0", 2026-02-22T23:25:50.216 INFO:teuthology.orchestra.run.trial045.stdout: "priority": 0, 2026-02-22T23:25:50.216 INFO:teuthology.orchestra.run.trial045.stdout: "weight": 0, 2026-02-22T23:25:50.216 INFO:teuthology.orchestra.run.trial045.stdout: "crush_location": "{}" 2026-02-22T23:25:50.217 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:25:50.217 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:25:50.217 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 2, 2026-02-22T23:25:50.217 INFO:teuthology.orchestra.run.trial045.stdout: "name": "b", 2026-02-22T23:25:50.217 INFO:teuthology.orchestra.run.trial045.stdout: "public_addrs": { 2026-02-22T23:25:50.217 INFO:teuthology.orchestra.run.trial045.stdout: "addrvec": [ 2026-02-22T23:25:50.217 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:25:50.217 INFO:teuthology.orchestra.run.trial045.stdout: "type": "v1", 2026-02-22T23:25:50.217 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6790", 2026-02-22T23:25:50.217 INFO:teuthology.orchestra.run.trial045.stdout: "nonce": 0 2026-02-22T23:25:50.217 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:25:50.217 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:25:50.217 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:25:50.217 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6790/0", 2026-02-22T23:25:50.217 INFO:teuthology.orchestra.run.trial045.stdout: "public_addr": "10.20.193.45:6790/0", 2026-02-22T23:25:50.217 INFO:teuthology.orchestra.run.trial045.stdout: "priority": 0, 2026-02-22T23:25:50.217 INFO:teuthology.orchestra.run.trial045.stdout: "weight": 0, 2026-02-22T23:25:50.217 INFO:teuthology.orchestra.run.trial045.stdout: "crush_location": "{}" 2026-02-22T23:25:50.217 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:25:50.217 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:25:50.217 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 3, 2026-02-22T23:25:50.217 INFO:teuthology.orchestra.run.trial045.stdout: "name": "g", 2026-02-22T23:25:50.217 INFO:teuthology.orchestra.run.trial045.stdout: "public_addrs": { 2026-02-22T23:25:50.217 INFO:teuthology.orchestra.run.trial045.stdout: "addrvec": [ 2026-02-22T23:25:50.218 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:25:50.218 INFO:teuthology.orchestra.run.trial045.stdout: "type": "v1", 2026-02-22T23:25:50.218 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.73:6790", 2026-02-22T23:25:50.218 INFO:teuthology.orchestra.run.trial045.stdout: "nonce": 0 2026-02-22T23:25:50.218 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:25:50.218 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:25:50.218 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:25:50.218 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.73:6790/0", 2026-02-22T23:25:50.218 INFO:teuthology.orchestra.run.trial045.stdout: "public_addr": "10.20.193.73:6790/0", 2026-02-22T23:25:50.218 INFO:teuthology.orchestra.run.trial045.stdout: "priority": 0, 2026-02-22T23:25:50.218 INFO:teuthology.orchestra.run.trial045.stdout: "weight": 0, 2026-02-22T23:25:50.218 INFO:teuthology.orchestra.run.trial045.stdout: "crush_location": "{}" 2026-02-22T23:25:50.218 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:25:50.218 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:25:50.218 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 4, 2026-02-22T23:25:50.218 INFO:teuthology.orchestra.run.trial045.stdout: "name": "c", 2026-02-22T23:25:50.218 INFO:teuthology.orchestra.run.trial045.stdout: "public_addrs": { 2026-02-22T23:25:50.218 INFO:teuthology.orchestra.run.trial045.stdout: "addrvec": [ 2026-02-22T23:25:50.218 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:25:50.218 INFO:teuthology.orchestra.run.trial045.stdout: "type": "v1", 2026-02-22T23:25:50.218 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6791", 2026-02-22T23:25:50.218 INFO:teuthology.orchestra.run.trial045.stdout: "nonce": 0 2026-02-22T23:25:50.218 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:25:50.218 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:25:50.219 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:25:50.219 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6791/0", 2026-02-22T23:25:50.219 INFO:teuthology.orchestra.run.trial045.stdout: "public_addr": "10.20.193.45:6791/0", 2026-02-22T23:25:50.219 INFO:teuthology.orchestra.run.trial045.stdout: "priority": 0, 2026-02-22T23:25:50.219 INFO:teuthology.orchestra.run.trial045.stdout: "weight": 0, 2026-02-22T23:25:50.219 INFO:teuthology.orchestra.run.trial045.stdout: "crush_location": "{}" 2026-02-22T23:25:50.219 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:25:50.219 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:25:50.219 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 5, 2026-02-22T23:25:50.219 INFO:teuthology.orchestra.run.trial045.stdout: "name": "h", 2026-02-22T23:25:50.219 INFO:teuthology.orchestra.run.trial045.stdout: "public_addrs": { 2026-02-22T23:25:50.219 INFO:teuthology.orchestra.run.trial045.stdout: "addrvec": [ 2026-02-22T23:25:50.219 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:25:50.219 INFO:teuthology.orchestra.run.trial045.stdout: "type": "v1", 2026-02-22T23:25:50.219 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.73:6791", 2026-02-22T23:25:50.219 INFO:teuthology.orchestra.run.trial045.stdout: "nonce": 0 2026-02-22T23:25:50.219 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:25:50.219 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:25:50.219 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:25:50.219 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.73:6791/0", 2026-02-22T23:25:50.219 INFO:teuthology.orchestra.run.trial045.stdout: "public_addr": "10.20.193.73:6791/0", 2026-02-22T23:25:50.219 INFO:teuthology.orchestra.run.trial045.stdout: "priority": 0, 2026-02-22T23:25:50.219 INFO:teuthology.orchestra.run.trial045.stdout: "weight": 0, 2026-02-22T23:25:50.219 INFO:teuthology.orchestra.run.trial045.stdout: "crush_location": "{}" 2026-02-22T23:25:50.220 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:25:50.220 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:25:50.220 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 6, 2026-02-22T23:25:50.220 INFO:teuthology.orchestra.run.trial045.stdout: "name": "d", 2026-02-22T23:25:50.220 INFO:teuthology.orchestra.run.trial045.stdout: "public_addrs": { 2026-02-22T23:25:50.220 INFO:teuthology.orchestra.run.trial045.stdout: "addrvec": [ 2026-02-22T23:25:50.220 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:25:50.220 INFO:teuthology.orchestra.run.trial045.stdout: "type": "v1", 2026-02-22T23:25:50.220 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6792", 2026-02-22T23:25:50.220 INFO:teuthology.orchestra.run.trial045.stdout: "nonce": 0 2026-02-22T23:25:50.220 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:25:50.220 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:25:50.220 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:25:50.220 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6792/0", 2026-02-22T23:25:50.220 INFO:teuthology.orchestra.run.trial045.stdout: "public_addr": "10.20.193.45:6792/0", 2026-02-22T23:25:50.220 INFO:teuthology.orchestra.run.trial045.stdout: "priority": 0, 2026-02-22T23:25:50.220 INFO:teuthology.orchestra.run.trial045.stdout: "weight": 0, 2026-02-22T23:25:50.220 INFO:teuthology.orchestra.run.trial045.stdout: "crush_location": "{}" 2026-02-22T23:25:50.220 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:25:50.220 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:25:50.220 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 7, 2026-02-22T23:25:50.220 INFO:teuthology.orchestra.run.trial045.stdout: "name": "i", 2026-02-22T23:25:50.220 INFO:teuthology.orchestra.run.trial045.stdout: "public_addrs": { 2026-02-22T23:25:50.221 INFO:teuthology.orchestra.run.trial045.stdout: "addrvec": [ 2026-02-22T23:25:50.221 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:25:50.221 INFO:teuthology.orchestra.run.trial045.stdout: "type": "v1", 2026-02-22T23:25:50.221 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.73:6792", 2026-02-22T23:25:50.221 INFO:teuthology.orchestra.run.trial045.stdout: "nonce": 0 2026-02-22T23:25:50.221 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:25:50.221 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:25:50.221 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:25:50.221 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.73:6792/0", 2026-02-22T23:25:50.221 INFO:teuthology.orchestra.run.trial045.stdout: "public_addr": "10.20.193.73:6792/0", 2026-02-22T23:25:50.221 INFO:teuthology.orchestra.run.trial045.stdout: "priority": 0, 2026-02-22T23:25:50.221 INFO:teuthology.orchestra.run.trial045.stdout: "weight": 0, 2026-02-22T23:25:50.221 INFO:teuthology.orchestra.run.trial045.stdout: "crush_location": "{}" 2026-02-22T23:25:50.221 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:25:50.221 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:25:50.221 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 8, 2026-02-22T23:25:50.221 INFO:teuthology.orchestra.run.trial045.stdout: "name": "e", 2026-02-22T23:25:50.221 INFO:teuthology.orchestra.run.trial045.stdout: "public_addrs": { 2026-02-22T23:25:50.221 INFO:teuthology.orchestra.run.trial045.stdout: "addrvec": [ 2026-02-22T23:25:50.221 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:25:50.221 INFO:teuthology.orchestra.run.trial045.stdout: "type": "v1", 2026-02-22T23:25:50.222 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6793", 2026-02-22T23:25:50.222 INFO:teuthology.orchestra.run.trial045.stdout: "nonce": 0 2026-02-22T23:25:50.222 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:25:50.222 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:25:50.222 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:25:50.222 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6793/0", 2026-02-22T23:25:50.222 INFO:teuthology.orchestra.run.trial045.stdout: "public_addr": "10.20.193.45:6793/0", 2026-02-22T23:25:50.222 INFO:teuthology.orchestra.run.trial045.stdout: "priority": 0, 2026-02-22T23:25:50.222 INFO:teuthology.orchestra.run.trial045.stdout: "weight": 0, 2026-02-22T23:25:50.222 INFO:teuthology.orchestra.run.trial045.stdout: "crush_location": "{}" 2026-02-22T23:25:50.222 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:25:50.222 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:25:50.222 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:25:50.222 INFO:teuthology.orchestra.run.trial045.stdout: "feature_map": { 2026-02-22T23:25:50.222 INFO:teuthology.orchestra.run.trial045.stdout: "mon": [ 2026-02-22T23:25:50.222 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:25:50.222 INFO:teuthology.orchestra.run.trial045.stdout: "features": "0x3f03cffffffdffff", 2026-02-22T23:25:50.222 INFO:teuthology.orchestra.run.trial045.stdout: "release": "squid", 2026-02-22T23:25:50.222 INFO:teuthology.orchestra.run.trial045.stdout: "num": 1 2026-02-22T23:25:50.222 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:25:50.222 INFO:teuthology.orchestra.run.trial045.stdout: ], 2026-02-22T23:25:50.222 INFO:teuthology.orchestra.run.trial045.stdout: "client": [ 2026-02-22T23:25:50.222 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:25:50.223 INFO:teuthology.orchestra.run.trial045.stdout: "features": "0x3f03cffffffdffff", 2026-02-22T23:25:50.223 INFO:teuthology.orchestra.run.trial045.stdout: "release": "squid", 2026-02-22T23:25:50.223 INFO:teuthology.orchestra.run.trial045.stdout: "num": 1 2026-02-22T23:25:50.223 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:25:50.223 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:25:50.223 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:25:50.223 INFO:teuthology.orchestra.run.trial045.stdout: "stretch_mode": false 2026-02-22T23:25:50.223 INFO:teuthology.orchestra.run.trial045.stdout:} 2026-02-22T23:25:50.224 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.200+0000 7effb428f640 1 -- 10.20.193.45:0/3935020551 >> v1:10.20.193.73:6800/2222410180 conn(0x7eff7c03feb0 legacy=0x7eff7c042370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:50.224 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.200+0000 7effb428f640 10 monclient: shutdown 2026-02-22T23:25:50.224 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.200+0000 7effb428f640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T23:25:50.224 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.200+0000 7effb428f640 1 -- 10.20.193.45:0/3935020551 >> v1:10.20.193.45:6791/0 conn(0x7effac0a0980 legacy=0x7effac136ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:50.224 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.200+0000 7effb2805640 1 -- 10.20.193.45:0/3935020551 reap_dead start 2026-02-22T23:25:50.224 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.200+0000 7effb2805640 1 -- 10.20.193.45:0/3935020551 reap_dead start 2026-02-22T23:25:50.224 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.200+0000 7effb428f640 1 -- 10.20.193.45:0/3935020551 shutdown_connections 2026-02-22T23:25:50.224 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.200+0000 7effb428f640 1 -- 10.20.193.45:0/3935020551 >> 10.20.193.45:0/3935020551 conn(0x7effac0a7780 msgr2=0x7effac0a4f60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:25:50.224 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.200+0000 7effb428f640 1 -- 10.20.193.45:0/3935020551 shutdown_connections 2026-02-22T23:25:50.224 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.200+0000 7effb428f640 1 -- 10.20.193.45:0/3935020551 wait complete. 2026-02-22T23:25:50.224 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2026-02-22T23:25:50.225 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon f 2026-02-22T23:25:50.225 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.f mon_status 2026-02-22T23:25:50.292 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.292+0000 7fb220553640 10 monclient: get_monmap_and_config 2026-02-22T23:25:50.292 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.292+0000 7fb220553640 10 monclient: build_initial_monmap 2026-02-22T23:25:50.292 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.292+0000 7fb220553640 10 monclient: monmap: 2026-02-22T23:25:50.292 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-22T23:25:50.292 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:50.292 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:25:50.292441+0000 2026-02-22T23:25:50.292 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:25:50.292441+0000 2026-02-22T23:25:50.292 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-22T23:25:50.292 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:50.293 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-22T23:25:50.293 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.noname-f 2026-02-22T23:25:50.293 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.noname-b 2026-02-22T23:25:50.293 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.noname-g 2026-02-22T23:25:50.293 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.noname-c 2026-02-22T23:25:50.293 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.noname-h 2026-02-22T23:25:50.293 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.noname-d 2026-02-22T23:25:50.293 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.noname-i 2026-02-22T23:25:50.293 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.noname-e 2026-02-22T23:25:50.293 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:50.298 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.292+0000 7fb220553640 1 Processor -- start 2026-02-22T23:25:50.298 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.292+0000 7fb220553640 1 -- start start 2026-02-22T23:25:50.298 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.292+0000 7fb220553640 10 monclient: init 2026-02-22T23:25:50.298 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.293+0000 7fb220553640 10 monclient: _reopen_session rank -1 2026-02-22T23:25:50.298 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.293+0000 7fb220553640 10 monclient: _add_conns ranks=[5,6,7,3,0,8,4,1,2] 2026-02-22T23:25:50.298 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.293+0000 7fb220553640 10 monclient(hunting): picked mon.noname-h con 0x7fb2180a5e00 addr v1:10.20.193.73:6791/0 2026-02-22T23:25:50.298 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.293+0000 7fb220553640 10 monclient(hunting): picked mon.noname-d con 0x7fb2180a68f0 addr v1:10.20.193.45:6792/0 2026-02-22T23:25:50.298 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.293+0000 7fb220553640 10 monclient(hunting): picked mon.noname-i con 0x7fb2180a6d00 addr v1:10.20.193.73:6792/0 2026-02-22T23:25:50.299 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.293+0000 7fb220553640 1 -- --> v1:10.20.193.73:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2180a2d00 con 0x7fb2180a5e00 2026-02-22T23:25:50.299 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.293+0000 7fb220553640 1 -- --> v1:10.20.193.45:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2180a2fe0 con 0x7fb2180a68f0 2026-02-22T23:25:50.299 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.293+0000 7fb220553640 1 -- --> v1:10.20.193.73:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2180a32c0 con 0x7fb2180a6d00 2026-02-22T23:25:50.299 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.293+0000 7fb220553640 10 monclient(hunting): _renew_subs 2026-02-22T23:25:50.299 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.293+0000 7fb220553640 10 monclient(hunting): authenticate will time out at 681.909252s 2026-02-22T23:25:50.299 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.293+0000 7fb21dac7640 1 --1- >> v1:10.20.193.45:6792/0 conn(0x7fb2180a68f0 0x7fb21813e080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.45:6792/0 says I am v1:10.20.193.45:57000/0 (socket says 10.20.193.45:57000) 2026-02-22T23:25:50.299 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.293+0000 7fb21dac7640 1 -- 10.20.193.45:0/2422256809 learned_addr learned my addr 10.20.193.45:0/2422256809 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-22T23:25:50.299 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.293+0000 7fb21d2c6640 1 -- 10.20.193.45:0/2422256809 <== mon.6 v1:10.20.193.45:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1826408734 0 0) 0x7fb2180a2fe0 con 0x7fb2180a68f0 2026-02-22T23:25:50.299 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.293+0000 7fb21d2c6640 10 monclient(hunting): _negotiate 2026-02-22T23:25:50.299 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.293+0000 7fb21d2c6640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:50.299 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.293+0000 7fb21d2c6640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:50.299 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.293+0000 7fb21d2c6640 10 monclient(hunting): my global_id is 4479 2026-02-22T23:25:50.299 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.293+0000 7fb21d2c6640 1 -- 10.20.193.45:0/2422256809 --> v1:10.20.193.45:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb200003620 con 0x7fb2180a68f0 2026-02-22T23:25:50.299 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.293+0000 7fb21d2c6640 1 -- 10.20.193.45:0/2422256809 <== mon.7 v1:10.20.193.73:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1837564250 0 0) 0x7fb2180a32c0 con 0x7fb2180a6d00 2026-02-22T23:25:50.299 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.293+0000 7fb21d2c6640 10 monclient(hunting): _negotiate 2026-02-22T23:25:50.299 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.293+0000 7fb21d2c6640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:50.299 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.293+0000 7fb21d2c6640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:50.299 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.293+0000 7fb21d2c6640 10 monclient(hunting): my global_id is 4399 2026-02-22T23:25:50.299 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.293+0000 7fb21d2c6640 1 -- 10.20.193.45:0/2422256809 --> v1:10.20.193.73:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb2180a2fe0 con 0x7fb2180a6d00 2026-02-22T23:25:50.299 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.293+0000 7fb21d2c6640 1 -- 10.20.193.45:0/2422256809 <== mon.6 v1:10.20.193.45:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2956089026 0 0) 0x7fb200003620 con 0x7fb2180a68f0 2026-02-22T23:25:50.300 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.293+0000 7fb21d2c6640 1 -- 10.20.193.45:0/2422256809 >> v1:10.20.193.73:6792/0 conn(0x7fb2180a6d00 legacy=0x7fb2181417b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:50.300 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.293+0000 7fb21d2c6640 1 -- 10.20.193.45:0/2422256809 >> v1:10.20.193.73:6791/0 conn(0x7fb2180a5e00 legacy=0x7fb2180a61e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:50.300 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.293+0000 7fb21d2c6640 10 monclient: _finish_hunting 0 2026-02-22T23:25:50.300 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.293+0000 7fb21d2c6640 1 monclient: found mon.noname-d 2026-02-22T23:25:50.300 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.293+0000 7fb21d2c6640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T23:25:50.300 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.293+0000 7fb21d2c6640 10 monclient: _send_mon_message to mon.noname-d at v1:10.20.193.45:6792/0 2026-02-22T23:25:50.300 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.293+0000 7fb21d2c6640 1 -- 10.20.193.45:0/2422256809 --> v1:10.20.193.45:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2180a35a0 con 0x7fb2180a68f0 2026-02-22T23:25:50.300 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.293+0000 7fb21d2c6640 10 monclient: _finish_auth 0 2026-02-22T23:25:50.300 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.293+0000 7fb21d2c6640 10 monclient: _check_auth_tickets 2026-02-22T23:25:50.300 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.293+0000 7fb21d2c6640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T23:25:50.300 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.293+0000 7fb21d2c6640 1 -- 10.20.193.45:0/2422256809 <== mon.6 v1:10.20.193.45:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7fb20c003040 con 0x7fb2180a68f0 2026-02-22T23:25:50.300 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.293+0000 7fb21d2c6640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:25:50.300 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.293+0000 7fb21d2c6640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2026-02-22T23:25:50.300 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.293+0000 7fb21d2c6640 10 monclient: dump: 2026-02-22T23:25:50.300 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:50.300 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:50.300 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:50.300 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:50.300 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:50.300 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:50.300 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:50.300 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:50.301 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:50.301 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:50.301 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:50.301 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:50.301 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:50.301 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:50.301 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:50.301 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:50.301 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.293+0000 7fb220553640 5 monclient: authenticate success, global_id 4479 2026-02-22T23:25:50.301 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.293+0000 7fb220553640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-22T23:25:50.301 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.293+0000 7fb21d2c6640 1 -- 10.20.193.45:0/2422256809 <== mon.6 v1:10.20.193.45:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb20c0031e0 con 0x7fb2180a68f0 2026-02-22T23:25:50.301 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.293+0000 7fb21d2c6640 10 monclient: handle_config config(0 keys) 2026-02-22T23:25:50.301 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.293+0000 7fb21d2c6640 1 -- 10.20.193.45:0/2422256809 <== mon.6 v1:10.20.193.45:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7fb20c004ce0 con 0x7fb2180a68f0 2026-02-22T23:25:50.301 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.293+0000 7fb21d2c6640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:25:50.301 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.293+0000 7fb21d2c6640 10 monclient: got monmap 1 from mon.d (according to old e1) 2026-02-22T23:25:50.301 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.293+0000 7fb21d2c6640 10 monclient: dump: 2026-02-22T23:25:50.301 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:50.301 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:50.301 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:50.301 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:50.301 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:50.301 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:50.302 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:50.302 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:50.302 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:50.302 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:50.302 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:50.302 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:50.302 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:50.302 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:50.302 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:50.302 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:50.302 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.293+0000 7fb220553640 10 monclient: get_monmap_and_config success 2026-02-22T23:25:50.302 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.293+0000 7fb220553640 4 set_mon_vals no callback set 2026-02-22T23:25:50.302 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.294+0000 7fb220553640 10 monclient: shutdown 2026-02-22T23:25:50.302 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.294+0000 7fb220553640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T23:25:50.302 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.294+0000 7fb220553640 1 -- 10.20.193.45:0/2422256809 >> v1:10.20.193.45:6792/0 conn(0x7fb2180a68f0 legacy=0x7fb21813e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:50.302 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.294+0000 7fb220553640 1 -- 10.20.193.45:0/2422256809 shutdown_connections 2026-02-22T23:25:50.302 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.294+0000 7fb220553640 1 -- 10.20.193.45:0/2422256809 >> 10.20.193.45:0/2422256809 conn(0x7fb2180abb50 msgr2=0x7fb2180a7f00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:25:50.302 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.294+0000 7fb220553640 1 -- 10.20.193.45:0/2422256809 shutdown_connections 2026-02-22T23:25:50.302 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.294+0000 7fb220553640 1 -- 10.20.193.45:0/2422256809 wait complete. 2026-02-22T23:25:50.302 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.294+0000 7fb220553640 10 monclient: build_initial_monmap 2026-02-22T23:25:50.302 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.294+0000 7fb220553640 10 monclient: monmap: 2026-02-22T23:25:50.302 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-22T23:25:50.303 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T23:25:50.303 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-22T23:25:50.303 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-22T23:25:50.303 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-22T23:25:50.303 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-22T23:25:50.303 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-22T23:25:50.303 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.noname-f 2026-02-22T23:25:50.303 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.noname-b 2026-02-22T23:25:50.303 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.noname-g 2026-02-22T23:25:50.303 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.noname-c 2026-02-22T23:25:50.303 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.noname-h 2026-02-22T23:25:50.303 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.noname-d 2026-02-22T23:25:50.303 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.noname-i 2026-02-22T23:25:50.303 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.noname-e 2026-02-22T23:25:50.303 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:50.303 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.294+0000 7fb220553640 1 Processor -- start 2026-02-22T23:25:50.303 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.294+0000 7fb220553640 1 -- start start 2026-02-22T23:25:50.303 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.294+0000 7fb220553640 10 monclient: init 2026-02-22T23:25:50.303 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.294+0000 7fb220553640 10 monclient: _reopen_session rank -1 2026-02-22T23:25:50.303 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.294+0000 7fb220553640 10 monclient: _add_conns ranks=[7,8,3,6,1,2,4,5,0] 2026-02-22T23:25:50.303 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.294+0000 7fb220553640 10 monclient(hunting): picked mon.noname-i con 0x7fb2180a5e00 addr v1:10.20.193.73:6792/0 2026-02-22T23:25:50.303 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.294+0000 7fb220553640 10 monclient(hunting): picked mon.noname-e con 0x7fb2180a68f0 addr v1:10.20.193.45:6793/0 2026-02-22T23:25:50.304 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.294+0000 7fb220553640 10 monclient(hunting): picked mon.noname-g con 0x7fb2180a6d00 addr v1:10.20.193.73:6790/0 2026-02-22T23:25:50.304 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.294+0000 7fb220553640 1 -- --> v1:10.20.193.73:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb218142090 con 0x7fb2180a6d00 2026-02-22T23:25:50.304 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.294+0000 7fb220553640 1 -- --> v1:10.20.193.73:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb218138290 con 0x7fb2180a5e00 2026-02-22T23:25:50.304 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.294+0000 7fb220553640 1 -- --> v1:10.20.193.45:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb218138850 con 0x7fb2180a68f0 2026-02-22T23:25:50.304 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.294+0000 7fb220553640 10 monclient(hunting): _renew_subs 2026-02-22T23:25:50.304 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.294+0000 7fb220553640 10 monclient(hunting): authenticate will time out at 681.910973s 2026-02-22T23:25:50.304 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.295+0000 7fb21dac7640 1 --1- >> v1:10.20.193.45:6793/0 conn(0x7fb2180a68f0 0x7fb2181d4f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.45:6793/0 says I am v1:10.20.193.45:36930/0 (socket says 10.20.193.45:36930) 2026-02-22T23:25:50.304 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.295+0000 7fb21dac7640 1 -- 10.20.193.45:0/1151683027 learned_addr learned my addr 10.20.193.45:0/1151683027 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-22T23:25:50.304 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.295+0000 7fb1feffd640 1 -- 10.20.193.45:0/1151683027 <== mon.8 v1:10.20.193.45:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1044442765 0 0) 0x7fb218138850 con 0x7fb2180a68f0 2026-02-22T23:25:50.304 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.295+0000 7fb1feffd640 10 monclient(hunting): _negotiate 2026-02-22T23:25:50.304 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.295+0000 7fb1feffd640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:50.304 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.295+0000 7fb1feffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:50.304 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.295+0000 7fb1feffd640 10 monclient(hunting): my global_id is 4508 2026-02-22T23:25:50.304 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.295+0000 7fb1feffd640 1 -- 10.20.193.45:0/1151683027 --> v1:10.20.193.45:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb1e8003620 con 0x7fb2180a68f0 2026-02-22T23:25:50.304 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.295+0000 7fb1feffd640 1 -- 10.20.193.45:0/1151683027 <== mon.8 v1:10.20.193.45:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2691391096 0 0) 0x7fb1e8003620 con 0x7fb2180a68f0 2026-02-22T23:25:50.304 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.295+0000 7fb1feffd640 1 -- 10.20.193.45:0/1151683027 --> v1:10.20.193.45:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb218138850 con 0x7fb2180a68f0 2026-02-22T23:25:50.304 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.295+0000 7fb1feffd640 1 -- 10.20.193.45:0/1151683027 <== mon.8 v1:10.20.193.45:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7fb20c004d20 con 0x7fb2180a68f0 2026-02-22T23:25:50.304 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.295+0000 7fb1feffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-22T23:25:50.304 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.295+0000 7fb1feffd640 10 monclient(hunting): got monmap 1 from mon.noname-e (according to old e1) 2026-02-22T23:25:50.304 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.295+0000 7fb1feffd640 10 monclient(hunting): dump: 2026-02-22T23:25:50.304 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:50.305 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:50.305 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:50.305 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:50.305 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:50.305 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:50.305 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:50.305 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:50.305 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:50.305 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:50.305 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:50.305 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:50.305 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:50.305 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:50.305 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:50.305 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:50.305 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.295+0000 7fb1feffd640 10 monclient(hunting): _finish_auth 0 2026-02-22T23:25:50.305 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.295+0000 7fb1feffd640 1 -- 10.20.193.45:0/1151683027 <== mon.7 v1:10.20.193.73:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3598306598 0 0) 0x7fb218138290 con 0x7fb2180a5e00 2026-02-22T23:25:50.305 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.295+0000 7fb1feffd640 10 monclient(hunting): _negotiate 2026-02-22T23:25:50.305 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.295+0000 7fb1feffd640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:50.305 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.295+0000 7fb1feffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:50.305 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.295+0000 7fb1feffd640 10 monclient(hunting): my global_id is 4408 2026-02-22T23:25:50.305 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.295+0000 7fb1feffd640 1 -- 10.20.193.45:0/1151683027 --> v1:10.20.193.73:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb1e8003620 con 0x7fb2180a5e00 2026-02-22T23:25:50.305 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.295+0000 7fb1feffd640 1 -- 10.20.193.45:0/1151683027 <== mon.8 v1:10.20.193.45:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3749534083 0 0) 0x7fb218138850 con 0x7fb2180a68f0 2026-02-22T23:25:50.306 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.295+0000 7fb1feffd640 1 -- 10.20.193.45:0/1151683027 >> v1:10.20.193.73:6792/0 conn(0x7fb2180a5e00 legacy=0x7fb2181d0030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:50.306 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.295+0000 7fb1feffd640 1 -- 10.20.193.45:0/1151683027 >> v1:10.20.193.73:6790/0 conn(0x7fb2180a6d00 legacy=0x7fb2181d8670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:50.306 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.295+0000 7fb1feffd640 10 monclient: _finish_hunting 0 2026-02-22T23:25:50.306 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.295+0000 7fb1feffd640 1 monclient: found mon.e 2026-02-22T23:25:50.306 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.295+0000 7fb1feffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T23:25:50.306 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.295+0000 7fb1feffd640 10 monclient: _send_mon_message to mon.e at v1:10.20.193.45:6793/0 2026-02-22T23:25:50.306 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.295+0000 7fb1feffd640 1 -- 10.20.193.45:0/1151683027 --> v1:10.20.193.45:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb218138570 con 0x7fb2180a68f0 2026-02-22T23:25:50.306 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.295+0000 7fb1feffd640 10 monclient: _finish_auth 0 2026-02-22T23:25:50.306 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.295+0000 7fb1feffd640 10 monclient: _check_auth_tickets 2026-02-22T23:25:50.306 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.295+0000 7fb1feffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T23:25:50.306 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.295+0000 7fb220553640 5 monclient: authenticate success, global_id 4508 2026-02-22T23:25:50.306 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.295+0000 7fb220553640 10 monclient: _renew_subs 2026-02-22T23:25:50.306 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.295+0000 7fb220553640 10 monclient: _send_mon_message to mon.e at v1:10.20.193.45:6793/0 2026-02-22T23:25:50.306 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.295+0000 7fb220553640 1 -- 10.20.193.45:0/1151683027 --> v1:10.20.193.45:6793/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fb218137210 con 0x7fb2180a68f0 2026-02-22T23:25:50.306 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.295+0000 7fb220553640 10 monclient: _renew_subs 2026-02-22T23:25:50.306 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.295+0000 7fb220553640 10 monclient: _send_mon_message to mon.e at v1:10.20.193.45:6793/0 2026-02-22T23:25:50.306 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.295+0000 7fb220553640 1 -- 10.20.193.45:0/1151683027 --> v1:10.20.193.45:6793/0 -- mon_subscribe({osdmap=0}) -- 0x7fb218136980 con 0x7fb2180a68f0 2026-02-22T23:25:50.306 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.295+0000 7fb1feffd640 1 -- 10.20.193.45:0/1151683027 <== mon.8 v1:10.20.193.45:6793/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb20c002ff0 con 0x7fb2180a68f0 2026-02-22T23:25:50.306 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.295+0000 7fb1feffd640 10 monclient: handle_config config(0 keys) 2026-02-22T23:25:50.306 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.295+0000 7fb1feffd640 1 -- 10.20.193.45:0/1151683027 <== mon.8 v1:10.20.193.45:6793/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7fb20c0052e0 con 0x7fb2180a68f0 2026-02-22T23:25:50.306 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.295+0000 7fb1feffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:25:50.306 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.295+0000 7fb21cac5640 4 set_mon_vals no callback set 2026-02-22T23:25:50.306 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.295+0000 7fb1feffd640 10 monclient: got monmap 1 from mon.e (according to old e1) 2026-02-22T23:25:50.306 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.295+0000 7fb1feffd640 10 monclient: dump: 2026-02-22T23:25:50.307 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:50.307 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:50.307 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:50.307 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:50.307 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:50.307 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:50.307 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:50.307 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:50.307 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:50.307 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:50.307 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:50.307 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:50.307 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:50.307 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:50.307 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:50.307 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:50.307 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.295+0000 7fb220553640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T23:25:50.307 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.295+0000 7fb220553640 1 -- 10.20.193.45:0/1151683027 --> v1:10.20.193.73:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fb2181427b0 con 0x7fb2181d0740 2026-02-22T23:25:50.307 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.295+0000 7fb1feffd640 1 -- 10.20.193.45:0/1151683027 <== mon.8 v1:10.20.193.45:6793/0 7 ==== mgrmap(e 5) ==== 50225+0+0 (unknown 2330357642 0 0) 0x7fb20c0118c0 con 0x7fb2180a68f0 2026-02-22T23:25:50.307 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.296+0000 7fb1feffd640 1 -- 10.20.193.45:0/1151683027 <== mon.8 v1:10.20.193.45:6793/0 8 ==== osd_map(21..21 src has 1..21) ==== 3921+0+0 (unknown 4068336701 0 0) 0x7fb20c04ddc0 con 0x7fb2180a68f0 2026-02-22T23:25:50.307 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.296+0000 7fb21eac9640 10 monclient: get_auth_request con 0x7fb1e803f7c0 auth_method 0 2026-02-22T23:25:50.307 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.296+0000 7fb1feffd640 1 -- 10.20.193.45:0/1151683027 <== mon.1 v1:10.20.193.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2484314488 0 0) 0x7fb1e8003620 con 0x7fb2181d0740 2026-02-22T23:25:50.307 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.296+0000 7fb1feffd640 10 monclient(hunting): _negotiate 2026-02-22T23:25:50.308 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.296+0000 7fb1feffd640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:50.308 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.296+0000 7fb1feffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:50.308 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.296+0000 7fb1feffd640 10 monclient(hunting): my global_id is 4537 2026-02-22T23:25:50.308 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.296+0000 7fb1feffd640 1 -- 10.20.193.45:0/1151683027 --> v1:10.20.193.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb218138850 con 0x7fb2181d0740 2026-02-22T23:25:50.308 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.296+0000 7fb1feffd640 1 -- 10.20.193.45:0/1151683027 <== mon.1 v1:10.20.193.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3441950855 0 0) 0x7fb218138850 con 0x7fb2181d0740 2026-02-22T23:25:50.308 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.296+0000 7fb1feffd640 1 -- 10.20.193.45:0/1151683027 --> v1:10.20.193.73:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb1e8003620 con 0x7fb2181d0740 2026-02-22T23:25:50.308 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.296+0000 7fb1feffd640 1 -- 10.20.193.45:0/1151683027 <== mon.1 v1:10.20.193.73:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7fb2080031a0 con 0x7fb2181d0740 2026-02-22T23:25:50.308 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.296+0000 7fb1feffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:25:50.308 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.296+0000 7fb1feffd640 10 monclient: got monmap 1 from mon.f (according to old e1) 2026-02-22T23:25:50.308 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.296+0000 7fb1feffd640 10 monclient: dump: 2026-02-22T23:25:50.308 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:50.308 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:50.308 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:50.308 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:50.308 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:50.308 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:50.308 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:50.308 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:50.308 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:50.308 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:50.308 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:50.308 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:50.308 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:50.308 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:50.309 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:50.309 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:50.309 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.296+0000 7fb1feffd640 1 -- 10.20.193.45:0/1151683027 <== mon.1 v1:10.20.193.73:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 747410933 0 0) 0x7fb1e8003620 con 0x7fb2181d0740 2026-02-22T23:25:50.309 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.296+0000 7fb1feffd640 1 -- 10.20.193.45:0/1151683027 --> v1:10.20.193.73:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb2181d0b20 con 0x7fb2181d0740 2026-02-22T23:25:50.309 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.297+0000 7fb1feffd640 1 -- 10.20.193.45:0/1151683027 <== mon.1 v1:10.20.193.73:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (unknown 0 0 2024835662) 0x7fb208003490 con 0x7fb2181d0740 2026-02-22T23:25:50.309 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.297+0000 7fb1feffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T23:25:50.309 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.297+0000 7fb1feffd640 10 monclient: _finish_command 1 = system:0 2026-02-22T23:25:50.309 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.297+0000 7fb1feffd640 1 -- 10.20.193.45:0/1151683027 >> v1:10.20.193.73:6789/0 conn(0x7fb2181d0740 legacy=0x7fb2180630c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:50.309 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.297+0000 7fb1feffd640 1 -- 10.20.193.45:0/1151683027 >> v1:10.20.193.73:6789/0 conn(0x7fb2181d0740 legacy=0x7fb2180630c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T23:25:50.310 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.300+0000 7fb220553640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-22T23:25:50.310 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.300+0000 7fb220553640 1 -- 10.20.193.45:0/1151683027 --> v1:10.20.193.73:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fb218142e50 con 0x7fb2180637d0 2026-02-22T23:25:50.310 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.300+0000 7fb1feffd640 1 -- 10.20.193.45:0/1151683027 <== mon.1 v1:10.20.193.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3824168749 0 0) 0x7fb218142e50 con 0x7fb2180637d0 2026-02-22T23:25:50.310 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.300+0000 7fb1feffd640 10 monclient(hunting): _negotiate 2026-02-22T23:25:50.310 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.300+0000 7fb1feffd640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:50.310 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.300+0000 7fb1feffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:50.310 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.300+0000 7fb1feffd640 10 monclient(hunting): my global_id is 4546 2026-02-22T23:25:50.310 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.300+0000 7fb1feffd640 1 -- 10.20.193.45:0/1151683027 --> v1:10.20.193.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb1e8003620 con 0x7fb2180637d0 2026-02-22T23:25:50.310 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.300+0000 7fb1feffd640 1 -- 10.20.193.45:0/1151683027 <== mon.1 v1:10.20.193.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 875564803 0 0) 0x7fb1e8003620 con 0x7fb2180637d0 2026-02-22T23:25:50.310 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.300+0000 7fb1feffd640 1 -- 10.20.193.45:0/1151683027 --> v1:10.20.193.73:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb218142e50 con 0x7fb2180637d0 2026-02-22T23:25:50.310 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.300+0000 7fb1feffd640 1 -- 10.20.193.45:0/1151683027 <== mon.1 v1:10.20.193.73:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7fb208003bf0 con 0x7fb2180637d0 2026-02-22T23:25:50.310 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.300+0000 7fb1feffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:25:50.310 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.300+0000 7fb1feffd640 10 monclient: got monmap 1 from mon.f (according to old e1) 2026-02-22T23:25:50.310 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.300+0000 7fb1feffd640 10 monclient: dump: 2026-02-22T23:25:50.310 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:50.310 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:50.310 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:50.310 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:50.311 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:50.311 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:50.311 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:50.311 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:50.311 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:50.311 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:50.311 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:50.311 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:50.311 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:50.311 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:50.311 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:50.311 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:50.311 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.300+0000 7fb1feffd640 1 -- 10.20.193.45:0/1151683027 <== mon.1 v1:10.20.193.73:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3710328421 0 0) 0x7fb218142e50 con 0x7fb2180637d0 2026-02-22T23:25:50.311 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.300+0000 7fb1feffd640 1 -- 10.20.193.45:0/1151683027 --> v1:10.20.193.73:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fb21806ce10 con 0x7fb2180637d0 2026-02-22T23:25:50.311 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.301+0000 7fb1feffd640 1 -- 10.20.193.45:0/1151683027 <== mon.1 v1:10.20.193.73:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7527 (unknown 0 0 3716785919) 0x7fb2080050c0 con 0x7fb2180637d0 2026-02-22T23:25:50.311 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.301+0000 7fb1feffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-22T23:25:50.311 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.301+0000 7fb1feffd640 10 monclient: _finish_command 2 = system:0 2026-02-22T23:25:50.311 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.301+0000 7fb1feffd640 1 -- 10.20.193.45:0/1151683027 >> v1:10.20.193.73:6789/0 conn(0x7fb2180637d0 legacy=0x7fb2181dedc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:50.311 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.301+0000 7fb1feffd640 1 -- 10.20.193.45:0/1151683027 >> v1:10.20.193.73:6789/0 conn(0x7fb2180637d0 legacy=0x7fb2181dedc0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T23:25:50.311 INFO:teuthology.orchestra.run.trial045.stdout:{ 2026-02-22T23:25:50.312 INFO:teuthology.orchestra.run.trial045.stdout: "name": "f", 2026-02-22T23:25:50.312 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 1, 2026-02-22T23:25:50.312 INFO:teuthology.orchestra.run.trial045.stdout: "state": "peon", 2026-02-22T23:25:50.312 INFO:teuthology.orchestra.run.trial045.stdout: "election_epoch": 8, 2026-02-22T23:25:50.312 INFO:teuthology.orchestra.run.trial045.stdout: "uptime": 30415, 2026-02-22T23:25:50.312 INFO:teuthology.orchestra.run.trial045.stdout: "quorum": [ 2026-02-22T23:25:50.312 INFO:teuthology.orchestra.run.trial045.stdout: 0, 2026-02-22T23:25:50.312 INFO:teuthology.orchestra.run.trial045.stdout: 1, 2026-02-22T23:25:50.312 INFO:teuthology.orchestra.run.trial045.stdout: 2, 2026-02-22T23:25:50.312 INFO:teuthology.orchestra.run.trial045.stdout: 3, 2026-02-22T23:25:50.312 INFO:teuthology.orchestra.run.trial045.stdout: 4, 2026-02-22T23:25:50.312 INFO:teuthology.orchestra.run.trial045.stdout: 5, 2026-02-22T23:25:50.312 INFO:teuthology.orchestra.run.trial045.stdout: 6, 2026-02-22T23:25:50.312 INFO:teuthology.orchestra.run.trial045.stdout: 7, 2026-02-22T23:25:50.312 INFO:teuthology.orchestra.run.trial045.stdout: 8 2026-02-22T23:25:50.312 INFO:teuthology.orchestra.run.trial045.stdout: ], 2026-02-22T23:25:50.312 INFO:teuthology.orchestra.run.trial045.stdout: "quorum_age": 25, 2026-02-22T23:25:50.312 INFO:teuthology.orchestra.run.trial045.stdout: "features": { 2026-02-22T23:25:50.312 INFO:teuthology.orchestra.run.trial045.stdout: "required_con": "2450521708007866372", 2026-02-22T23:25:50.312 INFO:teuthology.orchestra.run.trial045.stdout: "required_mon": [ 2026-02-22T23:25:50.312 INFO:teuthology.orchestra.run.trial045.stdout: "kraken", 2026-02-22T23:25:50.312 INFO:teuthology.orchestra.run.trial045.stdout: "luminous", 2026-02-22T23:25:50.313 INFO:teuthology.orchestra.run.trial045.stdout: "mimic", 2026-02-22T23:25:50.313 INFO:teuthology.orchestra.run.trial045.stdout: "osdmap-prune", 2026-02-22T23:25:50.313 INFO:teuthology.orchestra.run.trial045.stdout: "nautilus", 2026-02-22T23:25:50.313 INFO:teuthology.orchestra.run.trial045.stdout: "octopus", 2026-02-22T23:25:50.313 INFO:teuthology.orchestra.run.trial045.stdout: "pacific", 2026-02-22T23:25:50.313 INFO:teuthology.orchestra.run.trial045.stdout: "elector-pinging", 2026-02-22T23:25:50.313 INFO:teuthology.orchestra.run.trial045.stdout: "quincy", 2026-02-22T23:25:50.313 INFO:teuthology.orchestra.run.trial045.stdout: "reef", 2026-02-22T23:25:50.313 INFO:teuthology.orchestra.run.trial045.stdout: "squid" 2026-02-22T23:25:50.313 INFO:teuthology.orchestra.run.trial045.stdout: ], 2026-02-22T23:25:50.313 INFO:teuthology.orchestra.run.trial045.stdout: "quorum_con": "4540701547738038271", 2026-02-22T23:25:50.313 INFO:teuthology.orchestra.run.trial045.stdout: "quorum_mon": [ 2026-02-22T23:25:50.313 INFO:teuthology.orchestra.run.trial045.stdout: "kraken", 2026-02-22T23:25:50.313 INFO:teuthology.orchestra.run.trial045.stdout: "luminous", 2026-02-22T23:25:50.313 INFO:teuthology.orchestra.run.trial045.stdout: "mimic", 2026-02-22T23:25:50.313 INFO:teuthology.orchestra.run.trial045.stdout: "osdmap-prune", 2026-02-22T23:25:50.313 INFO:teuthology.orchestra.run.trial045.stdout: "nautilus", 2026-02-22T23:25:50.313 INFO:teuthology.orchestra.run.trial045.stdout: "octopus", 2026-02-22T23:25:50.313 INFO:teuthology.orchestra.run.trial045.stdout: "pacific", 2026-02-22T23:25:50.313 INFO:teuthology.orchestra.run.trial045.stdout: "elector-pinging", 2026-02-22T23:25:50.313 INFO:teuthology.orchestra.run.trial045.stdout: "quincy", 2026-02-22T23:25:50.313 INFO:teuthology.orchestra.run.trial045.stdout: "reef", 2026-02-22T23:25:50.313 INFO:teuthology.orchestra.run.trial045.stdout: "squid" 2026-02-22T23:25:50.313 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:25:50.313 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:25:50.313 INFO:teuthology.orchestra.run.trial045.stdout: "outside_quorum": [], 2026-02-22T23:25:50.314 INFO:teuthology.orchestra.run.trial045.stdout: "extra_probe_peers": [], 2026-02-22T23:25:50.314 INFO:teuthology.orchestra.run.trial045.stdout: "sync_provider": [], 2026-02-22T23:25:50.314 INFO:teuthology.orchestra.run.trial045.stdout: "monmap": { 2026-02-22T23:25:50.314 INFO:teuthology.orchestra.run.trial045.stdout: "epoch": 1, 2026-02-22T23:25:50.314 INFO:teuthology.orchestra.run.trial045.stdout: "fsid": "4b60f18f-6660-4731-b731-dc85c4078413", 2026-02-22T23:25:50.314 INFO:teuthology.orchestra.run.trial045.stdout: "modified": "2026-02-22T23:24:52.393472Z", 2026-02-22T23:25:50.314 INFO:teuthology.orchestra.run.trial045.stdout: "created": "2026-02-22T23:24:52.393472Z", 2026-02-22T23:25:50.314 INFO:teuthology.orchestra.run.trial045.stdout: "min_mon_release": 19, 2026-02-22T23:25:50.314 INFO:teuthology.orchestra.run.trial045.stdout: "min_mon_release_name": "squid", 2026-02-22T23:25:50.314 INFO:teuthology.orchestra.run.trial045.stdout: "election_strategy": 3, 2026-02-22T23:25:50.314 INFO:teuthology.orchestra.run.trial045.stdout: "disallowed_leaders": "", 2026-02-22T23:25:50.314 INFO:teuthology.orchestra.run.trial045.stdout: "stretch_mode": false, 2026-02-22T23:25:50.314 INFO:teuthology.orchestra.run.trial045.stdout: "tiebreaker_mon": "", 2026-02-22T23:25:50.314 INFO:teuthology.orchestra.run.trial045.stdout: "removed_ranks": "", 2026-02-22T23:25:50.314 INFO:teuthology.orchestra.run.trial045.stdout: "features": { 2026-02-22T23:25:50.314 INFO:teuthology.orchestra.run.trial045.stdout: "persistent": [ 2026-02-22T23:25:50.314 INFO:teuthology.orchestra.run.trial045.stdout: "kraken", 2026-02-22T23:25:50.314 INFO:teuthology.orchestra.run.trial045.stdout: "luminous", 2026-02-22T23:25:50.314 INFO:teuthology.orchestra.run.trial045.stdout: "mimic", 2026-02-22T23:25:50.314 INFO:teuthology.orchestra.run.trial045.stdout: "osdmap-prune", 2026-02-22T23:25:50.314 INFO:teuthology.orchestra.run.trial045.stdout: "nautilus", 2026-02-22T23:25:50.314 INFO:teuthology.orchestra.run.trial045.stdout: "octopus", 2026-02-22T23:25:50.314 INFO:teuthology.orchestra.run.trial045.stdout: "pacific", 2026-02-22T23:25:50.314 INFO:teuthology.orchestra.run.trial045.stdout: "elector-pinging", 2026-02-22T23:25:50.314 INFO:teuthology.orchestra.run.trial045.stdout: "quincy", 2026-02-22T23:25:50.314 INFO:teuthology.orchestra.run.trial045.stdout: "reef", 2026-02-22T23:25:50.315 INFO:teuthology.orchestra.run.trial045.stdout: "squid" 2026-02-22T23:25:50.315 INFO:teuthology.orchestra.run.trial045.stdout: ], 2026-02-22T23:25:50.315 INFO:teuthology.orchestra.run.trial045.stdout: "optional": [] 2026-02-22T23:25:50.315 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:25:50.315 INFO:teuthology.orchestra.run.trial045.stdout: "mons": [ 2026-02-22T23:25:50.315 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:25:50.315 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 0, 2026-02-22T23:25:50.315 INFO:teuthology.orchestra.run.trial045.stdout: "name": "a", 2026-02-22T23:25:50.315 INFO:teuthology.orchestra.run.trial045.stdout: "public_addrs": { 2026-02-22T23:25:50.315 INFO:teuthology.orchestra.run.trial045.stdout: "addrvec": [ 2026-02-22T23:25:50.315 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:25:50.315 INFO:teuthology.orchestra.run.trial045.stdout: "type": "v1", 2026-02-22T23:25:50.315 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6789", 2026-02-22T23:25:50.315 INFO:teuthology.orchestra.run.trial045.stdout: "nonce": 0 2026-02-22T23:25:50.315 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:25:50.315 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:25:50.315 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:25:50.315 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6789/0", 2026-02-22T23:25:50.315 INFO:teuthology.orchestra.run.trial045.stdout: "public_addr": "10.20.193.45:6789/0", 2026-02-22T23:25:50.315 INFO:teuthology.orchestra.run.trial045.stdout: "priority": 0, 2026-02-22T23:25:50.315 INFO:teuthology.orchestra.run.trial045.stdout: "weight": 0, 2026-02-22T23:25:50.315 INFO:teuthology.orchestra.run.trial045.stdout: "crush_location": "{}" 2026-02-22T23:25:50.315 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:25:50.315 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:25:50.315 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 1, 2026-02-22T23:25:50.315 INFO:teuthology.orchestra.run.trial045.stdout: "name": "f", 2026-02-22T23:25:50.315 INFO:teuthology.orchestra.run.trial045.stdout: "public_addrs": { 2026-02-22T23:25:50.315 INFO:teuthology.orchestra.run.trial045.stdout: "addrvec": [ 2026-02-22T23:25:50.316 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:25:50.316 INFO:teuthology.orchestra.run.trial045.stdout: "type": "v1", 2026-02-22T23:25:50.316 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.73:6789", 2026-02-22T23:25:50.316 INFO:teuthology.orchestra.run.trial045.stdout: "nonce": 0 2026-02-22T23:25:50.316 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:25:50.316 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:25:50.316 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:25:50.316 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.73:6789/0", 2026-02-22T23:25:50.316 INFO:teuthology.orchestra.run.trial045.stdout: "public_addr": "10.20.193.73:6789/0", 2026-02-22T23:25:50.316 INFO:teuthology.orchestra.run.trial045.stdout: "priority": 0, 2026-02-22T23:25:50.316 INFO:teuthology.orchestra.run.trial045.stdout: "weight": 0, 2026-02-22T23:25:50.316 INFO:teuthology.orchestra.run.trial045.stdout: "crush_location": "{}" 2026-02-22T23:25:50.316 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:25:50.316 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:25:50.316 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 2, 2026-02-22T23:25:50.316 INFO:teuthology.orchestra.run.trial045.stdout: "name": "b", 2026-02-22T23:25:50.316 INFO:teuthology.orchestra.run.trial045.stdout: "public_addrs": { 2026-02-22T23:25:50.316 INFO:teuthology.orchestra.run.trial045.stdout: "addrvec": [ 2026-02-22T23:25:50.316 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:25:50.316 INFO:teuthology.orchestra.run.trial045.stdout: "type": "v1", 2026-02-22T23:25:50.316 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6790", 2026-02-22T23:25:50.316 INFO:teuthology.orchestra.run.trial045.stdout: "nonce": 0 2026-02-22T23:25:50.316 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:25:50.316 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:25:50.316 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:25:50.316 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6790/0", 2026-02-22T23:25:50.316 INFO:teuthology.orchestra.run.trial045.stdout: "public_addr": "10.20.193.45:6790/0", 2026-02-22T23:25:50.316 INFO:teuthology.orchestra.run.trial045.stdout: "priority": 0, 2026-02-22T23:25:50.317 INFO:teuthology.orchestra.run.trial045.stdout: "weight": 0, 2026-02-22T23:25:50.317 INFO:teuthology.orchestra.run.trial045.stdout: "crush_location": "{}" 2026-02-22T23:25:50.317 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:25:50.317 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:25:50.317 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 3, 2026-02-22T23:25:50.317 INFO:teuthology.orchestra.run.trial045.stdout: "name": "g", 2026-02-22T23:25:50.317 INFO:teuthology.orchestra.run.trial045.stdout: "public_addrs": { 2026-02-22T23:25:50.317 INFO:teuthology.orchestra.run.trial045.stdout: "addrvec": [ 2026-02-22T23:25:50.317 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:25:50.317 INFO:teuthology.orchestra.run.trial045.stdout: "type": "v1", 2026-02-22T23:25:50.317 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.73:6790", 2026-02-22T23:25:50.317 INFO:teuthology.orchestra.run.trial045.stdout: "nonce": 0 2026-02-22T23:25:50.317 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:25:50.317 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:25:50.317 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:25:50.317 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.73:6790/0", 2026-02-22T23:25:50.317 INFO:teuthology.orchestra.run.trial045.stdout: "public_addr": "10.20.193.73:6790/0", 2026-02-22T23:25:50.317 INFO:teuthology.orchestra.run.trial045.stdout: "priority": 0, 2026-02-22T23:25:50.317 INFO:teuthology.orchestra.run.trial045.stdout: "weight": 0, 2026-02-22T23:25:50.317 INFO:teuthology.orchestra.run.trial045.stdout: "crush_location": "{}" 2026-02-22T23:25:50.317 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:25:50.317 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:25:50.317 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 4, 2026-02-22T23:25:50.317 INFO:teuthology.orchestra.run.trial045.stdout: "name": "c", 2026-02-22T23:25:50.317 INFO:teuthology.orchestra.run.trial045.stdout: "public_addrs": { 2026-02-22T23:25:50.317 INFO:teuthology.orchestra.run.trial045.stdout: "addrvec": [ 2026-02-22T23:25:50.317 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:25:50.317 INFO:teuthology.orchestra.run.trial045.stdout: "type": "v1", 2026-02-22T23:25:50.318 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6791", 2026-02-22T23:25:50.318 INFO:teuthology.orchestra.run.trial045.stdout: "nonce": 0 2026-02-22T23:25:50.318 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:25:50.318 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:25:50.318 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:25:50.318 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6791/0", 2026-02-22T23:25:50.318 INFO:teuthology.orchestra.run.trial045.stdout: "public_addr": "10.20.193.45:6791/0", 2026-02-22T23:25:50.318 INFO:teuthology.orchestra.run.trial045.stdout: "priority": 0, 2026-02-22T23:25:50.318 INFO:teuthology.orchestra.run.trial045.stdout: "weight": 0, 2026-02-22T23:25:50.318 INFO:teuthology.orchestra.run.trial045.stdout: "crush_location": "{}" 2026-02-22T23:25:50.318 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:25:50.318 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:25:50.318 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 5, 2026-02-22T23:25:50.318 INFO:teuthology.orchestra.run.trial045.stdout: "name": "h", 2026-02-22T23:25:50.318 INFO:teuthology.orchestra.run.trial045.stdout: "public_addrs": { 2026-02-22T23:25:50.318 INFO:teuthology.orchestra.run.trial045.stdout: "addrvec": [ 2026-02-22T23:25:50.318 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:25:50.318 INFO:teuthology.orchestra.run.trial045.stdout: "type": "v1", 2026-02-22T23:25:50.318 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.73:6791", 2026-02-22T23:25:50.318 INFO:teuthology.orchestra.run.trial045.stdout: "nonce": 0 2026-02-22T23:25:50.318 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:25:50.318 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:25:50.318 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:25:50.318 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.73:6791/0", 2026-02-22T23:25:50.318 INFO:teuthology.orchestra.run.trial045.stdout: "public_addr": "10.20.193.73:6791/0", 2026-02-22T23:25:50.318 INFO:teuthology.orchestra.run.trial045.stdout: "priority": 0, 2026-02-22T23:25:50.318 INFO:teuthology.orchestra.run.trial045.stdout: "weight": 0, 2026-02-22T23:25:50.318 INFO:teuthology.orchestra.run.trial045.stdout: "crush_location": "{}" 2026-02-22T23:25:50.318 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:25:50.318 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:25:50.319 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 6, 2026-02-22T23:25:50.319 INFO:teuthology.orchestra.run.trial045.stdout: "name": "d", 2026-02-22T23:25:50.319 INFO:teuthology.orchestra.run.trial045.stdout: "public_addrs": { 2026-02-22T23:25:50.319 INFO:teuthology.orchestra.run.trial045.stdout: "addrvec": [ 2026-02-22T23:25:50.319 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:25:50.319 INFO:teuthology.orchestra.run.trial045.stdout: "type": "v1", 2026-02-22T23:25:50.319 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6792", 2026-02-22T23:25:50.319 INFO:teuthology.orchestra.run.trial045.stdout: "nonce": 0 2026-02-22T23:25:50.319 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:25:50.319 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:25:50.319 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:25:50.319 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6792/0", 2026-02-22T23:25:50.319 INFO:teuthology.orchestra.run.trial045.stdout: "public_addr": "10.20.193.45:6792/0", 2026-02-22T23:25:50.319 INFO:teuthology.orchestra.run.trial045.stdout: "priority": 0, 2026-02-22T23:25:50.319 INFO:teuthology.orchestra.run.trial045.stdout: "weight": 0, 2026-02-22T23:25:50.319 INFO:teuthology.orchestra.run.trial045.stdout: "crush_location": "{}" 2026-02-22T23:25:50.319 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:25:50.319 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:25:50.319 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 7, 2026-02-22T23:25:50.319 INFO:teuthology.orchestra.run.trial045.stdout: "name": "i", 2026-02-22T23:25:50.319 INFO:teuthology.orchestra.run.trial045.stdout: "public_addrs": { 2026-02-22T23:25:50.319 INFO:teuthology.orchestra.run.trial045.stdout: "addrvec": [ 2026-02-22T23:25:50.319 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:25:50.319 INFO:teuthology.orchestra.run.trial045.stdout: "type": "v1", 2026-02-22T23:25:50.319 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.73:6792", 2026-02-22T23:25:50.319 INFO:teuthology.orchestra.run.trial045.stdout: "nonce": 0 2026-02-22T23:25:50.319 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:25:50.319 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:25:50.319 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:25:50.319 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.73:6792/0", 2026-02-22T23:25:50.320 INFO:teuthology.orchestra.run.trial045.stdout: "public_addr": "10.20.193.73:6792/0", 2026-02-22T23:25:50.320 INFO:teuthology.orchestra.run.trial045.stdout: "priority": 0, 2026-02-22T23:25:50.320 INFO:teuthology.orchestra.run.trial045.stdout: "weight": 0, 2026-02-22T23:25:50.320 INFO:teuthology.orchestra.run.trial045.stdout: "crush_location": "{}" 2026-02-22T23:25:50.320 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:25:50.320 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:25:50.320 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 8, 2026-02-22T23:25:50.320 INFO:teuthology.orchestra.run.trial045.stdout: "name": "e", 2026-02-22T23:25:50.320 INFO:teuthology.orchestra.run.trial045.stdout: "public_addrs": { 2026-02-22T23:25:50.320 INFO:teuthology.orchestra.run.trial045.stdout: "addrvec": [ 2026-02-22T23:25:50.320 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:25:50.320 INFO:teuthology.orchestra.run.trial045.stdout: "type": "v1", 2026-02-22T23:25:50.320 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6793", 2026-02-22T23:25:50.320 INFO:teuthology.orchestra.run.trial045.stdout: "nonce": 0 2026-02-22T23:25:50.320 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:25:50.320 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:25:50.320 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:25:50.320 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6793/0", 2026-02-22T23:25:50.320 INFO:teuthology.orchestra.run.trial045.stdout: "public_addr": "10.20.193.45:6793/0", 2026-02-22T23:25:50.320 INFO:teuthology.orchestra.run.trial045.stdout: "priority": 0, 2026-02-22T23:25:50.320 INFO:teuthology.orchestra.run.trial045.stdout: "weight": 0, 2026-02-22T23:25:50.320 INFO:teuthology.orchestra.run.trial045.stdout: "crush_location": "{}" 2026-02-22T23:25:50.320 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:25:50.320 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:25:50.320 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:25:50.320 INFO:teuthology.orchestra.run.trial045.stdout: "feature_map": { 2026-02-22T23:25:50.320 INFO:teuthology.orchestra.run.trial045.stdout: "mon": [ 2026-02-22T23:25:50.321 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:25:50.321 INFO:teuthology.orchestra.run.trial045.stdout: "features": "0x3f03cffffffdffff", 2026-02-22T23:25:50.321 INFO:teuthology.orchestra.run.trial045.stdout: "release": "squid", 2026-02-22T23:25:50.321 INFO:teuthology.orchestra.run.trial045.stdout: "num": 1 2026-02-22T23:25:50.321 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:25:50.321 INFO:teuthology.orchestra.run.trial045.stdout: ], 2026-02-22T23:25:50.321 INFO:teuthology.orchestra.run.trial045.stdout: "client": [ 2026-02-22T23:25:50.321 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:25:50.321 INFO:teuthology.orchestra.run.trial045.stdout: "features": "0x3f03cffffffdffff", 2026-02-22T23:25:50.321 INFO:teuthology.orchestra.run.trial045.stdout: "release": "squid", 2026-02-22T23:25:50.321 INFO:teuthology.orchestra.run.trial045.stdout: "num": 1 2026-02-22T23:25:50.321 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:25:50.321 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:25:50.321 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:25:50.321 INFO:teuthology.orchestra.run.trial045.stdout: "stretch_mode": false 2026-02-22T23:25:50.321 INFO:teuthology.orchestra.run.trial045.stdout:} 2026-02-22T23:25:50.322 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.301+0000 7fb220553640 1 -- 10.20.193.45:0/1151683027 >> v1:10.20.193.73:6800/2222410180 conn(0x7fb1e803f7c0 legacy=0x7fb1e8041c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:50.322 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.301+0000 7fb220553640 10 monclient: shutdown 2026-02-22T23:25:50.322 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.301+0000 7fb220553640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T23:25:50.322 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.301+0000 7fb220553640 1 -- 10.20.193.45:0/1151683027 >> v1:10.20.193.45:6793/0 conn(0x7fb2180a68f0 legacy=0x7fb2181d4f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:50.322 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.301+0000 7fb21eac9640 1 -- 10.20.193.45:0/1151683027 reap_dead start 2026-02-22T23:25:50.322 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.301+0000 7fb21eac9640 1 -- 10.20.193.45:0/1151683027 reap_dead start 2026-02-22T23:25:50.322 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.301+0000 7fb220553640 1 -- 10.20.193.45:0/1151683027 shutdown_connections 2026-02-22T23:25:50.322 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.301+0000 7fb220553640 1 -- 10.20.193.45:0/1151683027 >> 10.20.193.45:0/1151683027 conn(0x7fb2180abb50 msgr2=0x7fb2180a4010 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:25:50.322 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.301+0000 7fb220553640 1 -- 10.20.193.45:0/1151683027 shutdown_connections 2026-02-22T23:25:50.322 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.301+0000 7fb220553640 1 -- 10.20.193.45:0/1151683027 wait complete. 2026-02-22T23:25:50.322 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2026-02-22T23:25:50.322 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon g 2026-02-22T23:25:50.323 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.g mon_status 2026-02-22T23:25:50.389 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.389+0000 7efd73457640 10 monclient: get_monmap_and_config 2026-02-22T23:25:50.389 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.389+0000 7efd73457640 10 monclient: build_initial_monmap 2026-02-22T23:25:50.389 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.389+0000 7efd73457640 10 monclient: monmap: 2026-02-22T23:25:50.389 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-22T23:25:50.389 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:50.389 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:25:50.389775+0000 2026-02-22T23:25:50.389 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:25:50.389775+0000 2026-02-22T23:25:50.389 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-22T23:25:50.389 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:50.389 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-22T23:25:50.389 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.noname-f 2026-02-22T23:25:50.390 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.noname-b 2026-02-22T23:25:50.390 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.noname-g 2026-02-22T23:25:50.390 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.noname-c 2026-02-22T23:25:50.390 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.noname-h 2026-02-22T23:25:50.390 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.noname-d 2026-02-22T23:25:50.390 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.noname-i 2026-02-22T23:25:50.390 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.noname-e 2026-02-22T23:25:50.390 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:50.395 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.389+0000 7efd73457640 1 Processor -- start 2026-02-22T23:25:50.395 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.390+0000 7efd73457640 1 -- start start 2026-02-22T23:25:50.395 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.390+0000 7efd73457640 10 monclient: init 2026-02-22T23:25:50.395 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.390+0000 7efd73457640 10 monclient: _reopen_session rank -1 2026-02-22T23:25:50.395 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.390+0000 7efd73457640 10 monclient: _add_conns ranks=[2,7,4,3,0,1,5,8,6] 2026-02-22T23:25:50.395 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.390+0000 7efd73457640 10 monclient(hunting): picked mon.noname-b con 0x7efd6c0a5d90 addr v1:10.20.193.45:6790/0 2026-02-22T23:25:50.395 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.390+0000 7efd73457640 10 monclient(hunting): picked mon.noname-i con 0x7efd6c0a6880 addr v1:10.20.193.73:6792/0 2026-02-22T23:25:50.395 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.390+0000 7efd73457640 10 monclient(hunting): picked mon.noname-c con 0x7efd6c0a3d30 addr v1:10.20.193.45:6791/0 2026-02-22T23:25:50.395 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.390+0000 7efd73457640 1 -- --> v1:10.20.193.45:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efd6c0a7200 con 0x7efd6c0a5d90 2026-02-22T23:25:50.396 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.390+0000 7efd73457640 1 -- --> v1:10.20.193.45:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efd6c0a8c90 con 0x7efd6c0a3d30 2026-02-22T23:25:50.396 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.390+0000 7efd73457640 1 -- --> v1:10.20.193.73:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efd6c0a6ef0 con 0x7efd6c0a6880 2026-02-22T23:25:50.396 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.390+0000 7efd73457640 10 monclient(hunting): _renew_subs 2026-02-22T23:25:50.396 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.390+0000 7efd73457640 10 monclient(hunting): authenticate will time out at 682.006510s 2026-02-22T23:25:50.396 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.390+0000 7efd711cc640 1 --1- >> v1:10.20.193.45:6790/0 conn(0x7efd6c0a5d90 0x7efd6c0a6170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.45:6790/0 says I am v1:10.20.193.45:51148/0 (socket says 10.20.193.45:51148) 2026-02-22T23:25:50.396 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.390+0000 7efd711cc640 1 -- 10.20.193.45:0/2278139974 learned_addr learned my addr 10.20.193.45:0/2278139974 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-22T23:25:50.396 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.390+0000 7efd5bfff640 1 -- 10.20.193.45:0/2278139974 <== mon.2 v1:10.20.193.45:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3478999237 0 0) 0x7efd6c0a7200 con 0x7efd6c0a5d90 2026-02-22T23:25:50.396 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.390+0000 7efd5bfff640 10 monclient(hunting): _negotiate 2026-02-22T23:25:50.396 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.390+0000 7efd5bfff640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:50.396 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.390+0000 7efd5bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:50.396 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.390+0000 7efd5bfff640 10 monclient(hunting): my global_id is 4556 2026-02-22T23:25:50.396 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.390+0000 7efd5bfff640 1 -- 10.20.193.45:0/2278139974 --> v1:10.20.193.45:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efd54003620 con 0x7efd6c0a5d90 2026-02-22T23:25:50.396 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.390+0000 7efd5bfff640 1 -- 10.20.193.45:0/2278139974 <== mon.4 v1:10.20.193.45:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3359193504 0 0) 0x7efd6c0a8c90 con 0x7efd6c0a3d30 2026-02-22T23:25:50.396 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.390+0000 7efd5bfff640 10 monclient(hunting): _negotiate 2026-02-22T23:25:50.396 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.390+0000 7efd5bfff640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:50.396 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.390+0000 7efd5bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:50.396 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.390+0000 7efd5bfff640 10 monclient(hunting): my global_id is 4531 2026-02-22T23:25:50.396 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.390+0000 7efd5bfff640 1 -- 10.20.193.45:0/2278139974 --> v1:10.20.193.45:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efd6c0a7200 con 0x7efd6c0a3d30 2026-02-22T23:25:50.396 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.390+0000 7efd5bfff640 1 -- 10.20.193.45:0/2278139974 <== mon.2 v1:10.20.193.45:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 191114081 0 0) 0x7efd54003620 con 0x7efd6c0a5d90 2026-02-22T23:25:50.396 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.390+0000 7efd5bfff640 1 -- 10.20.193.45:0/2278139974 >> v1:10.20.193.73:6792/0 conn(0x7efd6c0a6880 legacy=0x7efd6c13e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T23:25:50.397 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.390+0000 7efd5bfff640 1 -- 10.20.193.45:0/2278139974 >> v1:10.20.193.45:6791/0 conn(0x7efd6c0a3d30 legacy=0x7efd6c141740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:50.397 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.390+0000 7efd5bfff640 10 monclient: _finish_hunting 0 2026-02-22T23:25:50.397 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.390+0000 7efd5bfff640 1 monclient: found mon.noname-b 2026-02-22T23:25:50.397 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.390+0000 7efd5bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T23:25:50.397 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.390+0000 7efd5bfff640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.45:6790/0 2026-02-22T23:25:50.397 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.390+0000 7efd5bfff640 1 -- 10.20.193.45:0/2278139974 --> v1:10.20.193.45:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd6c0a2c20 con 0x7efd6c0a5d90 2026-02-22T23:25:50.397 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.390+0000 7efd5bfff640 10 monclient: _finish_auth 0 2026-02-22T23:25:50.397 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.390+0000 7efd5bfff640 10 monclient: _check_auth_tickets 2026-02-22T23:25:50.397 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.390+0000 7efd5bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T23:25:50.397 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.390+0000 7efd5bfff640 1 -- 10.20.193.45:0/2278139974 <== mon.2 v1:10.20.193.45:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7efd5c003040 con 0x7efd6c0a5d90 2026-02-22T23:25:50.397 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.390+0000 7efd73457640 5 monclient: authenticate success, global_id 4556 2026-02-22T23:25:50.397 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.390+0000 7efd73457640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-22T23:25:50.397 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.390+0000 7efd5bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:25:50.397 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.390+0000 7efd5bfff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-22T23:25:50.397 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.390+0000 7efd5bfff640 10 monclient: dump: 2026-02-22T23:25:50.397 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:50.397 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:50.397 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:50.397 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:50.397 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:50.397 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:50.397 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:50.397 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:50.398 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:50.398 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:50.398 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:50.398 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:50.398 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:50.398 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:50.398 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:50.398 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:50.398 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.390+0000 7efd73457640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-22T23:25:50.398 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.390+0000 7efd5bfff640 1 -- 10.20.193.45:0/2278139974 <== mon.2 v1:10.20.193.45:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7efd5c0031e0 con 0x7efd6c0a5d90 2026-02-22T23:25:50.398 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.390+0000 7efd5bfff640 10 monclient: handle_config config(0 keys) 2026-02-22T23:25:50.398 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.390+0000 7efd5bfff640 1 -- 10.20.193.45:0/2278139974 <== mon.2 v1:10.20.193.45:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7efd5c004ce0 con 0x7efd6c0a5d90 2026-02-22T23:25:50.398 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.390+0000 7efd73457640 10 monclient: get_monmap_and_config success 2026-02-22T23:25:50.398 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.390+0000 7efd73457640 4 set_mon_vals no callback set 2026-02-22T23:25:50.398 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.390+0000 7efd5bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:25:50.398 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.390+0000 7efd5bfff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-22T23:25:50.398 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.390+0000 7efd5bfff640 10 monclient: dump: 2026-02-22T23:25:50.398 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:50.398 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:50.398 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:50.398 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:50.398 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:50.399 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:50.399 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:50.399 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:50.399 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:50.399 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:50.399 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:50.399 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:50.399 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:50.399 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:50.399 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:50.399 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:50.399 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.391+0000 7efd73457640 10 monclient: shutdown 2026-02-22T23:25:50.399 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.391+0000 7efd73457640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T23:25:50.399 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.391+0000 7efd73457640 1 -- 10.20.193.45:0/2278139974 >> v1:10.20.193.45:6790/0 conn(0x7efd6c0a5d90 legacy=0x7efd6c0a6170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:50.399 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.391+0000 7efd73457640 1 -- 10.20.193.45:0/2278139974 shutdown_connections 2026-02-22T23:25:50.399 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.391+0000 7efd73457640 1 -- 10.20.193.45:0/2278139974 >> 10.20.193.45:0/2278139974 conn(0x7efd6c0ab9c0 msgr2=0x7efd6c0a7e90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:25:50.399 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.391+0000 7efd73457640 1 -- 10.20.193.45:0/2278139974 shutdown_connections 2026-02-22T23:25:50.399 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.391+0000 7efd73457640 1 -- 10.20.193.45:0/2278139974 wait complete. 2026-02-22T23:25:50.399 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.391+0000 7efd73457640 10 monclient: build_initial_monmap 2026-02-22T23:25:50.399 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.391+0000 7efd73457640 10 monclient: monmap: 2026-02-22T23:25:50.399 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-22T23:25:50.399 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T23:25:50.400 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-22T23:25:50.400 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-22T23:25:50.400 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-22T23:25:50.400 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-22T23:25:50.400 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-22T23:25:50.400 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.noname-f 2026-02-22T23:25:50.400 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.noname-b 2026-02-22T23:25:50.400 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.noname-g 2026-02-22T23:25:50.400 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.noname-c 2026-02-22T23:25:50.400 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.noname-h 2026-02-22T23:25:50.400 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.noname-d 2026-02-22T23:25:50.400 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.noname-i 2026-02-22T23:25:50.400 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.noname-e 2026-02-22T23:25:50.400 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:50.400 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.391+0000 7efd73457640 1 Processor -- start 2026-02-22T23:25:50.400 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.391+0000 7efd73457640 1 -- start start 2026-02-22T23:25:50.400 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.391+0000 7efd73457640 10 monclient: init 2026-02-22T23:25:50.400 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.392+0000 7efd73457640 10 monclient: _reopen_session rank -1 2026-02-22T23:25:50.400 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.392+0000 7efd73457640 10 monclient: _add_conns ranks=[7,6,3,8,1,5,2,0,4] 2026-02-22T23:25:50.400 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.392+0000 7efd73457640 10 monclient(hunting): picked mon.noname-i con 0x7efd6c0a3d30 addr v1:10.20.193.73:6792/0 2026-02-22T23:25:50.400 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.392+0000 7efd73457640 10 monclient(hunting): picked mon.noname-d con 0x7efd6c0a5d90 addr v1:10.20.193.45:6792/0 2026-02-22T23:25:50.401 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.392+0000 7efd73457640 10 monclient(hunting): picked mon.noname-g con 0x7efd6c0a6880 addr v1:10.20.193.73:6790/0 2026-02-22T23:25:50.401 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.392+0000 7efd73457640 1 -- --> v1:10.20.193.73:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efd6c1419d0 con 0x7efd6c0a6880 2026-02-22T23:25:50.401 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.392+0000 7efd73457640 1 -- --> v1:10.20.193.45:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efd6c128660 con 0x7efd6c0a5d90 2026-02-22T23:25:50.401 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.392+0000 7efd73457640 1 -- --> v1:10.20.193.73:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efd6c128940 con 0x7efd6c0a3d30 2026-02-22T23:25:50.401 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.392+0000 7efd73457640 10 monclient(hunting): _renew_subs 2026-02-22T23:25:50.401 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.392+0000 7efd73457640 10 monclient(hunting): authenticate will time out at 682.008257s 2026-02-22T23:25:50.401 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.392+0000 7efd709cb640 1 --1- >> v1:10.20.193.45:6792/0 conn(0x7efd6c0a5d90 0x7efd6c1d41a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.45:6792/0 says I am v1:10.20.193.45:57014/0 (socket says 10.20.193.45:57014) 2026-02-22T23:25:50.401 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.392+0000 7efd709cb640 1 -- 10.20.193.45:0/125710776 learned_addr learned my addr 10.20.193.45:0/125710776 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-22T23:25:50.401 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.392+0000 7efd59ffb640 1 -- 10.20.193.45:0/125710776 <== mon.6 v1:10.20.193.45:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1093078325 0 0) 0x7efd6c128660 con 0x7efd6c0a5d90 2026-02-22T23:25:50.401 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.392+0000 7efd59ffb640 10 monclient(hunting): _negotiate 2026-02-22T23:25:50.401 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.392+0000 7efd59ffb640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:50.401 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.392+0000 7efd59ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:50.401 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.392+0000 7efd59ffb640 10 monclient(hunting): my global_id is 4488 2026-02-22T23:25:50.401 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.392+0000 7efd59ffb640 1 -- 10.20.193.45:0/125710776 --> v1:10.20.193.45:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efd3c003620 con 0x7efd6c0a5d90 2026-02-22T23:25:50.401 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.392+0000 7efd59ffb640 1 -- 10.20.193.45:0/125710776 <== mon.6 v1:10.20.193.45:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3235888483 0 0) 0x7efd3c003620 con 0x7efd6c0a5d90 2026-02-22T23:25:50.401 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.392+0000 7efd59ffb640 1 -- 10.20.193.45:0/125710776 --> v1:10.20.193.45:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7efd6c128660 con 0x7efd6c0a5d90 2026-02-22T23:25:50.401 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.392+0000 7efd59ffb640 1 -- 10.20.193.45:0/125710776 <== mon.6 v1:10.20.193.45:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7efd60004280 con 0x7efd6c0a5d90 2026-02-22T23:25:50.401 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.392+0000 7efd59ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-22T23:25:50.401 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.392+0000 7efd59ffb640 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2026-02-22T23:25:50.401 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.392+0000 7efd59ffb640 10 monclient(hunting): dump: 2026-02-22T23:25:50.401 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:50.401 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:50.402 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:50.402 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:50.402 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:50.402 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:50.402 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:50.402 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:50.402 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:50.402 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:50.402 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:50.402 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:50.402 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:50.402 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:50.402 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:50.402 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:50.402 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.392+0000 7efd59ffb640 10 monclient(hunting): _finish_auth 0 2026-02-22T23:25:50.402 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.392+0000 7efd59ffb640 1 -- 10.20.193.45:0/125710776 <== mon.7 v1:10.20.193.73:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3765100702 0 0) 0x7efd6c128940 con 0x7efd6c0a3d30 2026-02-22T23:25:50.402 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.392+0000 7efd59ffb640 10 monclient(hunting): _negotiate 2026-02-22T23:25:50.402 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.392+0000 7efd59ffb640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:50.402 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.392+0000 7efd59ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:50.402 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.392+0000 7efd59ffb640 10 monclient(hunting): my global_id is 4417 2026-02-22T23:25:50.402 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.392+0000 7efd59ffb640 1 -- 10.20.193.45:0/125710776 --> v1:10.20.193.73:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efd3c003620 con 0x7efd6c0a3d30 2026-02-22T23:25:50.402 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.392+0000 7efd59ffb640 1 -- 10.20.193.45:0/125710776 <== mon.6 v1:10.20.193.45:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3163624924 0 0) 0x7efd6c128660 con 0x7efd6c0a5d90 2026-02-22T23:25:50.402 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.392+0000 7efd59ffb640 1 -- 10.20.193.45:0/125710776 >> v1:10.20.193.73:6792/0 conn(0x7efd6c0a3d30 legacy=0x7efd6c1412c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:50.403 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.392+0000 7efd59ffb640 1 -- 10.20.193.45:0/125710776 >> v1:10.20.193.73:6790/0 conn(0x7efd6c0a6880 legacy=0x7efd6c1d78d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:50.403 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.392+0000 7efd59ffb640 10 monclient: _finish_hunting 0 2026-02-22T23:25:50.403 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.392+0000 7efd59ffb640 1 monclient: found mon.d 2026-02-22T23:25:50.403 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.392+0000 7efd59ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T23:25:50.403 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.392+0000 7efd59ffb640 10 monclient: _send_mon_message to mon.d at v1:10.20.193.45:6792/0 2026-02-22T23:25:50.403 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.392+0000 7efd59ffb640 1 -- 10.20.193.45:0/125710776 --> v1:10.20.193.45:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd6c1276b0 con 0x7efd6c0a5d90 2026-02-22T23:25:50.403 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.392+0000 7efd59ffb640 10 monclient: _finish_auth 0 2026-02-22T23:25:50.403 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.392+0000 7efd59ffb640 10 monclient: _check_auth_tickets 2026-02-22T23:25:50.403 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.392+0000 7efd59ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T23:25:50.403 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.392+0000 7efd73457640 5 monclient: authenticate success, global_id 4488 2026-02-22T23:25:50.403 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.392+0000 7efd73457640 10 monclient: _renew_subs 2026-02-22T23:25:50.403 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.392+0000 7efd73457640 10 monclient: _send_mon_message to mon.d at v1:10.20.193.45:6792/0 2026-02-22T23:25:50.403 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.392+0000 7efd73457640 1 -- 10.20.193.45:0/125710776 --> v1:10.20.193.45:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7efd6c0a1800 con 0x7efd6c0a5d90 2026-02-22T23:25:50.403 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.392+0000 7efd73457640 10 monclient: _renew_subs 2026-02-22T23:25:50.403 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.392+0000 7efd73457640 10 monclient: _send_mon_message to mon.d at v1:10.20.193.45:6792/0 2026-02-22T23:25:50.403 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.392+0000 7efd73457640 1 -- 10.20.193.45:0/125710776 --> v1:10.20.193.45:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7efd6c1cee60 con 0x7efd6c0a5d90 2026-02-22T23:25:50.403 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.392+0000 7efd59ffb640 1 -- 10.20.193.45:0/125710776 <== mon.6 v1:10.20.193.45:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7efd60002990 con 0x7efd6c0a5d90 2026-02-22T23:25:50.403 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.392+0000 7efd59ffb640 10 monclient: handle_config config(0 keys) 2026-02-22T23:25:50.403 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.392+0000 7efd59ffb640 1 -- 10.20.193.45:0/125710776 <== mon.6 v1:10.20.193.45:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7efd60002f80 con 0x7efd6c0a5d90 2026-02-22T23:25:50.403 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.392+0000 7efd59ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:25:50.403 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.392+0000 7efd59ffb640 10 monclient: got monmap 1 from mon.d (according to old e1) 2026-02-22T23:25:50.403 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.392+0000 7efd59ffb640 10 monclient: dump: 2026-02-22T23:25:50.404 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:50.404 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:50.404 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:50.404 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:50.404 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:50.404 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:50.404 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:50.404 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:50.404 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:50.404 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:50.404 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:50.404 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:50.404 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:50.404 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:50.404 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:50.404 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:50.404 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.392+0000 7efd5b7fe640 4 set_mon_vals no callback set 2026-02-22T23:25:50.404 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.393+0000 7efd73457640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T23:25:50.404 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.393+0000 7efd73457640 1 -- 10.20.193.45:0/125710776 --> v1:10.20.193.73:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7efd6c1cfd60 con 0x7efd6c1219e0 2026-02-22T23:25:50.404 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.393+0000 7efd59ffb640 1 -- 10.20.193.45:0/125710776 <== mon.6 v1:10.20.193.45:6792/0 7 ==== mgrmap(e 5) ==== 50225+0+0 (unknown 2330357642 0 0) 0x7efd60003120 con 0x7efd6c0a5d90 2026-02-22T23:25:50.404 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.393+0000 7efd59ffb640 1 -- 10.20.193.45:0/125710776 <== mon.6 v1:10.20.193.45:6792/0 8 ==== osd_map(21..21 src has 1..21) ==== 3921+0+0 (unknown 4068336701 0 0) 0x7efd6004de40 con 0x7efd6c0a5d90 2026-02-22T23:25:50.404 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.393+0000 7efd59ffb640 1 -- 10.20.193.45:0/125710776 <== mon.3 v1:10.20.193.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3116228946 0 0) 0x7efd6c1cfd60 con 0x7efd6c1219e0 2026-02-22T23:25:50.405 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.393+0000 7efd59ffb640 10 monclient(hunting): _negotiate 2026-02-22T23:25:50.405 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.393+0000 7efd59ffb640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:50.405 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.393+0000 7efd59ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:50.405 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.393+0000 7efd59ffb640 10 monclient(hunting): my global_id is 4476 2026-02-22T23:25:50.405 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.393+0000 7efd59ffb640 1 -- 10.20.193.45:0/125710776 --> v1:10.20.193.73:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efd6c128660 con 0x7efd6c1219e0 2026-02-22T23:25:50.405 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.393+0000 7efd719cd640 10 monclient: get_auth_request con 0x7efd3c03f7e0 auth_method 0 2026-02-22T23:25:50.405 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.393+0000 7efd59ffb640 1 -- 10.20.193.45:0/125710776 <== mon.3 v1:10.20.193.73:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1653047900 0 0) 0x7efd6c128660 con 0x7efd6c1219e0 2026-02-22T23:25:50.405 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.393+0000 7efd59ffb640 1 -- 10.20.193.45:0/125710776 --> v1:10.20.193.73:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7efd6c1cfd60 con 0x7efd6c1219e0 2026-02-22T23:25:50.405 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.393+0000 7efd59ffb640 1 -- 10.20.193.45:0/125710776 <== mon.3 v1:10.20.193.73:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7efd5c002dc0 con 0x7efd6c1219e0 2026-02-22T23:25:50.405 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.393+0000 7efd59ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:25:50.405 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.393+0000 7efd59ffb640 10 monclient: got monmap 1 from mon.g (according to old e1) 2026-02-22T23:25:50.405 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.393+0000 7efd59ffb640 10 monclient: dump: 2026-02-22T23:25:50.405 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:50.405 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:50.405 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:50.405 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:50.405 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:50.405 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:50.405 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:50.405 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:50.405 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:50.405 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:50.405 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:50.406 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:50.406 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:50.406 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:50.406 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:50.406 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:50.406 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.393+0000 7efd59ffb640 1 -- 10.20.193.45:0/125710776 <== mon.3 v1:10.20.193.73:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1803604492 0 0) 0x7efd6c1cfd60 con 0x7efd6c1219e0 2026-02-22T23:25:50.406 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.393+0000 7efd59ffb640 1 -- 10.20.193.45:0/125710776 --> v1:10.20.193.73:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7efd6c1cf1f0 con 0x7efd6c1219e0 2026-02-22T23:25:50.406 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.394+0000 7efd59ffb640 1 -- 10.20.193.45:0/125710776 <== mon.3 v1:10.20.193.73:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (unknown 0 0 2024835662) 0x7efd5c002e30 con 0x7efd6c1219e0 2026-02-22T23:25:50.406 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.394+0000 7efd59ffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T23:25:50.406 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.394+0000 7efd59ffb640 10 monclient: _finish_command 1 = system:0 2026-02-22T23:25:50.406 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.394+0000 7efd59ffb640 1 -- 10.20.193.45:0/125710776 >> v1:10.20.193.73:6790/0 conn(0x7efd6c1219e0 legacy=0x7efd6c121dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:50.406 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.394+0000 7efd59ffb640 1 -- 10.20.193.45:0/125710776 >> v1:10.20.193.73:6790/0 conn(0x7efd6c1219e0 legacy=0x7efd6c121dc0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T23:25:50.407 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.397+0000 7efd73457640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-22T23:25:50.407 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.397+0000 7efd73457640 1 -- 10.20.193.45:0/125710776 --> v1:10.20.193.73:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7efd6c0a9b30 con 0x7efd6c1224d0 2026-02-22T23:25:50.407 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.397+0000 7efd59ffb640 1 -- 10.20.193.45:0/125710776 <== mon.3 v1:10.20.193.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 301997326 0 0) 0x7efd6c0a9b30 con 0x7efd6c1224d0 2026-02-22T23:25:50.407 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.397+0000 7efd59ffb640 10 monclient(hunting): _negotiate 2026-02-22T23:25:50.407 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.397+0000 7efd59ffb640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:50.407 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.397+0000 7efd59ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:50.407 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.397+0000 7efd59ffb640 10 monclient(hunting): my global_id is 4485 2026-02-22T23:25:50.407 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.397+0000 7efd59ffb640 1 -- 10.20.193.45:0/125710776 --> v1:10.20.193.73:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efd6c1cfd60 con 0x7efd6c1224d0 2026-02-22T23:25:50.407 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.398+0000 7efd59ffb640 1 -- 10.20.193.45:0/125710776 <== mon.3 v1:10.20.193.73:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 116555628 0 0) 0x7efd6c1cfd60 con 0x7efd6c1224d0 2026-02-22T23:25:50.407 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.398+0000 7efd59ffb640 1 -- 10.20.193.45:0/125710776 --> v1:10.20.193.73:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7efd6c0a9b30 con 0x7efd6c1224d0 2026-02-22T23:25:50.408 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.398+0000 7efd59ffb640 1 -- 10.20.193.45:0/125710776 <== mon.3 v1:10.20.193.73:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7efd5c005000 con 0x7efd6c1224d0 2026-02-22T23:25:50.408 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.398+0000 7efd59ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:25:50.408 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.398+0000 7efd59ffb640 10 monclient: got monmap 1 from mon.g (according to old e1) 2026-02-22T23:25:50.408 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.398+0000 7efd59ffb640 10 monclient: dump: 2026-02-22T23:25:50.408 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:50.408 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:50.408 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:50.408 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:50.408 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:50.408 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:50.408 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:50.408 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:50.408 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:50.408 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:50.408 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:50.408 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:50.408 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:50.408 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:50.408 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:50.408 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:50.408 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.398+0000 7efd59ffb640 1 -- 10.20.193.45:0/125710776 <== mon.3 v1:10.20.193.73:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3050584971 0 0) 0x7efd6c0a9b30 con 0x7efd6c1224d0 2026-02-22T23:25:50.408 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.398+0000 7efd59ffb640 1 -- 10.20.193.45:0/125710776 --> v1:10.20.193.73:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7efd6c06ce10 con 0x7efd6c1224d0 2026-02-22T23:25:50.409 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.398+0000 7efd59ffb640 1 -- 10.20.193.45:0/125710776 <== mon.3 v1:10.20.193.73:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7694 (unknown 0 0 2413731022) 0x7efd5c0051b0 con 0x7efd6c1224d0 2026-02-22T23:25:50.409 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.398+0000 7efd59ffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-22T23:25:50.409 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.398+0000 7efd59ffb640 10 monclient: _finish_command 2 = system:0 2026-02-22T23:25:50.409 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.398+0000 7efd59ffb640 1 -- 10.20.193.45:0/125710776 >> v1:10.20.193.73:6790/0 conn(0x7efd6c1224d0 legacy=0x7efd6c1de020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:50.409 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.398+0000 7efd59ffb640 1 -- 10.20.193.45:0/125710776 >> v1:10.20.193.73:6790/0 conn(0x7efd6c1224d0 legacy=0x7efd6c1de020 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T23:25:50.409 INFO:teuthology.orchestra.run.trial045.stdout:{ 2026-02-22T23:25:50.409 INFO:teuthology.orchestra.run.trial045.stdout: "name": "g", 2026-02-22T23:25:50.409 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 3, 2026-02-22T23:25:50.409 INFO:teuthology.orchestra.run.trial045.stdout: "state": "peon", 2026-02-22T23:25:50.409 INFO:teuthology.orchestra.run.trial045.stdout: "election_epoch": 8, 2026-02-22T23:25:50.409 INFO:teuthology.orchestra.run.trial045.stdout: "uptime": 30515, 2026-02-22T23:25:50.409 INFO:teuthology.orchestra.run.trial045.stdout: "quorum": [ 2026-02-22T23:25:50.409 INFO:teuthology.orchestra.run.trial045.stdout: 0, 2026-02-22T23:25:50.409 INFO:teuthology.orchestra.run.trial045.stdout: 1, 2026-02-22T23:25:50.409 INFO:teuthology.orchestra.run.trial045.stdout: 2, 2026-02-22T23:25:50.409 INFO:teuthology.orchestra.run.trial045.stdout: 3, 2026-02-22T23:25:50.409 INFO:teuthology.orchestra.run.trial045.stdout: 4, 2026-02-22T23:25:50.410 INFO:teuthology.orchestra.run.trial045.stdout: 5, 2026-02-22T23:25:50.410 INFO:teuthology.orchestra.run.trial045.stdout: 6, 2026-02-22T23:25:50.410 INFO:teuthology.orchestra.run.trial045.stdout: 7, 2026-02-22T23:25:50.410 INFO:teuthology.orchestra.run.trial045.stdout: 8 2026-02-22T23:25:50.410 INFO:teuthology.orchestra.run.trial045.stdout: ], 2026-02-22T23:25:50.410 INFO:teuthology.orchestra.run.trial045.stdout: "quorum_age": 25, 2026-02-22T23:25:50.410 INFO:teuthology.orchestra.run.trial045.stdout: "features": { 2026-02-22T23:25:50.410 INFO:teuthology.orchestra.run.trial045.stdout: "required_con": "2450521708007866372", 2026-02-22T23:25:50.410 INFO:teuthology.orchestra.run.trial045.stdout: "required_mon": [ 2026-02-22T23:25:50.410 INFO:teuthology.orchestra.run.trial045.stdout: "kraken", 2026-02-22T23:25:50.410 INFO:teuthology.orchestra.run.trial045.stdout: "luminous", 2026-02-22T23:25:50.410 INFO:teuthology.orchestra.run.trial045.stdout: "mimic", 2026-02-22T23:25:50.410 INFO:teuthology.orchestra.run.trial045.stdout: "osdmap-prune", 2026-02-22T23:25:50.410 INFO:teuthology.orchestra.run.trial045.stdout: "nautilus", 2026-02-22T23:25:50.410 INFO:teuthology.orchestra.run.trial045.stdout: "octopus", 2026-02-22T23:25:50.410 INFO:teuthology.orchestra.run.trial045.stdout: "pacific", 2026-02-22T23:25:50.410 INFO:teuthology.orchestra.run.trial045.stdout: "elector-pinging", 2026-02-22T23:25:50.410 INFO:teuthology.orchestra.run.trial045.stdout: "quincy", 2026-02-22T23:25:50.410 INFO:teuthology.orchestra.run.trial045.stdout: "reef", 2026-02-22T23:25:50.410 INFO:teuthology.orchestra.run.trial045.stdout: "squid" 2026-02-22T23:25:50.410 INFO:teuthology.orchestra.run.trial045.stdout: ], 2026-02-22T23:25:50.411 INFO:teuthology.orchestra.run.trial045.stdout: "quorum_con": "4540701547738038271", 2026-02-22T23:25:50.411 INFO:teuthology.orchestra.run.trial045.stdout: "quorum_mon": [ 2026-02-22T23:25:50.411 INFO:teuthology.orchestra.run.trial045.stdout: "kraken", 2026-02-22T23:25:50.411 INFO:teuthology.orchestra.run.trial045.stdout: "luminous", 2026-02-22T23:25:50.411 INFO:teuthology.orchestra.run.trial045.stdout: "mimic", 2026-02-22T23:25:50.411 INFO:teuthology.orchestra.run.trial045.stdout: "osdmap-prune", 2026-02-22T23:25:50.411 INFO:teuthology.orchestra.run.trial045.stdout: "nautilus", 2026-02-22T23:25:50.411 INFO:teuthology.orchestra.run.trial045.stdout: "octopus", 2026-02-22T23:25:50.411 INFO:teuthology.orchestra.run.trial045.stdout: "pacific", 2026-02-22T23:25:50.411 INFO:teuthology.orchestra.run.trial045.stdout: "elector-pinging", 2026-02-22T23:25:50.411 INFO:teuthology.orchestra.run.trial045.stdout: "quincy", 2026-02-22T23:25:50.411 INFO:teuthology.orchestra.run.trial045.stdout: "reef", 2026-02-22T23:25:50.411 INFO:teuthology.orchestra.run.trial045.stdout: "squid" 2026-02-22T23:25:50.411 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:25:50.411 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:25:50.411 INFO:teuthology.orchestra.run.trial045.stdout: "outside_quorum": [], 2026-02-22T23:25:50.411 INFO:teuthology.orchestra.run.trial045.stdout: "extra_probe_peers": [], 2026-02-22T23:25:50.411 INFO:teuthology.orchestra.run.trial045.stdout: "sync_provider": [], 2026-02-22T23:25:50.411 INFO:teuthology.orchestra.run.trial045.stdout: "monmap": { 2026-02-22T23:25:50.411 INFO:teuthology.orchestra.run.trial045.stdout: "epoch": 1, 2026-02-22T23:25:50.411 INFO:teuthology.orchestra.run.trial045.stdout: "fsid": "4b60f18f-6660-4731-b731-dc85c4078413", 2026-02-22T23:25:50.412 INFO:teuthology.orchestra.run.trial045.stdout: "modified": "2026-02-22T23:24:52.393472Z", 2026-02-22T23:25:50.412 INFO:teuthology.orchestra.run.trial045.stdout: "created": "2026-02-22T23:24:52.393472Z", 2026-02-22T23:25:50.412 INFO:teuthology.orchestra.run.trial045.stdout: "min_mon_release": 19, 2026-02-22T23:25:50.412 INFO:teuthology.orchestra.run.trial045.stdout: "min_mon_release_name": "squid", 2026-02-22T23:25:50.412 INFO:teuthology.orchestra.run.trial045.stdout: "election_strategy": 3, 2026-02-22T23:25:50.412 INFO:teuthology.orchestra.run.trial045.stdout: "disallowed_leaders": "", 2026-02-22T23:25:50.412 INFO:teuthology.orchestra.run.trial045.stdout: "stretch_mode": false, 2026-02-22T23:25:50.412 INFO:teuthology.orchestra.run.trial045.stdout: "tiebreaker_mon": "", 2026-02-22T23:25:50.412 INFO:teuthology.orchestra.run.trial045.stdout: "removed_ranks": "", 2026-02-22T23:25:50.412 INFO:teuthology.orchestra.run.trial045.stdout: "features": { 2026-02-22T23:25:50.412 INFO:teuthology.orchestra.run.trial045.stdout: "persistent": [ 2026-02-22T23:25:50.412 INFO:teuthology.orchestra.run.trial045.stdout: "kraken", 2026-02-22T23:25:50.412 INFO:teuthology.orchestra.run.trial045.stdout: "luminous", 2026-02-22T23:25:50.412 INFO:teuthology.orchestra.run.trial045.stdout: "mimic", 2026-02-22T23:25:50.412 INFO:teuthology.orchestra.run.trial045.stdout: "osdmap-prune", 2026-02-22T23:25:50.412 INFO:teuthology.orchestra.run.trial045.stdout: "nautilus", 2026-02-22T23:25:50.412 INFO:teuthology.orchestra.run.trial045.stdout: "octopus", 2026-02-22T23:25:50.412 INFO:teuthology.orchestra.run.trial045.stdout: "pacific", 2026-02-22T23:25:50.412 INFO:teuthology.orchestra.run.trial045.stdout: "elector-pinging", 2026-02-22T23:25:50.412 INFO:teuthology.orchestra.run.trial045.stdout: "quincy", 2026-02-22T23:25:50.412 INFO:teuthology.orchestra.run.trial045.stdout: "reef", 2026-02-22T23:25:50.412 INFO:teuthology.orchestra.run.trial045.stdout: "squid" 2026-02-22T23:25:50.413 INFO:teuthology.orchestra.run.trial045.stdout: ], 2026-02-22T23:25:50.413 INFO:teuthology.orchestra.run.trial045.stdout: "optional": [] 2026-02-22T23:25:50.413 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:25:50.413 INFO:teuthology.orchestra.run.trial045.stdout: "mons": [ 2026-02-22T23:25:50.413 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:25:50.413 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 0, 2026-02-22T23:25:50.413 INFO:teuthology.orchestra.run.trial045.stdout: "name": "a", 2026-02-22T23:25:50.413 INFO:teuthology.orchestra.run.trial045.stdout: "public_addrs": { 2026-02-22T23:25:50.413 INFO:teuthology.orchestra.run.trial045.stdout: "addrvec": [ 2026-02-22T23:25:50.413 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:25:50.413 INFO:teuthology.orchestra.run.trial045.stdout: "type": "v1", 2026-02-22T23:25:50.413 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6789", 2026-02-22T23:25:50.413 INFO:teuthology.orchestra.run.trial045.stdout: "nonce": 0 2026-02-22T23:25:50.413 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:25:50.413 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:25:50.413 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:25:50.413 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6789/0", 2026-02-22T23:25:50.413 INFO:teuthology.orchestra.run.trial045.stdout: "public_addr": "10.20.193.45:6789/0", 2026-02-22T23:25:50.413 INFO:teuthology.orchestra.run.trial045.stdout: "priority": 0, 2026-02-22T23:25:50.413 INFO:teuthology.orchestra.run.trial045.stdout: "weight": 0, 2026-02-22T23:25:50.413 INFO:teuthology.orchestra.run.trial045.stdout: "crush_location": "{}" 2026-02-22T23:25:50.414 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:25:50.414 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:25:50.414 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 1, 2026-02-22T23:25:50.414 INFO:teuthology.orchestra.run.trial045.stdout: "name": "f", 2026-02-22T23:25:50.414 INFO:teuthology.orchestra.run.trial045.stdout: "public_addrs": { 2026-02-22T23:25:50.414 INFO:teuthology.orchestra.run.trial045.stdout: "addrvec": [ 2026-02-22T23:25:50.414 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:25:50.414 INFO:teuthology.orchestra.run.trial045.stdout: "type": "v1", 2026-02-22T23:25:50.414 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.73:6789", 2026-02-22T23:25:50.414 INFO:teuthology.orchestra.run.trial045.stdout: "nonce": 0 2026-02-22T23:25:50.414 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:25:50.414 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:25:50.414 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:25:50.414 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.73:6789/0", 2026-02-22T23:25:50.414 INFO:teuthology.orchestra.run.trial045.stdout: "public_addr": "10.20.193.73:6789/0", 2026-02-22T23:25:50.414 INFO:teuthology.orchestra.run.trial045.stdout: "priority": 0, 2026-02-22T23:25:50.414 INFO:teuthology.orchestra.run.trial045.stdout: "weight": 0, 2026-02-22T23:25:50.414 INFO:teuthology.orchestra.run.trial045.stdout: "crush_location": "{}" 2026-02-22T23:25:50.414 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:25:50.414 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:25:50.414 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 2, 2026-02-22T23:25:50.414 INFO:teuthology.orchestra.run.trial045.stdout: "name": "b", 2026-02-22T23:25:50.414 INFO:teuthology.orchestra.run.trial045.stdout: "public_addrs": { 2026-02-22T23:25:50.415 INFO:teuthology.orchestra.run.trial045.stdout: "addrvec": [ 2026-02-22T23:25:50.415 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:25:50.415 INFO:teuthology.orchestra.run.trial045.stdout: "type": "v1", 2026-02-22T23:25:50.415 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6790", 2026-02-22T23:25:50.415 INFO:teuthology.orchestra.run.trial045.stdout: "nonce": 0 2026-02-22T23:25:50.415 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:25:50.415 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:25:50.415 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:25:50.415 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6790/0", 2026-02-22T23:25:50.415 INFO:teuthology.orchestra.run.trial045.stdout: "public_addr": "10.20.193.45:6790/0", 2026-02-22T23:25:50.415 INFO:teuthology.orchestra.run.trial045.stdout: "priority": 0, 2026-02-22T23:25:50.415 INFO:teuthology.orchestra.run.trial045.stdout: "weight": 0, 2026-02-22T23:25:50.415 INFO:teuthology.orchestra.run.trial045.stdout: "crush_location": "{}" 2026-02-22T23:25:50.415 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:25:50.415 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:25:50.415 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 3, 2026-02-22T23:25:50.415 INFO:teuthology.orchestra.run.trial045.stdout: "name": "g", 2026-02-22T23:25:50.415 INFO:teuthology.orchestra.run.trial045.stdout: "public_addrs": { 2026-02-22T23:25:50.415 INFO:teuthology.orchestra.run.trial045.stdout: "addrvec": [ 2026-02-22T23:25:50.415 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:25:50.415 INFO:teuthology.orchestra.run.trial045.stdout: "type": "v1", 2026-02-22T23:25:50.415 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.73:6790", 2026-02-22T23:25:50.416 INFO:teuthology.orchestra.run.trial045.stdout: "nonce": 0 2026-02-22T23:25:50.416 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:25:50.416 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:25:50.416 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:25:50.416 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.73:6790/0", 2026-02-22T23:25:50.416 INFO:teuthology.orchestra.run.trial045.stdout: "public_addr": "10.20.193.73:6790/0", 2026-02-22T23:25:50.416 INFO:teuthology.orchestra.run.trial045.stdout: "priority": 0, 2026-02-22T23:25:50.416 INFO:teuthology.orchestra.run.trial045.stdout: "weight": 0, 2026-02-22T23:25:50.416 INFO:teuthology.orchestra.run.trial045.stdout: "crush_location": "{}" 2026-02-22T23:25:50.416 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:25:50.416 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:25:50.416 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 4, 2026-02-22T23:25:50.416 INFO:teuthology.orchestra.run.trial045.stdout: "name": "c", 2026-02-22T23:25:50.416 INFO:teuthology.orchestra.run.trial045.stdout: "public_addrs": { 2026-02-22T23:25:50.416 INFO:teuthology.orchestra.run.trial045.stdout: "addrvec": [ 2026-02-22T23:25:50.416 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:25:50.416 INFO:teuthology.orchestra.run.trial045.stdout: "type": "v1", 2026-02-22T23:25:50.416 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6791", 2026-02-22T23:25:50.416 INFO:teuthology.orchestra.run.trial045.stdout: "nonce": 0 2026-02-22T23:25:50.416 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:25:50.416 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:25:50.416 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:25:50.417 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6791/0", 2026-02-22T23:25:50.417 INFO:teuthology.orchestra.run.trial045.stdout: "public_addr": "10.20.193.45:6791/0", 2026-02-22T23:25:50.417 INFO:teuthology.orchestra.run.trial045.stdout: "priority": 0, 2026-02-22T23:25:50.417 INFO:teuthology.orchestra.run.trial045.stdout: "weight": 0, 2026-02-22T23:25:50.417 INFO:teuthology.orchestra.run.trial045.stdout: "crush_location": "{}" 2026-02-22T23:25:50.417 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:25:50.417 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:25:50.417 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 5, 2026-02-22T23:25:50.417 INFO:teuthology.orchestra.run.trial045.stdout: "name": "h", 2026-02-22T23:25:50.417 INFO:teuthology.orchestra.run.trial045.stdout: "public_addrs": { 2026-02-22T23:25:50.417 INFO:teuthology.orchestra.run.trial045.stdout: "addrvec": [ 2026-02-22T23:25:50.417 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:25:50.417 INFO:teuthology.orchestra.run.trial045.stdout: "type": "v1", 2026-02-22T23:25:50.417 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.73:6791", 2026-02-22T23:25:50.417 INFO:teuthology.orchestra.run.trial045.stdout: "nonce": 0 2026-02-22T23:25:50.417 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:25:50.417 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:25:50.417 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:25:50.417 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.73:6791/0", 2026-02-22T23:25:50.417 INFO:teuthology.orchestra.run.trial045.stdout: "public_addr": "10.20.193.73:6791/0", 2026-02-22T23:25:50.417 INFO:teuthology.orchestra.run.trial045.stdout: "priority": 0, 2026-02-22T23:25:50.417 INFO:teuthology.orchestra.run.trial045.stdout: "weight": 0, 2026-02-22T23:25:50.418 INFO:teuthology.orchestra.run.trial045.stdout: "crush_location": "{}" 2026-02-22T23:25:50.418 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:25:50.418 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:25:50.418 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 6, 2026-02-22T23:25:50.418 INFO:teuthology.orchestra.run.trial045.stdout: "name": "d", 2026-02-22T23:25:50.418 INFO:teuthology.orchestra.run.trial045.stdout: "public_addrs": { 2026-02-22T23:25:50.418 INFO:teuthology.orchestra.run.trial045.stdout: "addrvec": [ 2026-02-22T23:25:50.418 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:25:50.418 INFO:teuthology.orchestra.run.trial045.stdout: "type": "v1", 2026-02-22T23:25:50.418 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6792", 2026-02-22T23:25:50.418 INFO:teuthology.orchestra.run.trial045.stdout: "nonce": 0 2026-02-22T23:25:50.418 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:25:50.418 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:25:50.418 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:25:50.418 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6792/0", 2026-02-22T23:25:50.418 INFO:teuthology.orchestra.run.trial045.stdout: "public_addr": "10.20.193.45:6792/0", 2026-02-22T23:25:50.418 INFO:teuthology.orchestra.run.trial045.stdout: "priority": 0, 2026-02-22T23:25:50.418 INFO:teuthology.orchestra.run.trial045.stdout: "weight": 0, 2026-02-22T23:25:50.418 INFO:teuthology.orchestra.run.trial045.stdout: "crush_location": "{}" 2026-02-22T23:25:50.418 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:25:50.418 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:25:50.418 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 7, 2026-02-22T23:25:50.418 INFO:teuthology.orchestra.run.trial045.stdout: "name": "i", 2026-02-22T23:25:50.418 INFO:teuthology.orchestra.run.trial045.stdout: "public_addrs": { 2026-02-22T23:25:50.419 INFO:teuthology.orchestra.run.trial045.stdout: "addrvec": [ 2026-02-22T23:25:50.419 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:25:50.419 INFO:teuthology.orchestra.run.trial045.stdout: "type": "v1", 2026-02-22T23:25:50.419 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.73:6792", 2026-02-22T23:25:50.419 INFO:teuthology.orchestra.run.trial045.stdout: "nonce": 0 2026-02-22T23:25:50.419 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:25:50.419 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:25:50.419 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:25:50.419 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.73:6792/0", 2026-02-22T23:25:50.419 INFO:teuthology.orchestra.run.trial045.stdout: "public_addr": "10.20.193.73:6792/0", 2026-02-22T23:25:50.419 INFO:teuthology.orchestra.run.trial045.stdout: "priority": 0, 2026-02-22T23:25:50.419 INFO:teuthology.orchestra.run.trial045.stdout: "weight": 0, 2026-02-22T23:25:50.419 INFO:teuthology.orchestra.run.trial045.stdout: "crush_location": "{}" 2026-02-22T23:25:50.419 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:25:50.419 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:25:50.419 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 8, 2026-02-22T23:25:50.419 INFO:teuthology.orchestra.run.trial045.stdout: "name": "e", 2026-02-22T23:25:50.419 INFO:teuthology.orchestra.run.trial045.stdout: "public_addrs": { 2026-02-22T23:25:50.419 INFO:teuthology.orchestra.run.trial045.stdout: "addrvec": [ 2026-02-22T23:25:50.419 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:25:50.419 INFO:teuthology.orchestra.run.trial045.stdout: "type": "v1", 2026-02-22T23:25:50.419 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6793", 2026-02-22T23:25:50.419 INFO:teuthology.orchestra.run.trial045.stdout: "nonce": 0 2026-02-22T23:25:50.419 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:25:50.420 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:25:50.420 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:25:50.420 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6793/0", 2026-02-22T23:25:50.420 INFO:teuthology.orchestra.run.trial045.stdout: "public_addr": "10.20.193.45:6793/0", 2026-02-22T23:25:50.420 INFO:teuthology.orchestra.run.trial045.stdout: "priority": 0, 2026-02-22T23:25:50.420 INFO:teuthology.orchestra.run.trial045.stdout: "weight": 0, 2026-02-22T23:25:50.420 INFO:teuthology.orchestra.run.trial045.stdout: "crush_location": "{}" 2026-02-22T23:25:50.420 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:25:50.420 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:25:50.420 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:25:50.420 INFO:teuthology.orchestra.run.trial045.stdout: "feature_map": { 2026-02-22T23:25:50.420 INFO:teuthology.orchestra.run.trial045.stdout: "mon": [ 2026-02-22T23:25:50.420 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:25:50.420 INFO:teuthology.orchestra.run.trial045.stdout: "features": "0x3f03cffffffdffff", 2026-02-22T23:25:50.420 INFO:teuthology.orchestra.run.trial045.stdout: "release": "squid", 2026-02-22T23:25:50.420 INFO:teuthology.orchestra.run.trial045.stdout: "num": 1 2026-02-22T23:25:50.420 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:25:50.420 INFO:teuthology.orchestra.run.trial045.stdout: ], 2026-02-22T23:25:50.420 INFO:teuthology.orchestra.run.trial045.stdout: "osd": [ 2026-02-22T23:25:50.420 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:25:50.420 INFO:teuthology.orchestra.run.trial045.stdout: "features": "0x3f03cffffffdffff", 2026-02-22T23:25:50.420 INFO:teuthology.orchestra.run.trial045.stdout: "release": "squid", 2026-02-22T23:25:50.420 INFO:teuthology.orchestra.run.trial045.stdout: "num": 2 2026-02-22T23:25:50.420 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:25:50.420 INFO:teuthology.orchestra.run.trial045.stdout: ], 2026-02-22T23:25:50.421 INFO:teuthology.orchestra.run.trial045.stdout: "client": [ 2026-02-22T23:25:50.421 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:25:50.421 INFO:teuthology.orchestra.run.trial045.stdout: "features": "0x3f03cffffffdffff", 2026-02-22T23:25:50.421 INFO:teuthology.orchestra.run.trial045.stdout: "release": "squid", 2026-02-22T23:25:50.421 INFO:teuthology.orchestra.run.trial045.stdout: "num": 1 2026-02-22T23:25:50.421 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:25:50.421 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:25:50.421 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:25:50.421 INFO:teuthology.orchestra.run.trial045.stdout: "stretch_mode": false 2026-02-22T23:25:50.421 INFO:teuthology.orchestra.run.trial045.stdout:} 2026-02-22T23:25:50.422 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.398+0000 7efd73457640 1 -- 10.20.193.45:0/125710776 >> v1:10.20.193.73:6800/2222410180 conn(0x7efd3c03f7e0 legacy=0x7efd3c041ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:50.422 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.398+0000 7efd73457640 10 monclient: shutdown 2026-02-22T23:25:50.422 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.398+0000 7efd73457640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T23:25:50.422 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.398+0000 7efd73457640 1 -- 10.20.193.45:0/125710776 >> v1:10.20.193.45:6792/0 conn(0x7efd6c0a5d90 legacy=0x7efd6c1d41a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:50.422 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.398+0000 7efd719cd640 1 -- 10.20.193.45:0/125710776 reap_dead start 2026-02-22T23:25:50.422 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.398+0000 7efd719cd640 1 -- 10.20.193.45:0/125710776 reap_dead start 2026-02-22T23:25:50.422 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.398+0000 7efd73457640 1 -- 10.20.193.45:0/125710776 shutdown_connections 2026-02-22T23:25:50.422 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.398+0000 7efd73457640 1 -- 10.20.193.45:0/125710776 >> 10.20.193.45:0/125710776 conn(0x7efd6c0ab9c0 msgr2=0x7efd6c142280 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:25:50.422 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.398+0000 7efd73457640 1 -- 10.20.193.45:0/125710776 shutdown_connections 2026-02-22T23:25:50.422 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.398+0000 7efd73457640 1 -- 10.20.193.45:0/125710776 wait complete. 2026-02-22T23:25:50.423 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2026-02-22T23:25:50.423 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon h 2026-02-22T23:25:50.423 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.h mon_status 2026-02-22T23:25:50.489 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.489+0000 7fd5d4bd6640 10 monclient: get_monmap_and_config 2026-02-22T23:25:50.489 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.489+0000 7fd5d4bd6640 10 monclient: build_initial_monmap 2026-02-22T23:25:50.489 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.489+0000 7fd5d4bd6640 10 monclient: monmap: 2026-02-22T23:25:50.489 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-22T23:25:50.489 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:50.490 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:25:50.489497+0000 2026-02-22T23:25:50.490 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:25:50.489497+0000 2026-02-22T23:25:50.490 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-22T23:25:50.490 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:50.490 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-22T23:25:50.490 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.noname-f 2026-02-22T23:25:50.490 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.noname-b 2026-02-22T23:25:50.490 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.noname-g 2026-02-22T23:25:50.490 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.noname-c 2026-02-22T23:25:50.490 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.noname-h 2026-02-22T23:25:50.490 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.noname-d 2026-02-22T23:25:50.490 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.noname-i 2026-02-22T23:25:50.490 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.noname-e 2026-02-22T23:25:50.490 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:50.490 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.489+0000 7fd5d4bd6640 1 Processor -- start 2026-02-22T23:25:50.490 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.489+0000 7fd5d4bd6640 1 -- start start 2026-02-22T23:25:50.490 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.489+0000 7fd5d4bd6640 10 monclient: init 2026-02-22T23:25:50.495 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.490+0000 7fd5d4bd6640 10 monclient: _reopen_session rank -1 2026-02-22T23:25:50.495 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.490+0000 7fd5d4bd6640 10 monclient: _add_conns ranks=[6,4,3,5,8,7,2,0,1] 2026-02-22T23:25:50.496 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.490+0000 7fd5d4bd6640 10 monclient(hunting): picked mon.noname-d con 0x7fd5d00a5e00 addr v1:10.20.193.45:6792/0 2026-02-22T23:25:50.496 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.490+0000 7fd5d4bd6640 10 monclient(hunting): picked mon.noname-c con 0x7fd5d00a68f0 addr v1:10.20.193.45:6791/0 2026-02-22T23:25:50.496 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.490+0000 7fd5d4bd6640 10 monclient(hunting): picked mon.noname-g con 0x7fd5d00a6d00 addr v1:10.20.193.73:6790/0 2026-02-22T23:25:50.496 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.490+0000 7fd5d4bd6640 1 -- --> v1:10.20.193.73:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd5d00a2d00 con 0x7fd5d00a6d00 2026-02-22T23:25:50.496 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.490+0000 7fd5d4bd6640 1 -- --> v1:10.20.193.45:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd5d00a2fe0 con 0x7fd5d00a68f0 2026-02-22T23:25:50.496 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.490+0000 7fd5d4bd6640 1 -- --> v1:10.20.193.45:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd5d00a32c0 con 0x7fd5d00a5e00 2026-02-22T23:25:50.496 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.490+0000 7fd5d4bd6640 10 monclient(hunting): _renew_subs 2026-02-22T23:25:50.496 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.490+0000 7fd5d4bd6640 10 monclient(hunting): authenticate will time out at 682.106116s 2026-02-22T23:25:50.496 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.490+0000 7fd5ce575640 1 --1- >> v1:10.20.193.45:6792/0 conn(0x7fd5d00a5e00 0x7fd5d00a61e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.45:6792/0 says I am v1:10.20.193.45:57020/0 (socket says 10.20.193.45:57020) 2026-02-22T23:25:50.496 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.490+0000 7fd5ce575640 1 -- 10.20.193.45:0/820900074 learned_addr learned my addr 10.20.193.45:0/820900074 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-22T23:25:50.496 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.490+0000 7fd5cd573640 1 -- 10.20.193.45:0/820900074 <== mon.6 v1:10.20.193.45:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 151742395 0 0) 0x7fd5d00a32c0 con 0x7fd5d00a5e00 2026-02-22T23:25:50.496 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.490+0000 7fd5cd573640 10 monclient(hunting): _negotiate 2026-02-22T23:25:50.496 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.490+0000 7fd5cd573640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:50.496 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.490+0000 7fd5cd573640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:50.496 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.490+0000 7fd5cd573640 10 monclient(hunting): my global_id is 4497 2026-02-22T23:25:50.496 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.490+0000 7fd5cd573640 1 -- 10.20.193.45:0/820900074 --> v1:10.20.193.45:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd5bc003620 con 0x7fd5d00a5e00 2026-02-22T23:25:50.496 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.490+0000 7fd5cd573640 1 -- 10.20.193.45:0/820900074 <== mon.4 v1:10.20.193.45:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4005296327 0 0) 0x7fd5d00a2fe0 con 0x7fd5d00a68f0 2026-02-22T23:25:50.496 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.490+0000 7fd5cd573640 10 monclient(hunting): _negotiate 2026-02-22T23:25:50.496 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.490+0000 7fd5cd573640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:50.497 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.490+0000 7fd5cd573640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:50.497 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.490+0000 7fd5cd573640 10 monclient(hunting): my global_id is 4540 2026-02-22T23:25:50.497 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.490+0000 7fd5cd573640 1 -- 10.20.193.45:0/820900074 --> v1:10.20.193.45:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd5d00a32c0 con 0x7fd5d00a68f0 2026-02-22T23:25:50.497 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.490+0000 7fd5cd573640 1 -- 10.20.193.45:0/820900074 <== mon.6 v1:10.20.193.45:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3585025209 0 0) 0x7fd5bc003620 con 0x7fd5d00a5e00 2026-02-22T23:25:50.497 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.490+0000 7fd5cd573640 1 -- 10.20.193.45:0/820900074 >> v1:10.20.193.45:6791/0 conn(0x7fd5d00a68f0 legacy=0x7fd5d013e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:50.497 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.490+0000 7fd5cd573640 1 -- 10.20.193.45:0/820900074 >> v1:10.20.193.73:6790/0 conn(0x7fd5d00a6d00 legacy=0x7fd5d01417b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:50.497 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.490+0000 7fd5cd573640 10 monclient: _finish_hunting 0 2026-02-22T23:25:50.497 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.490+0000 7fd5cd573640 1 monclient: found mon.noname-d 2026-02-22T23:25:50.497 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.490+0000 7fd5cd573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T23:25:50.497 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.490+0000 7fd5cd573640 10 monclient: _send_mon_message to mon.noname-d at v1:10.20.193.45:6792/0 2026-02-22T23:25:50.497 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.490+0000 7fd5cd573640 1 -- 10.20.193.45:0/820900074 --> v1:10.20.193.45:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5d00a35a0 con 0x7fd5d00a5e00 2026-02-22T23:25:50.497 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.490+0000 7fd5cd573640 10 monclient: _finish_auth 0 2026-02-22T23:25:50.497 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.490+0000 7fd5cd573640 10 monclient: _check_auth_tickets 2026-02-22T23:25:50.497 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.490+0000 7fd5cd573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T23:25:50.497 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.490+0000 7fd5cd573640 1 -- 10.20.193.45:0/820900074 <== mon.6 v1:10.20.193.45:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7fd5c4002f70 con 0x7fd5d00a5e00 2026-02-22T23:25:50.497 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.490+0000 7fd5d4bd6640 5 monclient: authenticate success, global_id 4497 2026-02-22T23:25:50.497 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.490+0000 7fd5d4bd6640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-22T23:25:50.497 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.490+0000 7fd5cd573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:25:50.497 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.490+0000 7fd5cd573640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2026-02-22T23:25:50.497 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.490+0000 7fd5cd573640 10 monclient: dump: 2026-02-22T23:25:50.497 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:50.498 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:50.498 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:50.498 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:50.498 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:50.498 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:50.498 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:50.498 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:50.498 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:50.498 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:50.498 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:50.498 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:50.498 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:50.498 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:50.498 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:50.498 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:50.498 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.490+0000 7fd5d4bd6640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-22T23:25:50.498 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.490+0000 7fd5cd573640 1 -- 10.20.193.45:0/820900074 <== mon.6 v1:10.20.193.45:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd5c4003110 con 0x7fd5d00a5e00 2026-02-22T23:25:50.498 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.490+0000 7fd5cd573640 10 monclient: handle_config config(0 keys) 2026-02-22T23:25:50.498 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.490+0000 7fd5cd573640 1 -- 10.20.193.45:0/820900074 <== mon.6 v1:10.20.193.45:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7fd5c40049a0 con 0x7fd5d00a5e00 2026-02-22T23:25:50.498 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.490+0000 7fd5cd573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:25:50.498 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.490+0000 7fd5cd573640 10 monclient: got monmap 1 from mon.d (according to old e1) 2026-02-22T23:25:50.498 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.490+0000 7fd5cd573640 10 monclient: dump: 2026-02-22T23:25:50.499 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:50.499 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:50.499 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:50.499 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:50.499 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:50.499 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:50.499 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:50.499 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:50.499 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:50.499 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:50.499 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:50.499 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:50.499 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:50.499 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:50.499 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:50.499 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:50.499 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.490+0000 7fd5d4bd6640 10 monclient: get_monmap_and_config success 2026-02-22T23:25:50.499 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.490+0000 7fd5d4bd6640 4 set_mon_vals no callback set 2026-02-22T23:25:50.499 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.490+0000 7fd5d4bd6640 10 monclient: shutdown 2026-02-22T23:25:50.499 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.490+0000 7fd5d4bd6640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T23:25:50.499 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.490+0000 7fd5d4bd6640 1 -- 10.20.193.45:0/820900074 >> v1:10.20.193.45:6792/0 conn(0x7fd5d00a5e00 legacy=0x7fd5d00a61e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:50.499 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.490+0000 7fd5d4bd6640 1 -- 10.20.193.45:0/820900074 shutdown_connections 2026-02-22T23:25:50.500 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.490+0000 7fd5d4bd6640 1 -- 10.20.193.45:0/820900074 >> 10.20.193.45:0/820900074 conn(0x7fd5d00abb50 msgr2=0x7fd5d00a7f00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:25:50.500 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.490+0000 7fd5d4bd6640 1 -- 10.20.193.45:0/820900074 shutdown_connections 2026-02-22T23:25:50.500 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.490+0000 7fd5d4bd6640 1 -- 10.20.193.45:0/820900074 wait complete. 2026-02-22T23:25:50.500 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.491+0000 7fd5d4bd6640 10 monclient: build_initial_monmap 2026-02-22T23:25:50.500 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.491+0000 7fd5d4bd6640 10 monclient: monmap: 2026-02-22T23:25:50.500 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-22T23:25:50.500 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T23:25:50.500 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-22T23:25:50.500 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-22T23:25:50.500 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-22T23:25:50.500 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-22T23:25:50.500 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-22T23:25:50.500 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.noname-f 2026-02-22T23:25:50.500 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.noname-b 2026-02-22T23:25:50.500 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.noname-g 2026-02-22T23:25:50.500 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.noname-c 2026-02-22T23:25:50.500 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.noname-h 2026-02-22T23:25:50.500 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.noname-d 2026-02-22T23:25:50.500 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.noname-i 2026-02-22T23:25:50.500 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.noname-e 2026-02-22T23:25:50.500 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:50.500 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.491+0000 7fd5d4bd6640 1 Processor -- start 2026-02-22T23:25:50.501 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.491+0000 7fd5d4bd6640 1 -- start start 2026-02-22T23:25:50.501 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.491+0000 7fd5d4bd6640 10 monclient: init 2026-02-22T23:25:50.501 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.491+0000 7fd5d4bd6640 10 monclient: _reopen_session rank -1 2026-02-22T23:25:50.501 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.491+0000 7fd5d4bd6640 10 monclient: _add_conns ranks=[6,2,1,0,7,4,8,5,3] 2026-02-22T23:25:50.501 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.491+0000 7fd5d4bd6640 10 monclient(hunting): picked mon.noname-d con 0x7fd5d00a5e00 addr v1:10.20.193.45:6792/0 2026-02-22T23:25:50.501 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.491+0000 7fd5d4bd6640 10 monclient(hunting): picked mon.noname-b con 0x7fd5d00a68f0 addr v1:10.20.193.45:6790/0 2026-02-22T23:25:50.501 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.491+0000 7fd5d4bd6640 10 monclient(hunting): picked mon.noname-f con 0x7fd5d00a6d00 addr v1:10.20.193.73:6789/0 2026-02-22T23:25:50.501 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.491+0000 7fd5d4bd6640 1 -- --> v1:10.20.193.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd5d00a1960 con 0x7fd5d00a6d00 2026-02-22T23:25:50.501 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.491+0000 7fd5d4bd6640 1 -- --> v1:10.20.193.45:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd5d00a1430 con 0x7fd5d00a68f0 2026-02-22T23:25:50.501 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.491+0000 7fd5d4bd6640 1 -- --> v1:10.20.193.45:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd5d00a9d60 con 0x7fd5d00a5e00 2026-02-22T23:25:50.501 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.491+0000 7fd5d4bd6640 10 monclient(hunting): _renew_subs 2026-02-22T23:25:50.501 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.491+0000 7fd5d4bd6640 10 monclient(hunting): authenticate will time out at 682.107725s 2026-02-22T23:25:50.501 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.491+0000 7fd5ce575640 1 --1- >> v1:10.20.193.45:6792/0 conn(0x7fd5d00a5e00 0x7fd5d01415c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.45:6792/0 says I am v1:10.20.193.45:57030/0 (socket says 10.20.193.45:57030) 2026-02-22T23:25:50.501 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.491+0000 7fd5ce575640 1 -- 10.20.193.45:0/2896189651 learned_addr learned my addr 10.20.193.45:0/2896189651 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-22T23:25:50.501 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.491+0000 7fd5b6ffd640 1 -- 10.20.193.45:0/2896189651 <== mon.6 v1:10.20.193.45:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1951032342 0 0) 0x7fd5d00a9d60 con 0x7fd5d00a5e00 2026-02-22T23:25:50.501 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.491+0000 7fd5b6ffd640 10 monclient(hunting): _negotiate 2026-02-22T23:25:50.501 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.491+0000 7fd5b6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:50.501 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.491+0000 7fd5b6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:50.501 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.491+0000 7fd5b6ffd640 10 monclient(hunting): my global_id is 4506 2026-02-22T23:25:50.501 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.491+0000 7fd5b6ffd640 1 -- 10.20.193.45:0/2896189651 --> v1:10.20.193.45:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd59c003620 con 0x7fd5d00a5e00 2026-02-22T23:25:50.501 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.491+0000 7fd5b6ffd640 1 -- 10.20.193.45:0/2896189651 <== mon.2 v1:10.20.193.45:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2186919832 0 0) 0x7fd5d00a1430 con 0x7fd5d00a68f0 2026-02-22T23:25:50.501 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.491+0000 7fd5b6ffd640 10 monclient(hunting): _negotiate 2026-02-22T23:25:50.502 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.491+0000 7fd5b6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:50.502 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.491+0000 7fd5b6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:50.502 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.491+0000 7fd5b6ffd640 10 monclient(hunting): my global_id is 4565 2026-02-22T23:25:50.502 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.491+0000 7fd5b6ffd640 1 -- 10.20.193.45:0/2896189651 --> v1:10.20.193.45:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd5d00a9d60 con 0x7fd5d00a68f0 2026-02-22T23:25:50.502 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.491+0000 7fd5b6ffd640 1 -- 10.20.193.45:0/2896189651 <== mon.6 v1:10.20.193.45:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2995943002 0 0) 0x7fd59c003620 con 0x7fd5d00a5e00 2026-02-22T23:25:50.502 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.491+0000 7fd5b6ffd640 1 -- 10.20.193.45:0/2896189651 --> v1:10.20.193.45:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd5d00a1430 con 0x7fd5d00a5e00 2026-02-22T23:25:50.502 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.491+0000 7fd5b6ffd640 1 -- 10.20.193.45:0/2896189651 <== mon.6 v1:10.20.193.45:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7fd5c40048e0 con 0x7fd5d00a5e00 2026-02-22T23:25:50.502 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.491+0000 7fd5b6ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-22T23:25:50.502 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.491+0000 7fd5b6ffd640 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2026-02-22T23:25:50.502 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.491+0000 7fd5b6ffd640 10 monclient(hunting): dump: 2026-02-22T23:25:50.502 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:50.502 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:50.502 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:50.502 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:50.502 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:50.502 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:50.502 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:50.502 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:50.502 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:50.502 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:50.502 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:50.502 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:50.502 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:50.502 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:50.503 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:50.503 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:50.503 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.491+0000 7fd5b6ffd640 10 monclient(hunting): _finish_auth 0 2026-02-22T23:25:50.503 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.492+0000 7fd5b6ffd640 1 -- 10.20.193.45:0/2896189651 <== mon.2 v1:10.20.193.45:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1181352071 0 0) 0x7fd5d00a9d60 con 0x7fd5d00a68f0 2026-02-22T23:25:50.503 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.492+0000 7fd5b6ffd640 1 -- 10.20.193.45:0/2896189651 --> v1:10.20.193.45:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd59c003620 con 0x7fd5d00a68f0 2026-02-22T23:25:50.503 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.492+0000 7fd5b6ffd640 1 -- 10.20.193.45:0/2896189651 <== mon.2 v1:10.20.193.45:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7fd5b8003320 con 0x7fd5d00a68f0 2026-02-22T23:25:50.503 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.492+0000 7fd5b6ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-22T23:25:50.503 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.492+0000 7fd5b6ffd640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-22T23:25:50.503 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.492+0000 7fd5b6ffd640 10 monclient(hunting): dump: 2026-02-22T23:25:50.503 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:50.503 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:50.503 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:50.503 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:50.503 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:50.503 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:50.503 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:50.503 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:50.503 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:50.503 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:50.503 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:50.503 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:50.503 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:50.504 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:50.504 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:50.504 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:50.504 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.492+0000 7fd5b6ffd640 1 -- 10.20.193.45:0/2896189651 <== mon.6 v1:10.20.193.45:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1466940264 0 0) 0x7fd5d00a1430 con 0x7fd5d00a5e00 2026-02-22T23:25:50.504 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.492+0000 7fd5b6ffd640 1 -- 10.20.193.45:0/2896189651 >> v1:10.20.193.45:6790/0 conn(0x7fd5d00a68f0 legacy=0x7fd5d01d4480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:50.504 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.492+0000 7fd5b6ffd640 1 -- 10.20.193.45:0/2896189651 >> v1:10.20.193.73:6789/0 conn(0x7fd5d00a6d00 legacy=0x7fd5d01d7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:50.504 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.492+0000 7fd5b6ffd640 10 monclient: _finish_hunting 0 2026-02-22T23:25:50.504 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.492+0000 7fd5b6ffd640 1 monclient: found mon.d 2026-02-22T23:25:50.504 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.492+0000 7fd5b6ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T23:25:50.504 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.492+0000 7fd5b6ffd640 10 monclient: _send_mon_message to mon.d at v1:10.20.193.45:6792/0 2026-02-22T23:25:50.504 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.492+0000 7fd5b6ffd640 1 -- 10.20.193.45:0/2896189651 --> v1:10.20.193.45:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5d0128c40 con 0x7fd5d00a5e00 2026-02-22T23:25:50.504 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.492+0000 7fd5b6ffd640 10 monclient: _finish_auth 0 2026-02-22T23:25:50.504 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.492+0000 7fd5b6ffd640 10 monclient: _check_auth_tickets 2026-02-22T23:25:50.504 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.492+0000 7fd5b6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T23:25:50.504 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.492+0000 7fd5d4bd6640 5 monclient: authenticate success, global_id 4506 2026-02-22T23:25:50.504 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.492+0000 7fd5d4bd6640 10 monclient: _renew_subs 2026-02-22T23:25:50.504 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.492+0000 7fd5d4bd6640 10 monclient: _send_mon_message to mon.d at v1:10.20.193.45:6792/0 2026-02-22T23:25:50.504 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.492+0000 7fd5d4bd6640 1 -- 10.20.193.45:0/2896189651 --> v1:10.20.193.45:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fd5d0128f20 con 0x7fd5d00a5e00 2026-02-22T23:25:50.504 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.492+0000 7fd5d4bd6640 10 monclient: _renew_subs 2026-02-22T23:25:50.504 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.492+0000 7fd5d4bd6640 10 monclient: _send_mon_message to mon.d at v1:10.20.193.45:6792/0 2026-02-22T23:25:50.504 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.492+0000 7fd5d4bd6640 1 -- 10.20.193.45:0/2896189651 --> v1:10.20.193.45:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7fd5d01279b0 con 0x7fd5d00a5e00 2026-02-22T23:25:50.504 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.492+0000 7fd5b6ffd640 1 -- 10.20.193.45:0/2896189651 <== mon.6 v1:10.20.193.45:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd5c4004d30 con 0x7fd5d00a5e00 2026-02-22T23:25:50.505 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.492+0000 7fd5b6ffd640 10 monclient: handle_config config(0 keys) 2026-02-22T23:25:50.505 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.492+0000 7fd5b6ffd640 1 -- 10.20.193.45:0/2896189651 <== mon.6 v1:10.20.193.45:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7fd5c4005220 con 0x7fd5d00a5e00 2026-02-22T23:25:50.505 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.492+0000 7fd5b6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:25:50.505 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.492+0000 7fd5b6ffd640 10 monclient: got monmap 1 from mon.d (according to old e1) 2026-02-22T23:25:50.505 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.492+0000 7fd5ccd72640 4 set_mon_vals no callback set 2026-02-22T23:25:50.505 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.492+0000 7fd5b6ffd640 10 monclient: dump: 2026-02-22T23:25:50.505 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:50.505 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:50.505 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:50.505 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:50.505 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:50.505 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:50.505 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:50.505 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:50.505 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:50.505 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:50.505 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:50.505 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:50.505 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:50.505 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:50.505 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:50.505 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:50.505 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.492+0000 7fd5d4bd6640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T23:25:50.506 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.492+0000 7fd5d4bd6640 1 -- 10.20.193.45:0/2896189651 --> v1:10.20.193.73:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fd5d00008d0 con 0x7fd5d01cf100 2026-02-22T23:25:50.506 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.492+0000 7fd5b6ffd640 1 -- 10.20.193.45:0/2896189651 <== mon.6 v1:10.20.193.45:6792/0 7 ==== mgrmap(e 5) ==== 50225+0+0 (unknown 2330357642 0 0) 0x7fd5c4011800 con 0x7fd5d00a5e00 2026-02-22T23:25:50.506 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.492+0000 7fd5b6ffd640 1 -- 10.20.193.45:0/2896189651 <== mon.6 v1:10.20.193.45:6792/0 8 ==== osd_map(21..21 src has 1..21) ==== 3921+0+0 (unknown 4068336701 0 0) 0x7fd5c404dc70 con 0x7fd5d00a5e00 2026-02-22T23:25:50.506 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.493+0000 7fd5ced76640 10 monclient: get_auth_request con 0x7fd59c03fe00 auth_method 0 2026-02-22T23:25:50.506 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.493+0000 7fd5b6ffd640 1 -- 10.20.193.45:0/2896189651 <== mon.5 v1:10.20.193.73:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1056844288 0 0) 0x7fd5d00008d0 con 0x7fd5d01cf100 2026-02-22T23:25:50.506 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.493+0000 7fd5b6ffd640 10 monclient(hunting): _negotiate 2026-02-22T23:25:50.506 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.493+0000 7fd5b6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:50.506 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.493+0000 7fd5b6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:50.506 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.493+0000 7fd5b6ffd640 10 monclient(hunting): my global_id is 4424 2026-02-22T23:25:50.506 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.493+0000 7fd5b6ffd640 1 -- 10.20.193.45:0/2896189651 --> v1:10.20.193.73:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd5d00a1430 con 0x7fd5d01cf100 2026-02-22T23:25:50.506 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.493+0000 7fd5b6ffd640 1 -- 10.20.193.45:0/2896189651 <== mon.5 v1:10.20.193.73:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 154992497 0 0) 0x7fd5d00a1430 con 0x7fd5d01cf100 2026-02-22T23:25:50.506 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.493+0000 7fd5b6ffd640 1 -- 10.20.193.45:0/2896189651 --> v1:10.20.193.73:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd5d00008d0 con 0x7fd5d01cf100 2026-02-22T23:25:50.506 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.493+0000 7fd5b6ffd640 1 -- 10.20.193.45:0/2896189651 <== mon.5 v1:10.20.193.73:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7fd5b8003ab0 con 0x7fd5d01cf100 2026-02-22T23:25:50.506 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.493+0000 7fd5b6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:25:50.506 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.493+0000 7fd5b6ffd640 10 monclient: got monmap 1 from mon.h (according to old e1) 2026-02-22T23:25:50.506 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.493+0000 7fd5b6ffd640 10 monclient: dump: 2026-02-22T23:25:50.506 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:50.506 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:50.506 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:50.506 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:50.506 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:50.506 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:50.507 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:50.507 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:50.507 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:50.507 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:50.507 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:50.507 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:50.507 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:50.507 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:50.507 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:50.507 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:50.507 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.493+0000 7fd5b6ffd640 1 -- 10.20.193.45:0/2896189651 <== mon.5 v1:10.20.193.73:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3048316469 0 0) 0x7fd5d00008d0 con 0x7fd5d01cf100 2026-02-22T23:25:50.507 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.493+0000 7fd5b6ffd640 1 -- 10.20.193.45:0/2896189651 --> v1:10.20.193.73:6791/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd5d0128810 con 0x7fd5d01cf100 2026-02-22T23:25:50.507 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.494+0000 7fd5b6ffd640 1 -- 10.20.193.45:0/2896189651 <== mon.5 v1:10.20.193.73:6791/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (unknown 0 0 2024835662) 0x7fd5b80050f0 con 0x7fd5d01cf100 2026-02-22T23:25:50.507 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.494+0000 7fd5b6ffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T23:25:50.507 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.494+0000 7fd5b6ffd640 10 monclient: _finish_command 1 = system:0 2026-02-22T23:25:50.507 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.494+0000 7fd5b6ffd640 1 -- 10.20.193.45:0/2896189651 >> v1:10.20.193.73:6791/0 conn(0x7fd5d01cf100 legacy=0x7fd5d0121a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:50.507 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.494+0000 7fd5b6ffd640 1 -- 10.20.193.45:0/2896189651 >> v1:10.20.193.73:6791/0 conn(0x7fd5d01cf100 legacy=0x7fd5d0121a50 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T23:25:50.508 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.497+0000 7fd5d4bd6640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-22T23:25:50.508 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.497+0000 7fd5d4bd6640 1 -- 10.20.193.45:0/2896189651 --> v1:10.20.193.73:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fd5d01cf4e0 con 0x7fd5d0122160 2026-02-22T23:25:50.508 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.497+0000 7fd5b6ffd640 1 -- 10.20.193.45:0/2896189651 <== mon.5 v1:10.20.193.73:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1516083468 0 0) 0x7fd5d01cf4e0 con 0x7fd5d0122160 2026-02-22T23:25:50.508 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.497+0000 7fd5b6ffd640 10 monclient(hunting): _negotiate 2026-02-22T23:25:50.508 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.497+0000 7fd5b6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:50.509 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.497+0000 7fd5b6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:50.509 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.497+0000 7fd5b6ffd640 10 monclient(hunting): my global_id is 4433 2026-02-22T23:25:50.509 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.497+0000 7fd5b6ffd640 1 -- 10.20.193.45:0/2896189651 --> v1:10.20.193.73:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd5d00008d0 con 0x7fd5d0122160 2026-02-22T23:25:50.509 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.497+0000 7fd5b6ffd640 1 -- 10.20.193.45:0/2896189651 <== mon.5 v1:10.20.193.73:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 446937761 0 0) 0x7fd5d00008d0 con 0x7fd5d0122160 2026-02-22T23:25:50.509 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.497+0000 7fd5b6ffd640 1 -- 10.20.193.45:0/2896189651 --> v1:10.20.193.73:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd5d01cf4e0 con 0x7fd5d0122160 2026-02-22T23:25:50.509 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.497+0000 7fd5b6ffd640 1 -- 10.20.193.45:0/2896189651 <== mon.5 v1:10.20.193.73:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7fd5b80059a0 con 0x7fd5d0122160 2026-02-22T23:25:50.509 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.497+0000 7fd5b6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:25:50.509 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.497+0000 7fd5b6ffd640 10 monclient: got monmap 1 from mon.h (according to old e1) 2026-02-22T23:25:50.509 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.497+0000 7fd5b6ffd640 10 monclient: dump: 2026-02-22T23:25:50.509 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:50.509 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:50.509 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:50.509 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:50.509 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:50.509 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:50.509 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:50.509 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:50.509 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:50.509 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:50.509 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:50.509 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:50.509 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:50.510 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:50.510 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:50.510 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:50.510 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.497+0000 7fd5b6ffd640 1 -- 10.20.193.45:0/2896189651 <== mon.5 v1:10.20.193.73:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1975423533 0 0) 0x7fd5d01cf4e0 con 0x7fd5d0122160 2026-02-22T23:25:50.510 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.497+0000 7fd5b6ffd640 1 -- 10.20.193.45:0/2896189651 --> v1:10.20.193.73:6791/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fd5d00a5770 con 0x7fd5d0122160 2026-02-22T23:25:50.510 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.497+0000 7fd5b6ffd640 1 -- 10.20.193.45:0/2896189651 <== mon.5 v1:10.20.193.73:6791/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7694 (unknown 0 0 1787437991) 0x7fd5b8003ab0 con 0x7fd5d0122160 2026-02-22T23:25:50.510 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.497+0000 7fd5b6ffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-22T23:25:50.510 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.497+0000 7fd5b6ffd640 10 monclient: _finish_command 2 = system:0 2026-02-22T23:25:50.510 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.497+0000 7fd5b6ffd640 1 -- 10.20.193.45:0/2896189651 >> v1:10.20.193.73:6791/0 conn(0x7fd5d0122160 legacy=0x7fd5d01de300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:50.510 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.497+0000 7fd5b6ffd640 1 -- 10.20.193.45:0/2896189651 >> v1:10.20.193.73:6791/0 conn(0x7fd5d0122160 legacy=0x7fd5d01de300 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T23:25:50.510 INFO:teuthology.orchestra.run.trial045.stdout:{ 2026-02-22T23:25:50.510 INFO:teuthology.orchestra.run.trial045.stdout: "name": "h", 2026-02-22T23:25:50.510 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 5, 2026-02-22T23:25:50.510 INFO:teuthology.orchestra.run.trial045.stdout: "state": "peon", 2026-02-22T23:25:50.510 INFO:teuthology.orchestra.run.trial045.stdout: "election_epoch": 8, 2026-02-22T23:25:50.510 INFO:teuthology.orchestra.run.trial045.stdout: "uptime": 30612, 2026-02-22T23:25:50.510 INFO:teuthology.orchestra.run.trial045.stdout: "quorum": [ 2026-02-22T23:25:50.511 INFO:teuthology.orchestra.run.trial045.stdout: 0, 2026-02-22T23:25:50.511 INFO:teuthology.orchestra.run.trial045.stdout: 1, 2026-02-22T23:25:50.511 INFO:teuthology.orchestra.run.trial045.stdout: 2, 2026-02-22T23:25:50.511 INFO:teuthology.orchestra.run.trial045.stdout: 3, 2026-02-22T23:25:50.511 INFO:teuthology.orchestra.run.trial045.stdout: 4, 2026-02-22T23:25:50.511 INFO:teuthology.orchestra.run.trial045.stdout: 5, 2026-02-22T23:25:50.511 INFO:teuthology.orchestra.run.trial045.stdout: 6, 2026-02-22T23:25:50.511 INFO:teuthology.orchestra.run.trial045.stdout: 7, 2026-02-22T23:25:50.511 INFO:teuthology.orchestra.run.trial045.stdout: 8 2026-02-22T23:25:50.511 INFO:teuthology.orchestra.run.trial045.stdout: ], 2026-02-22T23:25:50.511 INFO:teuthology.orchestra.run.trial045.stdout: "quorum_age": 25, 2026-02-22T23:25:50.511 INFO:teuthology.orchestra.run.trial045.stdout: "features": { 2026-02-22T23:25:50.511 INFO:teuthology.orchestra.run.trial045.stdout: "required_con": "2450521708007866372", 2026-02-22T23:25:50.511 INFO:teuthology.orchestra.run.trial045.stdout: "required_mon": [ 2026-02-22T23:25:50.511 INFO:teuthology.orchestra.run.trial045.stdout: "kraken", 2026-02-22T23:25:50.511 INFO:teuthology.orchestra.run.trial045.stdout: "luminous", 2026-02-22T23:25:50.511 INFO:teuthology.orchestra.run.trial045.stdout: "mimic", 2026-02-22T23:25:50.511 INFO:teuthology.orchestra.run.trial045.stdout: "osdmap-prune", 2026-02-22T23:25:50.511 INFO:teuthology.orchestra.run.trial045.stdout: "nautilus", 2026-02-22T23:25:50.511 INFO:teuthology.orchestra.run.trial045.stdout: "octopus", 2026-02-22T23:25:50.511 INFO:teuthology.orchestra.run.trial045.stdout: "pacific", 2026-02-22T23:25:50.512 INFO:teuthology.orchestra.run.trial045.stdout: "elector-pinging", 2026-02-22T23:25:50.512 INFO:teuthology.orchestra.run.trial045.stdout: "quincy", 2026-02-22T23:25:50.512 INFO:teuthology.orchestra.run.trial045.stdout: "reef", 2026-02-22T23:25:50.512 INFO:teuthology.orchestra.run.trial045.stdout: "squid" 2026-02-22T23:25:50.512 INFO:teuthology.orchestra.run.trial045.stdout: ], 2026-02-22T23:25:50.512 INFO:teuthology.orchestra.run.trial045.stdout: "quorum_con": "4540701547738038271", 2026-02-22T23:25:50.512 INFO:teuthology.orchestra.run.trial045.stdout: "quorum_mon": [ 2026-02-22T23:25:50.512 INFO:teuthology.orchestra.run.trial045.stdout: "kraken", 2026-02-22T23:25:50.512 INFO:teuthology.orchestra.run.trial045.stdout: "luminous", 2026-02-22T23:25:50.512 INFO:teuthology.orchestra.run.trial045.stdout: "mimic", 2026-02-22T23:25:50.512 INFO:teuthology.orchestra.run.trial045.stdout: "osdmap-prune", 2026-02-22T23:25:50.512 INFO:teuthology.orchestra.run.trial045.stdout: "nautilus", 2026-02-22T23:25:50.512 INFO:teuthology.orchestra.run.trial045.stdout: "octopus", 2026-02-22T23:25:50.512 INFO:teuthology.orchestra.run.trial045.stdout: "pacific", 2026-02-22T23:25:50.512 INFO:teuthology.orchestra.run.trial045.stdout: "elector-pinging", 2026-02-22T23:25:50.512 INFO:teuthology.orchestra.run.trial045.stdout: "quincy", 2026-02-22T23:25:50.512 INFO:teuthology.orchestra.run.trial045.stdout: "reef", 2026-02-22T23:25:50.512 INFO:teuthology.orchestra.run.trial045.stdout: "squid" 2026-02-22T23:25:50.512 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:25:50.512 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:25:50.512 INFO:teuthology.orchestra.run.trial045.stdout: "outside_quorum": [], 2026-02-22T23:25:50.512 INFO:teuthology.orchestra.run.trial045.stdout: "extra_probe_peers": [], 2026-02-22T23:25:50.513 INFO:teuthology.orchestra.run.trial045.stdout: "sync_provider": [], 2026-02-22T23:25:50.513 INFO:teuthology.orchestra.run.trial045.stdout: "monmap": { 2026-02-22T23:25:50.513 INFO:teuthology.orchestra.run.trial045.stdout: "epoch": 1, 2026-02-22T23:25:50.513 INFO:teuthology.orchestra.run.trial045.stdout: "fsid": "4b60f18f-6660-4731-b731-dc85c4078413", 2026-02-22T23:25:50.513 INFO:teuthology.orchestra.run.trial045.stdout: "modified": "2026-02-22T23:24:52.393472Z", 2026-02-22T23:25:50.513 INFO:teuthology.orchestra.run.trial045.stdout: "created": "2026-02-22T23:24:52.393472Z", 2026-02-22T23:25:50.513 INFO:teuthology.orchestra.run.trial045.stdout: "min_mon_release": 19, 2026-02-22T23:25:50.513 INFO:teuthology.orchestra.run.trial045.stdout: "min_mon_release_name": "squid", 2026-02-22T23:25:50.513 INFO:teuthology.orchestra.run.trial045.stdout: "election_strategy": 3, 2026-02-22T23:25:50.513 INFO:teuthology.orchestra.run.trial045.stdout: "disallowed_leaders": "", 2026-02-22T23:25:50.513 INFO:teuthology.orchestra.run.trial045.stdout: "stretch_mode": false, 2026-02-22T23:25:50.513 INFO:teuthology.orchestra.run.trial045.stdout: "tiebreaker_mon": "", 2026-02-22T23:25:50.513 INFO:teuthology.orchestra.run.trial045.stdout: "removed_ranks": "", 2026-02-22T23:25:50.513 INFO:teuthology.orchestra.run.trial045.stdout: "features": { 2026-02-22T23:25:50.513 INFO:teuthology.orchestra.run.trial045.stdout: "persistent": [ 2026-02-22T23:25:50.513 INFO:teuthology.orchestra.run.trial045.stdout: "kraken", 2026-02-22T23:25:50.513 INFO:teuthology.orchestra.run.trial045.stdout: "luminous", 2026-02-22T23:25:50.513 INFO:teuthology.orchestra.run.trial045.stdout: "mimic", 2026-02-22T23:25:50.513 INFO:teuthology.orchestra.run.trial045.stdout: "osdmap-prune", 2026-02-22T23:25:50.513 INFO:teuthology.orchestra.run.trial045.stdout: "nautilus", 2026-02-22T23:25:50.513 INFO:teuthology.orchestra.run.trial045.stdout: "octopus", 2026-02-22T23:25:50.513 INFO:teuthology.orchestra.run.trial045.stdout: "pacific", 2026-02-22T23:25:50.514 INFO:teuthology.orchestra.run.trial045.stdout: "elector-pinging", 2026-02-22T23:25:50.514 INFO:teuthology.orchestra.run.trial045.stdout: "quincy", 2026-02-22T23:25:50.514 INFO:teuthology.orchestra.run.trial045.stdout: "reef", 2026-02-22T23:25:50.514 INFO:teuthology.orchestra.run.trial045.stdout: "squid" 2026-02-22T23:25:50.514 INFO:teuthology.orchestra.run.trial045.stdout: ], 2026-02-22T23:25:50.514 INFO:teuthology.orchestra.run.trial045.stdout: "optional": [] 2026-02-22T23:25:50.514 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:25:50.514 INFO:teuthology.orchestra.run.trial045.stdout: "mons": [ 2026-02-22T23:25:50.514 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:25:50.514 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 0, 2026-02-22T23:25:50.514 INFO:teuthology.orchestra.run.trial045.stdout: "name": "a", 2026-02-22T23:25:50.514 INFO:teuthology.orchestra.run.trial045.stdout: "public_addrs": { 2026-02-22T23:25:50.514 INFO:teuthology.orchestra.run.trial045.stdout: "addrvec": [ 2026-02-22T23:25:50.514 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:25:50.514 INFO:teuthology.orchestra.run.trial045.stdout: "type": "v1", 2026-02-22T23:25:50.514 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6789", 2026-02-22T23:25:50.514 INFO:teuthology.orchestra.run.trial045.stdout: "nonce": 0 2026-02-22T23:25:50.514 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:25:50.514 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:25:50.514 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:25:50.514 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6789/0", 2026-02-22T23:25:50.514 INFO:teuthology.orchestra.run.trial045.stdout: "public_addr": "10.20.193.45:6789/0", 2026-02-22T23:25:50.515 INFO:teuthology.orchestra.run.trial045.stdout: "priority": 0, 2026-02-22T23:25:50.515 INFO:teuthology.orchestra.run.trial045.stdout: "weight": 0, 2026-02-22T23:25:50.515 INFO:teuthology.orchestra.run.trial045.stdout: "crush_location": "{}" 2026-02-22T23:25:50.515 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:25:50.515 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:25:50.515 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 1, 2026-02-22T23:25:50.515 INFO:teuthology.orchestra.run.trial045.stdout: "name": "f", 2026-02-22T23:25:50.515 INFO:teuthology.orchestra.run.trial045.stdout: "public_addrs": { 2026-02-22T23:25:50.515 INFO:teuthology.orchestra.run.trial045.stdout: "addrvec": [ 2026-02-22T23:25:50.515 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:25:50.515 INFO:teuthology.orchestra.run.trial045.stdout: "type": "v1", 2026-02-22T23:25:50.515 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.73:6789", 2026-02-22T23:25:50.515 INFO:teuthology.orchestra.run.trial045.stdout: "nonce": 0 2026-02-22T23:25:50.515 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:25:50.515 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:25:50.515 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:25:50.515 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.73:6789/0", 2026-02-22T23:25:50.515 INFO:teuthology.orchestra.run.trial045.stdout: "public_addr": "10.20.193.73:6789/0", 2026-02-22T23:25:50.515 INFO:teuthology.orchestra.run.trial045.stdout: "priority": 0, 2026-02-22T23:25:50.515 INFO:teuthology.orchestra.run.trial045.stdout: "weight": 0, 2026-02-22T23:25:50.515 INFO:teuthology.orchestra.run.trial045.stdout: "crush_location": "{}" 2026-02-22T23:25:50.515 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:25:50.516 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:25:50.516 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 2, 2026-02-22T23:25:50.516 INFO:teuthology.orchestra.run.trial045.stdout: "name": "b", 2026-02-22T23:25:50.516 INFO:teuthology.orchestra.run.trial045.stdout: "public_addrs": { 2026-02-22T23:25:50.516 INFO:teuthology.orchestra.run.trial045.stdout: "addrvec": [ 2026-02-22T23:25:50.516 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:25:50.516 INFO:teuthology.orchestra.run.trial045.stdout: "type": "v1", 2026-02-22T23:25:50.516 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6790", 2026-02-22T23:25:50.516 INFO:teuthology.orchestra.run.trial045.stdout: "nonce": 0 2026-02-22T23:25:50.516 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:25:50.516 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:25:50.516 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:25:50.516 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6790/0", 2026-02-22T23:25:50.516 INFO:teuthology.orchestra.run.trial045.stdout: "public_addr": "10.20.193.45:6790/0", 2026-02-22T23:25:50.516 INFO:teuthology.orchestra.run.trial045.stdout: "priority": 0, 2026-02-22T23:25:50.516 INFO:teuthology.orchestra.run.trial045.stdout: "weight": 0, 2026-02-22T23:25:50.516 INFO:teuthology.orchestra.run.trial045.stdout: "crush_location": "{}" 2026-02-22T23:25:50.516 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:25:50.516 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:25:50.516 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 3, 2026-02-22T23:25:50.516 INFO:teuthology.orchestra.run.trial045.stdout: "name": "g", 2026-02-22T23:25:50.516 INFO:teuthology.orchestra.run.trial045.stdout: "public_addrs": { 2026-02-22T23:25:50.517 INFO:teuthology.orchestra.run.trial045.stdout: "addrvec": [ 2026-02-22T23:25:50.517 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:25:50.517 INFO:teuthology.orchestra.run.trial045.stdout: "type": "v1", 2026-02-22T23:25:50.517 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.73:6790", 2026-02-22T23:25:50.517 INFO:teuthology.orchestra.run.trial045.stdout: "nonce": 0 2026-02-22T23:25:50.517 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:25:50.517 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:25:50.517 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:25:50.517 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.73:6790/0", 2026-02-22T23:25:50.517 INFO:teuthology.orchestra.run.trial045.stdout: "public_addr": "10.20.193.73:6790/0", 2026-02-22T23:25:50.517 INFO:teuthology.orchestra.run.trial045.stdout: "priority": 0, 2026-02-22T23:25:50.517 INFO:teuthology.orchestra.run.trial045.stdout: "weight": 0, 2026-02-22T23:25:50.517 INFO:teuthology.orchestra.run.trial045.stdout: "crush_location": "{}" 2026-02-22T23:25:50.517 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:25:50.517 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:25:50.517 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 4, 2026-02-22T23:25:50.517 INFO:teuthology.orchestra.run.trial045.stdout: "name": "c", 2026-02-22T23:25:50.517 INFO:teuthology.orchestra.run.trial045.stdout: "public_addrs": { 2026-02-22T23:25:50.517 INFO:teuthology.orchestra.run.trial045.stdout: "addrvec": [ 2026-02-22T23:25:50.517 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:25:50.517 INFO:teuthology.orchestra.run.trial045.stdout: "type": "v1", 2026-02-22T23:25:50.518 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6791", 2026-02-22T23:25:50.518 INFO:teuthology.orchestra.run.trial045.stdout: "nonce": 0 2026-02-22T23:25:50.518 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:25:50.518 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:25:50.518 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:25:50.518 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6791/0", 2026-02-22T23:25:50.518 INFO:teuthology.orchestra.run.trial045.stdout: "public_addr": "10.20.193.45:6791/0", 2026-02-22T23:25:50.518 INFO:teuthology.orchestra.run.trial045.stdout: "priority": 0, 2026-02-22T23:25:50.518 INFO:teuthology.orchestra.run.trial045.stdout: "weight": 0, 2026-02-22T23:25:50.518 INFO:teuthology.orchestra.run.trial045.stdout: "crush_location": "{}" 2026-02-22T23:25:50.518 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:25:50.518 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:25:50.518 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 5, 2026-02-22T23:25:50.518 INFO:teuthology.orchestra.run.trial045.stdout: "name": "h", 2026-02-22T23:25:50.518 INFO:teuthology.orchestra.run.trial045.stdout: "public_addrs": { 2026-02-22T23:25:50.518 INFO:teuthology.orchestra.run.trial045.stdout: "addrvec": [ 2026-02-22T23:25:50.518 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:25:50.518 INFO:teuthology.orchestra.run.trial045.stdout: "type": "v1", 2026-02-22T23:25:50.518 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.73:6791", 2026-02-22T23:25:50.518 INFO:teuthology.orchestra.run.trial045.stdout: "nonce": 0 2026-02-22T23:25:50.518 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:25:50.518 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:25:50.518 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:25:50.519 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.73:6791/0", 2026-02-22T23:25:50.519 INFO:teuthology.orchestra.run.trial045.stdout: "public_addr": "10.20.193.73:6791/0", 2026-02-22T23:25:50.519 INFO:teuthology.orchestra.run.trial045.stdout: "priority": 0, 2026-02-22T23:25:50.519 INFO:teuthology.orchestra.run.trial045.stdout: "weight": 0, 2026-02-22T23:25:50.519 INFO:teuthology.orchestra.run.trial045.stdout: "crush_location": "{}" 2026-02-22T23:25:50.519 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:25:50.519 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:25:50.519 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 6, 2026-02-22T23:25:50.519 INFO:teuthology.orchestra.run.trial045.stdout: "name": "d", 2026-02-22T23:25:50.519 INFO:teuthology.orchestra.run.trial045.stdout: "public_addrs": { 2026-02-22T23:25:50.519 INFO:teuthology.orchestra.run.trial045.stdout: "addrvec": [ 2026-02-22T23:25:50.519 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:25:50.519 INFO:teuthology.orchestra.run.trial045.stdout: "type": "v1", 2026-02-22T23:25:50.519 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6792", 2026-02-22T23:25:50.519 INFO:teuthology.orchestra.run.trial045.stdout: "nonce": 0 2026-02-22T23:25:50.519 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:25:50.519 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:25:50.519 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:25:50.519 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6792/0", 2026-02-22T23:25:50.519 INFO:teuthology.orchestra.run.trial045.stdout: "public_addr": "10.20.193.45:6792/0", 2026-02-22T23:25:50.519 INFO:teuthology.orchestra.run.trial045.stdout: "priority": 0, 2026-02-22T23:25:50.519 INFO:teuthology.orchestra.run.trial045.stdout: "weight": 0, 2026-02-22T23:25:50.520 INFO:teuthology.orchestra.run.trial045.stdout: "crush_location": "{}" 2026-02-22T23:25:50.520 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:25:50.520 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:25:50.520 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 7, 2026-02-22T23:25:50.520 INFO:teuthology.orchestra.run.trial045.stdout: "name": "i", 2026-02-22T23:25:50.520 INFO:teuthology.orchestra.run.trial045.stdout: "public_addrs": { 2026-02-22T23:25:50.520 INFO:teuthology.orchestra.run.trial045.stdout: "addrvec": [ 2026-02-22T23:25:50.520 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:25:50.520 INFO:teuthology.orchestra.run.trial045.stdout: "type": "v1", 2026-02-22T23:25:50.520 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.73:6792", 2026-02-22T23:25:50.520 INFO:teuthology.orchestra.run.trial045.stdout: "nonce": 0 2026-02-22T23:25:50.520 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:25:50.520 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:25:50.520 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:25:50.520 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.73:6792/0", 2026-02-22T23:25:50.520 INFO:teuthology.orchestra.run.trial045.stdout: "public_addr": "10.20.193.73:6792/0", 2026-02-22T23:25:50.520 INFO:teuthology.orchestra.run.trial045.stdout: "priority": 0, 2026-02-22T23:25:50.520 INFO:teuthology.orchestra.run.trial045.stdout: "weight": 0, 2026-02-22T23:25:50.520 INFO:teuthology.orchestra.run.trial045.stdout: "crush_location": "{}" 2026-02-22T23:25:50.520 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:25:50.520 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:25:50.520 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 8, 2026-02-22T23:25:50.520 INFO:teuthology.orchestra.run.trial045.stdout: "name": "e", 2026-02-22T23:25:50.521 INFO:teuthology.orchestra.run.trial045.stdout: "public_addrs": { 2026-02-22T23:25:50.521 INFO:teuthology.orchestra.run.trial045.stdout: "addrvec": [ 2026-02-22T23:25:50.521 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:25:50.521 INFO:teuthology.orchestra.run.trial045.stdout: "type": "v1", 2026-02-22T23:25:50.521 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6793", 2026-02-22T23:25:50.521 INFO:teuthology.orchestra.run.trial045.stdout: "nonce": 0 2026-02-22T23:25:50.521 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:25:50.521 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:25:50.521 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:25:50.521 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6793/0", 2026-02-22T23:25:50.521 INFO:teuthology.orchestra.run.trial045.stdout: "public_addr": "10.20.193.45:6793/0", 2026-02-22T23:25:50.521 INFO:teuthology.orchestra.run.trial045.stdout: "priority": 0, 2026-02-22T23:25:50.521 INFO:teuthology.orchestra.run.trial045.stdout: "weight": 0, 2026-02-22T23:25:50.521 INFO:teuthology.orchestra.run.trial045.stdout: "crush_location": "{}" 2026-02-22T23:25:50.521 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:25:50.521 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:25:50.521 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:25:50.521 INFO:teuthology.orchestra.run.trial045.stdout: "feature_map": { 2026-02-22T23:25:50.521 INFO:teuthology.orchestra.run.trial045.stdout: "mon": [ 2026-02-22T23:25:50.522 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:25:50.522 INFO:teuthology.orchestra.run.trial045.stdout: "features": "0x3f03cffffffdffff", 2026-02-22T23:25:50.522 INFO:teuthology.orchestra.run.trial045.stdout: "release": "squid", 2026-02-22T23:25:50.522 INFO:teuthology.orchestra.run.trial045.stdout: "num": 1 2026-02-22T23:25:50.522 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:25:50.522 INFO:teuthology.orchestra.run.trial045.stdout: ], 2026-02-22T23:25:50.522 INFO:teuthology.orchestra.run.trial045.stdout: "osd": [ 2026-02-22T23:25:50.522 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:25:50.522 INFO:teuthology.orchestra.run.trial045.stdout: "features": "0x3f03cffffffdffff", 2026-02-22T23:25:50.522 INFO:teuthology.orchestra.run.trial045.stdout: "release": "squid", 2026-02-22T23:25:50.522 INFO:teuthology.orchestra.run.trial045.stdout: "num": 1 2026-02-22T23:25:50.522 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:25:50.522 INFO:teuthology.orchestra.run.trial045.stdout: ], 2026-02-22T23:25:50.522 INFO:teuthology.orchestra.run.trial045.stdout: "client": [ 2026-02-22T23:25:50.522 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:25:50.522 INFO:teuthology.orchestra.run.trial045.stdout: "features": "0x3f03cffffffdffff", 2026-02-22T23:25:50.522 INFO:teuthology.orchestra.run.trial045.stdout: "release": "squid", 2026-02-22T23:25:50.522 INFO:teuthology.orchestra.run.trial045.stdout: "num": 2 2026-02-22T23:25:50.522 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:25:50.522 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:25:50.522 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:25:50.522 INFO:teuthology.orchestra.run.trial045.stdout: "stretch_mode": false 2026-02-22T23:25:50.522 INFO:teuthology.orchestra.run.trial045.stdout:} 2026-02-22T23:25:50.523 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.498+0000 7fd5d4bd6640 1 -- 10.20.193.45:0/2896189651 >> v1:10.20.193.73:6800/2222410180 conn(0x7fd59c03fe00 legacy=0x7fd59c0422c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:50.523 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.498+0000 7fd5d4bd6640 10 monclient: shutdown 2026-02-22T23:25:50.524 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.498+0000 7fd5d4bd6640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T23:25:50.524 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.498+0000 7fd5d4bd6640 1 -- 10.20.193.45:0/2896189651 >> v1:10.20.193.45:6792/0 conn(0x7fd5d00a5e00 legacy=0x7fd5d01415c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:50.524 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.498+0000 7fd5ced76640 1 -- 10.20.193.45:0/2896189651 reap_dead start 2026-02-22T23:25:50.524 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.498+0000 7fd5ced76640 1 -- 10.20.193.45:0/2896189651 reap_dead start 2026-02-22T23:25:50.524 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.498+0000 7fd5d4bd6640 1 -- 10.20.193.45:0/2896189651 shutdown_connections 2026-02-22T23:25:50.524 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.498+0000 7fd5d4bd6640 1 -- 10.20.193.45:0/2896189651 >> 10.20.193.45:0/2896189651 conn(0x7fd5d00abb50 msgr2=0x7fd5d01422f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:25:50.524 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.498+0000 7fd5d4bd6640 1 -- 10.20.193.45:0/2896189651 shutdown_connections 2026-02-22T23:25:50.524 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.498+0000 7fd5d4bd6640 1 -- 10.20.193.45:0/2896189651 wait complete. 2026-02-22T23:25:50.524 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2026-02-22T23:25:50.524 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon i 2026-02-22T23:25:50.524 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.i mon_status 2026-02-22T23:25:50.592 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.592+0000 7fbdce998640 10 monclient: get_monmap_and_config 2026-02-22T23:25:50.592 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.592+0000 7fbdce998640 10 monclient: build_initial_monmap 2026-02-22T23:25:50.592 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.592+0000 7fbdce998640 10 monclient: monmap: 2026-02-22T23:25:50.592 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-22T23:25:50.592 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:50.592 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:25:50.592426+0000 2026-02-22T23:25:50.592 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:25:50.592426+0000 2026-02-22T23:25:50.592 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-22T23:25:50.592 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:50.592 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-22T23:25:50.592 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.noname-f 2026-02-22T23:25:50.592 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.noname-b 2026-02-22T23:25:50.592 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.noname-g 2026-02-22T23:25:50.592 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.noname-c 2026-02-22T23:25:50.592 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.noname-h 2026-02-22T23:25:50.592 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.noname-d 2026-02-22T23:25:50.592 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.noname-i 2026-02-22T23:25:50.592 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.noname-e 2026-02-22T23:25:50.592 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:50.593 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.592+0000 7fbdce998640 1 Processor -- start 2026-02-22T23:25:50.593 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.592+0000 7fbdce998640 1 -- start start 2026-02-22T23:25:50.594 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.592+0000 7fbdce998640 10 monclient: init 2026-02-22T23:25:50.594 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.592+0000 7fbdce998640 10 monclient: _reopen_session rank -1 2026-02-22T23:25:50.594 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.592+0000 7fbdce998640 10 monclient: _add_conns ranks=[3,1,4,8,7,2,0,6,5] 2026-02-22T23:25:50.594 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.592+0000 7fbdce998640 10 monclient(hunting): picked mon.noname-g con 0x7fbdc80a1a60 addr v1:10.20.193.73:6790/0 2026-02-22T23:25:50.594 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.592+0000 7fbdce998640 10 monclient(hunting): picked mon.noname-f con 0x7fbdc806f1e0 addr v1:10.20.193.73:6789/0 2026-02-22T23:25:50.594 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.592+0000 7fbdce998640 10 monclient(hunting): picked mon.noname-c con 0x7fbdc80a0980 addr v1:10.20.193.45:6791/0 2026-02-22T23:25:50.594 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.592+0000 7fbdce998640 1 -- --> v1:10.20.193.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbdc809df00 con 0x7fbdc806f1e0 2026-02-22T23:25:50.594 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.592+0000 7fbdce998640 1 -- --> v1:10.20.193.73:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbdc8137660 con 0x7fbdc80a1a60 2026-02-22T23:25:50.594 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.592+0000 7fbdce998640 1 -- --> v1:10.20.193.45:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbdc80a4510 con 0x7fbdc80a0980 2026-02-22T23:25:50.594 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.592+0000 7fbdce998640 10 monclient(hunting): _renew_subs 2026-02-22T23:25:50.594 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.592+0000 7fbdce998640 10 monclient(hunting): authenticate will time out at 682.208965s 2026-02-22T23:25:50.594 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.593+0000 7fbdccf0e640 1 --1- >> v1:10.20.193.45:6791/0 conn(0x7fbdc80a0980 0x7fbdc813ecb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.45:6791/0 says I am v1:10.20.193.45:38144/0 (socket says 10.20.193.45:38144) 2026-02-22T23:25:50.594 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.593+0000 7fbdccf0e640 1 -- 10.20.193.45:0/1450715490 learned_addr learned my addr 10.20.193.45:0/1450715490 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-22T23:25:50.594 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.593+0000 7fbdc6ffd640 1 -- 10.20.193.45:0/1450715490 <== mon.4 v1:10.20.193.45:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1375663258 0 0) 0x7fbdc80a4510 con 0x7fbdc80a0980 2026-02-22T23:25:50.594 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.593+0000 7fbdc6ffd640 10 monclient(hunting): _negotiate 2026-02-22T23:25:50.594 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.593+0000 7fbdc6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:50.594 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.593+0000 7fbdc6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:50.594 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.593+0000 7fbdc6ffd640 10 monclient(hunting): my global_id is 4549 2026-02-22T23:25:50.594 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.593+0000 7fbdc6ffd640 1 -- 10.20.193.45:0/1450715490 --> v1:10.20.193.45:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbdac003620 con 0x7fbdc80a0980 2026-02-22T23:25:50.594 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.593+0000 7fbdc6ffd640 1 -- 10.20.193.45:0/1450715490 <== mon.4 v1:10.20.193.45:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2844018544 0 0) 0x7fbdac003620 con 0x7fbdc80a0980 2026-02-22T23:25:50.594 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.593+0000 7fbdc6ffd640 1 -- 10.20.193.45:0/1450715490 >> v1:10.20.193.73:6790/0 conn(0x7fbdc80a1a60 legacy=0x7fbdc8136840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:50.594 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.593+0000 7fbdc6ffd640 1 -- 10.20.193.45:0/1450715490 >> v1:10.20.193.73:6789/0 conn(0x7fbdc806f1e0 legacy=0x7fbdc8136f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:50.594 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.593+0000 7fbdc6ffd640 10 monclient: _finish_hunting 0 2026-02-22T23:25:50.594 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.593+0000 7fbdc6ffd640 1 monclient: found mon.noname-c 2026-02-22T23:25:50.594 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.593+0000 7fbdc6ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T23:25:50.594 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.593+0000 7fbdc6ffd640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.45:6791/0 2026-02-22T23:25:50.594 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.593+0000 7fbdc6ffd640 1 -- 10.20.193.45:0/1450715490 --> v1:10.20.193.45:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbdc8143400 con 0x7fbdc80a0980 2026-02-22T23:25:50.594 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.593+0000 7fbdc6ffd640 10 monclient: _finish_auth 0 2026-02-22T23:25:50.594 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.593+0000 7fbdc6ffd640 10 monclient: _check_auth_tickets 2026-02-22T23:25:50.594 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.593+0000 7fbdc6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T23:25:50.594 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.593+0000 7fbdce998640 5 monclient: authenticate success, global_id 4549 2026-02-22T23:25:50.594 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.593+0000 7fbdc6ffd640 1 -- 10.20.193.45:0/1450715490 <== mon.4 v1:10.20.193.45:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7fbdbc0033c0 con 0x7fbdc80a0980 2026-02-22T23:25:50.594 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.593+0000 7fbdce998640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-22T23:25:50.594 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.593+0000 7fbdc6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:25:50.594 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.593+0000 7fbdc6ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-22T23:25:50.594 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.593+0000 7fbdc6ffd640 10 monclient: dump: 2026-02-22T23:25:50.594 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:50.594 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:50.594 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:50.594 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:50.594 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:50.594 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:50.595 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:50.595 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:50.595 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:50.595 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:50.595 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:50.595 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:50.595 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:50.595 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:50.595 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:50.595 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:50.595 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.593+0000 7fbdce998640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-22T23:25:50.595 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.593+0000 7fbdc6ffd640 1 -- 10.20.193.45:0/1450715490 <== mon.4 v1:10.20.193.45:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fbdbc0035e0 con 0x7fbdc80a0980 2026-02-22T23:25:50.595 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.593+0000 7fbdc6ffd640 10 monclient: handle_config config(0 keys) 2026-02-22T23:25:50.595 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.593+0000 7fbdc6ffd640 1 -- 10.20.193.45:0/1450715490 <== mon.4 v1:10.20.193.45:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7fbdbc005060 con 0x7fbdc80a0980 2026-02-22T23:25:50.595 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.593+0000 7fbdce998640 10 monclient: get_monmap_and_config success 2026-02-22T23:25:50.595 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.593+0000 7fbdc6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:25:50.595 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.593+0000 7fbdce998640 4 set_mon_vals no callback set 2026-02-22T23:25:50.595 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.593+0000 7fbdc6ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T23:25:50.595 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.593+0000 7fbdc6ffd640 10 monclient: dump: 2026-02-22T23:25:50.595 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:50.595 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:50.595 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:50.595 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:50.595 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:50.595 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:50.595 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:50.595 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:50.595 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:50.595 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:50.595 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:50.595 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:50.595 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:50.595 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:50.595 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:50.595 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:50.595 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.593+0000 7fbdce998640 10 monclient: shutdown 2026-02-22T23:25:50.595 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.593+0000 7fbdce998640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T23:25:50.595 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.593+0000 7fbdce998640 1 -- 10.20.193.45:0/1450715490 >> v1:10.20.193.45:6791/0 conn(0x7fbdc80a0980 legacy=0x7fbdc813ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:50.595 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.593+0000 7fbdce998640 1 -- 10.20.193.45:0/1450715490 shutdown_connections 2026-02-22T23:25:50.595 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.593+0000 7fbdce998640 1 -- 10.20.193.45:0/1450715490 >> 10.20.193.45:0/1450715490 conn(0x7fbdc80a7780 msgr2=0x7fbdc80a3b60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:25:50.595 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.593+0000 7fbdce998640 1 -- 10.20.193.45:0/1450715490 shutdown_connections 2026-02-22T23:25:50.595 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.593+0000 7fbdce998640 1 -- 10.20.193.45:0/1450715490 wait complete. 2026-02-22T23:25:50.595 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.594+0000 7fbdce998640 10 monclient: build_initial_monmap 2026-02-22T23:25:50.595 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.594+0000 7fbdce998640 10 monclient: monmap: 2026-02-22T23:25:50.595 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-22T23:25:50.596 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T23:25:50.596 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-22T23:25:50.596 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-22T23:25:50.596 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-22T23:25:50.596 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-22T23:25:50.596 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-22T23:25:50.596 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.noname-f 2026-02-22T23:25:50.596 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.noname-b 2026-02-22T23:25:50.596 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.noname-g 2026-02-22T23:25:50.596 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.noname-c 2026-02-22T23:25:50.596 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.noname-h 2026-02-22T23:25:50.596 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.noname-d 2026-02-22T23:25:50.596 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.noname-i 2026-02-22T23:25:50.596 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.noname-e 2026-02-22T23:25:50.596 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:50.596 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.594+0000 7fbdce998640 1 Processor -- start 2026-02-22T23:25:50.596 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.594+0000 7fbdce998640 1 -- start start 2026-02-22T23:25:50.596 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.594+0000 7fbdce998640 10 monclient: init 2026-02-22T23:25:50.597 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.594+0000 7fbdce998640 10 monclient: _reopen_session rank -1 2026-02-22T23:25:50.597 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.594+0000 7fbdce998640 10 monclient: _add_conns ranks=[0,5,1,2,3,4,7,6,8] 2026-02-22T23:25:50.597 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.594+0000 7fbdce998640 10 monclient(hunting): picked mon.noname-a con 0x7fbdc80a0980 addr v1:10.20.193.45:6789/0 2026-02-22T23:25:50.597 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.594+0000 7fbdce998640 10 monclient(hunting): picked mon.noname-h con 0x7fbdc80a1a60 addr v1:10.20.193.73:6791/0 2026-02-22T23:25:50.597 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.594+0000 7fbdce998640 10 monclient(hunting): picked mon.noname-f con 0x7fbdc813fb00 addr v1:10.20.193.73:6789/0 2026-02-22T23:25:50.597 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.594+0000 7fbdce998640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbdc80a2930 con 0x7fbdc80a0980 2026-02-22T23:25:50.597 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.594+0000 7fbdce998640 1 -- --> v1:10.20.193.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbdc8072380 con 0x7fbdc813fb00 2026-02-22T23:25:50.597 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.594+0000 7fbdce998640 1 -- --> v1:10.20.193.73:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbdc80733a0 con 0x7fbdc80a1a60 2026-02-22T23:25:50.597 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.594+0000 7fbdce998640 10 monclient(hunting): _renew_subs 2026-02-22T23:25:50.597 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.594+0000 7fbdce998640 10 monclient(hunting): authenticate will time out at 682.210492s 2026-02-22T23:25:50.598 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.594+0000 7fbdc7fff640 1 --1- >> v1:10.20.193.45:6789/0 conn(0x7fbdc80a0980 0x7fbdc813f3f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.45:6789/0 says I am v1:10.20.193.45:58358/0 (socket says 10.20.193.45:58358) 2026-02-22T23:25:50.598 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.594+0000 7fbdc7fff640 1 -- 10.20.193.45:0/1409395657 learned_addr learned my addr 10.20.193.45:0/1409395657 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-22T23:25:50.598 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.594+0000 7fbdc4ff9640 1 -- 10.20.193.45:0/1409395657 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 362418174 0 0) 0x7fbdc80a2930 con 0x7fbdc80a0980 2026-02-22T23:25:50.598 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.594+0000 7fbdc4ff9640 10 monclient(hunting): _negotiate 2026-02-22T23:25:50.598 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.594+0000 7fbdc4ff9640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:50.598 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.594+0000 7fbdc4ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:50.598 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.594+0000 7fbdc4ff9640 10 monclient(hunting): my global_id is 4464 2026-02-22T23:25:50.598 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.594+0000 7fbdc4ff9640 1 -- 10.20.193.45:0/1409395657 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbd98003620 con 0x7fbdc80a0980 2026-02-22T23:25:50.598 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.594+0000 7fbdc4ff9640 1 -- 10.20.193.45:0/1409395657 <== mon.1 v1:10.20.193.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2861900731 0 0) 0x7fbdc8072380 con 0x7fbdc813fb00 2026-02-22T23:25:50.598 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.594+0000 7fbdc4ff9640 10 monclient(hunting): _negotiate 2026-02-22T23:25:50.598 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.594+0000 7fbdc4ff9640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:50.598 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.594+0000 7fbdc4ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:50.598 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.594+0000 7fbdc4ff9640 10 monclient(hunting): my global_id is 4564 2026-02-22T23:25:50.598 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.594+0000 7fbdc4ff9640 1 -- 10.20.193.45:0/1409395657 --> v1:10.20.193.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbdc80a2930 con 0x7fbdc813fb00 2026-02-22T23:25:50.598 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.594+0000 7fbdc4ff9640 1 -- 10.20.193.45:0/1409395657 <== mon.0 v1:10.20.193.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1193339474 0 0) 0x7fbd98003620 con 0x7fbdc80a0980 2026-02-22T23:25:50.598 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.594+0000 7fbdc4ff9640 1 -- 10.20.193.45:0/1409395657 --> v1:10.20.193.45:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fbdc8072380 con 0x7fbdc80a0980 2026-02-22T23:25:50.598 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.594+0000 7fbdc4ff9640 1 -- 10.20.193.45:0/1409395657 <== mon.0 v1:10.20.193.45:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7fbdb4003340 con 0x7fbdc80a0980 2026-02-22T23:25:50.598 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.594+0000 7fbdc4ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-22T23:25:50.598 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.594+0000 7fbdc4ff9640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T23:25:50.598 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.594+0000 7fbdc4ff9640 10 monclient(hunting): dump: 2026-02-22T23:25:50.598 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:50.598 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:50.598 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:50.598 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:50.598 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:50.598 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:50.598 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:50.598 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:50.598 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:50.598 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:50.598 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:50.598 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:50.598 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:50.598 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:50.598 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:50.598 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:50.598 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.594+0000 7fbdc4ff9640 10 monclient(hunting): _finish_auth 0 2026-02-22T23:25:50.598 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.594+0000 7fbdc4ff9640 1 -- 10.20.193.45:0/1409395657 <== mon.0 v1:10.20.193.45:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1808150768 0 0) 0x7fbdc8072380 con 0x7fbdc80a0980 2026-02-22T23:25:50.598 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.594+0000 7fbdc4ff9640 1 -- 10.20.193.45:0/1409395657 >> v1:10.20.193.73:6791/0 conn(0x7fbdc80a1a60 legacy=0x7fbdc81d25b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:50.599 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.594+0000 7fbdc4ff9640 1 -- 10.20.193.45:0/1409395657 >> v1:10.20.193.73:6789/0 conn(0x7fbdc813fb00 legacy=0x7fbdc81d5ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:50.599 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.594+0000 7fbdc4ff9640 10 monclient: _finish_hunting 0 2026-02-22T23:25:50.599 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.594+0000 7fbdc4ff9640 1 monclient: found mon.a 2026-02-22T23:25:50.599 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.594+0000 7fbdc4ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T23:25:50.599 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.594+0000 7fbdc4ff9640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-22T23:25:50.599 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.594+0000 7fbdc4ff9640 1 -- 10.20.193.45:0/1409395657 --> v1:10.20.193.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbdc8071ce0 con 0x7fbdc80a0980 2026-02-22T23:25:50.599 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.594+0000 7fbdc4ff9640 10 monclient: _finish_auth 0 2026-02-22T23:25:50.599 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.594+0000 7fbdc4ff9640 10 monclient: _check_auth_tickets 2026-02-22T23:25:50.599 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.594+0000 7fbdc4ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T23:25:50.599 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.594+0000 7fbdce998640 5 monclient: authenticate success, global_id 4464 2026-02-22T23:25:50.599 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.594+0000 7fbdce998640 10 monclient: _renew_subs 2026-02-22T23:25:50.599 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.594+0000 7fbdce998640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-22T23:25:50.599 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.594+0000 7fbdce998640 1 -- 10.20.193.45:0/1409395657 --> v1:10.20.193.45:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fbdc81ca730 con 0x7fbdc80a0980 2026-02-22T23:25:50.599 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.595+0000 7fbdce998640 10 monclient: _renew_subs 2026-02-22T23:25:50.599 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.595+0000 7fbdce998640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-22T23:25:50.599 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.595+0000 7fbdce998640 1 -- 10.20.193.45:0/1409395657 --> v1:10.20.193.45:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fbdc8070ca0 con 0x7fbdc80a0980 2026-02-22T23:25:50.599 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.595+0000 7fbdc4ff9640 1 -- 10.20.193.45:0/1409395657 <== mon.0 v1:10.20.193.45:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fbdb40039c0 con 0x7fbdc80a0980 2026-02-22T23:25:50.599 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.595+0000 7fbdc4ff9640 10 monclient: handle_config config(0 keys) 2026-02-22T23:25:50.599 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.595+0000 7fbdc4ff9640 1 -- 10.20.193.45:0/1409395657 <== mon.0 v1:10.20.193.45:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7fbdb4003ef0 con 0x7fbdc80a0980 2026-02-22T23:25:50.599 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.595+0000 7fbdc4ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:25:50.599 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.595+0000 7fbdc67fc640 4 set_mon_vals no callback set 2026-02-22T23:25:50.599 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.595+0000 7fbdc4ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T23:25:50.599 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.595+0000 7fbdc4ff9640 10 monclient: dump: 2026-02-22T23:25:50.599 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:50.599 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:50.599 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:50.599 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:50.599 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:50.599 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:50.599 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:50.599 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:50.599 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:50.599 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:50.599 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:50.599 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:50.599 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:50.599 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:50.599 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:50.599 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:50.599 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.595+0000 7fbdce998640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T23:25:50.600 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.595+0000 7fbdce998640 1 -- 10.20.193.45:0/1409395657 --> v1:10.20.193.73:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fbdc806ce10 con 0x7fbdc806f1e0 2026-02-22T23:25:50.600 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.595+0000 7fbdc4ff9640 1 -- 10.20.193.45:0/1409395657 <== mon.0 v1:10.20.193.45:6789/0 7 ==== mgrmap(e 5) ==== 50225+0+0 (unknown 2330357642 0 0) 0x7fbdb4004110 con 0x7fbdc80a0980 2026-02-22T23:25:50.600 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.595+0000 7fbdc4ff9640 1 -- 10.20.193.45:0/1409395657 <== mon.0 v1:10.20.193.45:6789/0 8 ==== osd_map(21..21 src has 1..21) ==== 3921+0+0 (unknown 4068336701 0 0) 0x7fbdb404de90 con 0x7fbdc80a0980 2026-02-22T23:25:50.600 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.595+0000 7fbdc4ff9640 1 -- 10.20.193.45:0/1409395657 <== mon.7 v1:10.20.193.73:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1536957712 0 0) 0x7fbdc806ce10 con 0x7fbdc806f1e0 2026-02-22T23:25:50.600 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.595+0000 7fbdc4ff9640 10 monclient(hunting): _negotiate 2026-02-22T23:25:50.600 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.595+0000 7fbdc4ff9640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:50.600 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.595+0000 7fbdc4ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:50.600 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.595+0000 7fbdc4ff9640 10 monclient(hunting): my global_id is 4426 2026-02-22T23:25:50.600 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.595+0000 7fbdc4ff9640 1 -- 10.20.193.45:0/1409395657 --> v1:10.20.193.73:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbdc8072380 con 0x7fbdc806f1e0 2026-02-22T23:25:50.600 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.595+0000 7fbdccf0e640 10 monclient: get_auth_request con 0x7fbd9803f8d0 auth_method 0 2026-02-22T23:25:50.600 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.596+0000 7fbdc4ff9640 1 -- 10.20.193.45:0/1409395657 <== mon.7 v1:10.20.193.73:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1600714266 0 0) 0x7fbdc8072380 con 0x7fbdc806f1e0 2026-02-22T23:25:50.600 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.596+0000 7fbdc4ff9640 1 -- 10.20.193.45:0/1409395657 --> v1:10.20.193.73:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fbdc806ce10 con 0x7fbdc806f1e0 2026-02-22T23:25:50.600 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.596+0000 7fbdc4ff9640 1 -- 10.20.193.45:0/1409395657 <== mon.7 v1:10.20.193.73:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7fbdb8002fa0 con 0x7fbdc806f1e0 2026-02-22T23:25:50.600 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.596+0000 7fbdc4ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:25:50.600 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.596+0000 7fbdc4ff9640 10 monclient: got monmap 1 from mon.i (according to old e1) 2026-02-22T23:25:50.600 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.596+0000 7fbdc4ff9640 10 monclient: dump: 2026-02-22T23:25:50.600 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:50.600 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:50.600 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:50.600 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:50.600 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:50.600 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:50.600 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:50.600 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:50.600 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:50.600 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:50.600 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:50.600 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:50.600 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:50.600 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:50.600 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:50.600 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:50.600 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.596+0000 7fbdc4ff9640 1 -- 10.20.193.45:0/1409395657 <== mon.7 v1:10.20.193.73:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 531090693 0 0) 0x7fbdc806ce10 con 0x7fbdc806f1e0 2026-02-22T23:25:50.600 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.596+0000 7fbdc4ff9640 1 -- 10.20.193.45:0/1409395657 --> v1:10.20.193.73:6792/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fbdc81428e0 con 0x7fbdc806f1e0 2026-02-22T23:25:50.600 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.596+0000 7fbdc4ff9640 1 -- 10.20.193.45:0/1409395657 <== mon.7 v1:10.20.193.73:6792/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (unknown 0 0 2024835662) 0x7fbdb80052e0 con 0x7fbdc806f1e0 2026-02-22T23:25:50.600 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.596+0000 7fbdc4ff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T23:25:50.600 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.596+0000 7fbdc4ff9640 10 monclient: _finish_command 1 = system:0 2026-02-22T23:25:50.600 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.596+0000 7fbdc4ff9640 1 -- 10.20.193.45:0/1409395657 >> v1:10.20.193.73:6792/0 conn(0x7fbdc806f1e0 legacy=0x7fbdc8128860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:50.601 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.596+0000 7fbdc4ff9640 1 -- 10.20.193.45:0/1409395657 >> v1:10.20.193.73:6792/0 conn(0x7fbdc806f1e0 legacy=0x7fbdc8128860 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T23:25:50.601 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.599+0000 7fbdce998640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-22T23:25:50.601 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.599+0000 7fbdce998640 1 -- 10.20.193.45:0/1409395657 --> v1:10.20.193.73:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fbdc8070fe0 con 0x7fbdc8140620 2026-02-22T23:25:50.601 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.600+0000 7fbdc4ff9640 1 -- 10.20.193.45:0/1409395657 <== mon.7 v1:10.20.193.73:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4092496367 0 0) 0x7fbdc8070fe0 con 0x7fbdc8140620 2026-02-22T23:25:50.601 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.600+0000 7fbdc4ff9640 10 monclient(hunting): _negotiate 2026-02-22T23:25:50.601 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.600+0000 7fbdc4ff9640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:25:50.601 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.600+0000 7fbdc4ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:25:50.601 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.600+0000 7fbdc4ff9640 10 monclient(hunting): my global_id is 4435 2026-02-22T23:25:50.601 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.600+0000 7fbdc4ff9640 1 -- 10.20.193.45:0/1409395657 --> v1:10.20.193.73:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbdc806ce10 con 0x7fbdc8140620 2026-02-22T23:25:50.601 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.600+0000 7fbdc4ff9640 1 -- 10.20.193.45:0/1409395657 <== mon.7 v1:10.20.193.73:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3607539958 0 0) 0x7fbdc806ce10 con 0x7fbdc8140620 2026-02-22T23:25:50.601 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.600+0000 7fbdc4ff9640 1 -- 10.20.193.45:0/1409395657 --> v1:10.20.193.73:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fbdc8070fe0 con 0x7fbdc8140620 2026-02-22T23:25:50.601 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.600+0000 7fbdc4ff9640 1 -- 10.20.193.45:0/1409395657 <== mon.7 v1:10.20.193.73:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7fbdb8003930 con 0x7fbdc8140620 2026-02-22T23:25:50.601 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.600+0000 7fbdc4ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:25:50.601 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.600+0000 7fbdc4ff9640 10 monclient: got monmap 1 from mon.i (according to old e1) 2026-02-22T23:25:50.601 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.600+0000 7fbdc4ff9640 10 monclient: dump: 2026-02-22T23:25:50.601 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:25:50.601 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:25:50.601 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:50.602 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:25:50.602 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:25:50.602 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:25:50.602 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:25:50.602 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:25:50.602 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:25:50.602 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:25:50.602 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:25:50.602 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:25:50.602 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:25:50.602 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:25:50.602 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:25:50.602 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:25:50.602 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.600+0000 7fbdc4ff9640 1 -- 10.20.193.45:0/1409395657 <== mon.7 v1:10.20.193.73:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2671141340 0 0) 0x7fbdc8070fe0 con 0x7fbdc8140620 2026-02-22T23:25:50.602 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.600+0000 7fbdc4ff9640 1 -- 10.20.193.45:0/1409395657 --> v1:10.20.193.73:6792/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fbdc8129680 con 0x7fbdc8140620 2026-02-22T23:25:50.602 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.600+0000 7fbdc4ff9640 1 -- 10.20.193.45:0/1409395657 <== mon.7 v1:10.20.193.73:6792/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7694 (unknown 0 0 1901128663) 0x7fbdb8004e40 con 0x7fbdc8140620 2026-02-22T23:25:50.602 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.600+0000 7fbdc4ff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-22T23:25:50.602 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.600+0000 7fbdc4ff9640 10 monclient: _finish_command 2 = system:0 2026-02-22T23:25:50.602 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.600+0000 7fbdc4ff9640 1 -- 10.20.193.45:0/1409395657 >> v1:10.20.193.73:6792/0 conn(0x7fbdc8140620 legacy=0x7fbdc8128f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:50.602 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.600+0000 7fbdc4ff9640 1 -- 10.20.193.45:0/1409395657 >> v1:10.20.193.73:6792/0 conn(0x7fbdc8140620 legacy=0x7fbdc8128f70 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T23:25:50.602 INFO:teuthology.orchestra.run.trial045.stdout:{ 2026-02-22T23:25:50.602 INFO:teuthology.orchestra.run.trial045.stdout: "name": "i", 2026-02-22T23:25:50.602 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 7, 2026-02-22T23:25:50.602 INFO:teuthology.orchestra.run.trial045.stdout: "state": "peon", 2026-02-22T23:25:50.602 INFO:teuthology.orchestra.run.trial045.stdout: "election_epoch": 8, 2026-02-22T23:25:50.602 INFO:teuthology.orchestra.run.trial045.stdout: "uptime": 30712, 2026-02-22T23:25:50.602 INFO:teuthology.orchestra.run.trial045.stdout: "quorum": [ 2026-02-22T23:25:50.602 INFO:teuthology.orchestra.run.trial045.stdout: 0, 2026-02-22T23:25:50.602 INFO:teuthology.orchestra.run.trial045.stdout: 1, 2026-02-22T23:25:50.602 INFO:teuthology.orchestra.run.trial045.stdout: 2, 2026-02-22T23:25:50.602 INFO:teuthology.orchestra.run.trial045.stdout: 3, 2026-02-22T23:25:50.602 INFO:teuthology.orchestra.run.trial045.stdout: 4, 2026-02-22T23:25:50.602 INFO:teuthology.orchestra.run.trial045.stdout: 5, 2026-02-22T23:25:50.602 INFO:teuthology.orchestra.run.trial045.stdout: 6, 2026-02-22T23:25:50.602 INFO:teuthology.orchestra.run.trial045.stdout: 7, 2026-02-22T23:25:50.603 INFO:teuthology.orchestra.run.trial045.stdout: 8 2026-02-22T23:25:50.603 INFO:teuthology.orchestra.run.trial045.stdout: ], 2026-02-22T23:25:50.603 INFO:teuthology.orchestra.run.trial045.stdout: "quorum_age": 25, 2026-02-22T23:25:50.603 INFO:teuthology.orchestra.run.trial045.stdout: "features": { 2026-02-22T23:25:50.603 INFO:teuthology.orchestra.run.trial045.stdout: "required_con": "2450521708007866372", 2026-02-22T23:25:50.603 INFO:teuthology.orchestra.run.trial045.stdout: "required_mon": [ 2026-02-22T23:25:50.603 INFO:teuthology.orchestra.run.trial045.stdout: "kraken", 2026-02-22T23:25:50.603 INFO:teuthology.orchestra.run.trial045.stdout: "luminous", 2026-02-22T23:25:50.603 INFO:teuthology.orchestra.run.trial045.stdout: "mimic", 2026-02-22T23:25:50.603 INFO:teuthology.orchestra.run.trial045.stdout: "osdmap-prune", 2026-02-22T23:25:50.603 INFO:teuthology.orchestra.run.trial045.stdout: "nautilus", 2026-02-22T23:25:50.603 INFO:teuthology.orchestra.run.trial045.stdout: "octopus", 2026-02-22T23:25:50.603 INFO:teuthology.orchestra.run.trial045.stdout: "pacific", 2026-02-22T23:25:50.603 INFO:teuthology.orchestra.run.trial045.stdout: "elector-pinging", 2026-02-22T23:25:50.603 INFO:teuthology.orchestra.run.trial045.stdout: "quincy", 2026-02-22T23:25:50.603 INFO:teuthology.orchestra.run.trial045.stdout: "reef", 2026-02-22T23:25:50.603 INFO:teuthology.orchestra.run.trial045.stdout: "squid" 2026-02-22T23:25:50.603 INFO:teuthology.orchestra.run.trial045.stdout: ], 2026-02-22T23:25:50.603 INFO:teuthology.orchestra.run.trial045.stdout: "quorum_con": "4540701547738038271", 2026-02-22T23:25:50.603 INFO:teuthology.orchestra.run.trial045.stdout: "quorum_mon": [ 2026-02-22T23:25:50.603 INFO:teuthology.orchestra.run.trial045.stdout: "kraken", 2026-02-22T23:25:50.603 INFO:teuthology.orchestra.run.trial045.stdout: "luminous", 2026-02-22T23:25:50.603 INFO:teuthology.orchestra.run.trial045.stdout: "mimic", 2026-02-22T23:25:50.603 INFO:teuthology.orchestra.run.trial045.stdout: "osdmap-prune", 2026-02-22T23:25:50.603 INFO:teuthology.orchestra.run.trial045.stdout: "nautilus", 2026-02-22T23:25:50.603 INFO:teuthology.orchestra.run.trial045.stdout: "octopus", 2026-02-22T23:25:50.603 INFO:teuthology.orchestra.run.trial045.stdout: "pacific", 2026-02-22T23:25:50.603 INFO:teuthology.orchestra.run.trial045.stdout: "elector-pinging", 2026-02-22T23:25:50.603 INFO:teuthology.orchestra.run.trial045.stdout: "quincy", 2026-02-22T23:25:50.603 INFO:teuthology.orchestra.run.trial045.stdout: "reef", 2026-02-22T23:25:50.603 INFO:teuthology.orchestra.run.trial045.stdout: "squid" 2026-02-22T23:25:50.603 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:25:50.603 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:25:50.603 INFO:teuthology.orchestra.run.trial045.stdout: "outside_quorum": [], 2026-02-22T23:25:50.603 INFO:teuthology.orchestra.run.trial045.stdout: "extra_probe_peers": [], 2026-02-22T23:25:50.603 INFO:teuthology.orchestra.run.trial045.stdout: "sync_provider": [], 2026-02-22T23:25:50.603 INFO:teuthology.orchestra.run.trial045.stdout: "monmap": { 2026-02-22T23:25:50.603 INFO:teuthology.orchestra.run.trial045.stdout: "epoch": 1, 2026-02-22T23:25:50.603 INFO:teuthology.orchestra.run.trial045.stdout: "fsid": "4b60f18f-6660-4731-b731-dc85c4078413", 2026-02-22T23:25:50.604 INFO:teuthology.orchestra.run.trial045.stdout: "modified": "2026-02-22T23:24:52.393472Z", 2026-02-22T23:25:50.604 INFO:teuthology.orchestra.run.trial045.stdout: "created": "2026-02-22T23:24:52.393472Z", 2026-02-22T23:25:50.604 INFO:teuthology.orchestra.run.trial045.stdout: "min_mon_release": 19, 2026-02-22T23:25:50.604 INFO:teuthology.orchestra.run.trial045.stdout: "min_mon_release_name": "squid", 2026-02-22T23:25:50.604 INFO:teuthology.orchestra.run.trial045.stdout: "election_strategy": 3, 2026-02-22T23:25:50.604 INFO:teuthology.orchestra.run.trial045.stdout: "disallowed_leaders": "", 2026-02-22T23:25:50.604 INFO:teuthology.orchestra.run.trial045.stdout: "stretch_mode": false, 2026-02-22T23:25:50.604 INFO:teuthology.orchestra.run.trial045.stdout: "tiebreaker_mon": "", 2026-02-22T23:25:50.604 INFO:teuthology.orchestra.run.trial045.stdout: "removed_ranks": "", 2026-02-22T23:25:50.604 INFO:teuthology.orchestra.run.trial045.stdout: "features": { 2026-02-22T23:25:50.604 INFO:teuthology.orchestra.run.trial045.stdout: "persistent": [ 2026-02-22T23:25:50.604 INFO:teuthology.orchestra.run.trial045.stdout: "kraken", 2026-02-22T23:25:50.604 INFO:teuthology.orchestra.run.trial045.stdout: "luminous", 2026-02-22T23:25:50.604 INFO:teuthology.orchestra.run.trial045.stdout: "mimic", 2026-02-22T23:25:50.604 INFO:teuthology.orchestra.run.trial045.stdout: "osdmap-prune", 2026-02-22T23:25:50.604 INFO:teuthology.orchestra.run.trial045.stdout: "nautilus", 2026-02-22T23:25:50.604 INFO:teuthology.orchestra.run.trial045.stdout: "octopus", 2026-02-22T23:25:50.604 INFO:teuthology.orchestra.run.trial045.stdout: "pacific", 2026-02-22T23:25:50.604 INFO:teuthology.orchestra.run.trial045.stdout: "elector-pinging", 2026-02-22T23:25:50.604 INFO:teuthology.orchestra.run.trial045.stdout: "quincy", 2026-02-22T23:25:50.604 INFO:teuthology.orchestra.run.trial045.stdout: "reef", 2026-02-22T23:25:50.604 INFO:teuthology.orchestra.run.trial045.stdout: "squid" 2026-02-22T23:25:50.604 INFO:teuthology.orchestra.run.trial045.stdout: ], 2026-02-22T23:25:50.604 INFO:teuthology.orchestra.run.trial045.stdout: "optional": [] 2026-02-22T23:25:50.604 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:25:50.604 INFO:teuthology.orchestra.run.trial045.stdout: "mons": [ 2026-02-22T23:25:50.604 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:25:50.604 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 0, 2026-02-22T23:25:50.604 INFO:teuthology.orchestra.run.trial045.stdout: "name": "a", 2026-02-22T23:25:50.604 INFO:teuthology.orchestra.run.trial045.stdout: "public_addrs": { 2026-02-22T23:25:50.604 INFO:teuthology.orchestra.run.trial045.stdout: "addrvec": [ 2026-02-22T23:25:50.604 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:25:50.604 INFO:teuthology.orchestra.run.trial045.stdout: "type": "v1", 2026-02-22T23:25:50.604 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6789", 2026-02-22T23:25:50.604 INFO:teuthology.orchestra.run.trial045.stdout: "nonce": 0 2026-02-22T23:25:50.604 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:25:50.604 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:25:50.604 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:25:50.605 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6789/0", 2026-02-22T23:25:50.605 INFO:teuthology.orchestra.run.trial045.stdout: "public_addr": "10.20.193.45:6789/0", 2026-02-22T23:25:50.605 INFO:teuthology.orchestra.run.trial045.stdout: "priority": 0, 2026-02-22T23:25:50.605 INFO:teuthology.orchestra.run.trial045.stdout: "weight": 0, 2026-02-22T23:25:50.605 INFO:teuthology.orchestra.run.trial045.stdout: "crush_location": "{}" 2026-02-22T23:25:50.605 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:25:50.605 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:25:50.605 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 1, 2026-02-22T23:25:50.605 INFO:teuthology.orchestra.run.trial045.stdout: "name": "f", 2026-02-22T23:25:50.605 INFO:teuthology.orchestra.run.trial045.stdout: "public_addrs": { 2026-02-22T23:25:50.605 INFO:teuthology.orchestra.run.trial045.stdout: "addrvec": [ 2026-02-22T23:25:50.605 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:25:50.605 INFO:teuthology.orchestra.run.trial045.stdout: "type": "v1", 2026-02-22T23:25:50.605 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.73:6789", 2026-02-22T23:25:50.605 INFO:teuthology.orchestra.run.trial045.stdout: "nonce": 0 2026-02-22T23:25:50.605 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:25:50.605 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:25:50.605 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:25:50.605 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.73:6789/0", 2026-02-22T23:25:50.605 INFO:teuthology.orchestra.run.trial045.stdout: "public_addr": "10.20.193.73:6789/0", 2026-02-22T23:25:50.605 INFO:teuthology.orchestra.run.trial045.stdout: "priority": 0, 2026-02-22T23:25:50.605 INFO:teuthology.orchestra.run.trial045.stdout: "weight": 0, 2026-02-22T23:25:50.605 INFO:teuthology.orchestra.run.trial045.stdout: "crush_location": "{}" 2026-02-22T23:25:50.605 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:25:50.605 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:25:50.605 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 2, 2026-02-22T23:25:50.605 INFO:teuthology.orchestra.run.trial045.stdout: "name": "b", 2026-02-22T23:25:50.605 INFO:teuthology.orchestra.run.trial045.stdout: "public_addrs": { 2026-02-22T23:25:50.605 INFO:teuthology.orchestra.run.trial045.stdout: "addrvec": [ 2026-02-22T23:25:50.605 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:25:50.605 INFO:teuthology.orchestra.run.trial045.stdout: "type": "v1", 2026-02-22T23:25:50.605 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6790", 2026-02-22T23:25:50.605 INFO:teuthology.orchestra.run.trial045.stdout: "nonce": 0 2026-02-22T23:25:50.605 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:25:50.605 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:25:50.605 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:25:50.605 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6790/0", 2026-02-22T23:25:50.605 INFO:teuthology.orchestra.run.trial045.stdout: "public_addr": "10.20.193.45:6790/0", 2026-02-22T23:25:50.605 INFO:teuthology.orchestra.run.trial045.stdout: "priority": 0, 2026-02-22T23:25:50.605 INFO:teuthology.orchestra.run.trial045.stdout: "weight": 0, 2026-02-22T23:25:50.606 INFO:teuthology.orchestra.run.trial045.stdout: "crush_location": "{}" 2026-02-22T23:25:50.606 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:25:50.606 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:25:50.606 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 3, 2026-02-22T23:25:50.606 INFO:teuthology.orchestra.run.trial045.stdout: "name": "g", 2026-02-22T23:25:50.606 INFO:teuthology.orchestra.run.trial045.stdout: "public_addrs": { 2026-02-22T23:25:50.606 INFO:teuthology.orchestra.run.trial045.stdout: "addrvec": [ 2026-02-22T23:25:50.606 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:25:50.606 INFO:teuthology.orchestra.run.trial045.stdout: "type": "v1", 2026-02-22T23:25:50.606 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.73:6790", 2026-02-22T23:25:50.606 INFO:teuthology.orchestra.run.trial045.stdout: "nonce": 0 2026-02-22T23:25:50.606 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:25:50.606 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:25:50.606 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:25:50.606 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.73:6790/0", 2026-02-22T23:25:50.606 INFO:teuthology.orchestra.run.trial045.stdout: "public_addr": "10.20.193.73:6790/0", 2026-02-22T23:25:50.606 INFO:teuthology.orchestra.run.trial045.stdout: "priority": 0, 2026-02-22T23:25:50.606 INFO:teuthology.orchestra.run.trial045.stdout: "weight": 0, 2026-02-22T23:25:50.606 INFO:teuthology.orchestra.run.trial045.stdout: "crush_location": "{}" 2026-02-22T23:25:50.606 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:25:50.606 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:25:50.606 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 4, 2026-02-22T23:25:50.606 INFO:teuthology.orchestra.run.trial045.stdout: "name": "c", 2026-02-22T23:25:50.606 INFO:teuthology.orchestra.run.trial045.stdout: "public_addrs": { 2026-02-22T23:25:50.606 INFO:teuthology.orchestra.run.trial045.stdout: "addrvec": [ 2026-02-22T23:25:50.606 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:25:50.606 INFO:teuthology.orchestra.run.trial045.stdout: "type": "v1", 2026-02-22T23:25:50.606 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6791", 2026-02-22T23:25:50.606 INFO:teuthology.orchestra.run.trial045.stdout: "nonce": 0 2026-02-22T23:25:50.606 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:25:50.606 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:25:50.606 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:25:50.606 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6791/0", 2026-02-22T23:25:50.606 INFO:teuthology.orchestra.run.trial045.stdout: "public_addr": "10.20.193.45:6791/0", 2026-02-22T23:25:50.606 INFO:teuthology.orchestra.run.trial045.stdout: "priority": 0, 2026-02-22T23:25:50.606 INFO:teuthology.orchestra.run.trial045.stdout: "weight": 0, 2026-02-22T23:25:50.606 INFO:teuthology.orchestra.run.trial045.stdout: "crush_location": "{}" 2026-02-22T23:25:50.606 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:25:50.606 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:25:50.606 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 5, 2026-02-22T23:25:50.606 INFO:teuthology.orchestra.run.trial045.stdout: "name": "h", 2026-02-22T23:25:50.607 INFO:teuthology.orchestra.run.trial045.stdout: "public_addrs": { 2026-02-22T23:25:50.607 INFO:teuthology.orchestra.run.trial045.stdout: "addrvec": [ 2026-02-22T23:25:50.607 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:25:50.607 INFO:teuthology.orchestra.run.trial045.stdout: "type": "v1", 2026-02-22T23:25:50.607 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.73:6791", 2026-02-22T23:25:50.607 INFO:teuthology.orchestra.run.trial045.stdout: "nonce": 0 2026-02-22T23:25:50.607 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:25:50.607 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:25:50.607 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:25:50.607 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.73:6791/0", 2026-02-22T23:25:50.607 INFO:teuthology.orchestra.run.trial045.stdout: "public_addr": "10.20.193.73:6791/0", 2026-02-22T23:25:50.607 INFO:teuthology.orchestra.run.trial045.stdout: "priority": 0, 2026-02-22T23:25:50.607 INFO:teuthology.orchestra.run.trial045.stdout: "weight": 0, 2026-02-22T23:25:50.607 INFO:teuthology.orchestra.run.trial045.stdout: "crush_location": "{}" 2026-02-22T23:25:50.607 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:25:50.607 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:25:50.607 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 6, 2026-02-22T23:25:50.607 INFO:teuthology.orchestra.run.trial045.stdout: "name": "d", 2026-02-22T23:25:50.607 INFO:teuthology.orchestra.run.trial045.stdout: "public_addrs": { 2026-02-22T23:25:50.607 INFO:teuthology.orchestra.run.trial045.stdout: "addrvec": [ 2026-02-22T23:25:50.607 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:25:50.607 INFO:teuthology.orchestra.run.trial045.stdout: "type": "v1", 2026-02-22T23:25:50.607 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6792", 2026-02-22T23:25:50.607 INFO:teuthology.orchestra.run.trial045.stdout: "nonce": 0 2026-02-22T23:25:50.607 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:25:50.607 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:25:50.607 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:25:50.607 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6792/0", 2026-02-22T23:25:50.607 INFO:teuthology.orchestra.run.trial045.stdout: "public_addr": "10.20.193.45:6792/0", 2026-02-22T23:25:50.607 INFO:teuthology.orchestra.run.trial045.stdout: "priority": 0, 2026-02-22T23:25:50.607 INFO:teuthology.orchestra.run.trial045.stdout: "weight": 0, 2026-02-22T23:25:50.607 INFO:teuthology.orchestra.run.trial045.stdout: "crush_location": "{}" 2026-02-22T23:25:50.607 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:25:50.607 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:25:50.607 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 7, 2026-02-22T23:25:50.607 INFO:teuthology.orchestra.run.trial045.stdout: "name": "i", 2026-02-22T23:25:50.607 INFO:teuthology.orchestra.run.trial045.stdout: "public_addrs": { 2026-02-22T23:25:50.607 INFO:teuthology.orchestra.run.trial045.stdout: "addrvec": [ 2026-02-22T23:25:50.607 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:25:50.608 INFO:teuthology.orchestra.run.trial045.stdout: "type": "v1", 2026-02-22T23:25:50.608 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.73:6792", 2026-02-22T23:25:50.608 INFO:teuthology.orchestra.run.trial045.stdout: "nonce": 0 2026-02-22T23:25:50.608 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:25:50.608 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:25:50.608 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:25:50.608 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.73:6792/0", 2026-02-22T23:25:50.608 INFO:teuthology.orchestra.run.trial045.stdout: "public_addr": "10.20.193.73:6792/0", 2026-02-22T23:25:50.608 INFO:teuthology.orchestra.run.trial045.stdout: "priority": 0, 2026-02-22T23:25:50.608 INFO:teuthology.orchestra.run.trial045.stdout: "weight": 0, 2026-02-22T23:25:50.608 INFO:teuthology.orchestra.run.trial045.stdout: "crush_location": "{}" 2026-02-22T23:25:50.608 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:25:50.608 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:25:50.608 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 8, 2026-02-22T23:25:50.608 INFO:teuthology.orchestra.run.trial045.stdout: "name": "e", 2026-02-22T23:25:50.608 INFO:teuthology.orchestra.run.trial045.stdout: "public_addrs": { 2026-02-22T23:25:50.608 INFO:teuthology.orchestra.run.trial045.stdout: "addrvec": [ 2026-02-22T23:25:50.608 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:25:50.608 INFO:teuthology.orchestra.run.trial045.stdout: "type": "v1", 2026-02-22T23:25:50.608 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6793", 2026-02-22T23:25:50.609 INFO:teuthology.orchestra.run.trial045.stdout: "nonce": 0 2026-02-22T23:25:50.609 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:25:50.609 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:25:50.609 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:25:50.609 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6793/0", 2026-02-22T23:25:50.609 INFO:teuthology.orchestra.run.trial045.stdout: "public_addr": "10.20.193.45:6793/0", 2026-02-22T23:25:50.609 INFO:teuthology.orchestra.run.trial045.stdout: "priority": 0, 2026-02-22T23:25:50.609 INFO:teuthology.orchestra.run.trial045.stdout: "weight": 0, 2026-02-22T23:25:50.609 INFO:teuthology.orchestra.run.trial045.stdout: "crush_location": "{}" 2026-02-22T23:25:50.609 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:25:50.609 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:25:50.609 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:25:50.609 INFO:teuthology.orchestra.run.trial045.stdout: "feature_map": { 2026-02-22T23:25:50.609 INFO:teuthology.orchestra.run.trial045.stdout: "mon": [ 2026-02-22T23:25:50.609 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:25:50.609 INFO:teuthology.orchestra.run.trial045.stdout: "features": "0x3f03cffffffdffff", 2026-02-22T23:25:50.609 INFO:teuthology.orchestra.run.trial045.stdout: "release": "squid", 2026-02-22T23:25:50.609 INFO:teuthology.orchestra.run.trial045.stdout: "num": 1 2026-02-22T23:25:50.609 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:25:50.609 INFO:teuthology.orchestra.run.trial045.stdout: ], 2026-02-22T23:25:50.609 INFO:teuthology.orchestra.run.trial045.stdout: "osd": [ 2026-02-22T23:25:50.609 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:25:50.609 INFO:teuthology.orchestra.run.trial045.stdout: "features": "0x3f03cffffffdffff", 2026-02-22T23:25:50.609 INFO:teuthology.orchestra.run.trial045.stdout: "release": "squid", 2026-02-22T23:25:50.609 INFO:teuthology.orchestra.run.trial045.stdout: "num": 1 2026-02-22T23:25:50.609 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:25:50.609 INFO:teuthology.orchestra.run.trial045.stdout: ], 2026-02-22T23:25:50.609 INFO:teuthology.orchestra.run.trial045.stdout: "client": [ 2026-02-22T23:25:50.609 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:25:50.609 INFO:teuthology.orchestra.run.trial045.stdout: "features": "0x3f03cffffffdffff", 2026-02-22T23:25:50.609 INFO:teuthology.orchestra.run.trial045.stdout: "release": "squid", 2026-02-22T23:25:50.609 INFO:teuthology.orchestra.run.trial045.stdout: "num": 1 2026-02-22T23:25:50.609 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:25:50.609 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:25:50.609 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:25:50.609 INFO:teuthology.orchestra.run.trial045.stdout: "stretch_mode": false 2026-02-22T23:25:50.609 INFO:teuthology.orchestra.run.trial045.stdout:} 2026-02-22T23:25:50.610 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.600+0000 7fbdce998640 1 -- 10.20.193.45:0/1409395657 >> v1:10.20.193.73:6800/2222410180 conn(0x7fbd9803f8d0 legacy=0x7fbd98041d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:50.610 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.600+0000 7fbdce998640 10 monclient: shutdown 2026-02-22T23:25:50.610 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.600+0000 7fbdce998640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T23:25:50.610 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.600+0000 7fbdce998640 1 -- 10.20.193.45:0/1409395657 >> v1:10.20.193.45:6789/0 conn(0x7fbdc80a0980 legacy=0x7fbdc813f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:25:50.610 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.600+0000 7fbdccf0e640 1 -- 10.20.193.45:0/1409395657 reap_dead start 2026-02-22T23:25:50.610 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.600+0000 7fbdccf0e640 1 -- 10.20.193.45:0/1409395657 reap_dead start 2026-02-22T23:25:50.610 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.600+0000 7fbdce998640 1 -- 10.20.193.45:0/1409395657 shutdown_connections 2026-02-22T23:25:50.610 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.600+0000 7fbdce998640 1 -- 10.20.193.45:0/1409395657 >> 10.20.193.45:0/1409395657 conn(0x7fbdc80a7780 msgr2=0x7fbdc80a4f60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:25:50.610 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.600+0000 7fbdce998640 1 -- 10.20.193.45:0/1409395657 shutdown_connections 2026-02-22T23:25:50.610 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:25:50.600+0000 7fbdce998640 1 -- 10.20.193.45:0/1409395657 wait complete. 2026-02-22T23:25:50.610 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2026-02-22T23:25:50.611 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['c', 'h', 'd', 'f'] 2026-02-22T23:25:50.611 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: ['b'] 2026-02-22T23:25:50.611 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.c 2026-02-22T23:25:50.611 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2026-02-22T23:25:50.611 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2026-02-22T23:25:50.611 INFO:teuthology.orchestra.run:waiting for 300 2026-02-22T23:25:50.619 INFO:tasks.ceph.mon.c:Stopped 2026-02-22T23:25:50.619 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.h 2026-02-22T23:25:50.619 INFO:tasks.mon_thrash.mon_thrasher:killing mon.h 2026-02-22T23:25:50.619 DEBUG:tasks.ceph.mon.h:waiting for process to exit 2026-02-22T23:25:50.619 INFO:teuthology.orchestra.run:waiting for 300 2026-02-22T23:25:50.628 INFO:tasks.ceph.mon.h:Stopped 2026-02-22T23:25:50.628 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.d 2026-02-22T23:25:50.628 INFO:tasks.mon_thrash.mon_thrasher:killing mon.d 2026-02-22T23:25:50.628 DEBUG:tasks.ceph.mon.d:waiting for process to exit 2026-02-22T23:25:50.628 INFO:teuthology.orchestra.run:waiting for 300 2026-02-22T23:25:50.668 INFO:tasks.ceph.mon.d:Stopped 2026-02-22T23:25:50.668 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.f 2026-02-22T23:25:50.668 INFO:tasks.mon_thrash.mon_thrasher:killing mon.f 2026-02-22T23:25:50.668 DEBUG:tasks.ceph.mon.f:waiting for process to exit 2026-02-22T23:25:50.668 INFO:teuthology.orchestra.run:waiting for 300 2026-02-22T23:25:50.678 INFO:tasks.ceph.mon.f:Stopped 2026-02-22T23:25:50.678 INFO:tasks.mon_thrash:Sending STOP to mon b 2026-02-22T23:25:50.678 INFO:tasks.ceph.mon.b:Sent signal 19 2026-02-22T23:25:50.678 INFO:tasks.mon_thrash.mon_thrasher:waiting for 15.0 secs to unfreeze mons 2026-02-22T23:26:05.679 INFO:tasks.mon_thrash:Sending CONT to mon b 2026-02-22T23:26:05.680 INFO:tasks.ceph.mon.b:Sent signal 18 2026-02-22T23:26:05.680 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 5 2026-02-22T23:26:05.680 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-22T23:26:05.749 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:05.747+0000 7f67340f5640 10 monclient: get_monmap_and_config 2026-02-22T23:26:05.750 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:05.747+0000 7f67340f5640 10 monclient: build_initial_monmap 2026-02-22T23:26:05.750 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:05.747+0000 7f67340f5640 10 monclient: monmap: 2026-02-22T23:26:05.750 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-22T23:26:05.750 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:26:05.750 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:26:05.748746+0000 2026-02-22T23:26:05.750 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:26:05.748746+0000 2026-02-22T23:26:05.750 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-22T23:26:05.750 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:26:05.750 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-22T23:26:05.751 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.noname-f 2026-02-22T23:26:05.751 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.noname-b 2026-02-22T23:26:05.751 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.noname-g 2026-02-22T23:26:05.751 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.noname-c 2026-02-22T23:26:05.751 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.noname-h 2026-02-22T23:26:05.751 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.noname-d 2026-02-22T23:26:05.751 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.noname-i 2026-02-22T23:26:05.751 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.noname-e 2026-02-22T23:26:05.751 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:26:05.751 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:05.747+0000 7f67340f5640 1 Processor -- start 2026-02-22T23:26:05.751 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:05.747+0000 7f67340f5640 1 -- start start 2026-02-22T23:26:05.751 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:05.747+0000 7f67340f5640 10 monclient: init 2026-02-22T23:26:05.752 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:05.748+0000 7f67340f5640 10 monclient: _reopen_session rank -1 2026-02-22T23:26:05.752 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:05.748+0000 7f67340f5640 10 monclient: _add_conns ranks=[2,1,0,4,7,6,3,5,8] 2026-02-22T23:26:05.752 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:05.748+0000 7f67340f5640 10 monclient(hunting): picked mon.noname-b con 0x7f672c0a1a60 addr v1:10.20.193.45:6790/0 2026-02-22T23:26:05.752 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:05.748+0000 7f67340f5640 10 monclient(hunting): picked mon.noname-f con 0x7f672c06f1e0 addr v1:10.20.193.73:6789/0 2026-02-22T23:26:05.752 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:05.748+0000 7f67340f5640 10 monclient(hunting): picked mon.noname-a con 0x7f672c0a0980 addr v1:10.20.193.45:6789/0 2026-02-22T23:26:05.752 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:05.748+0000 7f67340f5640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f672c09df00 con 0x7f672c0a0980 2026-02-22T23:26:05.752 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:05.748+0000 7f67340f5640 1 -- --> v1:10.20.193.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f672c137660 con 0x7f672c06f1e0 2026-02-22T23:26:05.752 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:05.748+0000 7f67340f5640 1 -- --> v1:10.20.193.45:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f672c0a4510 con 0x7f672c0a1a60 2026-02-22T23:26:05.752 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:05.748+0000 7f67340f5640 10 monclient(hunting): _renew_subs 2026-02-22T23:26:05.752 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:05.748+0000 7f67340f5640 10 monclient(hunting): authenticate will time out at 697.365272s 2026-02-22T23:26:05.752 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:05.748+0000 7f6731669640 1 -- >> v1:10.20.193.73:6789/0 conn(0x7f672c06f1e0 legacy=0x7f672c136f50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.73:6789/0 2026-02-22T23:26:05.753 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:05.748+0000 7f6731e6a640 1 --1- >> v1:10.20.193.45:6790/0 conn(0x7f672c0a1a60 0x7f672c136840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.45:6790/0 says I am v1:10.20.193.45:60438/0 (socket says 10.20.193.45:60438) 2026-02-22T23:26:05.753 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:05.748+0000 7f6731e6a640 1 -- 10.20.193.45:0/3657172203 learned_addr learned my addr 10.20.193.45:0/3657172203 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-22T23:26:05.949 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:05.949+0000 7f6731669640 1 -- 10.20.193.45:0/3657172203 >> v1:10.20.193.73:6789/0 conn(0x7f672c06f1e0 legacy=0x7f672c136f50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.73:6789/0 2026-02-22T23:26:06.351 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:06.350+0000 7f6731669640 1 -- 10.20.193.45:0/3657172203 >> v1:10.20.193.73:6789/0 conn(0x7f672c06f1e0 legacy=0x7f672c136f50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.73:6789/0 2026-02-22T23:26:07.152 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:07.151+0000 7f6731669640 1 -- 10.20.193.45:0/3657172203 >> v1:10.20.193.73:6789/0 conn(0x7f672c06f1e0 legacy=0x7f672c136f50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.73:6789/0 2026-02-22T23:26:08.750 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:08.748+0000 7f671b7fe640 10 monclient(hunting): tick 2026-02-22T23:26:08.750 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:08.748+0000 7f671b7fe640 10 monclient(hunting): _check_auth_tickets 2026-02-22T23:26:08.751 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:08.748+0000 7f671b7fe640 1 monclient(hunting): continuing hunt 2026-02-22T23:26:08.751 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:08.748+0000 7f671b7fe640 10 monclient(hunting): _reopen_session rank -1 2026-02-22T23:26:08.751 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:08.748+0000 7f671b7fe640 1 -- 10.20.193.45:0/3657172203 >> v1:10.20.193.45:6790/0 conn(0x7f672c0a1a60 legacy=0x7f672c136840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:26:08.751 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:08.748+0000 7f671b7fe640 1 -- 10.20.193.45:0/3657172203 >> v1:10.20.193.73:6789/0 conn(0x7f672c06f1e0 legacy=0x7f672c136f50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-22T23:26:08.751 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:08.748+0000 7f671b7fe640 1 -- 10.20.193.45:0/3657172203 >> v1:10.20.193.45:6789/0 conn(0x7f672c0a0980 legacy=0x7f672c13ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:26:08.751 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:08.748+0000 7f671b7fe640 10 monclient: _add_conns ranks=[5,4,7,3,6,8] 2026-02-22T23:26:08.751 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:08.748+0000 7f671b7fe640 10 monclient(hunting): picked mon.noname-h con 0x7f67100038c0 addr v1:10.20.193.73:6791/0 2026-02-22T23:26:08.751 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:08.748+0000 7f671b7fe640 10 monclient(hunting): picked mon.noname-c con 0x7f6710007510 addr v1:10.20.193.45:6791/0 2026-02-22T23:26:08.751 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:08.748+0000 7f671b7fe640 10 monclient(hunting): picked mon.noname-i con 0x7f671000b2a0 addr v1:10.20.193.73:6792/0 2026-02-22T23:26:08.751 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:08.748+0000 7f671b7fe640 1 -- 10.20.193.45:0/3657172203 --> v1:10.20.193.45:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f672c143400 con 0x7f6710007510 2026-02-22T23:26:08.752 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:08.748+0000 7f6731669640 1 -- 10.20.193.45:0/3657172203 >> v1:10.20.193.45:6791/0 conn(0x7f6710007510 legacy=0x7f67100099d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.45:6791/0 2026-02-22T23:26:08.752 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:08.748+0000 7f671b7fe640 1 -- 10.20.193.45:0/3657172203 --> v1:10.20.193.73:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f672c137660 con 0x7f67100038c0 2026-02-22T23:26:08.752 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:08.748+0000 7f671b7fe640 1 -- 10.20.193.45:0/3657172203 --> v1:10.20.193.73:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6710011110 con 0x7f671000b2a0 2026-02-22T23:26:08.752 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:08.748+0000 7f671b7fe640 10 monclient(hunting): _renew_subs 2026-02-22T23:26:08.752 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:08.748+0000 7f6731e6a640 1 -- 10.20.193.45:0/3657172203 >> v1:10.20.193.73:6791/0 conn(0x7f67100038c0 legacy=0x7f6710005cd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.73:6791/0 2026-02-22T23:26:08.949 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:08.949+0000 7f6731669640 1 -- 10.20.193.45:0/3657172203 >> v1:10.20.193.45:6791/0 conn(0x7f6710007510 legacy=0x7f67100099d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.45:6791/0 2026-02-22T23:26:08.949 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:08.949+0000 7f6731e6a640 1 -- 10.20.193.45:0/3657172203 >> v1:10.20.193.73:6791/0 conn(0x7f67100038c0 legacy=0x7f6710005cd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.73:6791/0 2026-02-22T23:26:09.351 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:09.350+0000 7f6731669640 1 -- 10.20.193.45:0/3657172203 >> v1:10.20.193.45:6791/0 conn(0x7f6710007510 legacy=0x7f67100099d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.45:6791/0 2026-02-22T23:26:09.351 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:09.350+0000 7f6731e6a640 1 -- 10.20.193.45:0/3657172203 >> v1:10.20.193.73:6791/0 conn(0x7f67100038c0 legacy=0x7f6710005cd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.73:6791/0 2026-02-22T23:26:09.891 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:09.889+0000 7f673266b640 1 -- 10.20.193.45:0/3657172203 >> v1:10.20.193.73:6792/0 conn(0x7f671000b2a0 legacy=0x7f671000d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 15 2026-02-22T23:26:09.891 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:09.889+0000 7f673266b640 1 -- 10.20.193.45:0/3657172203 >> v1:10.20.193.73:6792/0 conn(0x7f671000b2a0 legacy=0x7f671000d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-22T23:26:09.891 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:09.889+0000 7f673266b640 1 --1- 10.20.193.45:0/3657172203 >> v1:10.20.193.73:6792/0 conn(0x7f671000b2a0 0x7f671000d760 :-1 s=OPENED pgs=119 cs=1 l=1).handle_message read tag failed 2026-02-22T23:26:09.891 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:09.889+0000 7f673266b640 1 --1- 10.20.193.45:0/3657172203 >> v1:10.20.193.73:6792/0 conn(0x7f671000b2a0 0x7f671000d760 :-1 s=OPENED pgs=119 cs=1 l=1).fault on lossy channel, failing 2026-02-22T23:26:09.892 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:09.889+0000 7f6730e68640 10 monclient(hunting): ms_handle_reset hunted mon v1:10.20.193.73:6792/0 2026-02-22T23:26:10.151 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:10.151+0000 7f6731669640 1 -- 10.20.193.45:0/3657172203 >> v1:10.20.193.45:6791/0 conn(0x7f6710007510 legacy=0x7f67100099d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.45:6791/0 2026-02-22T23:26:10.152 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:10.151+0000 7f6731e6a640 1 -- 10.20.193.45:0/3657172203 >> v1:10.20.193.73:6791/0 conn(0x7f67100038c0 legacy=0x7f6710005cd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.73:6791/0 2026-02-22T23:26:11.750 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:11.749+0000 7f671b7fe640 10 monclient(hunting): tick 2026-02-22T23:26:11.750 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:11.749+0000 7f671b7fe640 10 monclient(hunting): _check_auth_tickets 2026-02-22T23:26:11.750 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:11.749+0000 7f671b7fe640 1 monclient(hunting): continuing hunt 2026-02-22T23:26:11.750 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:11.749+0000 7f671b7fe640 10 monclient(hunting): _reopen_session rank -1 2026-02-22T23:26:11.751 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:11.749+0000 7f671b7fe640 1 -- 10.20.193.45:0/3657172203 >> v1:10.20.193.73:6792/0 conn(0x7f671000b2a0 legacy=0x7f671000d760 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T23:26:11.751 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:11.749+0000 7f671b7fe640 1 -- 10.20.193.45:0/3657172203 >> v1:10.20.193.73:6791/0 conn(0x7f67100038c0 legacy=0x7f6710005cd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-22T23:26:11.751 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:11.749+0000 7f671b7fe640 1 -- 10.20.193.45:0/3657172203 >> v1:10.20.193.45:6791/0 conn(0x7f6710007510 legacy=0x7f67100099d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-22T23:26:11.751 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:11.749+0000 7f673266b640 1 -- 10.20.193.45:0/3657172203 reap_dead start 2026-02-22T23:26:11.751 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:11.749+0000 7f671b7fe640 10 monclient: _add_conns ranks=[8,3,6] 2026-02-22T23:26:11.751 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:11.749+0000 7f671b7fe640 10 monclient(hunting): picked mon.noname-e con 0x7f6710010070 addr v1:10.20.193.45:6793/0 2026-02-22T23:26:11.751 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:11.749+0000 7f671b7fe640 10 monclient(hunting): picked mon.noname-g con 0x7f6710010480 addr v1:10.20.193.73:6790/0 2026-02-22T23:26:11.751 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:11.749+0000 7f671b7fe640 10 monclient(hunting): picked mon.noname-d con 0x7f6710010a80 addr v1:10.20.193.45:6792/0 2026-02-22T23:26:11.751 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:11.749+0000 7f671b7fe640 1 -- 10.20.193.45:0/3657172203 --> v1:10.20.193.73:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6710012410 con 0x7f6710010480 2026-02-22T23:26:11.751 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:11.749+0000 7f671b7fe640 1 -- 10.20.193.45:0/3657172203 --> v1:10.20.193.45:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f672c143400 con 0x7f6710010a80 2026-02-22T23:26:11.751 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:11.749+0000 7f671b7fe640 1 -- 10.20.193.45:0/3657172203 --> v1:10.20.193.45:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f672c137660 con 0x7f6710010070 2026-02-22T23:26:11.752 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:11.749+0000 7f671b7fe640 10 monclient(hunting): _renew_subs 2026-02-22T23:26:11.752 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:11.749+0000 7f673266b640 1 -- 10.20.193.45:0/3657172203 >> v1:10.20.193.45:6792/0 conn(0x7f6710010a80 legacy=0x7f6710009950 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.45:6792/0 2026-02-22T23:26:11.951 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:11.950+0000 7f673266b640 1 -- 10.20.193.45:0/3657172203 >> v1:10.20.193.45:6792/0 conn(0x7f6710010a80 legacy=0x7f6710009950 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.45:6792/0 2026-02-22T23:26:12.351 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:12.351+0000 7f673266b640 1 -- 10.20.193.45:0/3657172203 >> v1:10.20.193.45:6792/0 conn(0x7f6710010a80 legacy=0x7f6710009950 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.45:6792/0 2026-02-22T23:26:13.152 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:13.152+0000 7f673266b640 1 -- 10.20.193.45:0/3657172203 >> v1:10.20.193.45:6792/0 conn(0x7f6710010a80 legacy=0x7f6710009950 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.45:6792/0 2026-02-22T23:26:14.751 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:14.749+0000 7f671b7fe640 10 monclient(hunting): tick 2026-02-22T23:26:14.751 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:14.749+0000 7f671b7fe640 10 monclient(hunting): _check_auth_tickets 2026-02-22T23:26:14.751 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:14.749+0000 7f671b7fe640 1 monclient(hunting): continuing hunt 2026-02-22T23:26:14.751 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:14.749+0000 7f671b7fe640 10 monclient(hunting): _reopen_session rank -1 2026-02-22T23:26:14.751 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:14.749+0000 7f671b7fe640 1 -- 10.20.193.45:0/3657172203 >> v1:10.20.193.45:6793/0 conn(0x7f6710010070 legacy=0x7f6710005cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:26:14.751 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:14.749+0000 7f671b7fe640 1 -- 10.20.193.45:0/3657172203 >> v1:10.20.193.45:6792/0 conn(0x7f6710010a80 legacy=0x7f6710009950 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-22T23:26:14.751 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:14.749+0000 7f671b7fe640 1 -- 10.20.193.45:0/3657172203 >> v1:10.20.193.73:6790/0 conn(0x7f6710010480 legacy=0x7f671000d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:26:14.751 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:14.749+0000 7f671b7fe640 10 monclient: _add_conns ranks=[7,1,6,5,4,8,0,2,3] 2026-02-22T23:26:14.752 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:14.749+0000 7f671b7fe640 10 monclient(hunting): picked mon.noname-i con 0x7f671000e040 addr v1:10.20.193.73:6792/0 2026-02-22T23:26:14.752 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:14.749+0000 7f671b7fe640 10 monclient(hunting): picked mon.noname-f con 0x7f6710012740 addr v1:10.20.193.73:6789/0 2026-02-22T23:26:14.752 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:14.749+0000 7f671b7fe640 10 monclient(hunting): picked mon.noname-d con 0x7f6710010a80 addr v1:10.20.193.45:6792/0 2026-02-22T23:26:14.752 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:14.749+0000 7f671b7fe640 1 -- 10.20.193.45:0/3657172203 --> v1:10.20.193.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f67100137a0 con 0x7f6710012740 2026-02-22T23:26:14.752 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:14.749+0000 7f671b7fe640 1 -- 10.20.193.45:0/3657172203 --> v1:10.20.193.45:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f672c143400 con 0x7f6710010a80 2026-02-22T23:26:14.752 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:14.749+0000 7f671b7fe640 1 -- 10.20.193.45:0/3657172203 --> v1:10.20.193.73:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6710013260 con 0x7f671000e040 2026-02-22T23:26:14.752 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:14.749+0000 7f671b7fe640 10 monclient(hunting): _renew_subs 2026-02-22T23:26:14.752 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:14.749+0000 7f673266b640 1 -- 10.20.193.45:0/3657172203 >> v1:10.20.193.45:6792/0 conn(0x7f6710010a80 legacy=0x7f6710009930 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.45:6792/0 2026-02-22T23:26:14.752 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:14.749+0000 7f6731669640 1 -- 10.20.193.45:0/3657172203 >> v1:10.20.193.73:6789/0 conn(0x7f6710012740 legacy=0x7f6710012b50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.73:6789/0 2026-02-22T23:26:14.865 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:14.864+0000 7f6730e68640 1 -- 10.20.193.45:0/3657172203 <== mon.7 v1:10.20.193.73:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2881543040 0 0) 0x7f6710013260 con 0x7f671000e040 2026-02-22T23:26:14.865 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:14.864+0000 7f6730e68640 10 monclient(hunting): _negotiate 2026-02-22T23:26:14.866 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:14.864+0000 7f6730e68640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:26:14.866 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:14.864+0000 7f6730e68640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:26:14.866 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:14.864+0000 7f6730e68640 10 monclient(hunting): my global_id is 4444 2026-02-22T23:26:14.866 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:14.864+0000 7f6730e68640 1 -- 10.20.193.45:0/3657172203 --> v1:10.20.193.73:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6714003620 con 0x7f671000e040 2026-02-22T23:26:14.866 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:14.865+0000 7f6730e68640 1 -- 10.20.193.45:0/3657172203 <== mon.7 v1:10.20.193.73:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 794290090 0 0) 0x7f6714003620 con 0x7f671000e040 2026-02-22T23:26:14.866 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:14.865+0000 7f6730e68640 1 -- 10.20.193.45:0/3657172203 >> v1:10.20.193.45:6792/0 conn(0x7f6710010a80 legacy=0x7f6710009930 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-22T23:26:14.866 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:14.865+0000 7f6730e68640 1 -- 10.20.193.45:0/3657172203 >> v1:10.20.193.73:6789/0 conn(0x7f6710012740 legacy=0x7f6710012b50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-22T23:26:14.866 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:14.865+0000 7f6730e68640 10 monclient: _finish_hunting 0 2026-02-22T23:26:14.866 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:14.865+0000 7f6730e68640 1 monclient: found mon.noname-i 2026-02-22T23:26:14.866 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:14.865+0000 7f6730e68640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T23:26:14.866 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:14.865+0000 7f6730e68640 10 monclient: _send_mon_message to mon.noname-i at v1:10.20.193.73:6792/0 2026-02-22T23:26:14.866 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:14.865+0000 7f6730e68640 1 -- 10.20.193.45:0/3657172203 --> v1:10.20.193.73:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6710013430 con 0x7f671000e040 2026-02-22T23:26:14.866 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:14.865+0000 7f6730e68640 10 monclient: _finish_auth 0 2026-02-22T23:26:14.866 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:14.865+0000 7f6730e68640 10 monclient: _check_auth_tickets 2026-02-22T23:26:14.866 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:14.865+0000 7f6730e68640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T23:26:14.866 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:14.865+0000 7f6730e68640 1 -- 10.20.193.45:0/3657172203 <== mon.7 v1:10.20.193.73:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f671c003040 con 0x7f671000e040 2026-02-22T23:26:14.866 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:14.865+0000 7f67340f5640 5 monclient: authenticate success, global_id 4444 2026-02-22T23:26:14.866 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:14.865+0000 7f67340f5640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-22T23:26:14.866 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:14.865+0000 7f6730e68640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:26:14.866 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:14.865+0000 7f6730e68640 10 monclient: got monmap 1 from mon.noname-i (according to old e1) 2026-02-22T23:26:14.866 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:14.865+0000 7f6730e68640 10 monclient: dump: 2026-02-22T23:26:14.866 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:26:14.866 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:26:14.866 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:26:14.866 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:26:14.866 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:26:14.867 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:26:14.867 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:26:14.867 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:26:14.867 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:26:14.867 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:26:14.867 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:26:14.867 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:26:14.867 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:26:14.867 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:26:14.867 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:26:14.867 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:26:14.867 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:14.865+0000 7f67340f5640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-22T23:26:14.867 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:14.866+0000 7f6730e68640 1 -- 10.20.193.45:0/3657172203 <== mon.7 v1:10.20.193.73:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f671c0031e0 con 0x7f671000e040 2026-02-22T23:26:14.867 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:14.866+0000 7f6730e68640 10 monclient: handle_config config(0 keys) 2026-02-22T23:26:14.867 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:14.866+0000 7f6730e68640 1 -- 10.20.193.45:0/3657172203 <== mon.7 v1:10.20.193.73:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f671c004ce0 con 0x7f671000e040 2026-02-22T23:26:14.867 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:14.866+0000 7f6730e68640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:26:14.867 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:14.866+0000 7f6730e68640 10 monclient: got monmap 1 from mon.i (according to old e1) 2026-02-22T23:26:14.867 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:14.866+0000 7f6730e68640 10 monclient: dump: 2026-02-22T23:26:14.867 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:26:14.867 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:26:14.867 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:26:14.867 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:26:14.867 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:26:14.867 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:26:14.867 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:26:14.867 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:26:14.867 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:26:14.867 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:26:14.867 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:26:14.867 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:26:14.867 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:26:14.867 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:26:14.867 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:26:14.867 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:26:14.868 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:14.866+0000 7f67340f5640 10 monclient: get_monmap_and_config success 2026-02-22T23:26:14.868 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:14.866+0000 7f67340f5640 4 set_mon_vals no callback set 2026-02-22T23:26:14.868 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:14.866+0000 7f67340f5640 10 monclient: shutdown 2026-02-22T23:26:14.868 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:14.866+0000 7f67340f5640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T23:26:14.868 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:14.866+0000 7f67340f5640 1 -- 10.20.193.45:0/3657172203 >> v1:10.20.193.73:6792/0 conn(0x7f671000e040 legacy=0x7f671000e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:26:14.868 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:14.866+0000 7f673266b640 1 -- 10.20.193.45:0/3657172203 reap_dead start 2026-02-22T23:26:14.868 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:14.866+0000 7f67340f5640 1 -- 10.20.193.45:0/3657172203 shutdown_connections 2026-02-22T23:26:14.868 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:14.866+0000 7f67340f5640 1 -- 10.20.193.45:0/3657172203 >> 10.20.193.45:0/3657172203 conn(0x7f672c0a7780 msgr2=0x7f672c0a3b60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:26:14.868 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:14.867+0000 7f67340f5640 1 -- 10.20.193.45:0/3657172203 shutdown_connections 2026-02-22T23:26:14.868 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:14.867+0000 7f67340f5640 1 -- 10.20.193.45:0/3657172203 wait complete. 2026-02-22T23:26:14.868 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:14.867+0000 7f67340f5640 10 monclient: build_initial_monmap 2026-02-22T23:26:14.868 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:14.867+0000 7f67340f5640 10 monclient: monmap: 2026-02-22T23:26:14.868 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-22T23:26:14.868 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T23:26:14.868 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-22T23:26:14.868 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-22T23:26:14.868 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-22T23:26:14.868 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-22T23:26:14.868 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-22T23:26:14.868 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.noname-f 2026-02-22T23:26:14.868 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.noname-b 2026-02-22T23:26:14.868 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.noname-g 2026-02-22T23:26:14.868 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.noname-c 2026-02-22T23:26:14.868 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.noname-h 2026-02-22T23:26:14.868 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.noname-d 2026-02-22T23:26:14.868 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.noname-i 2026-02-22T23:26:14.868 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.noname-e 2026-02-22T23:26:14.868 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:26:14.870 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:14.867+0000 7f67340f5640 1 Processor -- start 2026-02-22T23:26:14.870 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:14.867+0000 7f67340f5640 1 -- start start 2026-02-22T23:26:14.870 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:14.867+0000 7f67340f5640 10 monclient: init 2026-02-22T23:26:14.870 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:14.868+0000 7f67340f5640 10 monclient: _reopen_session rank -1 2026-02-22T23:26:14.870 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:14.868+0000 7f67340f5640 10 monclient: _add_conns ranks=[8,1,0,2,4,3,5,7,6] 2026-02-22T23:26:14.870 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:14.868+0000 7f67340f5640 10 monclient(hunting): picked mon.noname-e con 0x7f671000e040 addr v1:10.20.193.45:6793/0 2026-02-22T23:26:14.870 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:14.868+0000 7f67340f5640 10 monclient(hunting): picked mon.noname-f con 0x7f672c1cb180 addr v1:10.20.193.73:6789/0 2026-02-22T23:26:14.870 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:14.868+0000 7f67340f5640 10 monclient(hunting): picked mon.noname-a con 0x7f672c136320 addr v1:10.20.193.45:6789/0 2026-02-22T23:26:14.870 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:14.868+0000 7f67340f5640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f672c1232f0 con 0x7f672c136320 2026-02-22T23:26:14.870 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:14.868+0000 7f67340f5640 1 -- --> v1:10.20.193.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f672c0a0490 con 0x7f672c1cb180 2026-02-22T23:26:14.870 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:14.868+0000 7f67340f5640 1 -- --> v1:10.20.193.45:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f672c09ffb0 con 0x7f671000e040 2026-02-22T23:26:14.870 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:14.868+0000 7f67340f5640 10 monclient(hunting): _renew_subs 2026-02-22T23:26:14.870 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:14.868+0000 7f67340f5640 10 monclient(hunting): authenticate will time out at 706.485149s 2026-02-22T23:26:14.870 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:14.868+0000 7f6731e6a640 1 --1- >> v1:10.20.193.45:6793/0 conn(0x7f671000e040 0x7f672c135c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.45:6793/0 says I am v1:10.20.193.45:54408/0 (socket says 10.20.193.45:54408) 2026-02-22T23:26:14.870 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:14.868+0000 7f6731e6a640 1 -- 10.20.193.45:0/1033577893 learned_addr learned my addr 10.20.193.45:0/1033577893 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-22T23:26:14.870 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:14.868+0000 7f6731669640 1 -- 10.20.193.45:0/1033577893 >> v1:10.20.193.73:6789/0 conn(0x7f672c1cb180 legacy=0x7f672c1d0230 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.73:6789/0 2026-02-22T23:26:14.870 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:14.868+0000 7f671a7fc640 1 -- 10.20.193.45:0/1033577893 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 951091104 0 0) 0x7f672c1232f0 con 0x7f672c136320 2026-02-22T23:26:14.870 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:14.868+0000 7f671a7fc640 10 monclient(hunting): _negotiate 2026-02-22T23:26:14.870 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:14.868+0000 7f671a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:26:14.870 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:14.868+0000 7f671a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:26:14.870 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:14.868+0000 7f671a7fc640 10 monclient(hunting): my global_id is 4473 2026-02-22T23:26:14.870 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:14.868+0000 7f671a7fc640 1 -- 10.20.193.45:0/1033577893 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f66fc003620 con 0x7f672c136320 2026-02-22T23:26:14.870 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:14.868+0000 7f671a7fc640 1 -- 10.20.193.45:0/1033577893 <== mon.8 v1:10.20.193.45:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 134001513 0 0) 0x7f672c09ffb0 con 0x7f671000e040 2026-02-22T23:26:14.870 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:14.868+0000 7f671a7fc640 10 monclient(hunting): _negotiate 2026-02-22T23:26:14.870 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:14.868+0000 7f671a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:26:14.870 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:14.868+0000 7f671a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:26:14.870 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:14.868+0000 7f671a7fc640 10 monclient(hunting): my global_id is 4517 2026-02-22T23:26:14.870 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:14.868+0000 7f671a7fc640 1 -- 10.20.193.45:0/1033577893 --> v1:10.20.193.45:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f672c1232f0 con 0x7f671000e040 2026-02-22T23:26:14.870 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:14.868+0000 7f671a7fc640 1 -- 10.20.193.45:0/1033577893 <== mon.0 v1:10.20.193.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3793344675 0 0) 0x7f66fc003620 con 0x7f672c136320 2026-02-22T23:26:14.870 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:14.868+0000 7f671a7fc640 1 -- 10.20.193.45:0/1033577893 --> v1:10.20.193.45:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f672c09ffb0 con 0x7f672c136320 2026-02-22T23:26:14.870 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:14.868+0000 7f671a7fc640 1 -- 10.20.193.45:0/1033577893 <== mon.0 v1:10.20.193.45:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f67280033d0 con 0x7f672c136320 2026-02-22T23:26:14.870 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:14.868+0000 7f671a7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-22T23:26:14.871 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:14.868+0000 7f671a7fc640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T23:26:14.871 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:14.868+0000 7f671a7fc640 10 monclient(hunting): dump: 2026-02-22T23:26:14.871 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:26:14.871 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:26:14.871 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:26:14.871 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:26:14.871 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:26:14.871 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:26:14.871 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:26:14.871 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:26:14.871 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:26:14.871 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:26:14.871 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:26:14.871 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:26:14.871 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:26:14.871 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:26:14.871 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:26:14.871 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:26:14.871 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:14.868+0000 7f671a7fc640 10 monclient(hunting): _finish_auth 0 2026-02-22T23:26:14.871 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:14.868+0000 7f671a7fc640 1 -- 10.20.193.45:0/1033577893 <== mon.8 v1:10.20.193.45:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1802096722 0 0) 0x7f672c1232f0 con 0x7f671000e040 2026-02-22T23:26:14.871 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:14.868+0000 7f671a7fc640 1 -- 10.20.193.45:0/1033577893 --> v1:10.20.193.45:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f66fc003620 con 0x7f671000e040 2026-02-22T23:26:14.871 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:14.868+0000 7f671a7fc640 1 -- 10.20.193.45:0/1033577893 <== mon.8 v1:10.20.193.45:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f671c0048e0 con 0x7f671000e040 2026-02-22T23:26:14.871 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:14.868+0000 7f671a7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-22T23:26:14.871 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:14.868+0000 7f671a7fc640 10 monclient(hunting): got monmap 1 from mon.e (according to old e1) 2026-02-22T23:26:14.871 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:14.868+0000 7f671a7fc640 10 monclient(hunting): dump: 2026-02-22T23:26:14.871 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:26:14.871 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:26:14.871 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:26:14.871 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:26:14.871 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:26:14.871 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:26:14.871 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:26:14.871 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:26:14.871 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:26:14.871 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:26:14.871 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:26:14.871 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:26:14.871 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:26:14.871 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:26:14.871 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:26:14.871 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:26:14.871 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:14.868+0000 7f671a7fc640 1 -- 10.20.193.45:0/1033577893 <== mon.0 v1:10.20.193.45:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1516088453 0 0) 0x7f672c09ffb0 con 0x7f672c136320 2026-02-22T23:26:14.871 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:14.868+0000 7f671a7fc640 1 -- 10.20.193.45:0/1033577893 >> v1:10.20.193.45:6793/0 conn(0x7f671000e040 legacy=0x7f672c135c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:26:14.871 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:14.868+0000 7f671a7fc640 1 -- 10.20.193.45:0/1033577893 >> v1:10.20.193.73:6789/0 conn(0x7f672c1cb180 legacy=0x7f672c1d0230 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-22T23:26:14.871 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:14.868+0000 7f671a7fc640 10 monclient: _finish_hunting 0 2026-02-22T23:26:14.871 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:14.868+0000 7f671a7fc640 1 monclient: found mon.a 2026-02-22T23:26:14.872 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:14.868+0000 7f671a7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T23:26:14.872 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:14.868+0000 7f671a7fc640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-22T23:26:14.872 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:14.868+0000 7f671a7fc640 1 -- 10.20.193.45:0/1033577893 --> v1:10.20.193.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f672c123010 con 0x7f672c136320 2026-02-22T23:26:14.872 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:14.868+0000 7f671a7fc640 10 monclient: _finish_auth 0 2026-02-22T23:26:14.872 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:14.868+0000 7f671a7fc640 10 monclient: _check_auth_tickets 2026-02-22T23:26:14.872 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:14.868+0000 7f671a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T23:26:14.872 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:14.868+0000 7f67340f5640 5 monclient: authenticate success, global_id 4473 2026-02-22T23:26:14.872 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:14.868+0000 7f67340f5640 10 monclient: _renew_subs 2026-02-22T23:26:14.872 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:14.868+0000 7f67340f5640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-22T23:26:14.872 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:14.868+0000 7f67340f5640 1 -- 10.20.193.45:0/1033577893 --> v1:10.20.193.45:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f672c122d30 con 0x7f672c136320 2026-02-22T23:26:14.872 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:14.868+0000 7f67340f5640 10 monclient: _renew_subs 2026-02-22T23:26:14.872 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:14.868+0000 7f67340f5640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-22T23:26:14.872 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:14.868+0000 7f67340f5640 1 -- 10.20.193.45:0/1033577893 --> v1:10.20.193.45:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f672c1d5080 con 0x7f672c136320 2026-02-22T23:26:14.872 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:14.868+0000 7f671a7fc640 1 -- 10.20.193.45:0/1033577893 <== mon.0 v1:10.20.193.45:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f67280038c0 con 0x7f672c136320 2026-02-22T23:26:14.872 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:14.868+0000 7f671a7fc640 10 monclient: handle_config config(0 keys) 2026-02-22T23:26:14.872 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:14.868+0000 7f671a7fc640 1 -- 10.20.193.45:0/1033577893 <== mon.0 v1:10.20.193.45:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f6728003dd0 con 0x7f672c136320 2026-02-22T23:26:14.872 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:14.868+0000 7f671a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:26:14.872 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:14.868+0000 7f671bfff640 4 set_mon_vals no callback set 2026-02-22T23:26:14.872 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:14.868+0000 7f671a7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T23:26:14.872 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:14.868+0000 7f671a7fc640 10 monclient: dump: 2026-02-22T23:26:14.872 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:26:14.872 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:26:14.872 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:26:14.872 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:26:14.872 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:26:14.872 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:26:14.872 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:26:14.872 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:26:14.872 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:26:14.872 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:26:14.872 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:26:14.872 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:26:14.872 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:26:14.872 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:26:14.872 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:26:14.872 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:26:14.872 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:14.869+0000 7f67340f5640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T23:26:14.872 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:14.869+0000 7f67340f5640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T23:26:14.872 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:14.869+0000 7f67340f5640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-22T23:26:14.872 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:14.869+0000 7f67340f5640 1 -- 10.20.193.45:0/1033577893 --> v1:10.20.193.45:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f672c0008d0 con 0x7f672c136320 2026-02-22T23:26:14.872 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:14.869+0000 7f671a7fc640 1 -- 10.20.193.45:0/1033577893 <== mon.0 v1:10.20.193.45:6789/0 7 ==== mgrmap(e 5) ==== 50225+0+0 (unknown 2330357642 0 0) 0x7f6728003ff0 con 0x7f672c136320 2026-02-22T23:26:14.873 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:14.869+0000 7f671a7fc640 1 -- 10.20.193.45:0/1033577893 <== mon.0 v1:10.20.193.45:6789/0 8 ==== osd_map(21..21 src has 1..21) ==== 3921+0+0 (unknown 4068336701 0 0) 0x7f672804dc60 con 0x7f672c136320 2026-02-22T23:26:14.873 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:14.869+0000 7f6731e6a640 10 monclient: get_auth_request con 0x7f66fc03fd60 auth_method 0 2026-02-22T23:26:14.873 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:14.872+0000 7f671a7fc640 1 -- 10.20.193.45:0/1033577893 <== mon.0 v1:10.20.193.45:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (unknown 1092875540 0 2568732696) 0x7f672c09df00 con 0x7f672c136320 2026-02-22T23:26:14.873 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:14.872+0000 7f671a7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T23:26:14.873 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:14.872+0000 7f671a7fc640 10 monclient: _finish_command 1 = system:0 2026-02-22T23:26:14.988 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:14.987+0000 7f67340f5640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-22T23:26:14.989 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:14.987+0000 7f67340f5640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-22T23:26:14.989 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:14.987+0000 7f67340f5640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-22T23:26:14.989 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:14.987+0000 7f67340f5640 1 -- 10.20.193.45:0/1033577893 --> v1:10.20.193.45:6789/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f672c136a50 con 0x7f672c136320 2026-02-22T23:26:14.989 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:14.988+0000 7f671a7fc640 1 -- 10.20.193.45:0/1033577893 <== mon.0 v1:10.20.193.45:6789/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+2689 (unknown 254746657 0 491976506) 0x7f67280176d0 con 0x7f672c136320 2026-02-22T23:26:14.989 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:14.988+0000 7f671a7fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-22T23:26:14.989 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:14.988+0000 7f671a7fc640 10 monclient: _finish_command 2 = system:0 2026-02-22T23:26:14.989 INFO:teuthology.orchestra.run.trial045.stdout:{"election_epoch":22,"quorum":[0,2,3,7,8],"quorum_names":["a","b","g","i","e"],"quorum_leader_name":"e","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"4b60f18f-6660-4731-b731-dc85c4078413","modified":"2026-02-22T23:24:52.393472Z","created":"2026-02-22T23:24:52.393472Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":3,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.45:6789","nonce":0}]},"addr":"10.20.193.45:6789/0","public_addr":"10.20.193.45:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.73:6789","nonce":0}]},"addr":"10.20.193.73:6789/0","public_addr":"10.20.193.73:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.45:6790","nonce":0}]},"addr":"10.20.193.45:6790/0","public_addr":"10.20.193.45:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.73:6790","nonce":0}]},"addr":"10.20.193.73:6790/0","public_addr":"10.20.193.73:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.45:6791","nonce":0}]},"addr":"10.20.193.45:6791/0","public_addr":"10.20.193.45:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.73:6791","nonce":0}]},"addr":"10.20.193.73:6791/0","public_addr":"10.20.193.73:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.45:6792","nonce":0}]},"addr":"10.20.193.45:6792/0","public_addr":"10.20.193.45:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.73:6792","nonce":0}]},"addr":"10.20.193.73:6792/0","public_addr":"10.20.193.73:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.45:6793","nonce":0}]},"addr":"10.20.193.45:6793/0","public_addr":"10.20.193.45:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-22T23:26:14.989 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:14.988+0000 7f67340f5640 1 -- 10.20.193.45:0/1033577893 >> v1:10.20.193.73:6800/2222410180 conn(0x7f66fc03fd60 legacy=0x7f66fc042220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:26:14.989 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:14.988+0000 7f67340f5640 10 monclient: shutdown 2026-02-22T23:26:14.989 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:14.988+0000 7f67340f5640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T23:26:14.989 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:14.988+0000 7f67340f5640 1 -- 10.20.193.45:0/1033577893 >> v1:10.20.193.45:6789/0 conn(0x7f672c136320 legacy=0x7f672c1d3960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:26:14.989 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:14.988+0000 7f67340f5640 1 -- 10.20.193.45:0/1033577893 shutdown_connections 2026-02-22T23:26:14.989 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:14.988+0000 7f67340f5640 1 -- 10.20.193.45:0/1033577893 >> 10.20.193.45:0/1033577893 conn(0x7f672c0a7780 msgr2=0x7f672c09ef10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:26:14.989 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:14.988+0000 7f67340f5640 1 -- 10.20.193.45:0/1033577893 shutdown_connections 2026-02-22T23:26:14.990 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:14.988+0000 7f67340f5640 1 -- 10.20.193.45:0/1033577893 wait complete. 2026-02-22T23:26:14.997 INFO:tasks.mon_thrash.ceph_manager:quorum is size 5 2026-02-22T23:26:14.997 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 5 for mon a 2026-02-22T23:26:14.997 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-22T23:26:15.066 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.065+0000 7fa7fbaa9640 10 monclient: get_monmap_and_config 2026-02-22T23:26:15.066 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.065+0000 7fa7fbaa9640 10 monclient: build_initial_monmap 2026-02-22T23:26:15.067 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.065+0000 7fa7fbaa9640 10 monclient: monmap: 2026-02-22T23:26:15.067 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-22T23:26:15.067 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:26:15.067 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:26:15.066502+0000 2026-02-22T23:26:15.067 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:26:15.066502+0000 2026-02-22T23:26:15.067 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-22T23:26:15.067 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:26:15.067 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-22T23:26:15.067 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.noname-f 2026-02-22T23:26:15.067 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.noname-b 2026-02-22T23:26:15.067 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.noname-g 2026-02-22T23:26:15.067 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.noname-c 2026-02-22T23:26:15.067 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.noname-h 2026-02-22T23:26:15.068 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.noname-d 2026-02-22T23:26:15.068 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.noname-i 2026-02-22T23:26:15.068 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.noname-e 2026-02-22T23:26:15.068 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:26:15.068 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.065+0000 7fa7fbaa9640 1 Processor -- start 2026-02-22T23:26:15.068 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.065+0000 7fa7fbaa9640 1 -- start start 2026-02-22T23:26:15.068 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.065+0000 7fa7fbaa9640 10 monclient: init 2026-02-22T23:26:15.075 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.065+0000 7fa7fbaa9640 10 monclient: _reopen_session rank -1 2026-02-22T23:26:15.075 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.065+0000 7fa7fbaa9640 10 monclient: _add_conns ranks=[7,2,6,5,0,1,4,8,3] 2026-02-22T23:26:15.075 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.065+0000 7fa7fbaa9640 10 monclient(hunting): picked mon.noname-i con 0x7fa7f40a1a60 addr v1:10.20.193.73:6792/0 2026-02-22T23:26:15.075 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.065+0000 7fa7fbaa9640 10 monclient(hunting): picked mon.noname-b con 0x7fa7f406f1e0 addr v1:10.20.193.45:6790/0 2026-02-22T23:26:15.075 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.066+0000 7fa7fbaa9640 10 monclient(hunting): picked mon.noname-d con 0x7fa7f40a0980 addr v1:10.20.193.45:6792/0 2026-02-22T23:26:15.075 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.066+0000 7fa7fbaa9640 1 -- --> v1:10.20.193.45:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa7f409df00 con 0x7fa7f406f1e0 2026-02-22T23:26:15.075 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.066+0000 7fa7fbaa9640 1 -- --> v1:10.20.193.45:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa7f4137660 con 0x7fa7f40a0980 2026-02-22T23:26:15.075 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.066+0000 7fa7fbaa9640 1 -- --> v1:10.20.193.73:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa7f40a4510 con 0x7fa7f40a1a60 2026-02-22T23:26:15.075 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.066+0000 7fa7fbaa9640 10 monclient(hunting): _renew_subs 2026-02-22T23:26:15.076 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.066+0000 7fa7fbaa9640 10 monclient(hunting): authenticate will time out at 706.683027s 2026-02-22T23:26:15.076 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.066+0000 7fa7fa01f640 1 -- >> v1:10.20.193.45:6792/0 conn(0x7fa7f40a0980 legacy=0x7fa7f413ecb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.45:6792/0 2026-02-22T23:26:15.076 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.066+0000 7fa7f901d640 1 --1- >> v1:10.20.193.45:6790/0 conn(0x7fa7f406f1e0 0x7fa7f4136f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.45:6790/0 says I am v1:10.20.193.45:46210/0 (socket says 10.20.193.45:46210) 2026-02-22T23:26:15.076 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.066+0000 7fa7f901d640 1 -- 10.20.193.45:0/2353566839 learned_addr learned my addr 10.20.193.45:0/2353566839 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-22T23:26:15.076 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.066+0000 7fa7f881c640 1 -- 10.20.193.45:0/2353566839 <== mon.2 v1:10.20.193.45:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1288948034 0 0) 0x7fa7e8002920 con 0x7fa7f406f1e0 2026-02-22T23:26:15.076 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.066+0000 7fa7f881c640 10 monclient(hunting): _negotiate 2026-02-22T23:26:15.076 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.066+0000 7fa7f881c640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:26:15.076 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.066+0000 7fa7f881c640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:26:15.076 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.066+0000 7fa7f881c640 10 monclient(hunting): my global_id is 4574 2026-02-22T23:26:15.076 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.066+0000 7fa7f881c640 1 -- 10.20.193.45:0/2353566839 --> v1:10.20.193.45:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa7dc003620 con 0x7fa7f406f1e0 2026-02-22T23:26:15.076 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.066+0000 7fa7f881c640 1 -- 10.20.193.45:0/2353566839 <== mon.2 v1:10.20.193.45:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1326356529 0 0) 0x7fa7dc003620 con 0x7fa7f406f1e0 2026-02-22T23:26:15.076 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.066+0000 7fa7f881c640 1 -- 10.20.193.45:0/2353566839 >> v1:10.20.193.73:6792/0 conn(0x7fa7f40a1a60 legacy=0x7fa7f4136840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T23:26:15.076 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.066+0000 7fa7f881c640 1 -- 10.20.193.45:0/2353566839 >> v1:10.20.193.45:6792/0 conn(0x7fa7f40a0980 legacy=0x7fa7f413ecb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-22T23:26:15.076 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.066+0000 7fa7f881c640 10 monclient: _finish_hunting 0 2026-02-22T23:26:15.077 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.066+0000 7fa7f881c640 1 monclient: found mon.noname-b 2026-02-22T23:26:15.077 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.066+0000 7fa7f881c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T23:26:15.077 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.066+0000 7fa7f881c640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.45:6790/0 2026-02-22T23:26:15.077 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.066+0000 7fa7f881c640 1 -- 10.20.193.45:0/2353566839 --> v1:10.20.193.45:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7f4143400 con 0x7fa7f406f1e0 2026-02-22T23:26:15.077 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.066+0000 7fa7f881c640 10 monclient: _finish_auth 0 2026-02-22T23:26:15.077 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.066+0000 7fa7f881c640 10 monclient: _check_auth_tickets 2026-02-22T23:26:15.077 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.066+0000 7fa7f881c640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T23:26:15.077 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.066+0000 7fa7f881c640 1 -- 10.20.193.45:0/2353566839 <== mon.2 v1:10.20.193.45:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7fa7e8003210 con 0x7fa7f406f1e0 2026-02-22T23:26:15.077 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.066+0000 7fa7fbaa9640 5 monclient: authenticate success, global_id 4574 2026-02-22T23:26:15.077 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.066+0000 7fa7fbaa9640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-22T23:26:15.077 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.066+0000 7fa7f881c640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:26:15.077 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.066+0000 7fa7f881c640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-22T23:26:15.077 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.066+0000 7fa7f881c640 10 monclient: dump: 2026-02-22T23:26:15.077 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:26:15.077 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:26:15.077 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:26:15.078 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:26:15.078 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:26:15.078 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:26:15.078 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:26:15.078 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:26:15.078 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:26:15.078 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:26:15.078 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:26:15.078 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:26:15.078 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:26:15.078 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:26:15.078 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:26:15.078 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:26:15.078 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.066+0000 7fa7fbaa9640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-22T23:26:15.078 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.066+0000 7fa7f881c640 1 -- 10.20.193.45:0/2353566839 <== mon.2 v1:10.20.193.45:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa7e8003470 con 0x7fa7f406f1e0 2026-02-22T23:26:15.078 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.066+0000 7fa7f881c640 10 monclient: handle_config config(0 keys) 2026-02-22T23:26:15.078 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.066+0000 7fa7fbaa9640 10 monclient: get_monmap_and_config success 2026-02-22T23:26:15.078 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.066+0000 7fa7fbaa9640 4 set_mon_vals no callback set 2026-02-22T23:26:15.079 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.066+0000 7fa7f881c640 1 -- 10.20.193.45:0/2353566839 <== mon.2 v1:10.20.193.45:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7fa7e8004ce0 con 0x7fa7f406f1e0 2026-02-22T23:26:15.079 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.066+0000 7fa7f881c640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:26:15.079 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.066+0000 7fa7f881c640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-22T23:26:15.079 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.066+0000 7fa7f881c640 10 monclient: dump: 2026-02-22T23:26:15.079 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:26:15.079 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:26:15.079 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:26:15.079 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:26:15.079 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:26:15.079 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:26:15.079 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:26:15.079 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:26:15.079 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:26:15.079 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:26:15.079 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:26:15.079 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:26:15.079 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:26:15.079 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:26:15.079 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:26:15.079 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:26:15.080 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.066+0000 7fa7fbaa9640 10 monclient: shutdown 2026-02-22T23:26:15.080 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.066+0000 7fa7fbaa9640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T23:26:15.080 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.066+0000 7fa7fbaa9640 1 -- 10.20.193.45:0/2353566839 >> v1:10.20.193.45:6790/0 conn(0x7fa7f406f1e0 legacy=0x7fa7f4136f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:26:15.080 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.066+0000 7fa7fbaa9640 1 -- 10.20.193.45:0/2353566839 shutdown_connections 2026-02-22T23:26:15.080 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.066+0000 7fa7fbaa9640 1 -- 10.20.193.45:0/2353566839 >> 10.20.193.45:0/2353566839 conn(0x7fa7f40a7780 msgr2=0x7fa7f40a3b60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:26:15.080 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.066+0000 7fa7fbaa9640 1 -- 10.20.193.45:0/2353566839 shutdown_connections 2026-02-22T23:26:15.080 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.066+0000 7fa7fbaa9640 1 -- 10.20.193.45:0/2353566839 wait complete. 2026-02-22T23:26:15.080 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.067+0000 7fa7fbaa9640 10 monclient: build_initial_monmap 2026-02-22T23:26:15.080 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.067+0000 7fa7fbaa9640 10 monclient: monmap: 2026-02-22T23:26:15.080 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-22T23:26:15.080 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T23:26:15.080 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-22T23:26:15.080 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-22T23:26:15.080 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-22T23:26:15.080 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-22T23:26:15.080 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-22T23:26:15.080 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.noname-f 2026-02-22T23:26:15.080 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.noname-b 2026-02-22T23:26:15.081 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.noname-g 2026-02-22T23:26:15.081 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.noname-c 2026-02-22T23:26:15.081 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.noname-h 2026-02-22T23:26:15.081 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.noname-d 2026-02-22T23:26:15.081 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.noname-i 2026-02-22T23:26:15.081 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.noname-e 2026-02-22T23:26:15.081 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:26:15.081 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.067+0000 7fa7fbaa9640 1 Processor -- start 2026-02-22T23:26:15.081 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.067+0000 7fa7fbaa9640 1 -- start start 2026-02-22T23:26:15.081 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.067+0000 7fa7fbaa9640 10 monclient: init 2026-02-22T23:26:15.081 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.067+0000 7fa7fbaa9640 10 monclient: _reopen_session rank -1 2026-02-22T23:26:15.081 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.067+0000 7fa7fbaa9640 10 monclient: _add_conns ranks=[1,8,2,4,5,0,3,6,7] 2026-02-22T23:26:15.081 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.067+0000 7fa7fbaa9640 10 monclient(hunting): picked mon.noname-f con 0x7fa7f40a0980 addr v1:10.20.193.73:6789/0 2026-02-22T23:26:15.081 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.067+0000 7fa7fbaa9640 10 monclient(hunting): picked mon.noname-e con 0x7fa7f40a1a60 addr v1:10.20.193.45:6793/0 2026-02-22T23:26:15.081 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.067+0000 7fa7fbaa9640 10 monclient(hunting): picked mon.noname-b con 0x7fa7f409f5e0 addr v1:10.20.193.45:6790/0 2026-02-22T23:26:15.081 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.067+0000 7fa7fbaa9640 1 -- --> v1:10.20.193.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa7f4126480 con 0x7fa7f40a0980 2026-02-22T23:26:15.081 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.067+0000 7fa7fbaa9640 1 -- --> v1:10.20.193.45:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa7f40a0220 con 0x7fa7f409f5e0 2026-02-22T23:26:15.081 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.067+0000 7fa7fbaa9640 1 -- --> v1:10.20.193.45:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa7f41261a0 con 0x7fa7f40a1a60 2026-02-22T23:26:15.081 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.067+0000 7fa7fbaa9640 10 monclient(hunting): _renew_subs 2026-02-22T23:26:15.081 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.067+0000 7fa7fbaa9640 10 monclient(hunting): authenticate will time out at 706.684571s 2026-02-22T23:26:15.082 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.067+0000 7fa7f981e640 1 -- >> v1:10.20.193.73:6789/0 conn(0x7fa7f40a0980 legacy=0x7fa7f413e5c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.73:6789/0 2026-02-22T23:26:15.082 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.067+0000 7fa7f901d640 1 --1- >> v1:10.20.193.45:6793/0 conn(0x7fa7f40a1a60 0x7fa7f41d46c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.45:6793/0 says I am v1:10.20.193.45:54420/0 (socket says 10.20.193.45:54420) 2026-02-22T23:26:15.082 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.067+0000 7fa7fa01f640 1 --1- >> v1:10.20.193.45:6790/0 conn(0x7fa7f409f5e0 0x7fa7f41d7df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.45:6790/0 says I am v1:10.20.193.45:46224/0 (socket says 10.20.193.45:46224) 2026-02-22T23:26:15.082 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.067+0000 7fa7f901d640 1 -- 10.20.193.45:0/384249796 learned_addr learned my addr 10.20.193.45:0/384249796 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-22T23:26:15.082 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.067+0000 7fa7e27fc640 1 -- 10.20.193.45:0/384249796 <== mon.8 v1:10.20.193.45:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 98550986 0 0) 0x7fa7f41261a0 con 0x7fa7f40a1a60 2026-02-22T23:26:15.082 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.067+0000 7fa7e27fc640 10 monclient(hunting): _negotiate 2026-02-22T23:26:15.082 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.067+0000 7fa7e27fc640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:26:15.082 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.067+0000 7fa7e27fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:26:15.082 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.067+0000 7fa7e27fc640 10 monclient(hunting): my global_id is 4526 2026-02-22T23:26:15.082 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.067+0000 7fa7e27fc640 1 -- 10.20.193.45:0/384249796 --> v1:10.20.193.45:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa7c4003620 con 0x7fa7f40a1a60 2026-02-22T23:26:15.082 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.067+0000 7fa7e27fc640 1 -- 10.20.193.45:0/384249796 <== mon.2 v1:10.20.193.45:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1247013205 0 0) 0x7fa7f40a0220 con 0x7fa7f409f5e0 2026-02-22T23:26:15.082 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.067+0000 7fa7e27fc640 10 monclient(hunting): _negotiate 2026-02-22T23:26:15.082 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.067+0000 7fa7e27fc640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:26:15.082 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.067+0000 7fa7e27fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:26:15.082 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.067+0000 7fa7e27fc640 10 monclient(hunting): my global_id is 4583 2026-02-22T23:26:15.082 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.067+0000 7fa7e27fc640 1 -- 10.20.193.45:0/384249796 --> v1:10.20.193.45:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa7f41261a0 con 0x7fa7f409f5e0 2026-02-22T23:26:15.082 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.067+0000 7fa7e27fc640 1 -- 10.20.193.45:0/384249796 <== mon.8 v1:10.20.193.45:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 848629152 0 0) 0x7fa7c4003620 con 0x7fa7f40a1a60 2026-02-22T23:26:15.082 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.067+0000 7fa7e27fc640 1 -- 10.20.193.45:0/384249796 --> v1:10.20.193.45:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa7f40a0220 con 0x7fa7f40a1a60 2026-02-22T23:26:15.082 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.067+0000 7fa7e27fc640 1 -- 10.20.193.45:0/384249796 <== mon.8 v1:10.20.193.45:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7fa7e8004c20 con 0x7fa7f40a1a60 2026-02-22T23:26:15.082 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.067+0000 7fa7e27fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-22T23:26:15.083 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.067+0000 7fa7e27fc640 10 monclient(hunting): got monmap 1 from mon.noname-e (according to old e1) 2026-02-22T23:26:15.083 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.067+0000 7fa7e27fc640 10 monclient(hunting): dump: 2026-02-22T23:26:15.083 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:26:15.083 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:26:15.083 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:26:15.083 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:26:15.083 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:26:15.083 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:26:15.083 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:26:15.083 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:26:15.083 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:26:15.083 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:26:15.083 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:26:15.083 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:26:15.083 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:26:15.083 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:26:15.083 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:26:15.083 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:26:15.083 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.067+0000 7fa7e27fc640 10 monclient(hunting): _finish_auth 0 2026-02-22T23:26:15.083 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.067+0000 7fa7e27fc640 1 -- 10.20.193.45:0/384249796 <== mon.2 v1:10.20.193.45:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2844269793 0 0) 0x7fa7f41261a0 con 0x7fa7f409f5e0 2026-02-22T23:26:15.083 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.067+0000 7fa7e27fc640 1 -- 10.20.193.45:0/384249796 --> v1:10.20.193.45:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa7c4003620 con 0x7fa7f409f5e0 2026-02-22T23:26:15.084 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.067+0000 7fa7e27fc640 1 -- 10.20.193.45:0/384249796 <== mon.2 v1:10.20.193.45:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7fa7f0004650 con 0x7fa7f409f5e0 2026-02-22T23:26:15.084 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.067+0000 7fa7e27fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-22T23:26:15.084 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.067+0000 7fa7e27fc640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-22T23:26:15.084 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.067+0000 7fa7e27fc640 10 monclient(hunting): dump: 2026-02-22T23:26:15.084 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:26:15.084 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:26:15.084 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:26:15.084 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:26:15.084 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:26:15.084 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:26:15.084 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:26:15.084 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:26:15.084 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:26:15.084 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:26:15.084 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:26:15.084 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:26:15.084 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:26:15.084 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:26:15.084 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:26:15.084 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:26:15.084 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.067+0000 7fa7e27fc640 1 -- 10.20.193.45:0/384249796 <== mon.8 v1:10.20.193.45:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1612028831 0 0) 0x7fa7f40a0220 con 0x7fa7f40a1a60 2026-02-22T23:26:15.084 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.067+0000 7fa7e27fc640 1 -- 10.20.193.45:0/384249796 >> v1:10.20.193.45:6790/0 conn(0x7fa7f409f5e0 legacy=0x7fa7f41d7df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:26:15.085 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.067+0000 7fa7e27fc640 1 -- 10.20.193.45:0/384249796 >> v1:10.20.193.73:6789/0 conn(0x7fa7f40a0980 legacy=0x7fa7f413e5c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-22T23:26:15.085 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.067+0000 7fa7e27fc640 10 monclient: _finish_hunting 0 2026-02-22T23:26:15.085 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.067+0000 7fa7e27fc640 1 monclient: found mon.e 2026-02-22T23:26:15.085 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.067+0000 7fa7e27fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T23:26:15.085 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.067+0000 7fa7e27fc640 10 monclient: _send_mon_message to mon.e at v1:10.20.193.45:6793/0 2026-02-22T23:26:15.085 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.067+0000 7fa7e27fc640 1 -- 10.20.193.45:0/384249796 --> v1:10.20.193.45:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7f4125030 con 0x7fa7f40a1a60 2026-02-22T23:26:15.085 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.067+0000 7fa7e27fc640 10 monclient: _finish_auth 0 2026-02-22T23:26:15.085 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.067+0000 7fa7e27fc640 10 monclient: _check_auth_tickets 2026-02-22T23:26:15.085 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.067+0000 7fa7e27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T23:26:15.085 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.067+0000 7fa7fbaa9640 5 monclient: authenticate success, global_id 4526 2026-02-22T23:26:15.085 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.067+0000 7fa7fbaa9640 10 monclient: _renew_subs 2026-02-22T23:26:15.085 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.067+0000 7fa7fbaa9640 10 monclient: _send_mon_message to mon.e at v1:10.20.193.45:6793/0 2026-02-22T23:26:15.085 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.067+0000 7fa7fbaa9640 1 -- 10.20.193.45:0/384249796 --> v1:10.20.193.45:6793/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fa7f413fc00 con 0x7fa7f40a1a60 2026-02-22T23:26:15.085 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.068+0000 7fa7fbaa9640 10 monclient: _renew_subs 2026-02-22T23:26:15.085 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.068+0000 7fa7fbaa9640 10 monclient: _send_mon_message to mon.e at v1:10.20.193.45:6793/0 2026-02-22T23:26:15.085 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.068+0000 7fa7fbaa9640 1 -- 10.20.193.45:0/384249796 --> v1:10.20.193.45:6793/0 -- mon_subscribe({osdmap=0}) -- 0x7fa7f413eeb0 con 0x7fa7f40a1a60 2026-02-22T23:26:15.085 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.068+0000 7fa7e27fc640 1 -- 10.20.193.45:0/384249796 <== mon.8 v1:10.20.193.45:6793/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa7e8004fe0 con 0x7fa7f40a1a60 2026-02-22T23:26:15.085 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.068+0000 7fa7e27fc640 10 monclient: handle_config config(0 keys) 2026-02-22T23:26:15.085 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.068+0000 7fa7e27fc640 1 -- 10.20.193.45:0/384249796 <== mon.8 v1:10.20.193.45:6793/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7fa7e80054d0 con 0x7fa7f40a1a60 2026-02-22T23:26:15.085 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.068+0000 7fa7e27fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:26:15.085 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.068+0000 7fa7e3fff640 4 set_mon_vals no callback set 2026-02-22T23:26:15.085 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.068+0000 7fa7e27fc640 10 monclient: got monmap 1 from mon.e (according to old e1) 2026-02-22T23:26:15.086 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.068+0000 7fa7e27fc640 10 monclient: dump: 2026-02-22T23:26:15.086 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:26:15.086 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:26:15.086 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:26:15.086 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:26:15.086 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:26:15.086 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:26:15.086 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:26:15.086 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:26:15.086 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:26:15.086 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:26:15.086 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:26:15.086 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:26:15.086 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:26:15.086 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:26:15.086 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:26:15.086 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:26:15.086 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.068+0000 7fa7fbaa9640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T23:26:15.086 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.068+0000 7fa7fbaa9640 1 -- 10.20.193.45:0/384249796 --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fa7f409f9c0 con 0x7fa7f406f1e0 2026-02-22T23:26:15.086 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.068+0000 7fa7e27fc640 1 -- 10.20.193.45:0/384249796 <== mon.8 v1:10.20.193.45:6793/0 7 ==== mgrmap(e 5) ==== 50225+0+0 (unknown 2330357642 0 0) 0x7fa7e8011ab0 con 0x7fa7f40a1a60 2026-02-22T23:26:15.086 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.068+0000 7fa7e27fc640 1 -- 10.20.193.45:0/384249796 <== mon.8 v1:10.20.193.45:6793/0 8 ==== osd_map(21..21 src has 1..21) ==== 3921+0+0 (unknown 4068336701 0 0) 0x7fa7e804dee0 con 0x7fa7f40a1a60 2026-02-22T23:26:15.086 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.068+0000 7fa7e27fc640 1 -- 10.20.193.45:0/384249796 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2588663382 0 0) 0x7fa7f409f9c0 con 0x7fa7f406f1e0 2026-02-22T23:26:15.086 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.068+0000 7fa7e27fc640 10 monclient(hunting): _negotiate 2026-02-22T23:26:15.087 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.068+0000 7fa7e27fc640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:26:15.087 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.068+0000 7fa7e27fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:26:15.087 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.068+0000 7fa7e27fc640 10 monclient(hunting): my global_id is 4482 2026-02-22T23:26:15.087 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.068+0000 7fa7e27fc640 1 -- 10.20.193.45:0/384249796 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa7f40a0220 con 0x7fa7f406f1e0 2026-02-22T23:26:15.087 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.068+0000 7fa7e27fc640 1 -- 10.20.193.45:0/384249796 <== mon.0 v1:10.20.193.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3643395052 0 0) 0x7fa7f40a0220 con 0x7fa7f406f1e0 2026-02-22T23:26:15.087 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.068+0000 7fa7e27fc640 1 -- 10.20.193.45:0/384249796 --> v1:10.20.193.45:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa7f409f9c0 con 0x7fa7f406f1e0 2026-02-22T23:26:15.087 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.068+0000 7fa7e27fc640 1 -- 10.20.193.45:0/384249796 <== mon.0 v1:10.20.193.45:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7fa7e4004050 con 0x7fa7f406f1e0 2026-02-22T23:26:15.087 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.068+0000 7fa7e27fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:26:15.087 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.068+0000 7fa7e27fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T23:26:15.087 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.068+0000 7fa7e27fc640 10 monclient: dump: 2026-02-22T23:26:15.087 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:26:15.087 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:26:15.087 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:26:15.087 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:26:15.087 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:26:15.087 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:26:15.087 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:26:15.087 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:26:15.087 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:26:15.087 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:26:15.087 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:26:15.087 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:26:15.087 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:26:15.087 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:26:15.087 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:26:15.088 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:26:15.088 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.068+0000 7fa7fa01f640 10 monclient: get_auth_request con 0x7fa7c403fd00 auth_method 0 2026-02-22T23:26:15.088 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.068+0000 7fa7e27fc640 1 -- 10.20.193.45:0/384249796 <== mon.0 v1:10.20.193.45:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2016174880 0 0) 0x7fa7f409f9c0 con 0x7fa7f406f1e0 2026-02-22T23:26:15.088 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.068+0000 7fa7e27fc640 1 -- 10.20.193.45:0/384249796 --> v1:10.20.193.45:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa7f4140190 con 0x7fa7f406f1e0 2026-02-22T23:26:15.088 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.069+0000 7fa7e27fc640 1 -- 10.20.193.45:0/384249796 <== mon.0 v1:10.20.193.45:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (unknown 0 0 2024835662) 0x7fa7e40044d0 con 0x7fa7f406f1e0 2026-02-22T23:26:15.088 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.069+0000 7fa7e27fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T23:26:15.088 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.069+0000 7fa7e27fc640 10 monclient: _finish_command 1 = system:0 2026-02-22T23:26:15.088 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.069+0000 7fa7e27fc640 1 -- 10.20.193.45:0/384249796 >> v1:10.20.193.45:6789/0 conn(0x7fa7f406f1e0 legacy=0x7fa7f4072760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:26:15.088 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.069+0000 7fa7e27fc640 1 -- 10.20.193.45:0/384249796 >> v1:10.20.193.45:6789/0 conn(0x7fa7f406f1e0 legacy=0x7fa7f4072760 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T23:26:15.088 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.072+0000 7fa7fbaa9640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-22T23:26:15.088 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.072+0000 7fa7fbaa9640 1 -- 10.20.193.45:0/384249796 --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fa7f4125be0 con 0x7fa7f4140620 2026-02-22T23:26:15.088 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.072+0000 7fa7e27fc640 1 -- 10.20.193.45:0/384249796 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 580046734 0 0) 0x7fa7f4125be0 con 0x7fa7f4140620 2026-02-22T23:26:15.088 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.072+0000 7fa7e27fc640 10 monclient(hunting): _negotiate 2026-02-22T23:26:15.088 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.072+0000 7fa7e27fc640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:26:15.088 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.072+0000 7fa7e27fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:26:15.088 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.072+0000 7fa7e27fc640 10 monclient(hunting): my global_id is 4491 2026-02-22T23:26:15.088 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.072+0000 7fa7e27fc640 1 -- 10.20.193.45:0/384249796 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa7f409f9c0 con 0x7fa7f4140620 2026-02-22T23:26:15.088 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.072+0000 7fa7e27fc640 1 -- 10.20.193.45:0/384249796 <== mon.0 v1:10.20.193.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2154623599 0 0) 0x7fa7f409f9c0 con 0x7fa7f4140620 2026-02-22T23:26:15.088 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.072+0000 7fa7e27fc640 1 -- 10.20.193.45:0/384249796 --> v1:10.20.193.45:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa7f4125be0 con 0x7fa7f4140620 2026-02-22T23:26:15.088 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.072+0000 7fa7e27fc640 1 -- 10.20.193.45:0/384249796 <== mon.0 v1:10.20.193.45:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7fa7e4002d50 con 0x7fa7f4140620 2026-02-22T23:26:15.088 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.072+0000 7fa7e27fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:26:15.088 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.072+0000 7fa7e27fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T23:26:15.088 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.072+0000 7fa7e27fc640 10 monclient: dump: 2026-02-22T23:26:15.089 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:26:15.089 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:26:15.089 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:26:15.089 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:26:15.089 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:26:15.089 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:26:15.089 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:26:15.089 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:26:15.089 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:26:15.089 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:26:15.089 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:26:15.089 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:26:15.089 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:26:15.089 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:26:15.089 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:26:15.089 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:26:15.089 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.072+0000 7fa7e27fc640 1 -- 10.20.193.45:0/384249796 <== mon.0 v1:10.20.193.45:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2773457784 0 0) 0x7fa7f4125be0 con 0x7fa7f4140620 2026-02-22T23:26:15.089 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.072+0000 7fa7e27fc640 1 -- 10.20.193.45:0/384249796 --> v1:10.20.193.45:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fa7f406ce10 con 0x7fa7f4140620 2026-02-22T23:26:15.089 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.072+0000 7fa7e27fc640 1 -- 10.20.193.45:0/384249796 <== mon.0 v1:10.20.193.45:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7483 (unknown 0 0 806103226) 0x7fa7e40058c0 con 0x7fa7f4140620 2026-02-22T23:26:15.089 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.072+0000 7fa7e27fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-22T23:26:15.089 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.072+0000 7fa7e27fc640 10 monclient: _finish_command 2 = system:0 2026-02-22T23:26:15.089 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.072+0000 7fa7e27fc640 1 -- 10.20.193.45:0/384249796 >> v1:10.20.193.45:6789/0 conn(0x7fa7f4140620 legacy=0x7fa7f4063880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:26:15.089 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.072+0000 7fa7e27fc640 1 -- 10.20.193.45:0/384249796 >> v1:10.20.193.45:6789/0 conn(0x7fa7f4140620 legacy=0x7fa7f4063880 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T23:26:15.090 INFO:teuthology.orchestra.run.trial045.stdout:{ 2026-02-22T23:26:15.090 INFO:teuthology.orchestra.run.trial045.stdout: "name": "a", 2026-02-22T23:26:15.090 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 0, 2026-02-22T23:26:15.090 INFO:teuthology.orchestra.run.trial045.stdout: "state": "peon", 2026-02-22T23:26:15.090 INFO:teuthology.orchestra.run.trial045.stdout: "election_epoch": 22, 2026-02-22T23:26:15.090 INFO:teuthology.orchestra.run.trial045.stdout: "uptime": 55229, 2026-02-22T23:26:15.090 INFO:teuthology.orchestra.run.trial045.stdout: "quorum": [ 2026-02-22T23:26:15.090 INFO:teuthology.orchestra.run.trial045.stdout: 0, 2026-02-22T23:26:15.090 INFO:teuthology.orchestra.run.trial045.stdout: 2, 2026-02-22T23:26:15.090 INFO:teuthology.orchestra.run.trial045.stdout: 3, 2026-02-22T23:26:15.090 INFO:teuthology.orchestra.run.trial045.stdout: 7, 2026-02-22T23:26:15.090 INFO:teuthology.orchestra.run.trial045.stdout: 8 2026-02-22T23:26:15.090 INFO:teuthology.orchestra.run.trial045.stdout: ], 2026-02-22T23:26:15.090 INFO:teuthology.orchestra.run.trial045.stdout: "quorum_age": 0, 2026-02-22T23:26:15.090 INFO:teuthology.orchestra.run.trial045.stdout: "features": { 2026-02-22T23:26:15.090 INFO:teuthology.orchestra.run.trial045.stdout: "required_con": "2450521708007866372", 2026-02-22T23:26:15.090 INFO:teuthology.orchestra.run.trial045.stdout: "required_mon": [ 2026-02-22T23:26:15.091 INFO:teuthology.orchestra.run.trial045.stdout: "kraken", 2026-02-22T23:26:15.091 INFO:teuthology.orchestra.run.trial045.stdout: "luminous", 2026-02-22T23:26:15.091 INFO:teuthology.orchestra.run.trial045.stdout: "mimic", 2026-02-22T23:26:15.091 INFO:teuthology.orchestra.run.trial045.stdout: "osdmap-prune", 2026-02-22T23:26:15.091 INFO:teuthology.orchestra.run.trial045.stdout: "nautilus", 2026-02-22T23:26:15.091 INFO:teuthology.orchestra.run.trial045.stdout: "octopus", 2026-02-22T23:26:15.091 INFO:teuthology.orchestra.run.trial045.stdout: "pacific", 2026-02-22T23:26:15.091 INFO:teuthology.orchestra.run.trial045.stdout: "elector-pinging", 2026-02-22T23:26:15.091 INFO:teuthology.orchestra.run.trial045.stdout: "quincy", 2026-02-22T23:26:15.091 INFO:teuthology.orchestra.run.trial045.stdout: "reef", 2026-02-22T23:26:15.091 INFO:teuthology.orchestra.run.trial045.stdout: "squid" 2026-02-22T23:26:15.091 INFO:teuthology.orchestra.run.trial045.stdout: ], 2026-02-22T23:26:15.091 INFO:teuthology.orchestra.run.trial045.stdout: "quorum_con": "4540701547738038271", 2026-02-22T23:26:15.091 INFO:teuthology.orchestra.run.trial045.stdout: "quorum_mon": [ 2026-02-22T23:26:15.091 INFO:teuthology.orchestra.run.trial045.stdout: "kraken", 2026-02-22T23:26:15.091 INFO:teuthology.orchestra.run.trial045.stdout: "luminous", 2026-02-22T23:26:15.091 INFO:teuthology.orchestra.run.trial045.stdout: "mimic", 2026-02-22T23:26:15.091 INFO:teuthology.orchestra.run.trial045.stdout: "osdmap-prune", 2026-02-22T23:26:15.091 INFO:teuthology.orchestra.run.trial045.stdout: "nautilus", 2026-02-22T23:26:15.091 INFO:teuthology.orchestra.run.trial045.stdout: "octopus", 2026-02-22T23:26:15.091 INFO:teuthology.orchestra.run.trial045.stdout: "pacific", 2026-02-22T23:26:15.091 INFO:teuthology.orchestra.run.trial045.stdout: "elector-pinging", 2026-02-22T23:26:15.091 INFO:teuthology.orchestra.run.trial045.stdout: "quincy", 2026-02-22T23:26:15.091 INFO:teuthology.orchestra.run.trial045.stdout: "reef", 2026-02-22T23:26:15.092 INFO:teuthology.orchestra.run.trial045.stdout: "squid" 2026-02-22T23:26:15.092 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:26:15.092 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:26:15.092 INFO:teuthology.orchestra.run.trial045.stdout: "outside_quorum": [], 2026-02-22T23:26:15.092 INFO:teuthology.orchestra.run.trial045.stdout: "extra_probe_peers": [], 2026-02-22T23:26:15.092 INFO:teuthology.orchestra.run.trial045.stdout: "sync_provider": [], 2026-02-22T23:26:15.092 INFO:teuthology.orchestra.run.trial045.stdout: "monmap": { 2026-02-22T23:26:15.092 INFO:teuthology.orchestra.run.trial045.stdout: "epoch": 1, 2026-02-22T23:26:15.092 INFO:teuthology.orchestra.run.trial045.stdout: "fsid": "4b60f18f-6660-4731-b731-dc85c4078413", 2026-02-22T23:26:15.092 INFO:teuthology.orchestra.run.trial045.stdout: "modified": "2026-02-22T23:24:52.393472Z", 2026-02-22T23:26:15.092 INFO:teuthology.orchestra.run.trial045.stdout: "created": "2026-02-22T23:24:52.393472Z", 2026-02-22T23:26:15.092 INFO:teuthology.orchestra.run.trial045.stdout: "min_mon_release": 19, 2026-02-22T23:26:15.092 INFO:teuthology.orchestra.run.trial045.stdout: "min_mon_release_name": "squid", 2026-02-22T23:26:15.092 INFO:teuthology.orchestra.run.trial045.stdout: "election_strategy": 3, 2026-02-22T23:26:15.092 INFO:teuthology.orchestra.run.trial045.stdout: "disallowed_leaders": "", 2026-02-22T23:26:15.092 INFO:teuthology.orchestra.run.trial045.stdout: "stretch_mode": false, 2026-02-22T23:26:15.092 INFO:teuthology.orchestra.run.trial045.stdout: "tiebreaker_mon": "", 2026-02-22T23:26:15.092 INFO:teuthology.orchestra.run.trial045.stdout: "removed_ranks": "", 2026-02-22T23:26:15.092 INFO:teuthology.orchestra.run.trial045.stdout: "features": { 2026-02-22T23:26:15.092 INFO:teuthology.orchestra.run.trial045.stdout: "persistent": [ 2026-02-22T23:26:15.092 INFO:teuthology.orchestra.run.trial045.stdout: "kraken", 2026-02-22T23:26:15.092 INFO:teuthology.orchestra.run.trial045.stdout: "luminous", 2026-02-22T23:26:15.092 INFO:teuthology.orchestra.run.trial045.stdout: "mimic", 2026-02-22T23:26:15.092 INFO:teuthology.orchestra.run.trial045.stdout: "osdmap-prune", 2026-02-22T23:26:15.093 INFO:teuthology.orchestra.run.trial045.stdout: "nautilus", 2026-02-22T23:26:15.093 INFO:teuthology.orchestra.run.trial045.stdout: "octopus", 2026-02-22T23:26:15.093 INFO:teuthology.orchestra.run.trial045.stdout: "pacific", 2026-02-22T23:26:15.093 INFO:teuthology.orchestra.run.trial045.stdout: "elector-pinging", 2026-02-22T23:26:15.093 INFO:teuthology.orchestra.run.trial045.stdout: "quincy", 2026-02-22T23:26:15.093 INFO:teuthology.orchestra.run.trial045.stdout: "reef", 2026-02-22T23:26:15.093 INFO:teuthology.orchestra.run.trial045.stdout: "squid" 2026-02-22T23:26:15.093 INFO:teuthology.orchestra.run.trial045.stdout: ], 2026-02-22T23:26:15.093 INFO:teuthology.orchestra.run.trial045.stdout: "optional": [] 2026-02-22T23:26:15.093 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:26:15.093 INFO:teuthology.orchestra.run.trial045.stdout: "mons": [ 2026-02-22T23:26:15.093 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:26:15.093 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 0, 2026-02-22T23:26:15.093 INFO:teuthology.orchestra.run.trial045.stdout: "name": "a", 2026-02-22T23:26:15.093 INFO:teuthology.orchestra.run.trial045.stdout: "public_addrs": { 2026-02-22T23:26:15.093 INFO:teuthology.orchestra.run.trial045.stdout: "addrvec": [ 2026-02-22T23:26:15.093 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:26:15.093 INFO:teuthology.orchestra.run.trial045.stdout: "type": "v1", 2026-02-22T23:26:15.093 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6789", 2026-02-22T23:26:15.093 INFO:teuthology.orchestra.run.trial045.stdout: "nonce": 0 2026-02-22T23:26:15.093 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:26:15.093 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:26:15.093 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:26:15.093 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6789/0", 2026-02-22T23:26:15.093 INFO:teuthology.orchestra.run.trial045.stdout: "public_addr": "10.20.193.45:6789/0", 2026-02-22T23:26:15.093 INFO:teuthology.orchestra.run.trial045.stdout: "priority": 0, 2026-02-22T23:26:15.093 INFO:teuthology.orchestra.run.trial045.stdout: "weight": 0, 2026-02-22T23:26:15.094 INFO:teuthology.orchestra.run.trial045.stdout: "crush_location": "{}" 2026-02-22T23:26:15.094 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:26:15.094 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:26:15.094 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 1, 2026-02-22T23:26:15.094 INFO:teuthology.orchestra.run.trial045.stdout: "name": "f", 2026-02-22T23:26:15.094 INFO:teuthology.orchestra.run.trial045.stdout: "public_addrs": { 2026-02-22T23:26:15.094 INFO:teuthology.orchestra.run.trial045.stdout: "addrvec": [ 2026-02-22T23:26:15.094 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:26:15.094 INFO:teuthology.orchestra.run.trial045.stdout: "type": "v1", 2026-02-22T23:26:15.094 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.73:6789", 2026-02-22T23:26:15.094 INFO:teuthology.orchestra.run.trial045.stdout: "nonce": 0 2026-02-22T23:26:15.094 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:26:15.094 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:26:15.094 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:26:15.094 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.73:6789/0", 2026-02-22T23:26:15.094 INFO:teuthology.orchestra.run.trial045.stdout: "public_addr": "10.20.193.73:6789/0", 2026-02-22T23:26:15.094 INFO:teuthology.orchestra.run.trial045.stdout: "priority": 0, 2026-02-22T23:26:15.094 INFO:teuthology.orchestra.run.trial045.stdout: "weight": 0, 2026-02-22T23:26:15.094 INFO:teuthology.orchestra.run.trial045.stdout: "crush_location": "{}" 2026-02-22T23:26:15.094 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:26:15.094 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:26:15.094 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 2, 2026-02-22T23:26:15.094 INFO:teuthology.orchestra.run.trial045.stdout: "name": "b", 2026-02-22T23:26:15.094 INFO:teuthology.orchestra.run.trial045.stdout: "public_addrs": { 2026-02-22T23:26:15.094 INFO:teuthology.orchestra.run.trial045.stdout: "addrvec": [ 2026-02-22T23:26:15.094 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:26:15.095 INFO:teuthology.orchestra.run.trial045.stdout: "type": "v1", 2026-02-22T23:26:15.095 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6790", 2026-02-22T23:26:15.095 INFO:teuthology.orchestra.run.trial045.stdout: "nonce": 0 2026-02-22T23:26:15.095 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:26:15.095 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:26:15.095 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:26:15.095 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6790/0", 2026-02-22T23:26:15.095 INFO:teuthology.orchestra.run.trial045.stdout: "public_addr": "10.20.193.45:6790/0", 2026-02-22T23:26:15.095 INFO:teuthology.orchestra.run.trial045.stdout: "priority": 0, 2026-02-22T23:26:15.095 INFO:teuthology.orchestra.run.trial045.stdout: "weight": 0, 2026-02-22T23:26:15.095 INFO:teuthology.orchestra.run.trial045.stdout: "crush_location": "{}" 2026-02-22T23:26:15.095 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:26:15.095 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:26:15.095 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 3, 2026-02-22T23:26:15.095 INFO:teuthology.orchestra.run.trial045.stdout: "name": "g", 2026-02-22T23:26:15.095 INFO:teuthology.orchestra.run.trial045.stdout: "public_addrs": { 2026-02-22T23:26:15.095 INFO:teuthology.orchestra.run.trial045.stdout: "addrvec": [ 2026-02-22T23:26:15.095 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:26:15.095 INFO:teuthology.orchestra.run.trial045.stdout: "type": "v1", 2026-02-22T23:26:15.095 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.73:6790", 2026-02-22T23:26:15.095 INFO:teuthology.orchestra.run.trial045.stdout: "nonce": 0 2026-02-22T23:26:15.095 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:26:15.095 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:26:15.095 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:26:15.095 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.73:6790/0", 2026-02-22T23:26:15.095 INFO:teuthology.orchestra.run.trial045.stdout: "public_addr": "10.20.193.73:6790/0", 2026-02-22T23:26:15.095 INFO:teuthology.orchestra.run.trial045.stdout: "priority": 0, 2026-02-22T23:26:15.095 INFO:teuthology.orchestra.run.trial045.stdout: "weight": 0, 2026-02-22T23:26:15.096 INFO:teuthology.orchestra.run.trial045.stdout: "crush_location": "{}" 2026-02-22T23:26:15.096 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:26:15.096 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:26:15.096 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 4, 2026-02-22T23:26:15.096 INFO:teuthology.orchestra.run.trial045.stdout: "name": "c", 2026-02-22T23:26:15.096 INFO:teuthology.orchestra.run.trial045.stdout: "public_addrs": { 2026-02-22T23:26:15.096 INFO:teuthology.orchestra.run.trial045.stdout: "addrvec": [ 2026-02-22T23:26:15.096 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:26:15.096 INFO:teuthology.orchestra.run.trial045.stdout: "type": "v1", 2026-02-22T23:26:15.096 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6791", 2026-02-22T23:26:15.096 INFO:teuthology.orchestra.run.trial045.stdout: "nonce": 0 2026-02-22T23:26:15.096 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:26:15.096 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:26:15.096 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:26:15.096 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6791/0", 2026-02-22T23:26:15.096 INFO:teuthology.orchestra.run.trial045.stdout: "public_addr": "10.20.193.45:6791/0", 2026-02-22T23:26:15.096 INFO:teuthology.orchestra.run.trial045.stdout: "priority": 0, 2026-02-22T23:26:15.096 INFO:teuthology.orchestra.run.trial045.stdout: "weight": 0, 2026-02-22T23:26:15.096 INFO:teuthology.orchestra.run.trial045.stdout: "crush_location": "{}" 2026-02-22T23:26:15.096 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:26:15.096 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:26:15.096 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 5, 2026-02-22T23:26:15.096 INFO:teuthology.orchestra.run.trial045.stdout: "name": "h", 2026-02-22T23:26:15.096 INFO:teuthology.orchestra.run.trial045.stdout: "public_addrs": { 2026-02-22T23:26:15.096 INFO:teuthology.orchestra.run.trial045.stdout: "addrvec": [ 2026-02-22T23:26:15.096 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:26:15.096 INFO:teuthology.orchestra.run.trial045.stdout: "type": "v1", 2026-02-22T23:26:15.096 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.73:6791", 2026-02-22T23:26:15.097 INFO:teuthology.orchestra.run.trial045.stdout: "nonce": 0 2026-02-22T23:26:15.097 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:26:15.097 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:26:15.097 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:26:15.097 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.73:6791/0", 2026-02-22T23:26:15.097 INFO:teuthology.orchestra.run.trial045.stdout: "public_addr": "10.20.193.73:6791/0", 2026-02-22T23:26:15.097 INFO:teuthology.orchestra.run.trial045.stdout: "priority": 0, 2026-02-22T23:26:15.097 INFO:teuthology.orchestra.run.trial045.stdout: "weight": 0, 2026-02-22T23:26:15.097 INFO:teuthology.orchestra.run.trial045.stdout: "crush_location": "{}" 2026-02-22T23:26:15.097 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:26:15.097 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:26:15.097 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 6, 2026-02-22T23:26:15.097 INFO:teuthology.orchestra.run.trial045.stdout: "name": "d", 2026-02-22T23:26:15.097 INFO:teuthology.orchestra.run.trial045.stdout: "public_addrs": { 2026-02-22T23:26:15.097 INFO:teuthology.orchestra.run.trial045.stdout: "addrvec": [ 2026-02-22T23:26:15.097 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:26:15.097 INFO:teuthology.orchestra.run.trial045.stdout: "type": "v1", 2026-02-22T23:26:15.097 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6792", 2026-02-22T23:26:15.097 INFO:teuthology.orchestra.run.trial045.stdout: "nonce": 0 2026-02-22T23:26:15.097 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:26:15.097 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:26:15.097 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:26:15.097 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6792/0", 2026-02-22T23:26:15.097 INFO:teuthology.orchestra.run.trial045.stdout: "public_addr": "10.20.193.45:6792/0", 2026-02-22T23:26:15.097 INFO:teuthology.orchestra.run.trial045.stdout: "priority": 0, 2026-02-22T23:26:15.097 INFO:teuthology.orchestra.run.trial045.stdout: "weight": 0, 2026-02-22T23:26:15.097 INFO:teuthology.orchestra.run.trial045.stdout: "crush_location": "{}" 2026-02-22T23:26:15.097 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:26:15.097 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:26:15.098 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 7, 2026-02-22T23:26:15.098 INFO:teuthology.orchestra.run.trial045.stdout: "name": "i", 2026-02-22T23:26:15.098 INFO:teuthology.orchestra.run.trial045.stdout: "public_addrs": { 2026-02-22T23:26:15.098 INFO:teuthology.orchestra.run.trial045.stdout: "addrvec": [ 2026-02-22T23:26:15.098 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:26:15.098 INFO:teuthology.orchestra.run.trial045.stdout: "type": "v1", 2026-02-22T23:26:15.098 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.73:6792", 2026-02-22T23:26:15.098 INFO:teuthology.orchestra.run.trial045.stdout: "nonce": 0 2026-02-22T23:26:15.098 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:26:15.098 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:26:15.098 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:26:15.098 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.73:6792/0", 2026-02-22T23:26:15.098 INFO:teuthology.orchestra.run.trial045.stdout: "public_addr": "10.20.193.73:6792/0", 2026-02-22T23:26:15.098 INFO:teuthology.orchestra.run.trial045.stdout: "priority": 0, 2026-02-22T23:26:15.098 INFO:teuthology.orchestra.run.trial045.stdout: "weight": 0, 2026-02-22T23:26:15.098 INFO:teuthology.orchestra.run.trial045.stdout: "crush_location": "{}" 2026-02-22T23:26:15.098 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:26:15.098 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:26:15.098 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 8, 2026-02-22T23:26:15.098 INFO:teuthology.orchestra.run.trial045.stdout: "name": "e", 2026-02-22T23:26:15.098 INFO:teuthology.orchestra.run.trial045.stdout: "public_addrs": { 2026-02-22T23:26:15.098 INFO:teuthology.orchestra.run.trial045.stdout: "addrvec": [ 2026-02-22T23:26:15.098 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:26:15.098 INFO:teuthology.orchestra.run.trial045.stdout: "type": "v1", 2026-02-22T23:26:15.098 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6793", 2026-02-22T23:26:15.098 INFO:teuthology.orchestra.run.trial045.stdout: "nonce": 0 2026-02-22T23:26:15.098 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:26:15.098 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:26:15.098 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:26:15.098 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6793/0", 2026-02-22T23:26:15.098 INFO:teuthology.orchestra.run.trial045.stdout: "public_addr": "10.20.193.45:6793/0", 2026-02-22T23:26:15.099 INFO:teuthology.orchestra.run.trial045.stdout: "priority": 0, 2026-02-22T23:26:15.099 INFO:teuthology.orchestra.run.trial045.stdout: "weight": 0, 2026-02-22T23:26:15.099 INFO:teuthology.orchestra.run.trial045.stdout: "crush_location": "{}" 2026-02-22T23:26:15.099 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:26:15.099 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:26:15.099 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:26:15.099 INFO:teuthology.orchestra.run.trial045.stdout: "feature_map": { 2026-02-22T23:26:15.099 INFO:teuthology.orchestra.run.trial045.stdout: "mon": [ 2026-02-22T23:26:15.099 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:26:15.099 INFO:teuthology.orchestra.run.trial045.stdout: "features": "0x3f03cffffffdffff", 2026-02-22T23:26:15.099 INFO:teuthology.orchestra.run.trial045.stdout: "release": "squid", 2026-02-22T23:26:15.099 INFO:teuthology.orchestra.run.trial045.stdout: "num": 1 2026-02-22T23:26:15.099 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:26:15.099 INFO:teuthology.orchestra.run.trial045.stdout: ], 2026-02-22T23:26:15.099 INFO:teuthology.orchestra.run.trial045.stdout: "client": [ 2026-02-22T23:26:15.099 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:26:15.099 INFO:teuthology.orchestra.run.trial045.stdout: "features": "0x3f03cffffffdffff", 2026-02-22T23:26:15.099 INFO:teuthology.orchestra.run.trial045.stdout: "release": "squid", 2026-02-22T23:26:15.099 INFO:teuthology.orchestra.run.trial045.stdout: "num": 1 2026-02-22T23:26:15.099 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:26:15.099 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:26:15.099 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:26:15.099 INFO:teuthology.orchestra.run.trial045.stdout: "stretch_mode": false 2026-02-22T23:26:15.099 INFO:teuthology.orchestra.run.trial045.stdout:} 2026-02-22T23:26:15.100 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.072+0000 7fa7fbaa9640 1 -- 10.20.193.45:0/384249796 >> v1:10.20.193.73:6800/2222410180 conn(0x7fa7c403fd00 legacy=0x7fa7c40421c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:26:15.100 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.072+0000 7fa7fbaa9640 10 monclient: shutdown 2026-02-22T23:26:15.100 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.072+0000 7fa7fbaa9640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T23:26:15.100 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.072+0000 7fa7fbaa9640 1 -- 10.20.193.45:0/384249796 >> v1:10.20.193.45:6793/0 conn(0x7fa7f40a1a60 legacy=0x7fa7f41d46c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:26:15.100 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.072+0000 7fa7fa01f640 1 -- 10.20.193.45:0/384249796 reap_dead start 2026-02-22T23:26:15.100 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.072+0000 7fa7fbaa9640 1 -- 10.20.193.45:0/384249796 shutdown_connections 2026-02-22T23:26:15.100 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.072+0000 7fa7fbaa9640 1 -- 10.20.193.45:0/384249796 >> 10.20.193.45:0/384249796 conn(0x7fa7f40a7780 msgr2=0x7fa7f4141d00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:26:15.100 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.072+0000 7fa7fbaa9640 1 -- 10.20.193.45:0/384249796 shutdown_connections 2026-02-22T23:26:15.100 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.072+0000 7fa7fbaa9640 1 -- 10.20.193.45:0/384249796 wait complete. 2026-02-22T23:26:15.101 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 5 2026-02-22T23:26:15.101 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 5 for mon b 2026-02-22T23:26:15.101 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-22T23:26:15.176 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.167+0000 7fc44ac58640 10 monclient: get_monmap_and_config 2026-02-22T23:26:15.176 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.167+0000 7fc44ac58640 10 monclient: build_initial_monmap 2026-02-22T23:26:15.176 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.167+0000 7fc44ac58640 10 monclient: monmap: 2026-02-22T23:26:15.176 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-22T23:26:15.176 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:26:15.176 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:26:15.168335+0000 2026-02-22T23:26:15.176 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:26:15.168335+0000 2026-02-22T23:26:15.176 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-22T23:26:15.176 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:26:15.176 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-22T23:26:15.176 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.noname-f 2026-02-22T23:26:15.176 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.noname-b 2026-02-22T23:26:15.177 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.noname-g 2026-02-22T23:26:15.177 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.noname-c 2026-02-22T23:26:15.177 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.noname-h 2026-02-22T23:26:15.177 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.noname-d 2026-02-22T23:26:15.177 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.noname-i 2026-02-22T23:26:15.177 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.noname-e 2026-02-22T23:26:15.177 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:26:15.177 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.167+0000 7fc44ac58640 1 Processor -- start 2026-02-22T23:26:15.177 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.167+0000 7fc44ac58640 1 -- start start 2026-02-22T23:26:15.177 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.167+0000 7fc44ac58640 10 monclient: init 2026-02-22T23:26:15.177 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.167+0000 7fc44ac58640 10 monclient: _reopen_session rank -1 2026-02-22T23:26:15.177 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.167+0000 7fc44ac58640 10 monclient: _add_conns ranks=[8,1,6,2,0,5,3,7,4] 2026-02-22T23:26:15.177 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.167+0000 7fc44ac58640 10 monclient(hunting): picked mon.noname-e con 0x7fc4440a1a60 addr v1:10.20.193.45:6793/0 2026-02-22T23:26:15.177 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.167+0000 7fc44ac58640 10 monclient(hunting): picked mon.noname-f con 0x7fc44406f1e0 addr v1:10.20.193.73:6789/0 2026-02-22T23:26:15.177 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.167+0000 7fc44ac58640 10 monclient(hunting): picked mon.noname-d con 0x7fc4440a0980 addr v1:10.20.193.45:6792/0 2026-02-22T23:26:15.178 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.167+0000 7fc44ac58640 1 -- --> v1:10.20.193.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc44409df00 con 0x7fc44406f1e0 2026-02-22T23:26:15.178 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.167+0000 7fc44ac58640 1 -- --> v1:10.20.193.45:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc444137660 con 0x7fc4440a0980 2026-02-22T23:26:15.178 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.167+0000 7fc44ac58640 1 -- --> v1:10.20.193.45:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc4440a4510 con 0x7fc4440a1a60 2026-02-22T23:26:15.178 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.167+0000 7fc44ac58640 10 monclient(hunting): _renew_subs 2026-02-22T23:26:15.178 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.167+0000 7fc44ac58640 10 monclient(hunting): authenticate will time out at 706.784914s 2026-02-22T23:26:15.178 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.167+0000 7fc4491ce640 1 -- >> v1:10.20.193.45:6792/0 conn(0x7fc4440a0980 legacy=0x7fc44413ecb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.45:6792/0 2026-02-22T23:26:15.178 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.167+0000 7fc43bfff640 1 -- >> v1:10.20.193.73:6789/0 conn(0x7fc44406f1e0 legacy=0x7fc444136f50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.73:6789/0 2026-02-22T23:26:15.178 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.167+0000 7fc4489cd640 1 --1- >> v1:10.20.193.45:6793/0 conn(0x7fc4440a1a60 0x7fc444136840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.45:6793/0 says I am v1:10.20.193.45:54436/0 (socket says 10.20.193.45:54436) 2026-02-22T23:26:15.178 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.168+0000 7fc4489cd640 1 -- 10.20.193.45:0/2017365736 learned_addr learned my addr 10.20.193.45:0/2017365736 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-22T23:26:15.178 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.168+0000 7fc43b7fe640 1 -- 10.20.193.45:0/2017365736 <== mon.8 v1:10.20.193.45:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1225359710 0 0) 0x7fc4440a4510 con 0x7fc4440a1a60 2026-02-22T23:26:15.178 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.168+0000 7fc43b7fe640 10 monclient(hunting): _negotiate 2026-02-22T23:26:15.178 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.168+0000 7fc43b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:26:15.178 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.168+0000 7fc43b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:26:15.178 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.168+0000 7fc43b7fe640 10 monclient(hunting): my global_id is 4535 2026-02-22T23:26:15.178 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.168+0000 7fc43b7fe640 1 -- 10.20.193.45:0/2017365736 --> v1:10.20.193.45:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc430003620 con 0x7fc4440a1a60 2026-02-22T23:26:15.178 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.168+0000 7fc43b7fe640 1 -- 10.20.193.45:0/2017365736 <== mon.8 v1:10.20.193.45:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1082536569 0 0) 0x7fc430003620 con 0x7fc4440a1a60 2026-02-22T23:26:15.178 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.168+0000 7fc43b7fe640 1 -- 10.20.193.45:0/2017365736 >> v1:10.20.193.45:6792/0 conn(0x7fc4440a0980 legacy=0x7fc44413ecb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-22T23:26:15.178 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.168+0000 7fc43b7fe640 1 -- 10.20.193.45:0/2017365736 >> v1:10.20.193.73:6789/0 conn(0x7fc44406f1e0 legacy=0x7fc444136f50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-22T23:26:15.179 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.168+0000 7fc43b7fe640 10 monclient: _finish_hunting 0 2026-02-22T23:26:15.179 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.168+0000 7fc43b7fe640 1 monclient: found mon.noname-e 2026-02-22T23:26:15.179 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.168+0000 7fc43b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T23:26:15.179 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.168+0000 7fc43b7fe640 10 monclient: _send_mon_message to mon.noname-e at v1:10.20.193.45:6793/0 2026-02-22T23:26:15.179 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.168+0000 7fc43b7fe640 1 -- 10.20.193.45:0/2017365736 --> v1:10.20.193.45:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc444143400 con 0x7fc4440a1a60 2026-02-22T23:26:15.179 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.168+0000 7fc43b7fe640 10 monclient: _finish_auth 0 2026-02-22T23:26:15.179 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.168+0000 7fc43b7fe640 10 monclient: _check_auth_tickets 2026-02-22T23:26:15.179 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.168+0000 7fc43b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T23:26:15.179 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.168+0000 7fc43b7fe640 1 -- 10.20.193.45:0/2017365736 <== mon.8 v1:10.20.193.45:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7fc434003040 con 0x7fc4440a1a60 2026-02-22T23:26:15.179 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.168+0000 7fc44ac58640 5 monclient: authenticate success, global_id 4535 2026-02-22T23:26:15.179 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.168+0000 7fc44ac58640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-22T23:26:15.179 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.168+0000 7fc43b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:26:15.179 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.168+0000 7fc43b7fe640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2026-02-22T23:26:15.179 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.168+0000 7fc43b7fe640 10 monclient: dump: 2026-02-22T23:26:15.179 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:26:15.179 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:26:15.179 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:26:15.179 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:26:15.180 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:26:15.180 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:26:15.180 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:26:15.180 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:26:15.180 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:26:15.180 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:26:15.180 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:26:15.180 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:26:15.180 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:26:15.180 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:26:15.180 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:26:15.180 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:26:15.180 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.168+0000 7fc44ac58640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-22T23:26:15.180 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.168+0000 7fc43b7fe640 1 -- 10.20.193.45:0/2017365736 <== mon.8 v1:10.20.193.45:6793/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc434003260 con 0x7fc4440a1a60 2026-02-22T23:26:15.180 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.168+0000 7fc43b7fe640 10 monclient: handle_config config(0 keys) 2026-02-22T23:26:15.180 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.168+0000 7fc43b7fe640 1 -- 10.20.193.45:0/2017365736 <== mon.8 v1:10.20.193.45:6793/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7fc434004ce0 con 0x7fc4440a1a60 2026-02-22T23:26:15.180 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.168+0000 7fc44ac58640 10 monclient: get_monmap_and_config success 2026-02-22T23:26:15.180 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.168+0000 7fc44ac58640 4 set_mon_vals no callback set 2026-02-22T23:26:15.181 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.168+0000 7fc43b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:26:15.181 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.168+0000 7fc43b7fe640 10 monclient: got monmap 1 from mon.e (according to old e1) 2026-02-22T23:26:15.181 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.168+0000 7fc43b7fe640 10 monclient: dump: 2026-02-22T23:26:15.181 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:26:15.181 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:26:15.181 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:26:15.181 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:26:15.181 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:26:15.181 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:26:15.181 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:26:15.181 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:26:15.181 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:26:15.181 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:26:15.181 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:26:15.181 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:26:15.181 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:26:15.181 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:26:15.181 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:26:15.181 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:26:15.181 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.168+0000 7fc44ac58640 10 monclient: shutdown 2026-02-22T23:26:15.182 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.168+0000 7fc44ac58640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T23:26:15.182 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.168+0000 7fc44ac58640 1 -- 10.20.193.45:0/2017365736 >> v1:10.20.193.45:6793/0 conn(0x7fc4440a1a60 legacy=0x7fc444136840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:26:15.182 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.168+0000 7fc44ac58640 1 -- 10.20.193.45:0/2017365736 shutdown_connections 2026-02-22T23:26:15.182 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.168+0000 7fc44ac58640 1 -- 10.20.193.45:0/2017365736 >> 10.20.193.45:0/2017365736 conn(0x7fc4440a7780 msgr2=0x7fc4440a3b60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:26:15.182 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.168+0000 7fc44ac58640 1 -- 10.20.193.45:0/2017365736 shutdown_connections 2026-02-22T23:26:15.182 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.168+0000 7fc44ac58640 1 -- 10.20.193.45:0/2017365736 wait complete. 2026-02-22T23:26:15.182 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.169+0000 7fc44ac58640 10 monclient: build_initial_monmap 2026-02-22T23:26:15.182 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.169+0000 7fc44ac58640 10 monclient: monmap: 2026-02-22T23:26:15.182 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-22T23:26:15.182 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T23:26:15.182 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-22T23:26:15.182 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-22T23:26:15.182 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-22T23:26:15.182 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-22T23:26:15.182 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-22T23:26:15.182 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.noname-f 2026-02-22T23:26:15.182 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.noname-b 2026-02-22T23:26:15.182 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.noname-g 2026-02-22T23:26:15.183 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.noname-c 2026-02-22T23:26:15.183 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.noname-h 2026-02-22T23:26:15.183 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.noname-d 2026-02-22T23:26:15.183 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.noname-i 2026-02-22T23:26:15.183 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.noname-e 2026-02-22T23:26:15.183 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:26:15.183 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.169+0000 7fc44ac58640 1 Processor -- start 2026-02-22T23:26:15.183 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.169+0000 7fc44ac58640 1 -- start start 2026-02-22T23:26:15.183 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.169+0000 7fc44ac58640 10 monclient: init 2026-02-22T23:26:15.183 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.169+0000 7fc44ac58640 10 monclient: _reopen_session rank -1 2026-02-22T23:26:15.183 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.169+0000 7fc44ac58640 10 monclient: _add_conns ranks=[6,0,3,5,4,2,1,8,7] 2026-02-22T23:26:15.183 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.169+0000 7fc44ac58640 10 monclient(hunting): picked mon.noname-d con 0x7fc4440a0980 addr v1:10.20.193.45:6792/0 2026-02-22T23:26:15.183 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.169+0000 7fc44ac58640 10 monclient(hunting): picked mon.noname-a con 0x7fc4440a1a60 addr v1:10.20.193.45:6789/0 2026-02-22T23:26:15.183 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.169+0000 7fc44ac58640 10 monclient(hunting): picked mon.noname-g con 0x7fc44413e080 addr v1:10.20.193.73:6790/0 2026-02-22T23:26:15.183 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.169+0000 7fc44ac58640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc44411e3a0 con 0x7fc4440a1a60 2026-02-22T23:26:15.183 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.169+0000 7fc44ac58640 1 -- --> v1:10.20.193.73:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc444143060 con 0x7fc44413e080 2026-02-22T23:26:15.183 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.169+0000 7fc4489cd640 1 -- >> v1:10.20.193.45:6792/0 conn(0x7fc4440a0980 legacy=0x7fc444136870 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.45:6792/0 2026-02-22T23:26:15.183 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.169+0000 7fc44ac58640 1 -- --> v1:10.20.193.45:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc4440a2c40 con 0x7fc4440a0980 2026-02-22T23:26:15.183 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.169+0000 7fc44ac58640 10 monclient(hunting): _renew_subs 2026-02-22T23:26:15.184 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.169+0000 7fc44ac58640 10 monclient(hunting): authenticate will time out at 706.786495s 2026-02-22T23:26:15.184 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.169+0000 7fc43bfff640 1 --1- >> v1:10.20.193.45:6789/0 conn(0x7fc4440a1a60 0x7fc4441d44b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.45:6789/0 says I am v1:10.20.193.45:49742/0 (socket says 10.20.193.45:49742) 2026-02-22T23:26:15.184 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.169+0000 7fc43bfff640 1 -- 10.20.193.45:0/3439024357 learned_addr learned my addr 10.20.193.45:0/3439024357 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-22T23:26:15.184 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.169+0000 7fc4397fa640 1 -- 10.20.193.45:0/3439024357 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3470984392 0 0) 0x7fc44411e3a0 con 0x7fc4440a1a60 2026-02-22T23:26:15.184 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.169+0000 7fc4397fa640 10 monclient(hunting): _negotiate 2026-02-22T23:26:15.184 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.169+0000 7fc4397fa640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:26:15.184 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.169+0000 7fc4397fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:26:15.184 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.169+0000 7fc4397fa640 10 monclient(hunting): my global_id is 4500 2026-02-22T23:26:15.184 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.169+0000 7fc4397fa640 1 -- 10.20.193.45:0/3439024357 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc414003620 con 0x7fc4440a1a60 2026-02-22T23:26:15.184 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.169+0000 7fc4397fa640 1 -- 10.20.193.45:0/3439024357 <== mon.0 v1:10.20.193.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2645713511 0 0) 0x7fc414003620 con 0x7fc4440a1a60 2026-02-22T23:26:15.184 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.169+0000 7fc4397fa640 1 -- 10.20.193.45:0/3439024357 --> v1:10.20.193.45:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc44411e3a0 con 0x7fc4440a1a60 2026-02-22T23:26:15.184 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.169+0000 7fc4397fa640 1 -- 10.20.193.45:0/3439024357 <== mon.0 v1:10.20.193.45:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7fc42c0044a0 con 0x7fc4440a1a60 2026-02-22T23:26:15.184 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.169+0000 7fc4397fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-22T23:26:15.184 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.169+0000 7fc4397fa640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T23:26:15.184 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.169+0000 7fc4397fa640 10 monclient(hunting): dump: 2026-02-22T23:26:15.184 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:26:15.184 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:26:15.184 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:26:15.184 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:26:15.185 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:26:15.185 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:26:15.185 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:26:15.185 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:26:15.185 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:26:15.185 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:26:15.185 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:26:15.185 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:26:15.185 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:26:15.185 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:26:15.185 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:26:15.185 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:26:15.185 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.169+0000 7fc4397fa640 10 monclient(hunting): _finish_auth 0 2026-02-22T23:26:15.185 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.169+0000 7fc4397fa640 1 -- 10.20.193.45:0/3439024357 <== mon.3 v1:10.20.193.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1556116691 0 0) 0x7fc444143060 con 0x7fc44413e080 2026-02-22T23:26:15.185 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.169+0000 7fc4397fa640 10 monclient(hunting): _negotiate 2026-02-22T23:26:15.185 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.169+0000 7fc4397fa640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:26:15.185 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.169+0000 7fc4397fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:26:15.185 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.169+0000 7fc4397fa640 10 monclient(hunting): my global_id is 4503 2026-02-22T23:26:15.186 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.169+0000 7fc4397fa640 1 -- 10.20.193.45:0/3439024357 --> v1:10.20.193.73:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc414003620 con 0x7fc44413e080 2026-02-22T23:26:15.186 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.169+0000 7fc4397fa640 1 -- 10.20.193.45:0/3439024357 <== mon.0 v1:10.20.193.45:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3120118805 0 0) 0x7fc44411e3a0 con 0x7fc4440a1a60 2026-02-22T23:26:15.186 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.169+0000 7fc4397fa640 1 -- 10.20.193.45:0/3439024357 >> v1:10.20.193.45:6792/0 conn(0x7fc4440a0980 legacy=0x7fc444136870 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-22T23:26:15.186 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.169+0000 7fc4397fa640 1 -- 10.20.193.45:0/3439024357 >> v1:10.20.193.73:6790/0 conn(0x7fc44413e080 legacy=0x7fc4441d7be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:26:15.186 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.169+0000 7fc4397fa640 10 monclient: _finish_hunting 0 2026-02-22T23:26:15.186 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.169+0000 7fc4397fa640 1 monclient: found mon.a 2026-02-22T23:26:15.186 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.169+0000 7fc4397fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T23:26:15.186 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.169+0000 7fc4397fa640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-22T23:26:15.186 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.169+0000 7fc4397fa640 1 -- 10.20.193.45:0/3439024357 --> v1:10.20.193.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4440a6270 con 0x7fc4440a1a60 2026-02-22T23:26:15.186 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.169+0000 7fc4397fa640 10 monclient: _finish_auth 0 2026-02-22T23:26:15.186 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.169+0000 7fc4397fa640 10 monclient: _check_auth_tickets 2026-02-22T23:26:15.186 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.169+0000 7fc4397fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T23:26:15.186 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.169+0000 7fc44ac58640 5 monclient: authenticate success, global_id 4500 2026-02-22T23:26:15.186 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.169+0000 7fc44ac58640 10 monclient: _renew_subs 2026-02-22T23:26:15.186 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.169+0000 7fc44ac58640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-22T23:26:15.186 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.169+0000 7fc44ac58640 1 -- 10.20.193.45:0/3439024357 --> v1:10.20.193.45:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fc44411dde0 con 0x7fc4440a1a60 2026-02-22T23:26:15.186 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.169+0000 7fc4397fa640 1 -- 10.20.193.45:0/3439024357 <== mon.0 v1:10.20.193.45:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc42c0046c0 con 0x7fc4440a1a60 2026-02-22T23:26:15.186 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.170+0000 7fc4397fa640 10 monclient: handle_config config(0 keys) 2026-02-22T23:26:15.186 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.170+0000 7fc4397fa640 1 -- 10.20.193.45:0/3439024357 <== mon.0 v1:10.20.193.45:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7fc42c004c70 con 0x7fc4440a1a60 2026-02-22T23:26:15.187 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.170+0000 7fc4397fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:26:15.187 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.170+0000 7fc4397fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T23:26:15.187 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.170+0000 7fc43affd640 4 set_mon_vals no callback set 2026-02-22T23:26:15.187 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.170+0000 7fc4397fa640 10 monclient: dump: 2026-02-22T23:26:15.187 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:26:15.187 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:26:15.187 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:26:15.187 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:26:15.187 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:26:15.187 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:26:15.187 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:26:15.187 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:26:15.187 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:26:15.187 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:26:15.187 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:26:15.187 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:26:15.187 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:26:15.187 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:26:15.187 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:26:15.188 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:26:15.188 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.170+0000 7fc44ac58640 10 monclient: _renew_subs 2026-02-22T23:26:15.188 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.170+0000 7fc44ac58640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-22T23:26:15.188 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.170+0000 7fc44ac58640 1 -- 10.20.193.45:0/3439024357 --> v1:10.20.193.45:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fc44413f5f0 con 0x7fc4440a1a60 2026-02-22T23:26:15.188 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.170+0000 7fc44ac58640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T23:26:15.188 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.170+0000 7fc44ac58640 1 -- 10.20.193.45:0/3439024357 --> v1:10.20.193.45:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fc4440008d0 con 0x7fc44406f1e0 2026-02-22T23:26:15.188 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.170+0000 7fc4397fa640 1 -- 10.20.193.45:0/3439024357 <== mon.0 v1:10.20.193.45:6789/0 7 ==== mgrmap(e 5) ==== 50225+0+0 (unknown 2330357642 0 0) 0x7fc42c004e90 con 0x7fc4440a1a60 2026-02-22T23:26:15.188 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.170+0000 7fc4397fa640 1 -- 10.20.193.45:0/3439024357 <== mon.2 v1:10.20.193.45:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1725947027 0 0) 0x7fc4440008d0 con 0x7fc44406f1e0 2026-02-22T23:26:15.188 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.170+0000 7fc4397fa640 10 monclient(hunting): _negotiate 2026-02-22T23:26:15.188 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.170+0000 7fc4397fa640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:26:15.188 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.170+0000 7fc4397fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:26:15.188 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.170+0000 7fc4397fa640 10 monclient(hunting): my global_id is 4592 2026-02-22T23:26:15.188 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.170+0000 7fc4397fa640 1 -- 10.20.193.45:0/3439024357 --> v1:10.20.193.45:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc44411e3a0 con 0x7fc44406f1e0 2026-02-22T23:26:15.188 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.170+0000 7fc4397fa640 1 -- 10.20.193.45:0/3439024357 <== mon.0 v1:10.20.193.45:6789/0 8 ==== osd_map(21..21 src has 1..21) ==== 3921+0+0 (unknown 4068336701 0 0) 0x7fc42c04ddc0 con 0x7fc4440a1a60 2026-02-22T23:26:15.188 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.170+0000 7fc4397fa640 1 -- 10.20.193.45:0/3439024357 <== mon.2 v1:10.20.193.45:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2555243036 0 0) 0x7fc44411e3a0 con 0x7fc44406f1e0 2026-02-22T23:26:15.188 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.170+0000 7fc4397fa640 1 -- 10.20.193.45:0/3439024357 --> v1:10.20.193.45:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc4440008d0 con 0x7fc44406f1e0 2026-02-22T23:26:15.188 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.170+0000 7fc4397fa640 1 -- 10.20.193.45:0/3439024357 <== mon.2 v1:10.20.193.45:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7fc434003000 con 0x7fc44406f1e0 2026-02-22T23:26:15.188 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.170+0000 7fc4397fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:26:15.189 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.170+0000 7fc4397fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-22T23:26:15.189 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.170+0000 7fc4397fa640 10 monclient: dump: 2026-02-22T23:26:15.189 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:26:15.189 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:26:15.189 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:26:15.189 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:26:15.189 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:26:15.189 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:26:15.189 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:26:15.189 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:26:15.189 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:26:15.189 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:26:15.189 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:26:15.189 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:26:15.189 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:26:15.189 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:26:15.189 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:26:15.189 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:26:15.189 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.170+0000 7fc4491ce640 10 monclient: get_auth_request con 0x7fc41403f6c0 auth_method 0 2026-02-22T23:26:15.189 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.170+0000 7fc4397fa640 1 -- 10.20.193.45:0/3439024357 <== mon.2 v1:10.20.193.45:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2698082398 0 0) 0x7fc4440008d0 con 0x7fc44406f1e0 2026-02-22T23:26:15.190 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.170+0000 7fc4397fa640 1 -- 10.20.193.45:0/3439024357 --> v1:10.20.193.45:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc44411dc30 con 0x7fc44406f1e0 2026-02-22T23:26:15.190 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.171+0000 7fc4397fa640 1 -- 10.20.193.45:0/3439024357 <== mon.2 v1:10.20.193.45:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (unknown 0 0 2024835662) 0x7fc434003000 con 0x7fc44406f1e0 2026-02-22T23:26:15.190 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.171+0000 7fc4397fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T23:26:15.190 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.171+0000 7fc4397fa640 10 monclient: _finish_command 1 = system:0 2026-02-22T23:26:15.190 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.171+0000 7fc4397fa640 1 -- 10.20.193.45:0/3439024357 >> v1:10.20.193.45:6790/0 conn(0x7fc44406f1e0 legacy=0x7fc4440705e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:26:15.190 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.171+0000 7fc4397fa640 1 -- 10.20.193.45:0/3439024357 >> v1:10.20.193.45:6790/0 conn(0x7fc44406f1e0 legacy=0x7fc4440705e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T23:26:15.190 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.174+0000 7fc44ac58640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-22T23:26:15.190 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.174+0000 7fc44ac58640 1 -- 10.20.193.45:0/3439024357 --> v1:10.20.193.45:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fc444071400 con 0x7fc444140620 2026-02-22T23:26:15.190 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.174+0000 7fc4397fa640 1 -- 10.20.193.45:0/3439024357 <== mon.2 v1:10.20.193.45:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3951563588 0 0) 0x7fc444071400 con 0x7fc444140620 2026-02-22T23:26:15.190 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.174+0000 7fc4397fa640 10 monclient(hunting): _negotiate 2026-02-22T23:26:15.190 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.174+0000 7fc4397fa640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:26:15.190 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.174+0000 7fc4397fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:26:15.190 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.174+0000 7fc4397fa640 10 monclient(hunting): my global_id is 4601 2026-02-22T23:26:15.190 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.174+0000 7fc4397fa640 1 -- 10.20.193.45:0/3439024357 --> v1:10.20.193.45:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc4440008d0 con 0x7fc444140620 2026-02-22T23:26:15.190 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.174+0000 7fc4397fa640 1 -- 10.20.193.45:0/3439024357 <== mon.2 v1:10.20.193.45:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2647866269 0 0) 0x7fc4440008d0 con 0x7fc444140620 2026-02-22T23:26:15.190 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.174+0000 7fc4397fa640 1 -- 10.20.193.45:0/3439024357 --> v1:10.20.193.45:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc444071400 con 0x7fc444140620 2026-02-22T23:26:15.190 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.174+0000 7fc4397fa640 1 -- 10.20.193.45:0/3439024357 <== mon.2 v1:10.20.193.45:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7fc434004fd0 con 0x7fc444140620 2026-02-22T23:26:15.190 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.174+0000 7fc4397fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:26:15.191 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.174+0000 7fc4397fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-22T23:26:15.191 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.174+0000 7fc4397fa640 10 monclient: dump: 2026-02-22T23:26:15.191 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:26:15.191 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:26:15.191 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:26:15.191 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:26:15.191 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:26:15.191 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:26:15.191 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:26:15.191 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:26:15.191 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:26:15.191 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:26:15.191 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:26:15.191 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:26:15.191 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:26:15.191 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:26:15.191 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:26:15.191 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:26:15.191 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.174+0000 7fc4397fa640 1 -- 10.20.193.45:0/3439024357 <== mon.2 v1:10.20.193.45:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1335625830 0 0) 0x7fc444071400 con 0x7fc444140620 2026-02-22T23:26:15.191 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.174+0000 7fc4397fa640 1 -- 10.20.193.45:0/3439024357 --> v1:10.20.193.45:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fc444136f80 con 0x7fc444140620 2026-02-22T23:26:15.192 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.174+0000 7fc4397fa640 1 -- 10.20.193.45:0/3439024357 <== mon.2 v1:10.20.193.45:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7650 (unknown 0 0 2642996241) 0x7fc4340072d0 con 0x7fc444140620 2026-02-22T23:26:15.192 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.174+0000 7fc4397fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-22T23:26:15.192 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.174+0000 7fc4397fa640 10 monclient: _finish_command 2 = system:0 2026-02-22T23:26:15.192 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.174+0000 7fc4397fa640 1 -- 10.20.193.45:0/3439024357 >> v1:10.20.193.45:6790/0 conn(0x7fc444140620 legacy=0x7fc444070cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:26:15.192 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.174+0000 7fc4397fa640 1 -- 10.20.193.45:0/3439024357 >> v1:10.20.193.45:6790/0 conn(0x7fc444140620 legacy=0x7fc444070cf0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T23:26:15.192 INFO:teuthology.orchestra.run.trial045.stdout:{ 2026-02-22T23:26:15.192 INFO:teuthology.orchestra.run.trial045.stdout: "name": "b", 2026-02-22T23:26:15.192 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 2, 2026-02-22T23:26:15.192 INFO:teuthology.orchestra.run.trial045.stdout: "state": "peon", 2026-02-22T23:26:15.192 INFO:teuthology.orchestra.run.trial045.stdout: "election_epoch": 22, 2026-02-22T23:26:15.192 INFO:teuthology.orchestra.run.trial045.stdout: "uptime": 55327, 2026-02-22T23:26:15.193 INFO:teuthology.orchestra.run.trial045.stdout: "quorum": [ 2026-02-22T23:26:15.193 INFO:teuthology.orchestra.run.trial045.stdout: 0, 2026-02-22T23:26:15.193 INFO:teuthology.orchestra.run.trial045.stdout: 2, 2026-02-22T23:26:15.193 INFO:teuthology.orchestra.run.trial045.stdout: 3, 2026-02-22T23:26:15.193 INFO:teuthology.orchestra.run.trial045.stdout: 7, 2026-02-22T23:26:15.193 INFO:teuthology.orchestra.run.trial045.stdout: 8 2026-02-22T23:26:15.193 INFO:teuthology.orchestra.run.trial045.stdout: ], 2026-02-22T23:26:15.193 INFO:teuthology.orchestra.run.trial045.stdout: "quorum_age": 0, 2026-02-22T23:26:15.193 INFO:teuthology.orchestra.run.trial045.stdout: "features": { 2026-02-22T23:26:15.193 INFO:teuthology.orchestra.run.trial045.stdout: "required_con": "2450521708007866372", 2026-02-22T23:26:15.193 INFO:teuthology.orchestra.run.trial045.stdout: "required_mon": [ 2026-02-22T23:26:15.193 INFO:teuthology.orchestra.run.trial045.stdout: "kraken", 2026-02-22T23:26:15.193 INFO:teuthology.orchestra.run.trial045.stdout: "luminous", 2026-02-22T23:26:15.193 INFO:teuthology.orchestra.run.trial045.stdout: "mimic", 2026-02-22T23:26:15.193 INFO:teuthology.orchestra.run.trial045.stdout: "osdmap-prune", 2026-02-22T23:26:15.193 INFO:teuthology.orchestra.run.trial045.stdout: "nautilus", 2026-02-22T23:26:15.193 INFO:teuthology.orchestra.run.trial045.stdout: "octopus", 2026-02-22T23:26:15.193 INFO:teuthology.orchestra.run.trial045.stdout: "pacific", 2026-02-22T23:26:15.194 INFO:teuthology.orchestra.run.trial045.stdout: "elector-pinging", 2026-02-22T23:26:15.194 INFO:teuthology.orchestra.run.trial045.stdout: "quincy", 2026-02-22T23:26:15.194 INFO:teuthology.orchestra.run.trial045.stdout: "reef", 2026-02-22T23:26:15.194 INFO:teuthology.orchestra.run.trial045.stdout: "squid" 2026-02-22T23:26:15.194 INFO:teuthology.orchestra.run.trial045.stdout: ], 2026-02-22T23:26:15.194 INFO:teuthology.orchestra.run.trial045.stdout: "quorum_con": "4540701547738038271", 2026-02-22T23:26:15.194 INFO:teuthology.orchestra.run.trial045.stdout: "quorum_mon": [ 2026-02-22T23:26:15.194 INFO:teuthology.orchestra.run.trial045.stdout: "kraken", 2026-02-22T23:26:15.194 INFO:teuthology.orchestra.run.trial045.stdout: "luminous", 2026-02-22T23:26:15.194 INFO:teuthology.orchestra.run.trial045.stdout: "mimic", 2026-02-22T23:26:15.194 INFO:teuthology.orchestra.run.trial045.stdout: "osdmap-prune", 2026-02-22T23:26:15.194 INFO:teuthology.orchestra.run.trial045.stdout: "nautilus", 2026-02-22T23:26:15.194 INFO:teuthology.orchestra.run.trial045.stdout: "octopus", 2026-02-22T23:26:15.194 INFO:teuthology.orchestra.run.trial045.stdout: "pacific", 2026-02-22T23:26:15.194 INFO:teuthology.orchestra.run.trial045.stdout: "elector-pinging", 2026-02-22T23:26:15.194 INFO:teuthology.orchestra.run.trial045.stdout: "quincy", 2026-02-22T23:26:15.194 INFO:teuthology.orchestra.run.trial045.stdout: "reef", 2026-02-22T23:26:15.194 INFO:teuthology.orchestra.run.trial045.stdout: "squid" 2026-02-22T23:26:15.194 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:26:15.194 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:26:15.195 INFO:teuthology.orchestra.run.trial045.stdout: "outside_quorum": [], 2026-02-22T23:26:15.195 INFO:teuthology.orchestra.run.trial045.stdout: "extra_probe_peers": [], 2026-02-22T23:26:15.195 INFO:teuthology.orchestra.run.trial045.stdout: "sync_provider": [], 2026-02-22T23:26:15.195 INFO:teuthology.orchestra.run.trial045.stdout: "monmap": { 2026-02-22T23:26:15.195 INFO:teuthology.orchestra.run.trial045.stdout: "epoch": 1, 2026-02-22T23:26:15.195 INFO:teuthology.orchestra.run.trial045.stdout: "fsid": "4b60f18f-6660-4731-b731-dc85c4078413", 2026-02-22T23:26:15.195 INFO:teuthology.orchestra.run.trial045.stdout: "modified": "2026-02-22T23:24:52.393472Z", 2026-02-22T23:26:15.195 INFO:teuthology.orchestra.run.trial045.stdout: "created": "2026-02-22T23:24:52.393472Z", 2026-02-22T23:26:15.195 INFO:teuthology.orchestra.run.trial045.stdout: "min_mon_release": 19, 2026-02-22T23:26:15.195 INFO:teuthology.orchestra.run.trial045.stdout: "min_mon_release_name": "squid", 2026-02-22T23:26:15.195 INFO:teuthology.orchestra.run.trial045.stdout: "election_strategy": 3, 2026-02-22T23:26:15.195 INFO:teuthology.orchestra.run.trial045.stdout: "disallowed_leaders": "", 2026-02-22T23:26:15.195 INFO:teuthology.orchestra.run.trial045.stdout: "stretch_mode": false, 2026-02-22T23:26:15.195 INFO:teuthology.orchestra.run.trial045.stdout: "tiebreaker_mon": "", 2026-02-22T23:26:15.195 INFO:teuthology.orchestra.run.trial045.stdout: "removed_ranks": "", 2026-02-22T23:26:15.195 INFO:teuthology.orchestra.run.trial045.stdout: "features": { 2026-02-22T23:26:15.195 INFO:teuthology.orchestra.run.trial045.stdout: "persistent": [ 2026-02-22T23:26:15.195 INFO:teuthology.orchestra.run.trial045.stdout: "kraken", 2026-02-22T23:26:15.195 INFO:teuthology.orchestra.run.trial045.stdout: "luminous", 2026-02-22T23:26:15.195 INFO:teuthology.orchestra.run.trial045.stdout: "mimic", 2026-02-22T23:26:15.196 INFO:teuthology.orchestra.run.trial045.stdout: "osdmap-prune", 2026-02-22T23:26:15.196 INFO:teuthology.orchestra.run.trial045.stdout: "nautilus", 2026-02-22T23:26:15.196 INFO:teuthology.orchestra.run.trial045.stdout: "octopus", 2026-02-22T23:26:15.196 INFO:teuthology.orchestra.run.trial045.stdout: "pacific", 2026-02-22T23:26:15.196 INFO:teuthology.orchestra.run.trial045.stdout: "elector-pinging", 2026-02-22T23:26:15.196 INFO:teuthology.orchestra.run.trial045.stdout: "quincy", 2026-02-22T23:26:15.196 INFO:teuthology.orchestra.run.trial045.stdout: "reef", 2026-02-22T23:26:15.196 INFO:teuthology.orchestra.run.trial045.stdout: "squid" 2026-02-22T23:26:15.196 INFO:teuthology.orchestra.run.trial045.stdout: ], 2026-02-22T23:26:15.196 INFO:teuthology.orchestra.run.trial045.stdout: "optional": [] 2026-02-22T23:26:15.196 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:26:15.196 INFO:teuthology.orchestra.run.trial045.stdout: "mons": [ 2026-02-22T23:26:15.196 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:26:15.196 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 0, 2026-02-22T23:26:15.196 INFO:teuthology.orchestra.run.trial045.stdout: "name": "a", 2026-02-22T23:26:15.196 INFO:teuthology.orchestra.run.trial045.stdout: "public_addrs": { 2026-02-22T23:26:15.196 INFO:teuthology.orchestra.run.trial045.stdout: "addrvec": [ 2026-02-22T23:26:15.196 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:26:15.196 INFO:teuthology.orchestra.run.trial045.stdout: "type": "v1", 2026-02-22T23:26:15.196 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6789", 2026-02-22T23:26:15.196 INFO:teuthology.orchestra.run.trial045.stdout: "nonce": 0 2026-02-22T23:26:15.197 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:26:15.197 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:26:15.197 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:26:15.197 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6789/0", 2026-02-22T23:26:15.197 INFO:teuthology.orchestra.run.trial045.stdout: "public_addr": "10.20.193.45:6789/0", 2026-02-22T23:26:15.197 INFO:teuthology.orchestra.run.trial045.stdout: "priority": 0, 2026-02-22T23:26:15.197 INFO:teuthology.orchestra.run.trial045.stdout: "weight": 0, 2026-02-22T23:26:15.197 INFO:teuthology.orchestra.run.trial045.stdout: "crush_location": "{}" 2026-02-22T23:26:15.197 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:26:15.197 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:26:15.197 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 1, 2026-02-22T23:26:15.197 INFO:teuthology.orchestra.run.trial045.stdout: "name": "f", 2026-02-22T23:26:15.197 INFO:teuthology.orchestra.run.trial045.stdout: "public_addrs": { 2026-02-22T23:26:15.197 INFO:teuthology.orchestra.run.trial045.stdout: "addrvec": [ 2026-02-22T23:26:15.197 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:26:15.197 INFO:teuthology.orchestra.run.trial045.stdout: "type": "v1", 2026-02-22T23:26:15.197 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.73:6789", 2026-02-22T23:26:15.197 INFO:teuthology.orchestra.run.trial045.stdout: "nonce": 0 2026-02-22T23:26:15.197 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:26:15.197 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:26:15.198 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:26:15.198 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.73:6789/0", 2026-02-22T23:26:15.198 INFO:teuthology.orchestra.run.trial045.stdout: "public_addr": "10.20.193.73:6789/0", 2026-02-22T23:26:15.198 INFO:teuthology.orchestra.run.trial045.stdout: "priority": 0, 2026-02-22T23:26:15.198 INFO:teuthology.orchestra.run.trial045.stdout: "weight": 0, 2026-02-22T23:26:15.198 INFO:teuthology.orchestra.run.trial045.stdout: "crush_location": "{}" 2026-02-22T23:26:15.198 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:26:15.198 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:26:15.198 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 2, 2026-02-22T23:26:15.198 INFO:teuthology.orchestra.run.trial045.stdout: "name": "b", 2026-02-22T23:26:15.198 INFO:teuthology.orchestra.run.trial045.stdout: "public_addrs": { 2026-02-22T23:26:15.198 INFO:teuthology.orchestra.run.trial045.stdout: "addrvec": [ 2026-02-22T23:26:15.198 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:26:15.198 INFO:teuthology.orchestra.run.trial045.stdout: "type": "v1", 2026-02-22T23:26:15.198 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6790", 2026-02-22T23:26:15.198 INFO:teuthology.orchestra.run.trial045.stdout: "nonce": 0 2026-02-22T23:26:15.198 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:26:15.198 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:26:15.198 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:26:15.198 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6790/0", 2026-02-22T23:26:15.199 INFO:teuthology.orchestra.run.trial045.stdout: "public_addr": "10.20.193.45:6790/0", 2026-02-22T23:26:15.199 INFO:teuthology.orchestra.run.trial045.stdout: "priority": 0, 2026-02-22T23:26:15.199 INFO:teuthology.orchestra.run.trial045.stdout: "weight": 0, 2026-02-22T23:26:15.199 INFO:teuthology.orchestra.run.trial045.stdout: "crush_location": "{}" 2026-02-22T23:26:15.199 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:26:15.199 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:26:15.199 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 3, 2026-02-22T23:26:15.199 INFO:teuthology.orchestra.run.trial045.stdout: "name": "g", 2026-02-22T23:26:15.199 INFO:teuthology.orchestra.run.trial045.stdout: "public_addrs": { 2026-02-22T23:26:15.199 INFO:teuthology.orchestra.run.trial045.stdout: "addrvec": [ 2026-02-22T23:26:15.199 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:26:15.199 INFO:teuthology.orchestra.run.trial045.stdout: "type": "v1", 2026-02-22T23:26:15.199 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.73:6790", 2026-02-22T23:26:15.199 INFO:teuthology.orchestra.run.trial045.stdout: "nonce": 0 2026-02-22T23:26:15.199 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:26:15.199 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:26:15.199 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:26:15.199 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.73:6790/0", 2026-02-22T23:26:15.199 INFO:teuthology.orchestra.run.trial045.stdout: "public_addr": "10.20.193.73:6790/0", 2026-02-22T23:26:15.199 INFO:teuthology.orchestra.run.trial045.stdout: "priority": 0, 2026-02-22T23:26:15.199 INFO:teuthology.orchestra.run.trial045.stdout: "weight": 0, 2026-02-22T23:26:15.199 INFO:teuthology.orchestra.run.trial045.stdout: "crush_location": "{}" 2026-02-22T23:26:15.200 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:26:15.200 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:26:15.200 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 4, 2026-02-22T23:26:15.200 INFO:teuthology.orchestra.run.trial045.stdout: "name": "c", 2026-02-22T23:26:15.200 INFO:teuthology.orchestra.run.trial045.stdout: "public_addrs": { 2026-02-22T23:26:15.200 INFO:teuthology.orchestra.run.trial045.stdout: "addrvec": [ 2026-02-22T23:26:15.200 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:26:15.200 INFO:teuthology.orchestra.run.trial045.stdout: "type": "v1", 2026-02-22T23:26:15.200 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6791", 2026-02-22T23:26:15.200 INFO:teuthology.orchestra.run.trial045.stdout: "nonce": 0 2026-02-22T23:26:15.200 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:26:15.200 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:26:15.200 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:26:15.200 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6791/0", 2026-02-22T23:26:15.200 INFO:teuthology.orchestra.run.trial045.stdout: "public_addr": "10.20.193.45:6791/0", 2026-02-22T23:26:15.200 INFO:teuthology.orchestra.run.trial045.stdout: "priority": 0, 2026-02-22T23:26:15.200 INFO:teuthology.orchestra.run.trial045.stdout: "weight": 0, 2026-02-22T23:26:15.200 INFO:teuthology.orchestra.run.trial045.stdout: "crush_location": "{}" 2026-02-22T23:26:15.200 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:26:15.200 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:26:15.200 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 5, 2026-02-22T23:26:15.200 INFO:teuthology.orchestra.run.trial045.stdout: "name": "h", 2026-02-22T23:26:15.201 INFO:teuthology.orchestra.run.trial045.stdout: "public_addrs": { 2026-02-22T23:26:15.201 INFO:teuthology.orchestra.run.trial045.stdout: "addrvec": [ 2026-02-22T23:26:15.201 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:26:15.201 INFO:teuthology.orchestra.run.trial045.stdout: "type": "v1", 2026-02-22T23:26:15.201 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.73:6791", 2026-02-22T23:26:15.201 INFO:teuthology.orchestra.run.trial045.stdout: "nonce": 0 2026-02-22T23:26:15.201 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:26:15.201 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:26:15.201 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:26:15.201 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.73:6791/0", 2026-02-22T23:26:15.201 INFO:teuthology.orchestra.run.trial045.stdout: "public_addr": "10.20.193.73:6791/0", 2026-02-22T23:26:15.201 INFO:teuthology.orchestra.run.trial045.stdout: "priority": 0, 2026-02-22T23:26:15.201 INFO:teuthology.orchestra.run.trial045.stdout: "weight": 0, 2026-02-22T23:26:15.201 INFO:teuthology.orchestra.run.trial045.stdout: "crush_location": "{}" 2026-02-22T23:26:15.201 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:26:15.201 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:26:15.201 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 6, 2026-02-22T23:26:15.201 INFO:teuthology.orchestra.run.trial045.stdout: "name": "d", 2026-02-22T23:26:15.201 INFO:teuthology.orchestra.run.trial045.stdout: "public_addrs": { 2026-02-22T23:26:15.201 INFO:teuthology.orchestra.run.trial045.stdout: "addrvec": [ 2026-02-22T23:26:15.201 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:26:15.201 INFO:teuthology.orchestra.run.trial045.stdout: "type": "v1", 2026-02-22T23:26:15.201 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6792", 2026-02-22T23:26:15.202 INFO:teuthology.orchestra.run.trial045.stdout: "nonce": 0 2026-02-22T23:26:15.202 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:26:15.202 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:26:15.202 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:26:15.202 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6792/0", 2026-02-22T23:26:15.202 INFO:teuthology.orchestra.run.trial045.stdout: "public_addr": "10.20.193.45:6792/0", 2026-02-22T23:26:15.202 INFO:teuthology.orchestra.run.trial045.stdout: "priority": 0, 2026-02-22T23:26:15.202 INFO:teuthology.orchestra.run.trial045.stdout: "weight": 0, 2026-02-22T23:26:15.202 INFO:teuthology.orchestra.run.trial045.stdout: "crush_location": "{}" 2026-02-22T23:26:15.202 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:26:15.202 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:26:15.202 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 7, 2026-02-22T23:26:15.202 INFO:teuthology.orchestra.run.trial045.stdout: "name": "i", 2026-02-22T23:26:15.202 INFO:teuthology.orchestra.run.trial045.stdout: "public_addrs": { 2026-02-22T23:26:15.202 INFO:teuthology.orchestra.run.trial045.stdout: "addrvec": [ 2026-02-22T23:26:15.202 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:26:15.202 INFO:teuthology.orchestra.run.trial045.stdout: "type": "v1", 2026-02-22T23:26:15.202 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.73:6792", 2026-02-22T23:26:15.202 INFO:teuthology.orchestra.run.trial045.stdout: "nonce": 0 2026-02-22T23:26:15.202 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:26:15.202 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:26:15.202 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:26:15.202 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.73:6792/0", 2026-02-22T23:26:15.202 INFO:teuthology.orchestra.run.trial045.stdout: "public_addr": "10.20.193.73:6792/0", 2026-02-22T23:26:15.203 INFO:teuthology.orchestra.run.trial045.stdout: "priority": 0, 2026-02-22T23:26:15.203 INFO:teuthology.orchestra.run.trial045.stdout: "weight": 0, 2026-02-22T23:26:15.203 INFO:teuthology.orchestra.run.trial045.stdout: "crush_location": "{}" 2026-02-22T23:26:15.203 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:26:15.203 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:26:15.203 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 8, 2026-02-22T23:26:15.203 INFO:teuthology.orchestra.run.trial045.stdout: "name": "e", 2026-02-22T23:26:15.203 INFO:teuthology.orchestra.run.trial045.stdout: "public_addrs": { 2026-02-22T23:26:15.203 INFO:teuthology.orchestra.run.trial045.stdout: "addrvec": [ 2026-02-22T23:26:15.203 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:26:15.203 INFO:teuthology.orchestra.run.trial045.stdout: "type": "v1", 2026-02-22T23:26:15.203 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6793", 2026-02-22T23:26:15.203 INFO:teuthology.orchestra.run.trial045.stdout: "nonce": 0 2026-02-22T23:26:15.203 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:26:15.203 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:26:15.203 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:26:15.203 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6793/0", 2026-02-22T23:26:15.203 INFO:teuthology.orchestra.run.trial045.stdout: "public_addr": "10.20.193.45:6793/0", 2026-02-22T23:26:15.203 INFO:teuthology.orchestra.run.trial045.stdout: "priority": 0, 2026-02-22T23:26:15.203 INFO:teuthology.orchestra.run.trial045.stdout: "weight": 0, 2026-02-22T23:26:15.203 INFO:teuthology.orchestra.run.trial045.stdout: "crush_location": "{}" 2026-02-22T23:26:15.203 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:26:15.203 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:26:15.203 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:26:15.203 INFO:teuthology.orchestra.run.trial045.stdout: "feature_map": { 2026-02-22T23:26:15.204 INFO:teuthology.orchestra.run.trial045.stdout: "mon": [ 2026-02-22T23:26:15.204 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:26:15.204 INFO:teuthology.orchestra.run.trial045.stdout: "features": "0x3f03cffffffdffff", 2026-02-22T23:26:15.204 INFO:teuthology.orchestra.run.trial045.stdout: "release": "squid", 2026-02-22T23:26:15.204 INFO:teuthology.orchestra.run.trial045.stdout: "num": 1 2026-02-22T23:26:15.204 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:26:15.204 INFO:teuthology.orchestra.run.trial045.stdout: ], 2026-02-22T23:26:15.204 INFO:teuthology.orchestra.run.trial045.stdout: "osd": [ 2026-02-22T23:26:15.204 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:26:15.204 INFO:teuthology.orchestra.run.trial045.stdout: "features": "0x3f03cffffffdffff", 2026-02-22T23:26:15.204 INFO:teuthology.orchestra.run.trial045.stdout: "release": "squid", 2026-02-22T23:26:15.204 INFO:teuthology.orchestra.run.trial045.stdout: "num": 4 2026-02-22T23:26:15.204 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:26:15.204 INFO:teuthology.orchestra.run.trial045.stdout: ], 2026-02-22T23:26:15.204 INFO:teuthology.orchestra.run.trial045.stdout: "client": [ 2026-02-22T23:26:15.204 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:26:15.204 INFO:teuthology.orchestra.run.trial045.stdout: "features": "0x3f03cffffffdffff", 2026-02-22T23:26:15.204 INFO:teuthology.orchestra.run.trial045.stdout: "release": "squid", 2026-02-22T23:26:15.204 INFO:teuthology.orchestra.run.trial045.stdout: "num": 2 2026-02-22T23:26:15.204 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:26:15.204 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:26:15.204 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:26:15.204 INFO:teuthology.orchestra.run.trial045.stdout: "stretch_mode": false 2026-02-22T23:26:15.204 INFO:teuthology.orchestra.run.trial045.stdout:} 2026-02-22T23:26:15.205 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.174+0000 7fc44ac58640 1 -- 10.20.193.45:0/3439024357 >> v1:10.20.193.73:6800/2222410180 conn(0x7fc41403f6c0 legacy=0x7fc414041b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:26:15.205 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.174+0000 7fc44ac58640 10 monclient: shutdown 2026-02-22T23:26:15.205 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.174+0000 7fc44ac58640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T23:26:15.205 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.174+0000 7fc44ac58640 1 -- 10.20.193.45:0/3439024357 >> v1:10.20.193.45:6789/0 conn(0x7fc4440a1a60 legacy=0x7fc4441d44b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:26:15.205 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.174+0000 7fc4491ce640 1 -- 10.20.193.45:0/3439024357 reap_dead start 2026-02-22T23:26:15.205 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.174+0000 7fc4491ce640 1 -- 10.20.193.45:0/3439024357 reap_dead start 2026-02-22T23:26:15.205 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.174+0000 7fc44ac58640 1 -- 10.20.193.45:0/3439024357 shutdown_connections 2026-02-22T23:26:15.206 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.174+0000 7fc44ac58640 1 -- 10.20.193.45:0/3439024357 >> 10.20.193.45:0/3439024357 conn(0x7fc4440a7780 msgr2=0x7fc444140db0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:26:15.206 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.174+0000 7fc44ac58640 1 -- 10.20.193.45:0/3439024357 shutdown_connections 2026-02-22T23:26:15.206 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.174+0000 7fc44ac58640 1 -- 10.20.193.45:0/3439024357 wait complete. 2026-02-22T23:26:15.206 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 5 2026-02-22T23:26:15.206 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 5 for mon e 2026-02-22T23:26:15.206 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.e mon_status 2026-02-22T23:26:15.273 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.272+0000 7f50ef04c640 10 monclient: get_monmap_and_config 2026-02-22T23:26:15.274 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.272+0000 7f50ef04c640 10 monclient: build_initial_monmap 2026-02-22T23:26:15.274 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.272+0000 7f50ef04c640 10 monclient: monmap: 2026-02-22T23:26:15.274 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-22T23:26:15.274 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:26:15.274 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:26:15.273672+0000 2026-02-22T23:26:15.274 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:26:15.273672+0000 2026-02-22T23:26:15.274 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-22T23:26:15.274 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:26:15.275 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-22T23:26:15.275 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.noname-f 2026-02-22T23:26:15.275 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.noname-b 2026-02-22T23:26:15.275 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.noname-g 2026-02-22T23:26:15.275 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.noname-c 2026-02-22T23:26:15.275 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.noname-h 2026-02-22T23:26:15.275 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.noname-d 2026-02-22T23:26:15.275 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.noname-i 2026-02-22T23:26:15.275 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.noname-e 2026-02-22T23:26:15.275 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:26:15.276 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.272+0000 7f50ef04c640 1 Processor -- start 2026-02-22T23:26:15.276 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.273+0000 7f50ef04c640 1 -- start start 2026-02-22T23:26:15.276 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.273+0000 7f50ef04c640 10 monclient: init 2026-02-22T23:26:15.276 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.273+0000 7f50ef04c640 10 monclient: _reopen_session rank -1 2026-02-22T23:26:15.276 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.273+0000 7f50ef04c640 10 monclient: _add_conns ranks=[5,1,6,3,8,2,4,7,0] 2026-02-22T23:26:15.276 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.273+0000 7f50ef04c640 10 monclient(hunting): picked mon.noname-h con 0x7f50e80a5e00 addr v1:10.20.193.73:6791/0 2026-02-22T23:26:15.276 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.273+0000 7f50ef04c640 10 monclient(hunting): picked mon.noname-f con 0x7f50e80a68f0 addr v1:10.20.193.73:6789/0 2026-02-22T23:26:15.276 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.273+0000 7f50ef04c640 10 monclient(hunting): picked mon.noname-d con 0x7f50e80a6d00 addr v1:10.20.193.45:6792/0 2026-02-22T23:26:15.276 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.273+0000 7f50ef04c640 1 -- --> v1:10.20.193.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f50e80a2d00 con 0x7f50e80a68f0 2026-02-22T23:26:15.277 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.273+0000 7f50ef04c640 1 -- --> v1:10.20.193.73:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f50e80a2fe0 con 0x7f50e80a5e00 2026-02-22T23:26:15.277 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.273+0000 7f50ef04c640 1 -- --> v1:10.20.193.45:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f50e80a32c0 con 0x7f50e80a6d00 2026-02-22T23:26:15.277 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.273+0000 7f50ef04c640 10 monclient(hunting): _renew_subs 2026-02-22T23:26:15.277 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.273+0000 7f50ef04c640 10 monclient(hunting): authenticate will time out at 706.890520s 2026-02-22T23:26:15.277 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.273+0000 7f50ed5c2640 1 -- >> v1:10.20.193.45:6792/0 conn(0x7f50e80a6d00 legacy=0x7f50e81417b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.45:6792/0 2026-02-22T23:26:15.277 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.273+0000 7f50ecdc1640 1 -- >> v1:10.20.193.73:6791/0 conn(0x7f50e80a5e00 legacy=0x7f50e80a61e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.73:6791/0 2026-02-22T23:26:15.277 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.273+0000 7f50dffff640 1 -- >> v1:10.20.193.73:6789/0 conn(0x7f50e80a68f0 legacy=0x7f50e813e080 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.73:6789/0 2026-02-22T23:26:15.474 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.474+0000 7f50ed5c2640 1 -- >> v1:10.20.193.45:6792/0 conn(0x7f50e80a6d00 legacy=0x7f50e81417b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.45:6792/0 2026-02-22T23:26:15.474 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.474+0000 7f50ecdc1640 1 -- >> v1:10.20.193.73:6791/0 conn(0x7f50e80a5e00 legacy=0x7f50e80a61e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.73:6791/0 2026-02-22T23:26:15.474 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.474+0000 7f50dffff640 1 -- >> v1:10.20.193.73:6789/0 conn(0x7f50e80a68f0 legacy=0x7f50e813e080 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.73:6789/0 2026-02-22T23:26:15.873 INFO:teuthology.orchestra.run.trial073.stdout:process_2_[46025]: starting. 2026-02-22T23:26:15.873 INFO:teuthology.orchestra.run.trial073.stdout:process_2_[46025]: deleting pool ceph_test_rados_delete_pools_parallel.trial073-46023 2026-02-22T23:26:15.873 INFO:teuthology.orchestra.run.trial073.stdout:process_2_[46025]: shutting down. 2026-02-22T23:26:15.876 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.875+0000 7f50ed5c2640 1 -- >> v1:10.20.193.45:6792/0 conn(0x7f50e80a6d00 legacy=0x7f50e81417b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.45:6792/0 2026-02-22T23:26:15.876 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.875+0000 7f50dffff640 1 -- >> v1:10.20.193.73:6789/0 conn(0x7f50e80a68f0 legacy=0x7f50e813e080 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.73:6789/0 2026-02-22T23:26:15.876 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:15.875+0000 7f50ecdc1640 1 -- >> v1:10.20.193.73:6791/0 conn(0x7f50e80a5e00 legacy=0x7f50e80a61e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.73:6791/0 2026-02-22T23:26:16.677 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:16.676+0000 7f50ed5c2640 1 -- >> v1:10.20.193.45:6792/0 conn(0x7f50e80a6d00 legacy=0x7f50e81417b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.45:6792/0 2026-02-22T23:26:16.677 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:16.676+0000 7f50dffff640 1 -- >> v1:10.20.193.73:6789/0 conn(0x7f50e80a68f0 legacy=0x7f50e813e080 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.73:6789/0 2026-02-22T23:26:16.677 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:16.677+0000 7f50ecdc1640 1 -- >> v1:10.20.193.73:6791/0 conn(0x7f50e80a5e00 legacy=0x7f50e80a61e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.73:6791/0 2026-02-22T23:26:17.922 INFO:teuthology.orchestra.run.trial073.stdout:******************************* 2026-02-22T23:26:17.923 INFO:teuthology.orchestra.run.trial073.stdout:process_3_[46058]: starting. 2026-02-22T23:26:17.923 INFO:teuthology.orchestra.run.trial073.stdout:process_3_[46058]: creating pool ceph_test_rados_delete_pools_parallel.trial073-46023 2026-02-22T23:26:17.923 INFO:teuthology.orchestra.run.trial073.stdout:process_3_[46058]: created object 0... 2026-02-22T23:26:17.923 INFO:teuthology.orchestra.run.trial073.stdout:process_3_[46058]: created object 25... 2026-02-22T23:26:17.923 INFO:teuthology.orchestra.run.trial073.stdout:process_3_[46058]: created object 49... 2026-02-22T23:26:17.923 INFO:teuthology.orchestra.run.trial073.stdout:process_3_[46058]: finishing. 2026-02-22T23:26:17.923 INFO:teuthology.orchestra.run.trial073.stdout:process_3_[46058]: shutting down. 2026-02-22T23:26:17.929 INFO:teuthology.orchestra.run.trial073.stdout:******************************* 2026-02-22T23:26:17.929 INFO:teuthology.orchestra.run.trial073.stdout:process_5_[46060]: starting. 2026-02-22T23:26:17.929 INFO:teuthology.orchestra.run.trial073.stdout:process_5_[46060]: listing objects. 2026-02-22T23:26:17.929 INFO:teuthology.orchestra.run.trial073.stdout:process_5_[46060]: listed object 0... 2026-02-22T23:26:17.929 INFO:teuthology.orchestra.run.trial073.stdout:process_5_[46060]: listed object 25... 2026-02-22T23:26:17.930 INFO:teuthology.orchestra.run.trial073.stdout:process_5_[46060]: saw 50 objects 2026-02-22T23:26:17.930 INFO:teuthology.orchestra.run.trial073.stdout:process_5_[46060]: shutting down. 2026-02-22T23:26:18.275 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.274+0000 7f50de7fc640 10 monclient(hunting): tick 2026-02-22T23:26:18.275 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.274+0000 7f50de7fc640 10 monclient(hunting): _check_auth_tickets 2026-02-22T23:26:18.275 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.274+0000 7f50de7fc640 1 monclient(hunting): continuing hunt 2026-02-22T23:26:18.275 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.274+0000 7f50de7fc640 10 monclient(hunting): _reopen_session rank -1 2026-02-22T23:26:18.275 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.274+0000 7f50de7fc640 1 -- >> v1:10.20.193.45:6792/0 conn(0x7f50e80a6d00 legacy=0x7f50e81417b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-22T23:26:18.275 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.274+0000 7f50de7fc640 1 -- >> v1:10.20.193.73:6791/0 conn(0x7f50e80a5e00 legacy=0x7f50e80a61e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-22T23:26:18.275 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.274+0000 7f50de7fc640 1 -- >> v1:10.20.193.73:6789/0 conn(0x7f50e80a68f0 legacy=0x7f50e813e080 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-22T23:26:18.275 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.274+0000 7f50de7fc640 10 monclient: _add_conns ranks=[2,3,4,7,0,8] 2026-02-22T23:26:18.275 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.274+0000 7f50de7fc640 10 monclient(hunting): picked mon.noname-b con 0x7f50cc003880 addr v1:10.20.193.45:6790/0 2026-02-22T23:26:18.275 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.274+0000 7f50de7fc640 10 monclient(hunting): picked mon.noname-g con 0x7f50cc007510 addr v1:10.20.193.73:6790/0 2026-02-22T23:26:18.276 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.274+0000 7f50de7fc640 10 monclient(hunting): picked mon.noname-c con 0x7f50cc00b2a0 addr v1:10.20.193.45:6791/0 2026-02-22T23:26:18.276 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.274+0000 7f50de7fc640 1 -- --> v1:10.20.193.45:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f50e80a35a0 con 0x7f50cc003880 2026-02-22T23:26:18.276 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.274+0000 7f50de7fc640 1 -- --> v1:10.20.193.73:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f50e80a2d00 con 0x7f50cc007510 2026-02-22T23:26:18.276 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.274+0000 7f50de7fc640 1 -- --> v1:10.20.193.45:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f50e80a2fe0 con 0x7f50cc00b2a0 2026-02-22T23:26:18.276 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.274+0000 7f50de7fc640 10 monclient(hunting): _renew_subs 2026-02-22T23:26:18.276 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.274+0000 7f50ed5c2640 1 -- >> v1:10.20.193.45:6791/0 conn(0x7f50cc00b2a0 legacy=0x7f50cc00d760 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.45:6791/0 2026-02-22T23:26:18.276 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.274+0000 7f50ecdc1640 1 --1- >> v1:10.20.193.45:6790/0 conn(0x7f50cc003880 0x7f50cc005cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.45:6790/0 says I am v1:10.20.193.45:46270/0 (socket says 10.20.193.45:46270) 2026-02-22T23:26:18.276 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.274+0000 7f50ecdc1640 1 -- 10.20.193.45:0/2349758880 learned_addr learned my addr 10.20.193.45:0/2349758880 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-22T23:26:18.276 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.274+0000 7f50df7fe640 1 -- 10.20.193.45:0/2349758880 <== mon.2 v1:10.20.193.45:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2896480259 0 0) 0x7f50e80a35a0 con 0x7f50cc003880 2026-02-22T23:26:18.276 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.274+0000 7f50df7fe640 10 monclient(hunting): _negotiate 2026-02-22T23:26:18.276 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.274+0000 7f50df7fe640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:26:18.276 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.274+0000 7f50df7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:26:18.276 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.274+0000 7f50df7fe640 10 monclient(hunting): my global_id is 4610 2026-02-22T23:26:18.276 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.274+0000 7f50df7fe640 1 -- 10.20.193.45:0/2349758880 --> v1:10.20.193.45:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f50d4003620 con 0x7f50cc003880 2026-02-22T23:26:18.276 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.275+0000 7f50df7fe640 1 -- 10.20.193.45:0/2349758880 <== mon.3 v1:10.20.193.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4157292843 0 0) 0x7f50e80a2d00 con 0x7f50cc007510 2026-02-22T23:26:18.276 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.275+0000 7f50df7fe640 10 monclient(hunting): _negotiate 2026-02-22T23:26:18.276 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.275+0000 7f50df7fe640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:26:18.276 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.275+0000 7f50df7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:26:18.276 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.275+0000 7f50df7fe640 10 monclient(hunting): my global_id is 4521 2026-02-22T23:26:18.276 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.275+0000 7f50df7fe640 1 -- 10.20.193.45:0/2349758880 --> v1:10.20.193.73:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f50e80a35a0 con 0x7f50cc007510 2026-02-22T23:26:18.276 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.275+0000 7f50df7fe640 1 -- 10.20.193.45:0/2349758880 <== mon.2 v1:10.20.193.45:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3995120231 0 0) 0x7f50d4003620 con 0x7f50cc003880 2026-02-22T23:26:18.276 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.275+0000 7f50df7fe640 1 -- 10.20.193.45:0/2349758880 >> v1:10.20.193.45:6791/0 conn(0x7f50cc00b2a0 legacy=0x7f50cc00d760 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-22T23:26:18.276 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.275+0000 7f50df7fe640 1 -- 10.20.193.45:0/2349758880 >> v1:10.20.193.73:6790/0 conn(0x7f50cc007510 legacy=0x7f50cc0099d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:26:18.276 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.275+0000 7f50df7fe640 10 monclient: _finish_hunting 0 2026-02-22T23:26:18.276 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.275+0000 7f50df7fe640 1 monclient: found mon.noname-b 2026-02-22T23:26:18.276 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.275+0000 7f50ed5c2640 1 -- 10.20.193.45:0/2349758880 reap_dead start 2026-02-22T23:26:18.276 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.275+0000 7f50df7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T23:26:18.276 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.275+0000 7f50df7fe640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.45:6790/0 2026-02-22T23:26:18.276 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.275+0000 7f50df7fe640 1 -- 10.20.193.45:0/2349758880 --> v1:10.20.193.45:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50e80a32c0 con 0x7f50cc003880 2026-02-22T23:26:18.276 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.275+0000 7f50df7fe640 10 monclient: _finish_auth 0 2026-02-22T23:26:18.276 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.275+0000 7f50df7fe640 10 monclient: _check_auth_tickets 2026-02-22T23:26:18.276 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.275+0000 7f50df7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T23:26:18.276 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.275+0000 7f50df7fe640 1 -- 10.20.193.45:0/2349758880 <== mon.2 v1:10.20.193.45:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f50d80042b0 con 0x7f50cc003880 2026-02-22T23:26:18.276 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.275+0000 7f50df7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:26:18.276 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.275+0000 7f50df7fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-22T23:26:18.277 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.275+0000 7f50df7fe640 10 monclient: dump: 2026-02-22T23:26:18.277 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:26:18.277 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:26:18.277 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:26:18.277 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:26:18.277 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:26:18.277 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:26:18.277 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:26:18.277 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:26:18.277 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:26:18.277 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:26:18.277 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:26:18.277 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:26:18.277 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:26:18.277 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:26:18.277 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:26:18.277 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:26:18.277 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.275+0000 7f50ef04c640 5 monclient: authenticate success, global_id 4610 2026-02-22T23:26:18.277 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.275+0000 7f50ef04c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-22T23:26:18.277 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.275+0000 7f50df7fe640 1 -- 10.20.193.45:0/2349758880 <== mon.2 v1:10.20.193.45:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f50d8004450 con 0x7f50cc003880 2026-02-22T23:26:18.277 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.275+0000 7f50df7fe640 10 monclient: handle_config config(0 keys) 2026-02-22T23:26:18.277 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.275+0000 7f50df7fe640 1 -- 10.20.193.45:0/2349758880 <== mon.2 v1:10.20.193.45:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f50d8004a80 con 0x7f50cc003880 2026-02-22T23:26:18.277 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.275+0000 7f50ef04c640 10 monclient: get_monmap_and_config success 2026-02-22T23:26:18.277 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.275+0000 7f50ef04c640 4 set_mon_vals no callback set 2026-02-22T23:26:18.277 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.275+0000 7f50df7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:26:18.277 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.275+0000 7f50df7fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-22T23:26:18.277 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.275+0000 7f50df7fe640 10 monclient: dump: 2026-02-22T23:26:18.277 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:26:18.277 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:26:18.277 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:26:18.277 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:26:18.277 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:26:18.277 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:26:18.277 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:26:18.277 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:26:18.277 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:26:18.277 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:26:18.277 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:26:18.277 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:26:18.277 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:26:18.277 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:26:18.277 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:26:18.278 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:26:18.279 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.276+0000 7f50ef04c640 10 monclient: shutdown 2026-02-22T23:26:18.279 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.276+0000 7f50ef04c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T23:26:18.279 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.276+0000 7f50ef04c640 1 -- 10.20.193.45:0/2349758880 >> v1:10.20.193.45:6790/0 conn(0x7f50cc003880 legacy=0x7f50cc005cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:26:18.279 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.276+0000 7f50ef04c640 1 -- 10.20.193.45:0/2349758880 shutdown_connections 2026-02-22T23:26:18.279 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.276+0000 7f50ef04c640 1 -- 10.20.193.45:0/2349758880 >> 10.20.193.45:0/2349758880 conn(0x7f50e80abb50 msgr2=0x7f50e80a7f00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:26:18.279 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.276+0000 7f50ef04c640 1 -- 10.20.193.45:0/2349758880 shutdown_connections 2026-02-22T23:26:18.279 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.276+0000 7f50ef04c640 1 -- 10.20.193.45:0/2349758880 wait complete. 2026-02-22T23:26:18.279 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.277+0000 7f50ef04c640 10 monclient: build_initial_monmap 2026-02-22T23:26:18.279 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.277+0000 7f50ef04c640 10 monclient: monmap: 2026-02-22T23:26:18.279 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-22T23:26:18.279 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T23:26:18.279 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-22T23:26:18.279 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-22T23:26:18.279 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-22T23:26:18.279 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-22T23:26:18.279 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-22T23:26:18.279 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.noname-f 2026-02-22T23:26:18.279 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.noname-b 2026-02-22T23:26:18.279 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.noname-g 2026-02-22T23:26:18.279 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.noname-c 2026-02-22T23:26:18.279 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.noname-h 2026-02-22T23:26:18.279 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.noname-d 2026-02-22T23:26:18.279 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.noname-i 2026-02-22T23:26:18.279 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.noname-e 2026-02-22T23:26:18.279 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:26:18.279 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.277+0000 7f50ef04c640 1 Processor -- start 2026-02-22T23:26:18.279 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.277+0000 7f50ef04c640 1 -- start start 2026-02-22T23:26:18.279 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.277+0000 7f50ef04c640 10 monclient: init 2026-02-22T23:26:18.280 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.277+0000 7f50ef04c640 10 monclient: _reopen_session rank -1 2026-02-22T23:26:18.280 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.277+0000 7f50ef04c640 10 monclient: _add_conns ranks=[6,2,7,5,1,4,8,0,3] 2026-02-22T23:26:18.280 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.277+0000 7f50ef04c640 10 monclient(hunting): picked mon.noname-d con 0x7f50cc003880 addr v1:10.20.193.45:6792/0 2026-02-22T23:26:18.280 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.277+0000 7f50ef04c640 10 monclient(hunting): picked mon.noname-b con 0x7f50e8139760 addr v1:10.20.193.45:6790/0 2026-02-22T23:26:18.280 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.277+0000 7f50ef04c640 10 monclient(hunting): picked mon.noname-i con 0x7f50e81cf6f0 addr v1:10.20.193.73:6792/0 2026-02-22T23:26:18.280 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.277+0000 7f50ef04c640 1 -- --> v1:10.20.193.45:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f50e8126a10 con 0x7f50e8139760 2026-02-22T23:26:18.280 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.277+0000 7f50ecdc1640 1 -- >> v1:10.20.193.45:6792/0 conn(0x7f50cc003880 legacy=0x7f50e8139050 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.45:6792/0 2026-02-22T23:26:18.280 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.277+0000 7f50ef04c640 1 -- --> v1:10.20.193.45:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f50e80a1c40 con 0x7f50cc003880 2026-02-22T23:26:18.280 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.277+0000 7f50ef04c640 1 -- --> v1:10.20.193.73:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f50e80a1910 con 0x7f50e81cf6f0 2026-02-22T23:26:18.280 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.277+0000 7f50ef04c640 10 monclient(hunting): _renew_subs 2026-02-22T23:26:18.280 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.277+0000 7f50ef04c640 10 monclient(hunting): authenticate will time out at 709.893649s 2026-02-22T23:26:18.280 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.277+0000 7f50dffff640 1 --1- >> v1:10.20.193.45:6790/0 conn(0x7f50e8139760 0x7f50e81d47b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.45:6790/0 says I am v1:10.20.193.45:46278/0 (socket says 10.20.193.45:46278) 2026-02-22T23:26:18.280 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.277+0000 7f50dffff640 1 -- 10.20.193.45:0/2344686586 learned_addr learned my addr 10.20.193.45:0/2344686586 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-22T23:26:18.280 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.277+0000 7f50dd7fa640 1 -- 10.20.193.45:0/2344686586 <== mon.2 v1:10.20.193.45:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2240737585 0 0) 0x7f50e8126a10 con 0x7f50e8139760 2026-02-22T23:26:18.280 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.277+0000 7f50dd7fa640 10 monclient(hunting): _negotiate 2026-02-22T23:26:18.280 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.277+0000 7f50dd7fa640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:26:18.280 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.277+0000 7f50dd7fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:26:18.280 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.277+0000 7f50dd7fa640 10 monclient(hunting): my global_id is 4619 2026-02-22T23:26:18.280 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.277+0000 7f50dd7fa640 1 -- 10.20.193.45:0/2344686586 --> v1:10.20.193.45:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f50b8003620 con 0x7f50e8139760 2026-02-22T23:26:18.280 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.278+0000 7f50dd7fa640 1 -- 10.20.193.45:0/2344686586 <== mon.2 v1:10.20.193.45:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2664927518 0 0) 0x7f50b8003620 con 0x7f50e8139760 2026-02-22T23:26:18.280 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.278+0000 7f50dd7fa640 1 -- 10.20.193.45:0/2344686586 --> v1:10.20.193.45:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f50e8126a10 con 0x7f50e8139760 2026-02-22T23:26:18.280 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.278+0000 7f50dd7fa640 1 -- 10.20.193.45:0/2344686586 <== mon.2 v1:10.20.193.45:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f50d00045b0 con 0x7f50e8139760 2026-02-22T23:26:18.280 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.278+0000 7f50dd7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-22T23:26:18.280 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.278+0000 7f50dd7fa640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-22T23:26:18.280 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.278+0000 7f50dd7fa640 10 monclient(hunting): dump: 2026-02-22T23:26:18.280 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:26:18.280 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:26:18.280 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:26:18.280 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:26:18.280 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:26:18.280 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:26:18.280 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:26:18.280 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:26:18.280 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:26:18.280 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:26:18.280 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:26:18.280 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:26:18.280 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:26:18.280 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:26:18.280 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:26:18.281 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:26:18.281 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.278+0000 7f50dd7fa640 10 monclient(hunting): _finish_auth 0 2026-02-22T23:26:18.281 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.278+0000 7f50dd7fa640 1 -- 10.20.193.45:0/2344686586 <== mon.2 v1:10.20.193.45:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 696955349 0 0) 0x7f50e8126a10 con 0x7f50e8139760 2026-02-22T23:26:18.281 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.278+0000 7f50dd7fa640 1 -- 10.20.193.45:0/2344686586 >> v1:10.20.193.73:6792/0 conn(0x7f50e81cf6f0 legacy=0x7f50e81d7ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:26:18.281 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.278+0000 7f50dd7fa640 1 -- 10.20.193.45:0/2344686586 >> v1:10.20.193.45:6792/0 conn(0x7f50cc003880 legacy=0x7f50e8139050 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-22T23:26:18.281 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.278+0000 7f50dd7fa640 10 monclient: _finish_hunting 0 2026-02-22T23:26:18.281 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.278+0000 7f50dd7fa640 1 monclient: found mon.b 2026-02-22T23:26:18.281 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.278+0000 7f50dd7fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T23:26:18.281 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.278+0000 7f50dd7fa640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.45:6790/0 2026-02-22T23:26:18.281 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.278+0000 7f50dd7fa640 1 -- 10.20.193.45:0/2344686586 --> v1:10.20.193.45:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50e80a4c50 con 0x7f50e8139760 2026-02-22T23:26:18.281 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.278+0000 7f50dd7fa640 10 monclient: _finish_auth 0 2026-02-22T23:26:18.281 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.278+0000 7f50dd7fa640 10 monclient: _check_auth_tickets 2026-02-22T23:26:18.281 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.278+0000 7f50dd7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T23:26:18.281 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.278+0000 7f50ef04c640 5 monclient: authenticate success, global_id 4619 2026-02-22T23:26:18.281 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.278+0000 7f50ef04c640 10 monclient: _renew_subs 2026-02-22T23:26:18.281 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.278+0000 7f50ef04c640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.45:6790/0 2026-02-22T23:26:18.281 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.278+0000 7f50ef04c640 1 -- 10.20.193.45:0/2344686586 --> v1:10.20.193.45:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f50e8126730 con 0x7f50e8139760 2026-02-22T23:26:18.281 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.278+0000 7f50ef04c640 10 monclient: _renew_subs 2026-02-22T23:26:18.281 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.278+0000 7f50ef04c640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.45:6790/0 2026-02-22T23:26:18.281 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.278+0000 7f50ef04c640 1 -- 10.20.193.45:0/2344686586 --> v1:10.20.193.45:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f50e81d9600 con 0x7f50e8139760 2026-02-22T23:26:18.281 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.278+0000 7f50dd7fa640 1 -- 10.20.193.45:0/2344686586 <== mon.2 v1:10.20.193.45:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f50d0004750 con 0x7f50e8139760 2026-02-22T23:26:18.281 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.278+0000 7f50dd7fa640 10 monclient: handle_config config(0 keys) 2026-02-22T23:26:18.281 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.278+0000 7f50dd7fa640 1 -- 10.20.193.45:0/2344686586 <== mon.2 v1:10.20.193.45:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f50d0004d80 con 0x7f50e8139760 2026-02-22T23:26:18.281 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.278+0000 7f50dd7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:26:18.281 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.278+0000 7f50dd7fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-22T23:26:18.281 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.278+0000 7f50dd7fa640 10 monclient: dump: 2026-02-22T23:26:18.281 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:26:18.281 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:26:18.281 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:26:18.281 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:26:18.281 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:26:18.281 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:26:18.281 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:26:18.281 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:26:18.281 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:26:18.281 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:26:18.281 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:26:18.281 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:26:18.281 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:26:18.281 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:26:18.281 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:26:18.282 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:26:18.282 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.278+0000 7f50deffd640 4 set_mon_vals no callback set 2026-02-22T23:26:18.282 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.279+0000 7f50ef04c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T23:26:18.282 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.279+0000 7f50dd7fa640 1 -- 10.20.193.45:0/2344686586 <== mon.2 v1:10.20.193.45:6790/0 7 ==== mgrmap(e 5) ==== 50225+0+0 (unknown 2330357642 0 0) 0x7f50d0004f20 con 0x7f50e8139760 2026-02-22T23:26:18.282 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.279+0000 7f50ef04c640 1 -- 10.20.193.45:0/2344686586 --> v1:10.20.193.45:6793/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f50e80008d0 con 0x7f50e80630c0 2026-02-22T23:26:18.282 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.279+0000 7f50dd7fa640 1 -- 10.20.193.45:0/2344686586 <== mon.2 v1:10.20.193.45:6790/0 8 ==== osd_map(24..24 src has 1..24) ==== 3893+0+0 (unknown 987433402 0 0) 0x7f50d004df80 con 0x7f50e8139760 2026-02-22T23:26:18.282 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.279+0000 7f50dd7fa640 1 -- 10.20.193.45:0/2344686586 <== mon.8 v1:10.20.193.45:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2149564627 0 0) 0x7f50e80008d0 con 0x7f50e80630c0 2026-02-22T23:26:18.282 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.279+0000 7f50dd7fa640 10 monclient(hunting): _negotiate 2026-02-22T23:26:18.282 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.279+0000 7f50dd7fa640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:26:18.282 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.279+0000 7f50dd7fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:26:18.282 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.279+0000 7f50dd7fa640 10 monclient(hunting): my global_id is 4553 2026-02-22T23:26:18.282 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.279+0000 7f50dd7fa640 1 -- 10.20.193.45:0/2344686586 --> v1:10.20.193.45:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f50e8126a10 con 0x7f50e80630c0 2026-02-22T23:26:18.282 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.279+0000 7f50ed5c2640 10 monclient: get_auth_request con 0x7f50b803f6e0 auth_method 0 2026-02-22T23:26:18.282 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.279+0000 7f50dd7fa640 1 -- 10.20.193.45:0/2344686586 <== mon.8 v1:10.20.193.45:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2503638068 0 0) 0x7f50e8126a10 con 0x7f50e80630c0 2026-02-22T23:26:18.283 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.279+0000 7f50dd7fa640 1 -- 10.20.193.45:0/2344686586 --> v1:10.20.193.45:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f50e80008d0 con 0x7f50e80630c0 2026-02-22T23:26:18.283 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.279+0000 7f50dd7fa640 1 -- 10.20.193.45:0/2344686586 <== mon.8 v1:10.20.193.45:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f50d80042b0 con 0x7f50e80630c0 2026-02-22T23:26:18.283 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.279+0000 7f50dd7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:26:18.283 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.279+0000 7f50dd7fa640 10 monclient: got monmap 1 from mon.e (according to old e1) 2026-02-22T23:26:18.283 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.279+0000 7f50dd7fa640 10 monclient: dump: 2026-02-22T23:26:18.283 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:26:18.283 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:26:18.283 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:26:18.283 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:26:18.283 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:26:18.283 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:26:18.283 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:26:18.283 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:26:18.283 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:26:18.283 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:26:18.283 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:26:18.283 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:26:18.283 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:26:18.283 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:26:18.283 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:26:18.283 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:26:18.283 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.279+0000 7f50dd7fa640 1 -- 10.20.193.45:0/2344686586 <== mon.8 v1:10.20.193.45:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1012930957 0 0) 0x7f50e80008d0 con 0x7f50e80630c0 2026-02-22T23:26:18.283 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.280+0000 7f50dd7fa640 1 -- 10.20.193.45:0/2344686586 --> v1:10.20.193.45:6793/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f50e80a5770 con 0x7f50e80630c0 2026-02-22T23:26:18.283 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.280+0000 7f50dd7fa640 1 -- 10.20.193.45:0/2344686586 <== mon.8 v1:10.20.193.45:6793/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (unknown 0 0 2024835662) 0x7f50d8004680 con 0x7f50e80630c0 2026-02-22T23:26:18.283 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.280+0000 7f50dd7fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T23:26:18.283 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.280+0000 7f50dd7fa640 10 monclient: _finish_command 1 = system:0 2026-02-22T23:26:18.283 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.280+0000 7f50dd7fa640 1 -- 10.20.193.45:0/2344686586 >> v1:10.20.193.45:6793/0 conn(0x7f50e80630c0 legacy=0x7f50e80634a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:26:18.283 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.280+0000 7f50dd7fa640 1 -- 10.20.193.45:0/2344686586 >> v1:10.20.193.45:6793/0 conn(0x7f50e80630c0 legacy=0x7f50e80634a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T23:26:18.284 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.283+0000 7f50ef04c640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-22T23:26:18.284 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.283+0000 7f50ef04c640 1 -- 10.20.193.45:0/2344686586 --> v1:10.20.193.45:6793/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f50e8063f90 con 0x7f50e8063bb0 2026-02-22T23:26:18.284 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.283+0000 7f50dd7fa640 1 -- 10.20.193.45:0/2344686586 <== mon.8 v1:10.20.193.45:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 125008374 0 0) 0x7f50e8063f90 con 0x7f50e8063bb0 2026-02-22T23:26:18.284 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.283+0000 7f50dd7fa640 10 monclient(hunting): _negotiate 2026-02-22T23:26:18.284 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.283+0000 7f50dd7fa640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:26:18.284 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.283+0000 7f50dd7fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:26:18.284 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.283+0000 7f50dd7fa640 10 monclient(hunting): my global_id is 4562 2026-02-22T23:26:18.284 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.283+0000 7f50dd7fa640 1 -- 10.20.193.45:0/2344686586 --> v1:10.20.193.45:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f50e80008d0 con 0x7f50e8063bb0 2026-02-22T23:26:18.284 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.283+0000 7f50dd7fa640 1 -- 10.20.193.45:0/2344686586 <== mon.8 v1:10.20.193.45:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3653429927 0 0) 0x7f50e80008d0 con 0x7f50e8063bb0 2026-02-22T23:26:18.284 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.283+0000 7f50dd7fa640 1 -- 10.20.193.45:0/2344686586 --> v1:10.20.193.45:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f50e8063f90 con 0x7f50e8063bb0 2026-02-22T23:26:18.284 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.283+0000 7f50dd7fa640 1 -- 10.20.193.45:0/2344686586 <== mon.8 v1:10.20.193.45:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f50d8004e70 con 0x7f50e8063bb0 2026-02-22T23:26:18.284 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.283+0000 7f50dd7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:26:18.284 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.283+0000 7f50dd7fa640 10 monclient: got monmap 1 from mon.e (according to old e1) 2026-02-22T23:26:18.284 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.283+0000 7f50dd7fa640 10 monclient: dump: 2026-02-22T23:26:18.284 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:26:18.284 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:26:18.284 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:26:18.284 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:26:18.284 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:26:18.284 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:26:18.284 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:26:18.284 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:26:18.284 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:26:18.284 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:26:18.284 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:26:18.284 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:26:18.284 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:26:18.284 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:26:18.284 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:26:18.285 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:26:18.285 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.283+0000 7f50dd7fa640 1 -- 10.20.193.45:0/2344686586 <== mon.8 v1:10.20.193.45:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 39756198 0 0) 0x7f50e8063f90 con 0x7f50e8063bb0 2026-02-22T23:26:18.285 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.283+0000 7f50dd7fa640 1 -- 10.20.193.45:0/2344686586 --> v1:10.20.193.45:6793/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f50e81dff20 con 0x7f50e8063bb0 2026-02-22T23:26:18.285 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.283+0000 7f50dd7fa640 1 -- 10.20.193.45:0/2344686586 <== mon.8 v1:10.20.193.45:6793/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7485 (unknown 0 0 2681658725) 0x7f50d8006320 con 0x7f50e8063bb0 2026-02-22T23:26:18.285 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.283+0000 7f50dd7fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-22T23:26:18.285 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.283+0000 7f50dd7fa640 10 monclient: _finish_command 2 = system:0 2026-02-22T23:26:18.285 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.283+0000 7f50dd7fa640 1 -- 10.20.193.45:0/2344686586 >> v1:10.20.193.45:6793/0 conn(0x7f50e8063bb0 legacy=0x7f50e81de800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:26:18.285 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.283+0000 7f50dd7fa640 1 -- 10.20.193.45:0/2344686586 >> v1:10.20.193.45:6793/0 conn(0x7f50e8063bb0 legacy=0x7f50e81de800 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T23:26:18.285 INFO:teuthology.orchestra.run.trial045.stdout:{ 2026-02-22T23:26:18.285 INFO:teuthology.orchestra.run.trial045.stdout: "name": "e", 2026-02-22T23:26:18.285 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 8, 2026-02-22T23:26:18.285 INFO:teuthology.orchestra.run.trial045.stdout: "state": "leader", 2026-02-22T23:26:18.285 INFO:teuthology.orchestra.run.trial045.stdout: "election_epoch": 22, 2026-02-22T23:26:18.285 INFO:teuthology.orchestra.run.trial045.stdout: "uptime": 58430, 2026-02-22T23:26:18.285 INFO:teuthology.orchestra.run.trial045.stdout: "quorum": [ 2026-02-22T23:26:18.285 INFO:teuthology.orchestra.run.trial045.stdout: 0, 2026-02-22T23:26:18.285 INFO:teuthology.orchestra.run.trial045.stdout: 2, 2026-02-22T23:26:18.285 INFO:teuthology.orchestra.run.trial045.stdout: 3, 2026-02-22T23:26:18.285 INFO:teuthology.orchestra.run.trial045.stdout: 7, 2026-02-22T23:26:18.285 INFO:teuthology.orchestra.run.trial045.stdout: 8 2026-02-22T23:26:18.285 INFO:teuthology.orchestra.run.trial045.stdout: ], 2026-02-22T23:26:18.285 INFO:teuthology.orchestra.run.trial045.stdout: "quorum_age": 3, 2026-02-22T23:26:18.285 INFO:teuthology.orchestra.run.trial045.stdout: "features": { 2026-02-22T23:26:18.285 INFO:teuthology.orchestra.run.trial045.stdout: "required_con": "2450521708007866372", 2026-02-22T23:26:18.285 INFO:teuthology.orchestra.run.trial045.stdout: "required_mon": [ 2026-02-22T23:26:18.285 INFO:teuthology.orchestra.run.trial045.stdout: "kraken", 2026-02-22T23:26:18.285 INFO:teuthology.orchestra.run.trial045.stdout: "luminous", 2026-02-22T23:26:18.285 INFO:teuthology.orchestra.run.trial045.stdout: "mimic", 2026-02-22T23:26:18.285 INFO:teuthology.orchestra.run.trial045.stdout: "osdmap-prune", 2026-02-22T23:26:18.285 INFO:teuthology.orchestra.run.trial045.stdout: "nautilus", 2026-02-22T23:26:18.285 INFO:teuthology.orchestra.run.trial045.stdout: "octopus", 2026-02-22T23:26:18.285 INFO:teuthology.orchestra.run.trial045.stdout: "pacific", 2026-02-22T23:26:18.285 INFO:teuthology.orchestra.run.trial045.stdout: "elector-pinging", 2026-02-22T23:26:18.286 INFO:teuthology.orchestra.run.trial045.stdout: "quincy", 2026-02-22T23:26:18.286 INFO:teuthology.orchestra.run.trial045.stdout: "reef", 2026-02-22T23:26:18.286 INFO:teuthology.orchestra.run.trial045.stdout: "squid" 2026-02-22T23:26:18.286 INFO:teuthology.orchestra.run.trial045.stdout: ], 2026-02-22T23:26:18.286 INFO:teuthology.orchestra.run.trial045.stdout: "quorum_con": "4540701547738038271", 2026-02-22T23:26:18.286 INFO:teuthology.orchestra.run.trial045.stdout: "quorum_mon": [ 2026-02-22T23:26:18.286 INFO:teuthology.orchestra.run.trial045.stdout: "kraken", 2026-02-22T23:26:18.286 INFO:teuthology.orchestra.run.trial045.stdout: "luminous", 2026-02-22T23:26:18.286 INFO:teuthology.orchestra.run.trial045.stdout: "mimic", 2026-02-22T23:26:18.286 INFO:teuthology.orchestra.run.trial045.stdout: "osdmap-prune", 2026-02-22T23:26:18.286 INFO:teuthology.orchestra.run.trial045.stdout: "nautilus", 2026-02-22T23:26:18.286 INFO:teuthology.orchestra.run.trial045.stdout: "octopus", 2026-02-22T23:26:18.286 INFO:teuthology.orchestra.run.trial045.stdout: "pacific", 2026-02-22T23:26:18.286 INFO:teuthology.orchestra.run.trial045.stdout: "elector-pinging", 2026-02-22T23:26:18.286 INFO:teuthology.orchestra.run.trial045.stdout: "quincy", 2026-02-22T23:26:18.286 INFO:teuthology.orchestra.run.trial045.stdout: "reef", 2026-02-22T23:26:18.286 INFO:teuthology.orchestra.run.trial045.stdout: "squid" 2026-02-22T23:26:18.286 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:26:18.286 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:26:18.286 INFO:teuthology.orchestra.run.trial045.stdout: "outside_quorum": [], 2026-02-22T23:26:18.286 INFO:teuthology.orchestra.run.trial045.stdout: "extra_probe_peers": [], 2026-02-22T23:26:18.286 INFO:teuthology.orchestra.run.trial045.stdout: "sync_provider": [], 2026-02-22T23:26:18.286 INFO:teuthology.orchestra.run.trial045.stdout: "monmap": { 2026-02-22T23:26:18.286 INFO:teuthology.orchestra.run.trial045.stdout: "epoch": 1, 2026-02-22T23:26:18.286 INFO:teuthology.orchestra.run.trial045.stdout: "fsid": "4b60f18f-6660-4731-b731-dc85c4078413", 2026-02-22T23:26:18.286 INFO:teuthology.orchestra.run.trial045.stdout: "modified": "2026-02-22T23:24:52.393472Z", 2026-02-22T23:26:18.286 INFO:teuthology.orchestra.run.trial045.stdout: "created": "2026-02-22T23:24:52.393472Z", 2026-02-22T23:26:18.286 INFO:teuthology.orchestra.run.trial045.stdout: "min_mon_release": 19, 2026-02-22T23:26:18.286 INFO:teuthology.orchestra.run.trial045.stdout: "min_mon_release_name": "squid", 2026-02-22T23:26:18.286 INFO:teuthology.orchestra.run.trial045.stdout: "election_strategy": 3, 2026-02-22T23:26:18.286 INFO:teuthology.orchestra.run.trial045.stdout: "disallowed_leaders": "", 2026-02-22T23:26:18.286 INFO:teuthology.orchestra.run.trial045.stdout: "stretch_mode": false, 2026-02-22T23:26:18.286 INFO:teuthology.orchestra.run.trial045.stdout: "tiebreaker_mon": "", 2026-02-22T23:26:18.286 INFO:teuthology.orchestra.run.trial045.stdout: "removed_ranks": "", 2026-02-22T23:26:18.286 INFO:teuthology.orchestra.run.trial045.stdout: "features": { 2026-02-22T23:26:18.286 INFO:teuthology.orchestra.run.trial045.stdout: "persistent": [ 2026-02-22T23:26:18.286 INFO:teuthology.orchestra.run.trial045.stdout: "kraken", 2026-02-22T23:26:18.286 INFO:teuthology.orchestra.run.trial045.stdout: "luminous", 2026-02-22T23:26:18.286 INFO:teuthology.orchestra.run.trial045.stdout: "mimic", 2026-02-22T23:26:18.286 INFO:teuthology.orchestra.run.trial045.stdout: "osdmap-prune", 2026-02-22T23:26:18.286 INFO:teuthology.orchestra.run.trial045.stdout: "nautilus", 2026-02-22T23:26:18.286 INFO:teuthology.orchestra.run.trial045.stdout: "octopus", 2026-02-22T23:26:18.287 INFO:teuthology.orchestra.run.trial045.stdout: "pacific", 2026-02-22T23:26:18.287 INFO:teuthology.orchestra.run.trial045.stdout: "elector-pinging", 2026-02-22T23:26:18.287 INFO:teuthology.orchestra.run.trial045.stdout: "quincy", 2026-02-22T23:26:18.287 INFO:teuthology.orchestra.run.trial045.stdout: "reef", 2026-02-22T23:26:18.287 INFO:teuthology.orchestra.run.trial045.stdout: "squid" 2026-02-22T23:26:18.287 INFO:teuthology.orchestra.run.trial045.stdout: ], 2026-02-22T23:26:18.287 INFO:teuthology.orchestra.run.trial045.stdout: "optional": [] 2026-02-22T23:26:18.287 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:26:18.287 INFO:teuthology.orchestra.run.trial045.stdout: "mons": [ 2026-02-22T23:26:18.287 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:26:18.287 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 0, 2026-02-22T23:26:18.287 INFO:teuthology.orchestra.run.trial045.stdout: "name": "a", 2026-02-22T23:26:18.287 INFO:teuthology.orchestra.run.trial045.stdout: "public_addrs": { 2026-02-22T23:26:18.287 INFO:teuthology.orchestra.run.trial045.stdout: "addrvec": [ 2026-02-22T23:26:18.287 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:26:18.287 INFO:teuthology.orchestra.run.trial045.stdout: "type": "v1", 2026-02-22T23:26:18.287 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6789", 2026-02-22T23:26:18.287 INFO:teuthology.orchestra.run.trial045.stdout: "nonce": 0 2026-02-22T23:26:18.287 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:26:18.287 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:26:18.287 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:26:18.287 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6789/0", 2026-02-22T23:26:18.287 INFO:teuthology.orchestra.run.trial045.stdout: "public_addr": "10.20.193.45:6789/0", 2026-02-22T23:26:18.287 INFO:teuthology.orchestra.run.trial045.stdout: "priority": 0, 2026-02-22T23:26:18.287 INFO:teuthology.orchestra.run.trial045.stdout: "weight": 0, 2026-02-22T23:26:18.287 INFO:teuthology.orchestra.run.trial045.stdout: "crush_location": "{}" 2026-02-22T23:26:18.287 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:26:18.287 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:26:18.287 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 1, 2026-02-22T23:26:18.287 INFO:teuthology.orchestra.run.trial045.stdout: "name": "f", 2026-02-22T23:26:18.287 INFO:teuthology.orchestra.run.trial045.stdout: "public_addrs": { 2026-02-22T23:26:18.287 INFO:teuthology.orchestra.run.trial045.stdout: "addrvec": [ 2026-02-22T23:26:18.287 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:26:18.287 INFO:teuthology.orchestra.run.trial045.stdout: "type": "v1", 2026-02-22T23:26:18.287 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.73:6789", 2026-02-22T23:26:18.287 INFO:teuthology.orchestra.run.trial045.stdout: "nonce": 0 2026-02-22T23:26:18.287 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:26:18.287 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:26:18.287 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:26:18.287 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.73:6789/0", 2026-02-22T23:26:18.287 INFO:teuthology.orchestra.run.trial045.stdout: "public_addr": "10.20.193.73:6789/0", 2026-02-22T23:26:18.288 INFO:teuthology.orchestra.run.trial045.stdout: "priority": 0, 2026-02-22T23:26:18.288 INFO:teuthology.orchestra.run.trial045.stdout: "weight": 0, 2026-02-22T23:26:18.288 INFO:teuthology.orchestra.run.trial045.stdout: "crush_location": "{}" 2026-02-22T23:26:18.288 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:26:18.288 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:26:18.288 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 2, 2026-02-22T23:26:18.288 INFO:teuthology.orchestra.run.trial045.stdout: "name": "b", 2026-02-22T23:26:18.288 INFO:teuthology.orchestra.run.trial045.stdout: "public_addrs": { 2026-02-22T23:26:18.288 INFO:teuthology.orchestra.run.trial045.stdout: "addrvec": [ 2026-02-22T23:26:18.288 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:26:18.288 INFO:teuthology.orchestra.run.trial045.stdout: "type": "v1", 2026-02-22T23:26:18.288 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6790", 2026-02-22T23:26:18.288 INFO:teuthology.orchestra.run.trial045.stdout: "nonce": 0 2026-02-22T23:26:18.288 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:26:18.288 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:26:18.288 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:26:18.288 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6790/0", 2026-02-22T23:26:18.288 INFO:teuthology.orchestra.run.trial045.stdout: "public_addr": "10.20.193.45:6790/0", 2026-02-22T23:26:18.288 INFO:teuthology.orchestra.run.trial045.stdout: "priority": 0, 2026-02-22T23:26:18.288 INFO:teuthology.orchestra.run.trial045.stdout: "weight": 0, 2026-02-22T23:26:18.288 INFO:teuthology.orchestra.run.trial045.stdout: "crush_location": "{}" 2026-02-22T23:26:18.288 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:26:18.288 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:26:18.288 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 3, 2026-02-22T23:26:18.288 INFO:teuthology.orchestra.run.trial045.stdout: "name": "g", 2026-02-22T23:26:18.288 INFO:teuthology.orchestra.run.trial045.stdout: "public_addrs": { 2026-02-22T23:26:18.288 INFO:teuthology.orchestra.run.trial045.stdout: "addrvec": [ 2026-02-22T23:26:18.288 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:26:18.288 INFO:teuthology.orchestra.run.trial045.stdout: "type": "v1", 2026-02-22T23:26:18.288 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.73:6790", 2026-02-22T23:26:18.288 INFO:teuthology.orchestra.run.trial045.stdout: "nonce": 0 2026-02-22T23:26:18.288 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:26:18.288 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:26:18.288 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:26:18.288 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.73:6790/0", 2026-02-22T23:26:18.288 INFO:teuthology.orchestra.run.trial045.stdout: "public_addr": "10.20.193.73:6790/0", 2026-02-22T23:26:18.288 INFO:teuthology.orchestra.run.trial045.stdout: "priority": 0, 2026-02-22T23:26:18.288 INFO:teuthology.orchestra.run.trial045.stdout: "weight": 0, 2026-02-22T23:26:18.288 INFO:teuthology.orchestra.run.trial045.stdout: "crush_location": "{}" 2026-02-22T23:26:18.288 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:26:18.288 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:26:18.288 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 4, 2026-02-22T23:26:18.289 INFO:teuthology.orchestra.run.trial045.stdout: "name": "c", 2026-02-22T23:26:18.289 INFO:teuthology.orchestra.run.trial045.stdout: "public_addrs": { 2026-02-22T23:26:18.289 INFO:teuthology.orchestra.run.trial045.stdout: "addrvec": [ 2026-02-22T23:26:18.289 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:26:18.289 INFO:teuthology.orchestra.run.trial045.stdout: "type": "v1", 2026-02-22T23:26:18.289 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6791", 2026-02-22T23:26:18.289 INFO:teuthology.orchestra.run.trial045.stdout: "nonce": 0 2026-02-22T23:26:18.289 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:26:18.289 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:26:18.289 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:26:18.289 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6791/0", 2026-02-22T23:26:18.289 INFO:teuthology.orchestra.run.trial045.stdout: "public_addr": "10.20.193.45:6791/0", 2026-02-22T23:26:18.289 INFO:teuthology.orchestra.run.trial045.stdout: "priority": 0, 2026-02-22T23:26:18.289 INFO:teuthology.orchestra.run.trial045.stdout: "weight": 0, 2026-02-22T23:26:18.289 INFO:teuthology.orchestra.run.trial045.stdout: "crush_location": "{}" 2026-02-22T23:26:18.289 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:26:18.289 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:26:18.289 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 5, 2026-02-22T23:26:18.289 INFO:teuthology.orchestra.run.trial045.stdout: "name": "h", 2026-02-22T23:26:18.289 INFO:teuthology.orchestra.run.trial045.stdout: "public_addrs": { 2026-02-22T23:26:18.289 INFO:teuthology.orchestra.run.trial045.stdout: "addrvec": [ 2026-02-22T23:26:18.289 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:26:18.289 INFO:teuthology.orchestra.run.trial045.stdout: "type": "v1", 2026-02-22T23:26:18.289 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.73:6791", 2026-02-22T23:26:18.289 INFO:teuthology.orchestra.run.trial045.stdout: "nonce": 0 2026-02-22T23:26:18.289 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:26:18.289 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:26:18.289 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:26:18.289 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.73:6791/0", 2026-02-22T23:26:18.289 INFO:teuthology.orchestra.run.trial045.stdout: "public_addr": "10.20.193.73:6791/0", 2026-02-22T23:26:18.289 INFO:teuthology.orchestra.run.trial045.stdout: "priority": 0, 2026-02-22T23:26:18.289 INFO:teuthology.orchestra.run.trial045.stdout: "weight": 0, 2026-02-22T23:26:18.289 INFO:teuthology.orchestra.run.trial045.stdout: "crush_location": "{}" 2026-02-22T23:26:18.289 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:26:18.289 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:26:18.289 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 6, 2026-02-22T23:26:18.289 INFO:teuthology.orchestra.run.trial045.stdout: "name": "d", 2026-02-22T23:26:18.289 INFO:teuthology.orchestra.run.trial045.stdout: "public_addrs": { 2026-02-22T23:26:18.289 INFO:teuthology.orchestra.run.trial045.stdout: "addrvec": [ 2026-02-22T23:26:18.289 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:26:18.289 INFO:teuthology.orchestra.run.trial045.stdout: "type": "v1", 2026-02-22T23:26:18.289 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6792", 2026-02-22T23:26:18.290 INFO:teuthology.orchestra.run.trial045.stdout: "nonce": 0 2026-02-22T23:26:18.290 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:26:18.290 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:26:18.290 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:26:18.290 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6792/0", 2026-02-22T23:26:18.290 INFO:teuthology.orchestra.run.trial045.stdout: "public_addr": "10.20.193.45:6792/0", 2026-02-22T23:26:18.290 INFO:teuthology.orchestra.run.trial045.stdout: "priority": 0, 2026-02-22T23:26:18.290 INFO:teuthology.orchestra.run.trial045.stdout: "weight": 0, 2026-02-22T23:26:18.290 INFO:teuthology.orchestra.run.trial045.stdout: "crush_location": "{}" 2026-02-22T23:26:18.290 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:26:18.290 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:26:18.290 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 7, 2026-02-22T23:26:18.290 INFO:teuthology.orchestra.run.trial045.stdout: "name": "i", 2026-02-22T23:26:18.290 INFO:teuthology.orchestra.run.trial045.stdout: "public_addrs": { 2026-02-22T23:26:18.290 INFO:teuthology.orchestra.run.trial045.stdout: "addrvec": [ 2026-02-22T23:26:18.290 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:26:18.290 INFO:teuthology.orchestra.run.trial045.stdout: "type": "v1", 2026-02-22T23:26:18.290 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.73:6792", 2026-02-22T23:26:18.290 INFO:teuthology.orchestra.run.trial045.stdout: "nonce": 0 2026-02-22T23:26:18.290 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:26:18.290 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:26:18.290 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:26:18.290 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.73:6792/0", 2026-02-22T23:26:18.290 INFO:teuthology.orchestra.run.trial045.stdout: "public_addr": "10.20.193.73:6792/0", 2026-02-22T23:26:18.290 INFO:teuthology.orchestra.run.trial045.stdout: "priority": 0, 2026-02-22T23:26:18.290 INFO:teuthology.orchestra.run.trial045.stdout: "weight": 0, 2026-02-22T23:26:18.290 INFO:teuthology.orchestra.run.trial045.stdout: "crush_location": "{}" 2026-02-22T23:26:18.290 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:26:18.290 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:26:18.290 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 8, 2026-02-22T23:26:18.290 INFO:teuthology.orchestra.run.trial045.stdout: "name": "e", 2026-02-22T23:26:18.290 INFO:teuthology.orchestra.run.trial045.stdout: "public_addrs": { 2026-02-22T23:26:18.290 INFO:teuthology.orchestra.run.trial045.stdout: "addrvec": [ 2026-02-22T23:26:18.290 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:26:18.290 INFO:teuthology.orchestra.run.trial045.stdout: "type": "v1", 2026-02-22T23:26:18.290 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6793", 2026-02-22T23:26:18.290 INFO:teuthology.orchestra.run.trial045.stdout: "nonce": 0 2026-02-22T23:26:18.290 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:26:18.290 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:26:18.290 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:26:18.290 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6793/0", 2026-02-22T23:26:18.291 INFO:teuthology.orchestra.run.trial045.stdout: "public_addr": "10.20.193.45:6793/0", 2026-02-22T23:26:18.291 INFO:teuthology.orchestra.run.trial045.stdout: "priority": 0, 2026-02-22T23:26:18.291 INFO:teuthology.orchestra.run.trial045.stdout: "weight": 0, 2026-02-22T23:26:18.291 INFO:teuthology.orchestra.run.trial045.stdout: "crush_location": "{}" 2026-02-22T23:26:18.291 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:26:18.291 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:26:18.291 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:26:18.291 INFO:teuthology.orchestra.run.trial045.stdout: "feature_map": { 2026-02-22T23:26:18.291 INFO:teuthology.orchestra.run.trial045.stdout: "mon": [ 2026-02-22T23:26:18.291 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:26:18.291 INFO:teuthology.orchestra.run.trial045.stdout: "features": "0x3f03cffffffdffff", 2026-02-22T23:26:18.291 INFO:teuthology.orchestra.run.trial045.stdout: "release": "squid", 2026-02-22T23:26:18.291 INFO:teuthology.orchestra.run.trial045.stdout: "num": 1 2026-02-22T23:26:18.291 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:26:18.291 INFO:teuthology.orchestra.run.trial045.stdout: ], 2026-02-22T23:26:18.291 INFO:teuthology.orchestra.run.trial045.stdout: "client": [ 2026-02-22T23:26:18.291 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:26:18.291 INFO:teuthology.orchestra.run.trial045.stdout: "features": "0x3f03cffffffdffff", 2026-02-22T23:26:18.291 INFO:teuthology.orchestra.run.trial045.stdout: "release": "squid", 2026-02-22T23:26:18.291 INFO:teuthology.orchestra.run.trial045.stdout: "num": 2 2026-02-22T23:26:18.291 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:26:18.291 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:26:18.291 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:26:18.291 INFO:teuthology.orchestra.run.trial045.stdout: "stretch_mode": false 2026-02-22T23:26:18.291 INFO:teuthology.orchestra.run.trial045.stdout:} 2026-02-22T23:26:18.291 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.284+0000 7f50ef04c640 1 -- 10.20.193.45:0/2344686586 >> v1:10.20.193.73:6800/2222410180 conn(0x7f50b803f6e0 legacy=0x7f50b8041ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:26:18.291 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.284+0000 7f50ef04c640 10 monclient: shutdown 2026-02-22T23:26:18.291 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.284+0000 7f50ef04c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T23:26:18.292 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.284+0000 7f50ef04c640 1 -- 10.20.193.45:0/2344686586 >> v1:10.20.193.45:6790/0 conn(0x7f50e8139760 legacy=0x7f50e81d47b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:26:18.292 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.284+0000 7f50ed5c2640 1 -- 10.20.193.45:0/2344686586 reap_dead start 2026-02-22T23:26:18.292 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.284+0000 7f50ed5c2640 1 -- 10.20.193.45:0/2344686586 reap_dead start 2026-02-22T23:26:18.292 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.284+0000 7f50ef04c640 1 -- 10.20.193.45:0/2344686586 shutdown_connections 2026-02-22T23:26:18.292 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.284+0000 7f50ef04c640 1 -- 10.20.193.45:0/2344686586 >> 10.20.193.45:0/2344686586 conn(0x7f50e80abb50 msgr2=0x7f50e81c2db0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:26:18.292 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.284+0000 7f50ef04c640 1 -- 10.20.193.45:0/2344686586 shutdown_connections 2026-02-22T23:26:18.292 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.284+0000 7f50ef04c640 1 -- 10.20.193.45:0/2344686586 wait complete. 2026-02-22T23:26:18.293 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 5 2026-02-22T23:26:18.293 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 5 for mon g 2026-02-22T23:26:18.293 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.g mon_status 2026-02-22T23:26:18.361 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.361+0000 7f9777914640 10 monclient: get_monmap_and_config 2026-02-22T23:26:18.361 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.361+0000 7f9777914640 10 monclient: build_initial_monmap 2026-02-22T23:26:18.361 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.361+0000 7f9777914640 10 monclient: monmap: 2026-02-22T23:26:18.361 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-22T23:26:18.361 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:26:18.361 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:26:18.361565+0000 2026-02-22T23:26:18.361 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:26:18.361565+0000 2026-02-22T23:26:18.361 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-22T23:26:18.361 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:26:18.361 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-22T23:26:18.361 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.noname-f 2026-02-22T23:26:18.361 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.noname-b 2026-02-22T23:26:18.361 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.noname-g 2026-02-22T23:26:18.361 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.noname-c 2026-02-22T23:26:18.361 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.noname-h 2026-02-22T23:26:18.361 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.noname-d 2026-02-22T23:26:18.361 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.noname-i 2026-02-22T23:26:18.361 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.noname-e 2026-02-22T23:26:18.361 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:26:18.366 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.361+0000 7f9777914640 1 Processor -- start 2026-02-22T23:26:18.367 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.361+0000 7f9777914640 1 -- start start 2026-02-22T23:26:18.367 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.361+0000 7f9777914640 10 monclient: init 2026-02-22T23:26:18.367 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.362+0000 7f9777914640 10 monclient: _reopen_session rank -1 2026-02-22T23:26:18.367 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.362+0000 7f9777914640 10 monclient: _add_conns ranks=[6,1,8,4,3,2,0,7,5] 2026-02-22T23:26:18.367 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.362+0000 7f9777914640 10 monclient(hunting): picked mon.noname-d con 0x7f97700a5e00 addr v1:10.20.193.45:6792/0 2026-02-22T23:26:18.367 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.362+0000 7f9777914640 10 monclient(hunting): picked mon.noname-f con 0x7f97700a68f0 addr v1:10.20.193.73:6789/0 2026-02-22T23:26:18.367 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.362+0000 7f9777914640 10 monclient(hunting): picked mon.noname-e con 0x7f97700a6d00 addr v1:10.20.193.45:6793/0 2026-02-22T23:26:18.367 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.362+0000 7f9777914640 1 -- --> v1:10.20.193.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f97700a2d00 con 0x7f97700a68f0 2026-02-22T23:26:18.367 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.362+0000 7f9777914640 1 -- --> v1:10.20.193.45:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f97700a2fe0 con 0x7f97700a5e00 2026-02-22T23:26:18.367 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.362+0000 7f9777914640 1 -- --> v1:10.20.193.45:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f97700a32c0 con 0x7f97700a6d00 2026-02-22T23:26:18.367 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.362+0000 7f9777914640 10 monclient(hunting): _renew_subs 2026-02-22T23:26:18.367 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.362+0000 7f9777914640 10 monclient(hunting): authenticate will time out at 709.978155s 2026-02-22T23:26:18.367 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.362+0000 7f9775689640 1 -- >> v1:10.20.193.45:6792/0 conn(0x7f97700a5e00 legacy=0x7f97700a61e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.45:6792/0 2026-02-22T23:26:18.367 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.362+0000 7f9774e88640 1 -- >> v1:10.20.193.73:6789/0 conn(0x7f97700a68f0 legacy=0x7f977013e080 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.73:6789/0 2026-02-22T23:26:18.367 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.362+0000 7f9775e8a640 1 --1- >> v1:10.20.193.45:6793/0 conn(0x7f97700a6d00 0x7f97701417b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.45:6793/0 says I am v1:10.20.193.45:54472/0 (socket says 10.20.193.45:54472) 2026-02-22T23:26:18.368 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.362+0000 7f9775e8a640 1 -- 10.20.193.45:0/1656301267 learned_addr learned my addr 10.20.193.45:0/1656301267 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-22T23:26:18.368 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.362+0000 7f975ffff640 1 -- 10.20.193.45:0/1656301267 <== mon.8 v1:10.20.193.45:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2518701913 0 0) 0x7f97700a32c0 con 0x7f97700a6d00 2026-02-22T23:26:18.368 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.362+0000 7f975ffff640 10 monclient(hunting): _negotiate 2026-02-22T23:26:18.368 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.362+0000 7f975ffff640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:26:18.368 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.362+0000 7f975ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:26:18.368 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.362+0000 7f975ffff640 10 monclient(hunting): my global_id is 4571 2026-02-22T23:26:18.368 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.362+0000 7f975ffff640 1 -- 10.20.193.45:0/1656301267 --> v1:10.20.193.45:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9758003620 con 0x7f97700a6d00 2026-02-22T23:26:18.368 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.362+0000 7f975ffff640 1 -- 10.20.193.45:0/1656301267 <== mon.8 v1:10.20.193.45:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3909311037 0 0) 0x7f9758003620 con 0x7f97700a6d00 2026-02-22T23:26:18.368 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.362+0000 7f975ffff640 1 -- 10.20.193.45:0/1656301267 >> v1:10.20.193.45:6792/0 conn(0x7f97700a5e00 legacy=0x7f97700a61e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-22T23:26:18.368 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.362+0000 7f975ffff640 1 -- 10.20.193.45:0/1656301267 >> v1:10.20.193.73:6789/0 conn(0x7f97700a68f0 legacy=0x7f977013e080 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-22T23:26:18.368 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.362+0000 7f975ffff640 10 monclient: _finish_hunting 0 2026-02-22T23:26:18.368 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.362+0000 7f975ffff640 1 monclient: found mon.noname-e 2026-02-22T23:26:18.368 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.362+0000 7f975ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T23:26:18.368 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.362+0000 7f975ffff640 10 monclient: _send_mon_message to mon.noname-e at v1:10.20.193.45:6793/0 2026-02-22T23:26:18.368 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.362+0000 7f975ffff640 1 -- 10.20.193.45:0/1656301267 --> v1:10.20.193.45:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97700a35a0 con 0x7f97700a6d00 2026-02-22T23:26:18.368 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.362+0000 7f975ffff640 10 monclient: _finish_auth 0 2026-02-22T23:26:18.369 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.362+0000 7f975ffff640 10 monclient: _check_auth_tickets 2026-02-22T23:26:18.369 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.362+0000 7f975ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T23:26:18.369 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.362+0000 7f975ffff640 1 -- 10.20.193.45:0/1656301267 <== mon.8 v1:10.20.193.45:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f976c0033c0 con 0x7f97700a6d00 2026-02-22T23:26:18.369 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.362+0000 7f9777914640 5 monclient: authenticate success, global_id 4571 2026-02-22T23:26:18.369 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.362+0000 7f9777914640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-22T23:26:18.369 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.362+0000 7f975ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:26:18.369 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.362+0000 7f975ffff640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2026-02-22T23:26:18.369 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.362+0000 7f975ffff640 10 monclient: dump: 2026-02-22T23:26:18.369 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:26:18.369 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:26:18.369 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:26:18.369 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:26:18.369 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:26:18.369 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:26:18.369 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:26:18.369 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:26:18.369 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:26:18.370 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:26:18.370 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:26:18.370 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:26:18.370 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:26:18.370 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:26:18.370 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:26:18.370 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:26:18.370 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.362+0000 7f9777914640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-22T23:26:18.370 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.362+0000 7f975ffff640 1 -- 10.20.193.45:0/1656301267 <== mon.8 v1:10.20.193.45:6793/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f976c0035e0 con 0x7f97700a6d00 2026-02-22T23:26:18.370 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.362+0000 7f975ffff640 10 monclient: handle_config config(0 keys) 2026-02-22T23:26:18.370 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.362+0000 7f975ffff640 1 -- 10.20.193.45:0/1656301267 <== mon.8 v1:10.20.193.45:6793/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f976c005060 con 0x7f97700a6d00 2026-02-22T23:26:18.370 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.362+0000 7f9777914640 10 monclient: get_monmap_and_config success 2026-02-22T23:26:18.370 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.362+0000 7f9777914640 4 set_mon_vals no callback set 2026-02-22T23:26:18.370 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.362+0000 7f975ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:26:18.370 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.362+0000 7f975ffff640 10 monclient: got monmap 1 from mon.e (according to old e1) 2026-02-22T23:26:18.370 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.362+0000 7f975ffff640 10 monclient: dump: 2026-02-22T23:26:18.370 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:26:18.371 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:26:18.371 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:26:18.371 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:26:18.371 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:26:18.371 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:26:18.371 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:26:18.371 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:26:18.371 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:26:18.371 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:26:18.371 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:26:18.371 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:26:18.371 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:26:18.371 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:26:18.371 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:26:18.371 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:26:18.371 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.362+0000 7f9777914640 10 monclient: shutdown 2026-02-22T23:26:18.371 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.362+0000 7f9777914640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T23:26:18.371 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.362+0000 7f9777914640 1 -- 10.20.193.45:0/1656301267 >> v1:10.20.193.45:6793/0 conn(0x7f97700a6d00 legacy=0x7f97701417b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:26:18.372 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.362+0000 7f9777914640 1 -- 10.20.193.45:0/1656301267 shutdown_connections 2026-02-22T23:26:18.372 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.362+0000 7f9777914640 1 -- 10.20.193.45:0/1656301267 >> 10.20.193.45:0/1656301267 conn(0x7f97700abb50 msgr2=0x7f97700a7f00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:26:18.372 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.362+0000 7f9777914640 1 -- 10.20.193.45:0/1656301267 shutdown_connections 2026-02-22T23:26:18.372 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.362+0000 7f9777914640 1 -- 10.20.193.45:0/1656301267 wait complete. 2026-02-22T23:26:18.372 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.363+0000 7f9777914640 10 monclient: build_initial_monmap 2026-02-22T23:26:18.372 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.363+0000 7f9777914640 10 monclient: monmap: 2026-02-22T23:26:18.372 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-22T23:26:18.372 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T23:26:18.372 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-22T23:26:18.372 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-22T23:26:18.372 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-22T23:26:18.372 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-22T23:26:18.372 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-22T23:26:18.372 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.noname-f 2026-02-22T23:26:18.372 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.noname-b 2026-02-22T23:26:18.372 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.noname-g 2026-02-22T23:26:18.372 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.noname-c 2026-02-22T23:26:18.373 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.noname-h 2026-02-22T23:26:18.373 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.noname-d 2026-02-22T23:26:18.373 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.noname-i 2026-02-22T23:26:18.373 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.noname-e 2026-02-22T23:26:18.373 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:26:18.373 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.363+0000 7f9777914640 1 Processor -- start 2026-02-22T23:26:18.373 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.363+0000 7f9777914640 1 -- start start 2026-02-22T23:26:18.373 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.363+0000 7f9777914640 10 monclient: init 2026-02-22T23:26:18.373 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.363+0000 7f9777914640 10 monclient: _reopen_session rank -1 2026-02-22T23:26:18.373 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.363+0000 7f9777914640 10 monclient: _add_conns ranks=[0,3,4,2,5,7,8,1,6] 2026-02-22T23:26:18.373 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.363+0000 7f9777914640 10 monclient(hunting): picked mon.noname-a con 0x7f97700a5e00 addr v1:10.20.193.45:6789/0 2026-02-22T23:26:18.373 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.363+0000 7f9777914640 10 monclient(hunting): picked mon.noname-g con 0x7f97700a68f0 addr v1:10.20.193.73:6790/0 2026-02-22T23:26:18.373 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.363+0000 7f9777914640 10 monclient(hunting): picked mon.noname-c con 0x7f97700a6d00 addr v1:10.20.193.45:6791/0 2026-02-22T23:26:18.373 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.363+0000 7f9777914640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f97700a9c10 con 0x7f97700a5e00 2026-02-22T23:26:18.373 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.363+0000 7f9777914640 1 -- --> v1:10.20.193.73:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f97701288e0 con 0x7f97700a68f0 2026-02-22T23:26:18.373 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.363+0000 7f9777914640 1 -- --> v1:10.20.193.45:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f97700a1890 con 0x7f97700a6d00 2026-02-22T23:26:18.373 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.363+0000 7f9777914640 10 monclient(hunting): _renew_subs 2026-02-22T23:26:18.374 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.363+0000 7f9777914640 10 monclient(hunting): authenticate will time out at 709.979684s 2026-02-22T23:26:18.374 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.363+0000 7f9775e8a640 1 -- >> v1:10.20.193.45:6791/0 conn(0x7f97700a6d00 legacy=0x7f97701d7b30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.45:6791/0 2026-02-22T23:26:18.374 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.363+0000 7f9775689640 1 --1- >> v1:10.20.193.45:6789/0 conn(0x7f97700a5e00 0x7f9770141540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.45:6789/0 says I am v1:10.20.193.45:49752/0 (socket says 10.20.193.45:49752) 2026-02-22T23:26:18.374 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.363+0000 7f9775689640 1 -- 10.20.193.45:0/412141230 learned_addr learned my addr 10.20.193.45:0/412141230 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-22T23:26:18.374 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.363+0000 7f975dffb640 1 -- 10.20.193.45:0/412141230 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1910757254 0 0) 0x7f97700a9c10 con 0x7f97700a5e00 2026-02-22T23:26:18.374 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.363+0000 7f975dffb640 10 monclient(hunting): _negotiate 2026-02-22T23:26:18.374 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.363+0000 7f975dffb640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:26:18.374 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.363+0000 7f975dffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:26:18.374 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.363+0000 7f975dffb640 10 monclient(hunting): my global_id is 4527 2026-02-22T23:26:18.374 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.363+0000 7f975dffb640 1 -- 10.20.193.45:0/412141230 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9740003620 con 0x7f97700a5e00 2026-02-22T23:26:18.374 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.364+0000 7f975dffb640 1 -- 10.20.193.45:0/412141230 <== mon.0 v1:10.20.193.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 650358290 0 0) 0x7f9740003620 con 0x7f97700a5e00 2026-02-22T23:26:18.374 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.364+0000 7f975dffb640 1 -- 10.20.193.45:0/412141230 --> v1:10.20.193.45:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f97700a9c10 con 0x7f97700a5e00 2026-02-22T23:26:18.374 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.364+0000 7f975dffb640 1 -- 10.20.193.45:0/412141230 <== mon.0 v1:10.20.193.45:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f9760004470 con 0x7f97700a5e00 2026-02-22T23:26:18.374 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.364+0000 7f975dffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-22T23:26:18.374 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.364+0000 7f975dffb640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T23:26:18.374 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.364+0000 7f975dffb640 10 monclient(hunting): dump: 2026-02-22T23:26:18.374 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:26:18.375 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:26:18.375 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:26:18.375 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:26:18.375 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:26:18.375 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:26:18.375 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:26:18.375 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:26:18.375 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:26:18.375 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:26:18.375 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:26:18.375 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:26:18.375 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:26:18.375 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:26:18.375 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:26:18.375 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:26:18.375 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.364+0000 7f975dffb640 10 monclient(hunting): _finish_auth 0 2026-02-22T23:26:18.375 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.364+0000 7f975dffb640 1 -- 10.20.193.45:0/412141230 <== mon.0 v1:10.20.193.45:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2012257611 0 0) 0x7f97700a9c10 con 0x7f97700a5e00 2026-02-22T23:26:18.376 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.364+0000 7f975dffb640 1 -- 10.20.193.45:0/412141230 >> v1:10.20.193.45:6791/0 conn(0x7f97700a6d00 legacy=0x7f97701d7b30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-22T23:26:18.376 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.364+0000 7f975dffb640 1 -- 10.20.193.45:0/412141230 >> v1:10.20.193.73:6790/0 conn(0x7f97700a68f0 legacy=0x7f97701d4400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:26:18.376 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.364+0000 7f975dffb640 10 monclient: _finish_hunting 0 2026-02-22T23:26:18.376 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.364+0000 7f975dffb640 1 monclient: found mon.a 2026-02-22T23:26:18.376 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.364+0000 7f975dffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T23:26:18.376 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.364+0000 7f975dffb640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-22T23:26:18.376 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.364+0000 7f975dffb640 1 -- 10.20.193.45:0/412141230 --> v1:10.20.193.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9770128600 con 0x7f97700a5e00 2026-02-22T23:26:18.376 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.364+0000 7f975dffb640 10 monclient: _finish_auth 0 2026-02-22T23:26:18.376 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.364+0000 7f975dffb640 10 monclient: _check_auth_tickets 2026-02-22T23:26:18.376 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.364+0000 7f975dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T23:26:18.376 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.364+0000 7f9777914640 5 monclient: authenticate success, global_id 4527 2026-02-22T23:26:18.376 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.364+0000 7f9777914640 10 monclient: _renew_subs 2026-02-22T23:26:18.376 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.364+0000 7f9777914640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-22T23:26:18.376 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.364+0000 7f9777914640 1 -- 10.20.193.45:0/412141230 --> v1:10.20.193.45:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f9770141c50 con 0x7f97700a5e00 2026-02-22T23:26:18.376 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.364+0000 7f9777914640 10 monclient: _renew_subs 2026-02-22T23:26:18.376 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.364+0000 7f9777914640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-22T23:26:18.377 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.364+0000 7f9777914640 1 -- 10.20.193.45:0/412141230 --> v1:10.20.193.45:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f9770127930 con 0x7f97700a5e00 2026-02-22T23:26:18.377 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.364+0000 7f975dffb640 1 -- 10.20.193.45:0/412141230 <== mon.0 v1:10.20.193.45:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9760004690 con 0x7f97700a5e00 2026-02-22T23:26:18.377 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.364+0000 7f975dffb640 10 monclient: handle_config config(0 keys) 2026-02-22T23:26:18.377 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.364+0000 7f975dffb640 1 -- 10.20.193.45:0/412141230 <== mon.0 v1:10.20.193.45:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f9760004c40 con 0x7f97700a5e00 2026-02-22T23:26:18.377 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.364+0000 7f975dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:26:18.377 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.364+0000 7f975dffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T23:26:18.377 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.364+0000 7f975f7fe640 4 set_mon_vals no callback set 2026-02-22T23:26:18.377 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.364+0000 7f975dffb640 10 monclient: dump: 2026-02-22T23:26:18.377 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:26:18.377 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:26:18.377 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:26:18.377 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:26:18.377 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:26:18.377 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:26:18.377 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:26:18.377 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:26:18.378 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:26:18.378 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:26:18.378 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:26:18.378 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:26:18.378 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:26:18.378 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:26:18.378 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:26:18.378 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:26:18.378 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.364+0000 7f9777914640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T23:26:18.378 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.364+0000 7f9777914640 1 -- 10.20.193.45:0/412141230 --> v1:10.20.193.73:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f97700008d0 con 0x7f97701cf0e0 2026-02-22T23:26:18.378 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.364+0000 7f975dffb640 1 -- 10.20.193.45:0/412141230 <== mon.0 v1:10.20.193.45:6789/0 7 ==== mgrmap(e 5) ==== 50225+0+0 (unknown 2330357642 0 0) 0x7f9760004de0 con 0x7f97700a5e00 2026-02-22T23:26:18.378 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.365+0000 7f975dffb640 1 -- 10.20.193.45:0/412141230 <== mon.0 v1:10.20.193.45:6789/0 8 ==== osd_map(24..24 src has 1..24) ==== 3893+0+0 (unknown 987433402 0 0) 0x7f976004de10 con 0x7f97700a5e00 2026-02-22T23:26:18.378 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.365+0000 7f975dffb640 1 -- 10.20.193.45:0/412141230 <== mon.3 v1:10.20.193.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1231852005 0 0) 0x7f97700008d0 con 0x7f97701cf0e0 2026-02-22T23:26:18.378 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.365+0000 7f975dffb640 10 monclient(hunting): _negotiate 2026-02-22T23:26:18.378 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.365+0000 7f975dffb640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:26:18.378 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.365+0000 7f975dffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:26:18.378 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.365+0000 7f975dffb640 10 monclient(hunting): my global_id is 4539 2026-02-22T23:26:18.379 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.365+0000 7f975dffb640 1 -- 10.20.193.45:0/412141230 --> v1:10.20.193.73:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f97700a9c10 con 0x7f97701cf0e0 2026-02-22T23:26:18.379 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.365+0000 7f9775e8a640 10 monclient: get_auth_request con 0x7f974003f760 auth_method 0 2026-02-22T23:26:18.379 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.365+0000 7f975dffb640 1 -- 10.20.193.45:0/412141230 <== mon.3 v1:10.20.193.73:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 565896635 0 0) 0x7f97700a9c10 con 0x7f97701cf0e0 2026-02-22T23:26:18.379 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.365+0000 7f975dffb640 1 -- 10.20.193.45:0/412141230 --> v1:10.20.193.73:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f97700008d0 con 0x7f97701cf0e0 2026-02-22T23:26:18.379 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.365+0000 7f975dffb640 1 -- 10.20.193.45:0/412141230 <== mon.3 v1:10.20.193.73:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f97640041a0 con 0x7f97701cf0e0 2026-02-22T23:26:18.379 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.365+0000 7f975dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:26:18.379 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.365+0000 7f975dffb640 10 monclient: got monmap 1 from mon.g (according to old e1) 2026-02-22T23:26:18.379 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.365+0000 7f975dffb640 10 monclient: dump: 2026-02-22T23:26:18.379 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:26:18.379 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:26:18.379 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:26:18.379 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:26:18.379 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:26:18.379 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:26:18.379 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:26:18.379 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:26:18.379 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:26:18.380 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:26:18.380 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:26:18.380 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:26:18.380 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:26:18.380 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:26:18.380 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:26:18.380 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:26:18.380 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.365+0000 7f975dffb640 1 -- 10.20.193.45:0/412141230 <== mon.3 v1:10.20.193.73:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 539602227 0 0) 0x7f97700008d0 con 0x7f97701cf0e0 2026-02-22T23:26:18.380 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.365+0000 7f975dffb640 1 -- 10.20.193.45:0/412141230 --> v1:10.20.193.73:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9770128e00 con 0x7f97701cf0e0 2026-02-22T23:26:18.380 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.365+0000 7f975dffb640 1 -- 10.20.193.45:0/412141230 <== mon.3 v1:10.20.193.73:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (unknown 0 0 2024835662) 0x7f97640064e0 con 0x7f97701cf0e0 2026-02-22T23:26:18.380 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.365+0000 7f975dffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T23:26:18.380 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.365+0000 7f975dffb640 10 monclient: _finish_command 1 = system:0 2026-02-22T23:26:18.380 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.365+0000 7f975dffb640 1 -- 10.20.193.45:0/412141230 >> v1:10.20.193.73:6790/0 conn(0x7f97701cf0e0 legacy=0x7f9770121a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:26:18.380 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.365+0000 7f975dffb640 1 -- 10.20.193.45:0/412141230 >> v1:10.20.193.73:6790/0 conn(0x7f97701cf0e0 legacy=0x7f9770121a50 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T23:26:18.382 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.368+0000 7f9777914640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-22T23:26:18.382 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.368+0000 7f9777914640 1 -- 10.20.193.45:0/412141230 --> v1:10.20.193.73:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f9770128b20 con 0x7f9770122160 2026-02-22T23:26:18.382 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.368+0000 7f975dffb640 1 -- 10.20.193.45:0/412141230 <== mon.3 v1:10.20.193.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4106122134 0 0) 0x7f9770128b20 con 0x7f9770122160 2026-02-22T23:26:18.382 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.368+0000 7f975dffb640 10 monclient(hunting): _negotiate 2026-02-22T23:26:18.382 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.368+0000 7f975dffb640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:26:18.382 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.368+0000 7f975dffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:26:18.382 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.368+0000 7f975dffb640 10 monclient(hunting): my global_id is 4548 2026-02-22T23:26:18.382 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.368+0000 7f975dffb640 1 -- 10.20.193.45:0/412141230 --> v1:10.20.193.73:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f97700008d0 con 0x7f9770122160 2026-02-22T23:26:18.382 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.368+0000 7f975dffb640 1 -- 10.20.193.45:0/412141230 <== mon.3 v1:10.20.193.73:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2095526716 0 0) 0x7f97700008d0 con 0x7f9770122160 2026-02-22T23:26:18.382 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.368+0000 7f975dffb640 1 -- 10.20.193.45:0/412141230 --> v1:10.20.193.73:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9770128b20 con 0x7f9770122160 2026-02-22T23:26:18.382 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.368+0000 7f975dffb640 1 -- 10.20.193.45:0/412141230 <== mon.3 v1:10.20.193.73:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f9764004bc0 con 0x7f9770122160 2026-02-22T23:26:18.382 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.368+0000 7f975dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:26:18.382 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.368+0000 7f975dffb640 10 monclient: got monmap 1 from mon.g (according to old e1) 2026-02-22T23:26:18.382 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.368+0000 7f975dffb640 10 monclient: dump: 2026-02-22T23:26:18.383 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:26:18.383 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:26:18.383 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:26:18.383 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:26:18.383 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:26:18.383 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:26:18.383 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:26:18.383 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:26:18.383 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:26:18.383 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:26:18.383 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:26:18.383 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:26:18.383 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:26:18.383 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:26:18.383 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:26:18.383 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:26:18.383 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.369+0000 7f975dffb640 1 -- 10.20.193.45:0/412141230 <== mon.3 v1:10.20.193.73:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3279898905 0 0) 0x7f9770128b20 con 0x7f9770122160 2026-02-22T23:26:18.384 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.369+0000 7f975dffb640 1 -- 10.20.193.45:0/412141230 --> v1:10.20.193.73:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f97701cf4c0 con 0x7f9770122160 2026-02-22T23:26:18.384 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.369+0000 7f975dffb640 1 -- 10.20.193.45:0/412141230 <== mon.3 v1:10.20.193.73:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7650 (unknown 0 0 3620156396) 0x7f97640060b0 con 0x7f9770122160 2026-02-22T23:26:18.384 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.369+0000 7f975dffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-22T23:26:18.384 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.369+0000 7f975dffb640 10 monclient: _finish_command 2 = system:0 2026-02-22T23:26:18.384 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.369+0000 7f975dffb640 1 -- 10.20.193.45:0/412141230 >> v1:10.20.193.73:6790/0 conn(0x7f9770122160 legacy=0x7f97701de280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:26:18.384 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.369+0000 7f975dffb640 1 -- 10.20.193.45:0/412141230 >> v1:10.20.193.73:6790/0 conn(0x7f9770122160 legacy=0x7f97701de280 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T23:26:18.384 INFO:teuthology.orchestra.run.trial045.stdout:{ 2026-02-22T23:26:18.384 INFO:teuthology.orchestra.run.trial045.stdout: "name": "g", 2026-02-22T23:26:18.384 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 3, 2026-02-22T23:26:18.384 INFO:teuthology.orchestra.run.trial045.stdout: "state": "peon", 2026-02-22T23:26:18.384 INFO:teuthology.orchestra.run.trial045.stdout: "election_epoch": 22, 2026-02-22T23:26:18.385 INFO:teuthology.orchestra.run.trial045.stdout: "uptime": 58486, 2026-02-22T23:26:18.385 INFO:teuthology.orchestra.run.trial045.stdout: "quorum": [ 2026-02-22T23:26:18.385 INFO:teuthology.orchestra.run.trial045.stdout: 0, 2026-02-22T23:26:18.385 INFO:teuthology.orchestra.run.trial045.stdout: 2, 2026-02-22T23:26:18.385 INFO:teuthology.orchestra.run.trial045.stdout: 3, 2026-02-22T23:26:18.385 INFO:teuthology.orchestra.run.trial045.stdout: 7, 2026-02-22T23:26:18.385 INFO:teuthology.orchestra.run.trial045.stdout: 8 2026-02-22T23:26:18.385 INFO:teuthology.orchestra.run.trial045.stdout: ], 2026-02-22T23:26:18.385 INFO:teuthology.orchestra.run.trial045.stdout: "quorum_age": 3, 2026-02-22T23:26:18.385 INFO:teuthology.orchestra.run.trial045.stdout: "features": { 2026-02-22T23:26:18.385 INFO:teuthology.orchestra.run.trial045.stdout: "required_con": "2450521708007866372", 2026-02-22T23:26:18.385 INFO:teuthology.orchestra.run.trial045.stdout: "required_mon": [ 2026-02-22T23:26:18.385 INFO:teuthology.orchestra.run.trial045.stdout: "kraken", 2026-02-22T23:26:18.385 INFO:teuthology.orchestra.run.trial045.stdout: "luminous", 2026-02-22T23:26:18.385 INFO:teuthology.orchestra.run.trial045.stdout: "mimic", 2026-02-22T23:26:18.385 INFO:teuthology.orchestra.run.trial045.stdout: "osdmap-prune", 2026-02-22T23:26:18.386 INFO:teuthology.orchestra.run.trial045.stdout: "nautilus", 2026-02-22T23:26:18.386 INFO:teuthology.orchestra.run.trial045.stdout: "octopus", 2026-02-22T23:26:18.386 INFO:teuthology.orchestra.run.trial045.stdout: "pacific", 2026-02-22T23:26:18.386 INFO:teuthology.orchestra.run.trial045.stdout: "elector-pinging", 2026-02-22T23:26:18.386 INFO:teuthology.orchestra.run.trial045.stdout: "quincy", 2026-02-22T23:26:18.386 INFO:teuthology.orchestra.run.trial045.stdout: "reef", 2026-02-22T23:26:18.386 INFO:teuthology.orchestra.run.trial045.stdout: "squid" 2026-02-22T23:26:18.386 INFO:teuthology.orchestra.run.trial045.stdout: ], 2026-02-22T23:26:18.386 INFO:teuthology.orchestra.run.trial045.stdout: "quorum_con": "4540701547738038271", 2026-02-22T23:26:18.386 INFO:teuthology.orchestra.run.trial045.stdout: "quorum_mon": [ 2026-02-22T23:26:18.386 INFO:teuthology.orchestra.run.trial045.stdout: "kraken", 2026-02-22T23:26:18.386 INFO:teuthology.orchestra.run.trial045.stdout: "luminous", 2026-02-22T23:26:18.386 INFO:teuthology.orchestra.run.trial045.stdout: "mimic", 2026-02-22T23:26:18.386 INFO:teuthology.orchestra.run.trial045.stdout: "osdmap-prune", 2026-02-22T23:26:18.386 INFO:teuthology.orchestra.run.trial045.stdout: "nautilus", 2026-02-22T23:26:18.386 INFO:teuthology.orchestra.run.trial045.stdout: "octopus", 2026-02-22T23:26:18.386 INFO:teuthology.orchestra.run.trial045.stdout: "pacific", 2026-02-22T23:26:18.386 INFO:teuthology.orchestra.run.trial045.stdout: "elector-pinging", 2026-02-22T23:26:18.387 INFO:teuthology.orchestra.run.trial045.stdout: "quincy", 2026-02-22T23:26:18.387 INFO:teuthology.orchestra.run.trial045.stdout: "reef", 2026-02-22T23:26:18.387 INFO:teuthology.orchestra.run.trial045.stdout: "squid" 2026-02-22T23:26:18.387 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:26:18.387 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:26:18.387 INFO:teuthology.orchestra.run.trial045.stdout: "outside_quorum": [], 2026-02-22T23:26:18.387 INFO:teuthology.orchestra.run.trial045.stdout: "extra_probe_peers": [], 2026-02-22T23:26:18.387 INFO:teuthology.orchestra.run.trial045.stdout: "sync_provider": [], 2026-02-22T23:26:18.387 INFO:teuthology.orchestra.run.trial045.stdout: "monmap": { 2026-02-22T23:26:18.387 INFO:teuthology.orchestra.run.trial045.stdout: "epoch": 1, 2026-02-22T23:26:18.387 INFO:teuthology.orchestra.run.trial045.stdout: "fsid": "4b60f18f-6660-4731-b731-dc85c4078413", 2026-02-22T23:26:18.387 INFO:teuthology.orchestra.run.trial045.stdout: "modified": "2026-02-22T23:24:52.393472Z", 2026-02-22T23:26:18.387 INFO:teuthology.orchestra.run.trial045.stdout: "created": "2026-02-22T23:24:52.393472Z", 2026-02-22T23:26:18.387 INFO:teuthology.orchestra.run.trial045.stdout: "min_mon_release": 19, 2026-02-22T23:26:18.387 INFO:teuthology.orchestra.run.trial045.stdout: "min_mon_release_name": "squid", 2026-02-22T23:26:18.387 INFO:teuthology.orchestra.run.trial045.stdout: "election_strategy": 3, 2026-02-22T23:26:18.387 INFO:teuthology.orchestra.run.trial045.stdout: "disallowed_leaders": "", 2026-02-22T23:26:18.388 INFO:teuthology.orchestra.run.trial045.stdout: "stretch_mode": false, 2026-02-22T23:26:18.388 INFO:teuthology.orchestra.run.trial045.stdout: "tiebreaker_mon": "", 2026-02-22T23:26:18.388 INFO:teuthology.orchestra.run.trial045.stdout: "removed_ranks": "", 2026-02-22T23:26:18.388 INFO:teuthology.orchestra.run.trial045.stdout: "features": { 2026-02-22T23:26:18.388 INFO:teuthology.orchestra.run.trial045.stdout: "persistent": [ 2026-02-22T23:26:18.388 INFO:teuthology.orchestra.run.trial045.stdout: "kraken", 2026-02-22T23:26:18.388 INFO:teuthology.orchestra.run.trial045.stdout: "luminous", 2026-02-22T23:26:18.388 INFO:teuthology.orchestra.run.trial045.stdout: "mimic", 2026-02-22T23:26:18.388 INFO:teuthology.orchestra.run.trial045.stdout: "osdmap-prune", 2026-02-22T23:26:18.388 INFO:teuthology.orchestra.run.trial045.stdout: "nautilus", 2026-02-22T23:26:18.388 INFO:teuthology.orchestra.run.trial045.stdout: "octopus", 2026-02-22T23:26:18.388 INFO:teuthology.orchestra.run.trial045.stdout: "pacific", 2026-02-22T23:26:18.388 INFO:teuthology.orchestra.run.trial045.stdout: "elector-pinging", 2026-02-22T23:26:18.388 INFO:teuthology.orchestra.run.trial045.stdout: "quincy", 2026-02-22T23:26:18.388 INFO:teuthology.orchestra.run.trial045.stdout: "reef", 2026-02-22T23:26:18.388 INFO:teuthology.orchestra.run.trial045.stdout: "squid" 2026-02-22T23:26:18.388 INFO:teuthology.orchestra.run.trial045.stdout: ], 2026-02-22T23:26:18.388 INFO:teuthology.orchestra.run.trial045.stdout: "optional": [] 2026-02-22T23:26:18.388 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:26:18.389 INFO:teuthology.orchestra.run.trial045.stdout: "mons": [ 2026-02-22T23:26:18.389 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:26:18.389 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 0, 2026-02-22T23:26:18.389 INFO:teuthology.orchestra.run.trial045.stdout: "name": "a", 2026-02-22T23:26:18.389 INFO:teuthology.orchestra.run.trial045.stdout: "public_addrs": { 2026-02-22T23:26:18.389 INFO:teuthology.orchestra.run.trial045.stdout: "addrvec": [ 2026-02-22T23:26:18.389 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:26:18.389 INFO:teuthology.orchestra.run.trial045.stdout: "type": "v1", 2026-02-22T23:26:18.389 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6789", 2026-02-22T23:26:18.389 INFO:teuthology.orchestra.run.trial045.stdout: "nonce": 0 2026-02-22T23:26:18.389 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:26:18.389 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:26:18.389 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:26:18.389 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6789/0", 2026-02-22T23:26:18.389 INFO:teuthology.orchestra.run.trial045.stdout: "public_addr": "10.20.193.45:6789/0", 2026-02-22T23:26:18.389 INFO:teuthology.orchestra.run.trial045.stdout: "priority": 0, 2026-02-22T23:26:18.389 INFO:teuthology.orchestra.run.trial045.stdout: "weight": 0, 2026-02-22T23:26:18.389 INFO:teuthology.orchestra.run.trial045.stdout: "crush_location": "{}" 2026-02-22T23:26:18.389 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:26:18.389 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:26:18.390 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 1, 2026-02-22T23:26:18.390 INFO:teuthology.orchestra.run.trial045.stdout: "name": "f", 2026-02-22T23:26:18.390 INFO:teuthology.orchestra.run.trial045.stdout: "public_addrs": { 2026-02-22T23:26:18.390 INFO:teuthology.orchestra.run.trial045.stdout: "addrvec": [ 2026-02-22T23:26:18.390 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:26:18.390 INFO:teuthology.orchestra.run.trial045.stdout: "type": "v1", 2026-02-22T23:26:18.390 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.73:6789", 2026-02-22T23:26:18.390 INFO:teuthology.orchestra.run.trial045.stdout: "nonce": 0 2026-02-22T23:26:18.390 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:26:18.390 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:26:18.390 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:26:18.390 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.73:6789/0", 2026-02-22T23:26:18.390 INFO:teuthology.orchestra.run.trial045.stdout: "public_addr": "10.20.193.73:6789/0", 2026-02-22T23:26:18.390 INFO:teuthology.orchestra.run.trial045.stdout: "priority": 0, 2026-02-22T23:26:18.390 INFO:teuthology.orchestra.run.trial045.stdout: "weight": 0, 2026-02-22T23:26:18.390 INFO:teuthology.orchestra.run.trial045.stdout: "crush_location": "{}" 2026-02-22T23:26:18.390 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:26:18.390 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:26:18.390 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 2, 2026-02-22T23:26:18.390 INFO:teuthology.orchestra.run.trial045.stdout: "name": "b", 2026-02-22T23:26:18.391 INFO:teuthology.orchestra.run.trial045.stdout: "public_addrs": { 2026-02-22T23:26:18.391 INFO:teuthology.orchestra.run.trial045.stdout: "addrvec": [ 2026-02-22T23:26:18.391 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:26:18.391 INFO:teuthology.orchestra.run.trial045.stdout: "type": "v1", 2026-02-22T23:26:18.391 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6790", 2026-02-22T23:26:18.391 INFO:teuthology.orchestra.run.trial045.stdout: "nonce": 0 2026-02-22T23:26:18.391 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:26:18.391 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:26:18.391 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:26:18.391 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6790/0", 2026-02-22T23:26:18.391 INFO:teuthology.orchestra.run.trial045.stdout: "public_addr": "10.20.193.45:6790/0", 2026-02-22T23:26:18.391 INFO:teuthology.orchestra.run.trial045.stdout: "priority": 0, 2026-02-22T23:26:18.391 INFO:teuthology.orchestra.run.trial045.stdout: "weight": 0, 2026-02-22T23:26:18.391 INFO:teuthology.orchestra.run.trial045.stdout: "crush_location": "{}" 2026-02-22T23:26:18.391 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:26:18.391 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:26:18.391 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 3, 2026-02-22T23:26:18.391 INFO:teuthology.orchestra.run.trial045.stdout: "name": "g", 2026-02-22T23:26:18.391 INFO:teuthology.orchestra.run.trial045.stdout: "public_addrs": { 2026-02-22T23:26:18.391 INFO:teuthology.orchestra.run.trial045.stdout: "addrvec": [ 2026-02-22T23:26:18.392 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:26:18.392 INFO:teuthology.orchestra.run.trial045.stdout: "type": "v1", 2026-02-22T23:26:18.392 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.73:6790", 2026-02-22T23:26:18.392 INFO:teuthology.orchestra.run.trial045.stdout: "nonce": 0 2026-02-22T23:26:18.392 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:26:18.392 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:26:18.392 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:26:18.392 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.73:6790/0", 2026-02-22T23:26:18.392 INFO:teuthology.orchestra.run.trial045.stdout: "public_addr": "10.20.193.73:6790/0", 2026-02-22T23:26:18.392 INFO:teuthology.orchestra.run.trial045.stdout: "priority": 0, 2026-02-22T23:26:18.392 INFO:teuthology.orchestra.run.trial045.stdout: "weight": 0, 2026-02-22T23:26:18.392 INFO:teuthology.orchestra.run.trial045.stdout: "crush_location": "{}" 2026-02-22T23:26:18.392 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:26:18.392 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:26:18.392 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 4, 2026-02-22T23:26:18.392 INFO:teuthology.orchestra.run.trial045.stdout: "name": "c", 2026-02-22T23:26:18.392 INFO:teuthology.orchestra.run.trial045.stdout: "public_addrs": { 2026-02-22T23:26:18.392 INFO:teuthology.orchestra.run.trial045.stdout: "addrvec": [ 2026-02-22T23:26:18.392 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:26:18.392 INFO:teuthology.orchestra.run.trial045.stdout: "type": "v1", 2026-02-22T23:26:18.392 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6791", 2026-02-22T23:26:18.392 INFO:teuthology.orchestra.run.trial045.stdout: "nonce": 0 2026-02-22T23:26:18.392 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:26:18.393 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:26:18.393 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:26:18.393 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6791/0", 2026-02-22T23:26:18.393 INFO:teuthology.orchestra.run.trial045.stdout: "public_addr": "10.20.193.45:6791/0", 2026-02-22T23:26:18.393 INFO:teuthology.orchestra.run.trial045.stdout: "priority": 0, 2026-02-22T23:26:18.393 INFO:teuthology.orchestra.run.trial045.stdout: "weight": 0, 2026-02-22T23:26:18.393 INFO:teuthology.orchestra.run.trial045.stdout: "crush_location": "{}" 2026-02-22T23:26:18.393 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:26:18.393 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:26:18.393 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 5, 2026-02-22T23:26:18.393 INFO:teuthology.orchestra.run.trial045.stdout: "name": "h", 2026-02-22T23:26:18.393 INFO:teuthology.orchestra.run.trial045.stdout: "public_addrs": { 2026-02-22T23:26:18.393 INFO:teuthology.orchestra.run.trial045.stdout: "addrvec": [ 2026-02-22T23:26:18.393 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:26:18.393 INFO:teuthology.orchestra.run.trial045.stdout: "type": "v1", 2026-02-22T23:26:18.393 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.73:6791", 2026-02-22T23:26:18.393 INFO:teuthology.orchestra.run.trial045.stdout: "nonce": 0 2026-02-22T23:26:18.393 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:26:18.393 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:26:18.393 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:26:18.393 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.73:6791/0", 2026-02-22T23:26:18.394 INFO:teuthology.orchestra.run.trial045.stdout: "public_addr": "10.20.193.73:6791/0", 2026-02-22T23:26:18.394 INFO:teuthology.orchestra.run.trial045.stdout: "priority": 0, 2026-02-22T23:26:18.394 INFO:teuthology.orchestra.run.trial045.stdout: "weight": 0, 2026-02-22T23:26:18.394 INFO:teuthology.orchestra.run.trial045.stdout: "crush_location": "{}" 2026-02-22T23:26:18.394 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:26:18.394 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:26:18.394 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 6, 2026-02-22T23:26:18.394 INFO:teuthology.orchestra.run.trial045.stdout: "name": "d", 2026-02-22T23:26:18.394 INFO:teuthology.orchestra.run.trial045.stdout: "public_addrs": { 2026-02-22T23:26:18.394 INFO:teuthology.orchestra.run.trial045.stdout: "addrvec": [ 2026-02-22T23:26:18.394 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:26:18.394 INFO:teuthology.orchestra.run.trial045.stdout: "type": "v1", 2026-02-22T23:26:18.394 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6792", 2026-02-22T23:26:18.394 INFO:teuthology.orchestra.run.trial045.stdout: "nonce": 0 2026-02-22T23:26:18.394 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:26:18.394 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:26:18.394 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:26:18.394 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6792/0", 2026-02-22T23:26:18.394 INFO:teuthology.orchestra.run.trial045.stdout: "public_addr": "10.20.193.45:6792/0", 2026-02-22T23:26:18.394 INFO:teuthology.orchestra.run.trial045.stdout: "priority": 0, 2026-02-22T23:26:18.394 INFO:teuthology.orchestra.run.trial045.stdout: "weight": 0, 2026-02-22T23:26:18.394 INFO:teuthology.orchestra.run.trial045.stdout: "crush_location": "{}" 2026-02-22T23:26:18.395 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:26:18.395 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:26:18.395 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 7, 2026-02-22T23:26:18.395 INFO:teuthology.orchestra.run.trial045.stdout: "name": "i", 2026-02-22T23:26:18.395 INFO:teuthology.orchestra.run.trial045.stdout: "public_addrs": { 2026-02-22T23:26:18.395 INFO:teuthology.orchestra.run.trial045.stdout: "addrvec": [ 2026-02-22T23:26:18.395 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:26:18.395 INFO:teuthology.orchestra.run.trial045.stdout: "type": "v1", 2026-02-22T23:26:18.395 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.73:6792", 2026-02-22T23:26:18.395 INFO:teuthology.orchestra.run.trial045.stdout: "nonce": 0 2026-02-22T23:26:18.395 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:26:18.395 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:26:18.395 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:26:18.395 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.73:6792/0", 2026-02-22T23:26:18.395 INFO:teuthology.orchestra.run.trial045.stdout: "public_addr": "10.20.193.73:6792/0", 2026-02-22T23:26:18.395 INFO:teuthology.orchestra.run.trial045.stdout: "priority": 0, 2026-02-22T23:26:18.395 INFO:teuthology.orchestra.run.trial045.stdout: "weight": 0, 2026-02-22T23:26:18.395 INFO:teuthology.orchestra.run.trial045.stdout: "crush_location": "{}" 2026-02-22T23:26:18.395 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:26:18.395 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:26:18.395 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 8, 2026-02-22T23:26:18.395 INFO:teuthology.orchestra.run.trial045.stdout: "name": "e", 2026-02-22T23:26:18.396 INFO:teuthology.orchestra.run.trial045.stdout: "public_addrs": { 2026-02-22T23:26:18.396 INFO:teuthology.orchestra.run.trial045.stdout: "addrvec": [ 2026-02-22T23:26:18.396 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:26:18.396 INFO:teuthology.orchestra.run.trial045.stdout: "type": "v1", 2026-02-22T23:26:18.396 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6793", 2026-02-22T23:26:18.396 INFO:teuthology.orchestra.run.trial045.stdout: "nonce": 0 2026-02-22T23:26:18.396 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:26:18.396 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:26:18.396 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:26:18.396 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6793/0", 2026-02-22T23:26:18.396 INFO:teuthology.orchestra.run.trial045.stdout: "public_addr": "10.20.193.45:6793/0", 2026-02-22T23:26:18.396 INFO:teuthology.orchestra.run.trial045.stdout: "priority": 0, 2026-02-22T23:26:18.396 INFO:teuthology.orchestra.run.trial045.stdout: "weight": 0, 2026-02-22T23:26:18.396 INFO:teuthology.orchestra.run.trial045.stdout: "crush_location": "{}" 2026-02-22T23:26:18.396 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:26:18.396 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:26:18.396 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:26:18.396 INFO:teuthology.orchestra.run.trial045.stdout: "feature_map": { 2026-02-22T23:26:18.396 INFO:teuthology.orchestra.run.trial045.stdout: "mon": [ 2026-02-22T23:26:18.396 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:26:18.396 INFO:teuthology.orchestra.run.trial045.stdout: "features": "0x3f03cffffffdffff", 2026-02-22T23:26:18.396 INFO:teuthology.orchestra.run.trial045.stdout: "release": "squid", 2026-02-22T23:26:18.396 INFO:teuthology.orchestra.run.trial045.stdout: "num": 1 2026-02-22T23:26:18.396 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:26:18.397 INFO:teuthology.orchestra.run.trial045.stdout: ], 2026-02-22T23:26:18.397 INFO:teuthology.orchestra.run.trial045.stdout: "osd": [ 2026-02-22T23:26:18.397 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:26:18.397 INFO:teuthology.orchestra.run.trial045.stdout: "features": "0x3f03cffffffdffff", 2026-02-22T23:26:18.397 INFO:teuthology.orchestra.run.trial045.stdout: "release": "squid", 2026-02-22T23:26:18.397 INFO:teuthology.orchestra.run.trial045.stdout: "num": 1 2026-02-22T23:26:18.397 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:26:18.397 INFO:teuthology.orchestra.run.trial045.stdout: ], 2026-02-22T23:26:18.397 INFO:teuthology.orchestra.run.trial045.stdout: "client": [ 2026-02-22T23:26:18.397 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:26:18.397 INFO:teuthology.orchestra.run.trial045.stdout: "features": "0x3f03cffffffdffff", 2026-02-22T23:26:18.397 INFO:teuthology.orchestra.run.trial045.stdout: "release": "squid", 2026-02-22T23:26:18.397 INFO:teuthology.orchestra.run.trial045.stdout: "num": 4 2026-02-22T23:26:18.397 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:26:18.397 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:26:18.397 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:26:18.397 INFO:teuthology.orchestra.run.trial045.stdout: "stretch_mode": false 2026-02-22T23:26:18.397 INFO:teuthology.orchestra.run.trial045.stdout:} 2026-02-22T23:26:18.398 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.369+0000 7f9777914640 1 -- 10.20.193.45:0/412141230 >> v1:10.20.193.73:6800/2222410180 conn(0x7f974003f760 legacy=0x7f9740041c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:26:18.398 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.369+0000 7f9777914640 10 monclient: shutdown 2026-02-22T23:26:18.398 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.369+0000 7f9777914640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T23:26:18.398 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.369+0000 7f9777914640 1 -- 10.20.193.45:0/412141230 >> v1:10.20.193.45:6789/0 conn(0x7f97700a5e00 legacy=0x7f9770141540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:26:18.398 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.369+0000 7f9775e8a640 1 -- 10.20.193.45:0/412141230 reap_dead start 2026-02-22T23:26:18.398 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.369+0000 7f9775e8a640 1 -- 10.20.193.45:0/412141230 reap_dead start 2026-02-22T23:26:18.398 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.369+0000 7f9777914640 1 -- 10.20.193.45:0/412141230 shutdown_connections 2026-02-22T23:26:18.398 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.369+0000 7f9777914640 1 -- 10.20.193.45:0/412141230 >> 10.20.193.45:0/412141230 conn(0x7f97700abb50 msgr2=0x7f97701422f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:26:18.399 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.369+0000 7f9777914640 1 -- 10.20.193.45:0/412141230 shutdown_connections 2026-02-22T23:26:18.399 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.369+0000 7f9777914640 1 -- 10.20.193.45:0/412141230 wait complete. 2026-02-22T23:26:18.399 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 5 2026-02-22T23:26:18.399 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 5 for mon i 2026-02-22T23:26:18.399 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.i mon_status 2026-02-22T23:26:18.465 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.465+0000 7fe779f40640 10 monclient: get_monmap_and_config 2026-02-22T23:26:18.465 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.465+0000 7fe779f40640 10 monclient: build_initial_monmap 2026-02-22T23:26:18.465 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.465+0000 7fe779f40640 10 monclient: monmap: 2026-02-22T23:26:18.465 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-22T23:26:18.465 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:26:18.466 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:26:18.465798+0000 2026-02-22T23:26:18.466 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:26:18.465798+0000 2026-02-22T23:26:18.466 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-22T23:26:18.466 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:26:18.466 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-22T23:26:18.466 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.noname-f 2026-02-22T23:26:18.466 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.noname-b 2026-02-22T23:26:18.466 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.noname-g 2026-02-22T23:26:18.466 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.noname-c 2026-02-22T23:26:18.466 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.noname-h 2026-02-22T23:26:18.466 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.noname-d 2026-02-22T23:26:18.466 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.noname-i 2026-02-22T23:26:18.466 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.noname-e 2026-02-22T23:26:18.466 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:26:18.473 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.466+0000 7fe779f40640 1 Processor -- start 2026-02-22T23:26:18.473 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.466+0000 7fe779f40640 1 -- start start 2026-02-22T23:26:18.473 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.466+0000 7fe779f40640 10 monclient: init 2026-02-22T23:26:18.473 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.466+0000 7fe779f40640 10 monclient: _reopen_session rank -1 2026-02-22T23:26:18.473 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.466+0000 7fe779f40640 10 monclient: _add_conns ranks=[2,4,8,0,5,1,6,3,7] 2026-02-22T23:26:18.473 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.466+0000 7fe779f40640 10 monclient(hunting): picked mon.noname-b con 0x7fe7740a4610 addr v1:10.20.193.45:6790/0 2026-02-22T23:26:18.473 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.466+0000 7fe779f40640 10 monclient(hunting): picked mon.noname-c con 0x7fe7740a5100 addr v1:10.20.193.45:6791/0 2026-02-22T23:26:18.473 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.466+0000 7fe779f40640 10 monclient(hunting): picked mon.noname-e con 0x7fe7740a3f10 addr v1:10.20.193.45:6793/0 2026-02-22T23:26:18.473 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.466+0000 7fe779f40640 1 -- --> v1:10.20.193.45:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe77406f720 con 0x7fe7740a4610 2026-02-22T23:26:18.473 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.466+0000 7fe779f40640 1 -- --> v1:10.20.193.45:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe7740a7250 con 0x7fe7740a5100 2026-02-22T23:26:18.474 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.466+0000 7fe779f40640 1 -- --> v1:10.20.193.45:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe7740a2c90 con 0x7fe7740a3f10 2026-02-22T23:26:18.474 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.466+0000 7fe779f40640 10 monclient(hunting): _renew_subs 2026-02-22T23:26:18.474 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.466+0000 7fe779f40640 10 monclient(hunting): authenticate will time out at 710.082653s 2026-02-22T23:26:18.474 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.466+0000 7fe772ffd640 1 -- >> v1:10.20.193.45:6791/0 conn(0x7fe7740a5100 legacy=0x7fe77413de70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.45:6791/0 2026-02-22T23:26:18.474 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.466+0000 7fe7737fe640 1 --1- >> v1:10.20.193.45:6790/0 conn(0x7fe7740a4610 0x7fe7740a49f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.45:6790/0 says I am v1:10.20.193.45:46288/0 (socket says 10.20.193.45:46288) 2026-02-22T23:26:18.474 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.466+0000 7fe7737fe640 1 -- 10.20.193.45:0/1542325746 learned_addr learned my addr 10.20.193.45:0/1542325746 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-22T23:26:18.474 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.466+0000 7fe7727fc640 1 -- 10.20.193.45:0/1542325746 <== mon.2 v1:10.20.193.45:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2703939252 0 0) 0x7fe77406f720 con 0x7fe7740a4610 2026-02-22T23:26:18.474 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.466+0000 7fe7727fc640 10 monclient(hunting): _negotiate 2026-02-22T23:26:18.474 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.466+0000 7fe7727fc640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:26:18.474 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.466+0000 7fe7727fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:26:18.474 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.466+0000 7fe7727fc640 10 monclient(hunting): my global_id is 4628 2026-02-22T23:26:18.474 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.466+0000 7fe7727fc640 1 -- 10.20.193.45:0/1542325746 --> v1:10.20.193.45:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe758003620 con 0x7fe7740a4610 2026-02-22T23:26:18.474 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.466+0000 7fe7727fc640 1 -- 10.20.193.45:0/1542325746 <== mon.8 v1:10.20.193.45:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2436427285 0 0) 0x7fe7740a2c90 con 0x7fe7740a3f10 2026-02-22T23:26:18.474 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.466+0000 7fe7727fc640 10 monclient(hunting): _negotiate 2026-02-22T23:26:18.474 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.466+0000 7fe7727fc640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:26:18.474 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.466+0000 7fe7727fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:26:18.475 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.466+0000 7fe7727fc640 10 monclient(hunting): my global_id is 4580 2026-02-22T23:26:18.475 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.466+0000 7fe7727fc640 1 -- 10.20.193.45:0/1542325746 --> v1:10.20.193.45:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe77406f720 con 0x7fe7740a3f10 2026-02-22T23:26:18.475 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.467+0000 7fe7727fc640 1 -- 10.20.193.45:0/1542325746 <== mon.8 v1:10.20.193.45:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4072748499 0 0) 0x7fe77406f720 con 0x7fe7740a3f10 2026-02-22T23:26:18.475 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.467+0000 7fe7727fc640 1 -- 10.20.193.45:0/1542325746 >> v1:10.20.193.45:6791/0 conn(0x7fe7740a5100 legacy=0x7fe77413de70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-22T23:26:18.475 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.467+0000 7fe7727fc640 1 -- 10.20.193.45:0/1542325746 >> v1:10.20.193.45:6790/0 conn(0x7fe7740a4610 legacy=0x7fe7740a49f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:26:18.475 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.467+0000 7fe7727fc640 10 monclient: _finish_hunting 0 2026-02-22T23:26:18.475 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.467+0000 7fe7727fc640 1 monclient: found mon.noname-e 2026-02-22T23:26:18.475 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.467+0000 7fe7727fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T23:26:18.475 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.467+0000 7fe7727fc640 10 monclient: _send_mon_message to mon.noname-e at v1:10.20.193.45:6793/0 2026-02-22T23:26:18.475 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.467+0000 7fe7727fc640 1 -- 10.20.193.45:0/1542325746 --> v1:10.20.193.45:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7740a3250 con 0x7fe7740a3f10 2026-02-22T23:26:18.475 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.467+0000 7fe7727fc640 10 monclient: _finish_auth 0 2026-02-22T23:26:18.475 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.467+0000 7fe7727fc640 10 monclient: _check_auth_tickets 2026-02-22T23:26:18.475 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.467+0000 7fe7727fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T23:26:18.475 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.467+0000 7fe7727fc640 1 -- 10.20.193.45:0/1542325746 <== mon.8 v1:10.20.193.45:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7fe7680033a0 con 0x7fe7740a3f10 2026-02-22T23:26:18.475 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.467+0000 7fe779f40640 5 monclient: authenticate success, global_id 4580 2026-02-22T23:26:18.475 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.467+0000 7fe779f40640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-22T23:26:18.476 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.467+0000 7fe7727fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:26:18.476 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.467+0000 7fe7727fc640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2026-02-22T23:26:18.476 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.467+0000 7fe7727fc640 10 monclient: dump: 2026-02-22T23:26:18.476 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:26:18.476 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:26:18.476 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:26:18.476 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:26:18.476 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:26:18.476 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:26:18.476 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:26:18.476 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:26:18.476 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:26:18.476 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:26:18.476 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:26:18.476 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:26:18.476 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:26:18.476 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:26:18.476 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:26:18.477 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:26:18.477 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.467+0000 7fe779f40640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-22T23:26:18.477 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.467+0000 7fe7727fc640 1 -- 10.20.193.45:0/1542325746 <== mon.8 v1:10.20.193.45:6793/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe7680035c0 con 0x7fe7740a3f10 2026-02-22T23:26:18.477 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.467+0000 7fe7727fc640 10 monclient: handle_config config(0 keys) 2026-02-22T23:26:18.477 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.467+0000 7fe779f40640 10 monclient: get_monmap_and_config success 2026-02-22T23:26:18.477 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.467+0000 7fe779f40640 4 set_mon_vals no callback set 2026-02-22T23:26:18.477 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.467+0000 7fe7727fc640 1 -- 10.20.193.45:0/1542325746 <== mon.8 v1:10.20.193.45:6793/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7fe768003dd0 con 0x7fe7740a3f10 2026-02-22T23:26:18.477 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.467+0000 7fe7727fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:26:18.477 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.467+0000 7fe7727fc640 10 monclient: got monmap 1 from mon.e (according to old e1) 2026-02-22T23:26:18.477 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.467+0000 7fe7727fc640 10 monclient: dump: 2026-02-22T23:26:18.477 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:26:18.477 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:26:18.477 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:26:18.477 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:26:18.477 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:26:18.478 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:26:18.478 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:26:18.478 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:26:18.478 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:26:18.478 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:26:18.478 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:26:18.478 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:26:18.478 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:26:18.478 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:26:18.478 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:26:18.478 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:26:18.478 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.467+0000 7fe779f40640 10 monclient: shutdown 2026-02-22T23:26:18.478 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.467+0000 7fe779f40640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T23:26:18.478 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.467+0000 7fe779f40640 1 -- 10.20.193.45:0/1542325746 >> v1:10.20.193.45:6793/0 conn(0x7fe7740a3f10 legacy=0x7fe7741415a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:26:18.478 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.467+0000 7fe779f40640 1 -- 10.20.193.45:0/1542325746 shutdown_connections 2026-02-22T23:26:18.478 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.467+0000 7fe779f40640 1 -- 10.20.193.45:0/1542325746 >> 10.20.193.45:0/1542325746 conn(0x7fe7740a7f70 msgr2=0x7fe7740a8380 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:26:18.479 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.467+0000 7fe779f40640 1 -- 10.20.193.45:0/1542325746 shutdown_connections 2026-02-22T23:26:18.479 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.467+0000 7fe779f40640 1 -- 10.20.193.45:0/1542325746 wait complete. 2026-02-22T23:26:18.479 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.467+0000 7fe779f40640 10 monclient: build_initial_monmap 2026-02-22T23:26:18.479 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.467+0000 7fe779f40640 10 monclient: monmap: 2026-02-22T23:26:18.479 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-22T23:26:18.479 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T23:26:18.479 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-22T23:26:18.479 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-22T23:26:18.479 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-22T23:26:18.479 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-22T23:26:18.479 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-22T23:26:18.479 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.noname-f 2026-02-22T23:26:18.479 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.noname-b 2026-02-22T23:26:18.479 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.noname-g 2026-02-22T23:26:18.479 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.noname-c 2026-02-22T23:26:18.479 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.noname-h 2026-02-22T23:26:18.479 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.noname-d 2026-02-22T23:26:18.480 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.noname-i 2026-02-22T23:26:18.480 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.noname-e 2026-02-22T23:26:18.480 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:26:18.480 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.468+0000 7fe779f40640 1 Processor -- start 2026-02-22T23:26:18.480 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.468+0000 7fe779f40640 1 -- start start 2026-02-22T23:26:18.480 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.468+0000 7fe779f40640 10 monclient: init 2026-02-22T23:26:18.480 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.468+0000 7fe779f40640 10 monclient: _reopen_session rank -1 2026-02-22T23:26:18.480 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.468+0000 7fe779f40640 10 monclient: _add_conns ranks=[0,5,1,2,3,4,6,8,7] 2026-02-22T23:26:18.480 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.468+0000 7fe779f40640 10 monclient(hunting): picked mon.noname-a con 0x7fe7740a3f10 addr v1:10.20.193.45:6789/0 2026-02-22T23:26:18.480 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.468+0000 7fe779f40640 10 monclient(hunting): picked mon.noname-h con 0x7fe7740a4610 addr v1:10.20.193.73:6791/0 2026-02-22T23:26:18.480 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.468+0000 7fe779f40640 10 monclient(hunting): picked mon.noname-f con 0x7fe7740a5100 addr v1:10.20.193.73:6789/0 2026-02-22T23:26:18.480 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.468+0000 7fe779f40640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe774142500 con 0x7fe7740a3f10 2026-02-22T23:26:18.480 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.468+0000 7fe779f40640 1 -- --> v1:10.20.193.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe7740a1ae0 con 0x7fe7740a5100 2026-02-22T23:26:18.480 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.468+0000 7fe779f40640 1 -- --> v1:10.20.193.73:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe774123790 con 0x7fe7740a4610 2026-02-22T23:26:18.480 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.468+0000 7fe779f40640 10 monclient(hunting): _renew_subs 2026-02-22T23:26:18.480 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.468+0000 7fe779f40640 10 monclient(hunting): authenticate will time out at 710.084452s 2026-02-22T23:26:18.480 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.468+0000 7fe772ffd640 1 -- >> v1:10.20.193.73:6791/0 conn(0x7fe7740a4610 legacy=0x7fe7741d43c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.73:6791/0 2026-02-22T23:26:18.481 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.468+0000 7fe773fff640 1 -- >> v1:10.20.193.73:6789/0 conn(0x7fe7740a5100 legacy=0x7fe7741d7af0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.73:6789/0 2026-02-22T23:26:18.481 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.468+0000 7fe7737fe640 1 --1- >> v1:10.20.193.45:6789/0 conn(0x7fe7740a3f10 0x7fe77413c3f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.45:6789/0 says I am v1:10.20.193.45:49758/0 (socket says 10.20.193.45:49758) 2026-02-22T23:26:18.481 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.468+0000 7fe7737fe640 1 -- 10.20.193.45:0/4132545458 learned_addr learned my addr 10.20.193.45:0/4132545458 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-22T23:26:18.481 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.468+0000 7fe74ffff640 1 -- 10.20.193.45:0/4132545458 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3450435608 0 0) 0x7fe760002a80 con 0x7fe7740a3f10 2026-02-22T23:26:18.481 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.468+0000 7fe74ffff640 10 monclient(hunting): _negotiate 2026-02-22T23:26:18.481 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.468+0000 7fe74ffff640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:26:18.481 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.468+0000 7fe74ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:26:18.481 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.468+0000 7fe74ffff640 10 monclient(hunting): my global_id is 4536 2026-02-22T23:26:18.481 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.468+0000 7fe74ffff640 1 -- 10.20.193.45:0/4132545458 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe744003620 con 0x7fe7740a3f10 2026-02-22T23:26:18.481 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.468+0000 7fe74ffff640 1 -- 10.20.193.45:0/4132545458 <== mon.0 v1:10.20.193.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3347540369 0 0) 0x7fe744003620 con 0x7fe7740a3f10 2026-02-22T23:26:18.481 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.468+0000 7fe74ffff640 1 -- 10.20.193.45:0/4132545458 --> v1:10.20.193.45:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe760002a80 con 0x7fe7740a3f10 2026-02-22T23:26:18.481 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.468+0000 7fe74ffff640 1 -- 10.20.193.45:0/4132545458 <== mon.0 v1:10.20.193.45:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7fe760003500 con 0x7fe7740a3f10 2026-02-22T23:26:18.481 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.468+0000 7fe74ffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-22T23:26:18.481 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.468+0000 7fe74ffff640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T23:26:18.481 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.468+0000 7fe74ffff640 10 monclient(hunting): dump: 2026-02-22T23:26:18.481 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:26:18.481 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:26:18.482 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:26:18.482 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:26:18.482 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:26:18.482 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:26:18.482 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:26:18.482 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:26:18.482 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:26:18.482 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:26:18.482 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:26:18.482 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:26:18.482 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:26:18.482 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:26:18.482 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:26:18.482 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:26:18.482 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.468+0000 7fe74ffff640 10 monclient(hunting): _finish_auth 0 2026-02-22T23:26:18.482 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.468+0000 7fe74ffff640 1 -- 10.20.193.45:0/4132545458 <== mon.0 v1:10.20.193.45:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2531576198 0 0) 0x7fe760002a80 con 0x7fe7740a3f10 2026-02-22T23:26:18.482 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.468+0000 7fe74ffff640 1 -- 10.20.193.45:0/4132545458 >> v1:10.20.193.73:6791/0 conn(0x7fe7740a4610 legacy=0x7fe7741d43c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-22T23:26:18.482 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.468+0000 7fe74ffff640 1 -- 10.20.193.45:0/4132545458 >> v1:10.20.193.73:6789/0 conn(0x7fe7740a5100 legacy=0x7fe7741d7af0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-22T23:26:18.483 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.468+0000 7fe74ffff640 10 monclient: _finish_hunting 0 2026-02-22T23:26:18.483 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.468+0000 7fe74ffff640 1 monclient: found mon.a 2026-02-22T23:26:18.483 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.468+0000 7fe74ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T23:26:18.483 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.468+0000 7fe74ffff640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-22T23:26:18.483 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.468+0000 7fe74ffff640 1 -- 10.20.193.45:0/4132545458 --> v1:10.20.193.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe774123a70 con 0x7fe7740a3f10 2026-02-22T23:26:18.483 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.468+0000 7fe74ffff640 10 monclient: _finish_auth 0 2026-02-22T23:26:18.483 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.468+0000 7fe74ffff640 10 monclient: _check_auth_tickets 2026-02-22T23:26:18.483 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.468+0000 7fe74ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T23:26:18.483 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.468+0000 7fe779f40640 5 monclient: authenticate success, global_id 4536 2026-02-22T23:26:18.483 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.468+0000 7fe779f40640 10 monclient: _renew_subs 2026-02-22T23:26:18.483 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.468+0000 7fe779f40640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-22T23:26:18.483 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.468+0000 7fe779f40640 1 -- 10.20.193.45:0/4132545458 --> v1:10.20.193.45:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fe7741222d0 con 0x7fe7740a3f10 2026-02-22T23:26:18.483 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.468+0000 7fe779f40640 10 monclient: _renew_subs 2026-02-22T23:26:18.483 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.468+0000 7fe779f40640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-22T23:26:18.483 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.468+0000 7fe779f40640 1 -- 10.20.193.45:0/4132545458 --> v1:10.20.193.45:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fe774122770 con 0x7fe7740a3f10 2026-02-22T23:26:18.483 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.468+0000 7fe74ffff640 1 -- 10.20.193.45:0/4132545458 <== mon.0 v1:10.20.193.45:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe760004b90 con 0x7fe7740a3f10 2026-02-22T23:26:18.483 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.468+0000 7fe74ffff640 10 monclient: handle_config config(0 keys) 2026-02-22T23:26:18.483 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.468+0000 7fe74ffff640 1 -- 10.20.193.45:0/4132545458 <== mon.0 v1:10.20.193.45:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7fe760005100 con 0x7fe7740a3f10 2026-02-22T23:26:18.484 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.468+0000 7fe74ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:26:18.484 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.468+0000 7fe74ffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T23:26:18.484 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.468+0000 7fe771ffb640 4 set_mon_vals no callback set 2026-02-22T23:26:18.484 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.468+0000 7fe74ffff640 10 monclient: dump: 2026-02-22T23:26:18.484 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:26:18.484 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:26:18.484 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:26:18.484 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:26:18.484 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:26:18.484 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:26:18.484 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:26:18.484 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:26:18.484 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:26:18.484 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:26:18.484 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:26:18.484 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:26:18.484 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:26:18.485 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:26:18.485 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:26:18.485 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:26:18.485 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.469+0000 7fe779f40640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T23:26:18.485 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.469+0000 7fe779f40640 1 -- 10.20.193.45:0/4132545458 --> v1:10.20.193.73:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fe7740008d0 con 0x7fe7741cbb20 2026-02-22T23:26:18.485 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.469+0000 7fe74ffff640 1 -- 10.20.193.45:0/4132545458 <== mon.0 v1:10.20.193.45:6789/0 7 ==== mgrmap(e 5) ==== 50225+0+0 (unknown 2330357642 0 0) 0x7fe7600052a0 con 0x7fe7740a3f10 2026-02-22T23:26:18.485 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.469+0000 7fe74ffff640 1 -- 10.20.193.45:0/4132545458 <== mon.0 v1:10.20.193.45:6789/0 8 ==== osd_map(24..24 src has 1..24) ==== 3893+0+0 (unknown 987433402 0 0) 0x7fe76004e190 con 0x7fe7740a3f10 2026-02-22T23:26:18.485 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.469+0000 7fe74ffff640 1 -- 10.20.193.45:0/4132545458 <== mon.7 v1:10.20.193.73:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3888555434 0 0) 0x7fe7740008d0 con 0x7fe7741cbb20 2026-02-22T23:26:18.485 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.469+0000 7fe74ffff640 10 monclient(hunting): _negotiate 2026-02-22T23:26:18.485 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.469+0000 7fe74ffff640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:26:18.485 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.469+0000 7fe74ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:26:18.485 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.469+0000 7fe74ffff640 10 monclient(hunting): my global_id is 4480 2026-02-22T23:26:18.485 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.469+0000 7fe74ffff640 1 -- 10.20.193.45:0/4132545458 --> v1:10.20.193.73:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe760002a80 con 0x7fe7741cbb20 2026-02-22T23:26:18.485 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.469+0000 7fe773fff640 10 monclient: get_auth_request con 0x7fe74403f640 auth_method 0 2026-02-22T23:26:18.485 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.469+0000 7fe74ffff640 1 -- 10.20.193.45:0/4132545458 <== mon.7 v1:10.20.193.73:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 84537388 0 0) 0x7fe760002a80 con 0x7fe7741cbb20 2026-02-22T23:26:18.485 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.470+0000 7fe74ffff640 1 -- 10.20.193.45:0/4132545458 --> v1:10.20.193.73:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe7740008d0 con 0x7fe7741cbb20 2026-02-22T23:26:18.485 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.470+0000 7fe74ffff640 1 -- 10.20.193.45:0/4132545458 <== mon.7 v1:10.20.193.73:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7fe764004240 con 0x7fe7741cbb20 2026-02-22T23:26:18.486 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.470+0000 7fe74ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:26:18.486 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.470+0000 7fe74ffff640 10 monclient: got monmap 1 from mon.i (according to old e1) 2026-02-22T23:26:18.486 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.470+0000 7fe74ffff640 10 monclient: dump: 2026-02-22T23:26:18.486 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:26:18.486 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:26:18.486 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:26:18.486 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:26:18.486 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:26:18.486 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:26:18.486 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:26:18.486 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:26:18.486 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:26:18.486 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:26:18.486 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:26:18.486 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:26:18.486 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:26:18.486 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:26:18.486 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:26:18.487 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:26:18.487 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.470+0000 7fe74ffff640 1 -- 10.20.193.45:0/4132545458 <== mon.7 v1:10.20.193.73:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 4066354042 0 0) 0x7fe7740008d0 con 0x7fe7741cbb20 2026-02-22T23:26:18.487 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.470+0000 7fe74ffff640 1 -- 10.20.193.45:0/4132545458 --> v1:10.20.193.73:6792/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe7741cbf00 con 0x7fe7741cbb20 2026-02-22T23:26:18.487 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.470+0000 7fe74ffff640 1 -- 10.20.193.45:0/4132545458 <== mon.7 v1:10.20.193.73:6792/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (unknown 0 0 2024835662) 0x7fe764006640 con 0x7fe7741cbb20 2026-02-22T23:26:18.487 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.470+0000 7fe74ffff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T23:26:18.487 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.470+0000 7fe74ffff640 10 monclient: _finish_command 1 = system:0 2026-02-22T23:26:18.487 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.470+0000 7fe74ffff640 1 -- 10.20.193.45:0/4132545458 >> v1:10.20.193.73:6792/0 conn(0x7fe7741cbb20 legacy=0x7fe77413cfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:26:18.487 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.470+0000 7fe74ffff640 1 -- 10.20.193.45:0/4132545458 >> v1:10.20.193.73:6792/0 conn(0x7fe7741cbb20 legacy=0x7fe77413cfa0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T23:26:18.488 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.473+0000 7fe779f40640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-22T23:26:18.488 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.473+0000 7fe779f40640 1 -- 10.20.193.45:0/4132545458 --> v1:10.20.193.73:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fe77413da90 con 0x7fe77413d6b0 2026-02-22T23:26:18.488 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.473+0000 7fe74ffff640 1 -- 10.20.193.45:0/4132545458 <== mon.7 v1:10.20.193.73:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 974326579 0 0) 0x7fe77413da90 con 0x7fe77413d6b0 2026-02-22T23:26:18.488 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.473+0000 7fe74ffff640 10 monclient(hunting): _negotiate 2026-02-22T23:26:18.488 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.473+0000 7fe74ffff640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:26:18.488 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.473+0000 7fe74ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:26:18.489 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.473+0000 7fe74ffff640 10 monclient(hunting): my global_id is 4489 2026-02-22T23:26:18.489 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.473+0000 7fe74ffff640 1 -- 10.20.193.45:0/4132545458 --> v1:10.20.193.73:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe7740008d0 con 0x7fe77413d6b0 2026-02-22T23:26:18.489 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.474+0000 7fe74ffff640 1 -- 10.20.193.45:0/4132545458 <== mon.7 v1:10.20.193.73:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2175588725 0 0) 0x7fe7740008d0 con 0x7fe77413d6b0 2026-02-22T23:26:18.489 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.474+0000 7fe74ffff640 1 -- 10.20.193.45:0/4132545458 --> v1:10.20.193.73:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe77413da90 con 0x7fe77413d6b0 2026-02-22T23:26:18.489 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.474+0000 7fe74ffff640 1 -- 10.20.193.45:0/4132545458 <== mon.7 v1:10.20.193.73:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7fe764004ba0 con 0x7fe77413d6b0 2026-02-22T23:26:18.489 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.474+0000 7fe74ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:26:18.489 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.474+0000 7fe74ffff640 10 monclient: got monmap 1 from mon.i (according to old e1) 2026-02-22T23:26:18.489 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.474+0000 7fe74ffff640 10 monclient: dump: 2026-02-22T23:26:18.489 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:26:18.489 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:26:18.489 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:26:18.489 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:26:18.489 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:26:18.489 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:26:18.489 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:26:18.489 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:26:18.489 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:26:18.490 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:26:18.490 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:26:18.490 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:26:18.490 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:26:18.490 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:26:18.490 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:26:18.490 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:26:18.490 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.474+0000 7fe74ffff640 1 -- 10.20.193.45:0/4132545458 <== mon.7 v1:10.20.193.73:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2033883983 0 0) 0x7fe77413da90 con 0x7fe77413d6b0 2026-02-22T23:26:18.490 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.474+0000 7fe74ffff640 1 -- 10.20.193.45:0/4132545458 --> v1:10.20.193.73:6792/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fe77413dc60 con 0x7fe77413d6b0 2026-02-22T23:26:18.490 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.474+0000 7fe74ffff640 1 -- 10.20.193.45:0/4132545458 <== mon.7 v1:10.20.193.73:6792/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7650 (unknown 0 0 2504377999) 0x7fe764006130 con 0x7fe77413d6b0 2026-02-22T23:26:18.490 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.474+0000 7fe74ffff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-22T23:26:18.490 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.474+0000 7fe74ffff640 10 monclient: _finish_command 2 = system:0 2026-02-22T23:26:18.490 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.474+0000 7fe74ffff640 1 -- 10.20.193.45:0/4132545458 >> v1:10.20.193.73:6792/0 conn(0x7fe77413d6b0 legacy=0x7fe7741de240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:26:18.490 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.474+0000 7fe74ffff640 1 -- 10.20.193.45:0/4132545458 >> v1:10.20.193.73:6792/0 conn(0x7fe77413d6b0 legacy=0x7fe7741de240 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T23:26:18.491 INFO:teuthology.orchestra.run.trial045.stdout:{ 2026-02-22T23:26:18.491 INFO:teuthology.orchestra.run.trial045.stdout: "name": "i", 2026-02-22T23:26:18.491 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 7, 2026-02-22T23:26:18.491 INFO:teuthology.orchestra.run.trial045.stdout: "state": "peon", 2026-02-22T23:26:18.491 INFO:teuthology.orchestra.run.trial045.stdout: "election_epoch": 22, 2026-02-22T23:26:18.491 INFO:teuthology.orchestra.run.trial045.stdout: "uptime": 58587, 2026-02-22T23:26:18.491 INFO:teuthology.orchestra.run.trial045.stdout: "quorum": [ 2026-02-22T23:26:18.491 INFO:teuthology.orchestra.run.trial045.stdout: 0, 2026-02-22T23:26:18.491 INFO:teuthology.orchestra.run.trial045.stdout: 2, 2026-02-22T23:26:18.491 INFO:teuthology.orchestra.run.trial045.stdout: 3, 2026-02-22T23:26:18.491 INFO:teuthology.orchestra.run.trial045.stdout: 7, 2026-02-22T23:26:18.491 INFO:teuthology.orchestra.run.trial045.stdout: 8 2026-02-22T23:26:18.491 INFO:teuthology.orchestra.run.trial045.stdout: ], 2026-02-22T23:26:18.491 INFO:teuthology.orchestra.run.trial045.stdout: "quorum_age": 3, 2026-02-22T23:26:18.492 INFO:teuthology.orchestra.run.trial045.stdout: "features": { 2026-02-22T23:26:18.492 INFO:teuthology.orchestra.run.trial045.stdout: "required_con": "2450521708007866372", 2026-02-22T23:26:18.492 INFO:teuthology.orchestra.run.trial045.stdout: "required_mon": [ 2026-02-22T23:26:18.492 INFO:teuthology.orchestra.run.trial045.stdout: "kraken", 2026-02-22T23:26:18.492 INFO:teuthology.orchestra.run.trial045.stdout: "luminous", 2026-02-22T23:26:18.492 INFO:teuthology.orchestra.run.trial045.stdout: "mimic", 2026-02-22T23:26:18.492 INFO:teuthology.orchestra.run.trial045.stdout: "osdmap-prune", 2026-02-22T23:26:18.492 INFO:teuthology.orchestra.run.trial045.stdout: "nautilus", 2026-02-22T23:26:18.492 INFO:teuthology.orchestra.run.trial045.stdout: "octopus", 2026-02-22T23:26:18.492 INFO:teuthology.orchestra.run.trial045.stdout: "pacific", 2026-02-22T23:26:18.492 INFO:teuthology.orchestra.run.trial045.stdout: "elector-pinging", 2026-02-22T23:26:18.492 INFO:teuthology.orchestra.run.trial045.stdout: "quincy", 2026-02-22T23:26:18.492 INFO:teuthology.orchestra.run.trial045.stdout: "reef", 2026-02-22T23:26:18.492 INFO:teuthology.orchestra.run.trial045.stdout: "squid" 2026-02-22T23:26:18.492 INFO:teuthology.orchestra.run.trial045.stdout: ], 2026-02-22T23:26:18.492 INFO:teuthology.orchestra.run.trial045.stdout: "quorum_con": "4540701547738038271", 2026-02-22T23:26:18.492 INFO:teuthology.orchestra.run.trial045.stdout: "quorum_mon": [ 2026-02-22T23:26:18.492 INFO:teuthology.orchestra.run.trial045.stdout: "kraken", 2026-02-22T23:26:18.493 INFO:teuthology.orchestra.run.trial045.stdout: "luminous", 2026-02-22T23:26:18.493 INFO:teuthology.orchestra.run.trial045.stdout: "mimic", 2026-02-22T23:26:18.493 INFO:teuthology.orchestra.run.trial045.stdout: "osdmap-prune", 2026-02-22T23:26:18.493 INFO:teuthology.orchestra.run.trial045.stdout: "nautilus", 2026-02-22T23:26:18.493 INFO:teuthology.orchestra.run.trial045.stdout: "octopus", 2026-02-22T23:26:18.493 INFO:teuthology.orchestra.run.trial045.stdout: "pacific", 2026-02-22T23:26:18.493 INFO:teuthology.orchestra.run.trial045.stdout: "elector-pinging", 2026-02-22T23:26:18.493 INFO:teuthology.orchestra.run.trial045.stdout: "quincy", 2026-02-22T23:26:18.493 INFO:teuthology.orchestra.run.trial045.stdout: "reef", 2026-02-22T23:26:18.493 INFO:teuthology.orchestra.run.trial045.stdout: "squid" 2026-02-22T23:26:18.493 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:26:18.493 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:26:18.493 INFO:teuthology.orchestra.run.trial045.stdout: "outside_quorum": [], 2026-02-22T23:26:18.493 INFO:teuthology.orchestra.run.trial045.stdout: "extra_probe_peers": [], 2026-02-22T23:26:18.493 INFO:teuthology.orchestra.run.trial045.stdout: "sync_provider": [], 2026-02-22T23:26:18.493 INFO:teuthology.orchestra.run.trial045.stdout: "monmap": { 2026-02-22T23:26:18.493 INFO:teuthology.orchestra.run.trial045.stdout: "epoch": 1, 2026-02-22T23:26:18.493 INFO:teuthology.orchestra.run.trial045.stdout: "fsid": "4b60f18f-6660-4731-b731-dc85c4078413", 2026-02-22T23:26:18.493 INFO:teuthology.orchestra.run.trial045.stdout: "modified": "2026-02-22T23:24:52.393472Z", 2026-02-22T23:26:18.494 INFO:teuthology.orchestra.run.trial045.stdout: "created": "2026-02-22T23:24:52.393472Z", 2026-02-22T23:26:18.494 INFO:teuthology.orchestra.run.trial045.stdout: "min_mon_release": 19, 2026-02-22T23:26:18.494 INFO:teuthology.orchestra.run.trial045.stdout: "min_mon_release_name": "squid", 2026-02-22T23:26:18.494 INFO:teuthology.orchestra.run.trial045.stdout: "election_strategy": 3, 2026-02-22T23:26:18.494 INFO:teuthology.orchestra.run.trial045.stdout: "disallowed_leaders": "", 2026-02-22T23:26:18.494 INFO:teuthology.orchestra.run.trial045.stdout: "stretch_mode": false, 2026-02-22T23:26:18.494 INFO:teuthology.orchestra.run.trial045.stdout: "tiebreaker_mon": "", 2026-02-22T23:26:18.494 INFO:teuthology.orchestra.run.trial045.stdout: "removed_ranks": "", 2026-02-22T23:26:18.494 INFO:teuthology.orchestra.run.trial045.stdout: "features": { 2026-02-22T23:26:18.494 INFO:teuthology.orchestra.run.trial045.stdout: "persistent": [ 2026-02-22T23:26:18.494 INFO:teuthology.orchestra.run.trial045.stdout: "kraken", 2026-02-22T23:26:18.494 INFO:teuthology.orchestra.run.trial045.stdout: "luminous", 2026-02-22T23:26:18.494 INFO:teuthology.orchestra.run.trial045.stdout: "mimic", 2026-02-22T23:26:18.494 INFO:teuthology.orchestra.run.trial045.stdout: "osdmap-prune", 2026-02-22T23:26:18.494 INFO:teuthology.orchestra.run.trial045.stdout: "nautilus", 2026-02-22T23:26:18.494 INFO:teuthology.orchestra.run.trial045.stdout: "octopus", 2026-02-22T23:26:18.494 INFO:teuthology.orchestra.run.trial045.stdout: "pacific", 2026-02-22T23:26:18.495 INFO:teuthology.orchestra.run.trial045.stdout: "elector-pinging", 2026-02-22T23:26:18.495 INFO:teuthology.orchestra.run.trial045.stdout: "quincy", 2026-02-22T23:26:18.495 INFO:teuthology.orchestra.run.trial045.stdout: "reef", 2026-02-22T23:26:18.495 INFO:teuthology.orchestra.run.trial045.stdout: "squid" 2026-02-22T23:26:18.495 INFO:teuthology.orchestra.run.trial045.stdout: ], 2026-02-22T23:26:18.495 INFO:teuthology.orchestra.run.trial045.stdout: "optional": [] 2026-02-22T23:26:18.495 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:26:18.495 INFO:teuthology.orchestra.run.trial045.stdout: "mons": [ 2026-02-22T23:26:18.495 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:26:18.495 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 0, 2026-02-22T23:26:18.495 INFO:teuthology.orchestra.run.trial045.stdout: "name": "a", 2026-02-22T23:26:18.495 INFO:teuthology.orchestra.run.trial045.stdout: "public_addrs": { 2026-02-22T23:26:18.495 INFO:teuthology.orchestra.run.trial045.stdout: "addrvec": [ 2026-02-22T23:26:18.495 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:26:18.495 INFO:teuthology.orchestra.run.trial045.stdout: "type": "v1", 2026-02-22T23:26:18.495 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6789", 2026-02-22T23:26:18.495 INFO:teuthology.orchestra.run.trial045.stdout: "nonce": 0 2026-02-22T23:26:18.495 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:26:18.496 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:26:18.496 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:26:18.496 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6789/0", 2026-02-22T23:26:18.496 INFO:teuthology.orchestra.run.trial045.stdout: "public_addr": "10.20.193.45:6789/0", 2026-02-22T23:26:18.496 INFO:teuthology.orchestra.run.trial045.stdout: "priority": 0, 2026-02-22T23:26:18.496 INFO:teuthology.orchestra.run.trial045.stdout: "weight": 0, 2026-02-22T23:26:18.496 INFO:teuthology.orchestra.run.trial045.stdout: "crush_location": "{}" 2026-02-22T23:26:18.496 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:26:18.496 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:26:18.496 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 1, 2026-02-22T23:26:18.496 INFO:teuthology.orchestra.run.trial045.stdout: "name": "f", 2026-02-22T23:26:18.496 INFO:teuthology.orchestra.run.trial045.stdout: "public_addrs": { 2026-02-22T23:26:18.496 INFO:teuthology.orchestra.run.trial045.stdout: "addrvec": [ 2026-02-22T23:26:18.496 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:26:18.496 INFO:teuthology.orchestra.run.trial045.stdout: "type": "v1", 2026-02-22T23:26:18.496 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.73:6789", 2026-02-22T23:26:18.496 INFO:teuthology.orchestra.run.trial045.stdout: "nonce": 0 2026-02-22T23:26:18.496 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:26:18.496 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:26:18.497 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:26:18.497 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.73:6789/0", 2026-02-22T23:26:18.497 INFO:teuthology.orchestra.run.trial045.stdout: "public_addr": "10.20.193.73:6789/0", 2026-02-22T23:26:18.497 INFO:teuthology.orchestra.run.trial045.stdout: "priority": 0, 2026-02-22T23:26:18.497 INFO:teuthology.orchestra.run.trial045.stdout: "weight": 0, 2026-02-22T23:26:18.497 INFO:teuthology.orchestra.run.trial045.stdout: "crush_location": "{}" 2026-02-22T23:26:18.497 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:26:18.497 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:26:18.497 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 2, 2026-02-22T23:26:18.497 INFO:teuthology.orchestra.run.trial045.stdout: "name": "b", 2026-02-22T23:26:18.497 INFO:teuthology.orchestra.run.trial045.stdout: "public_addrs": { 2026-02-22T23:26:18.497 INFO:teuthology.orchestra.run.trial045.stdout: "addrvec": [ 2026-02-22T23:26:18.497 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:26:18.497 INFO:teuthology.orchestra.run.trial045.stdout: "type": "v1", 2026-02-22T23:26:18.497 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6790", 2026-02-22T23:26:18.497 INFO:teuthology.orchestra.run.trial045.stdout: "nonce": 0 2026-02-22T23:26:18.497 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:26:18.497 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:26:18.497 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:26:18.498 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6790/0", 2026-02-22T23:26:18.498 INFO:teuthology.orchestra.run.trial045.stdout: "public_addr": "10.20.193.45:6790/0", 2026-02-22T23:26:18.498 INFO:teuthology.orchestra.run.trial045.stdout: "priority": 0, 2026-02-22T23:26:18.498 INFO:teuthology.orchestra.run.trial045.stdout: "weight": 0, 2026-02-22T23:26:18.498 INFO:teuthology.orchestra.run.trial045.stdout: "crush_location": "{}" 2026-02-22T23:26:18.498 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:26:18.498 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:26:18.498 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 3, 2026-02-22T23:26:18.498 INFO:teuthology.orchestra.run.trial045.stdout: "name": "g", 2026-02-22T23:26:18.498 INFO:teuthology.orchestra.run.trial045.stdout: "public_addrs": { 2026-02-22T23:26:18.498 INFO:teuthology.orchestra.run.trial045.stdout: "addrvec": [ 2026-02-22T23:26:18.498 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:26:18.498 INFO:teuthology.orchestra.run.trial045.stdout: "type": "v1", 2026-02-22T23:26:18.498 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.73:6790", 2026-02-22T23:26:18.498 INFO:teuthology.orchestra.run.trial045.stdout: "nonce": 0 2026-02-22T23:26:18.498 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:26:18.498 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:26:18.498 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:26:18.499 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.73:6790/0", 2026-02-22T23:26:18.499 INFO:teuthology.orchestra.run.trial045.stdout: "public_addr": "10.20.193.73:6790/0", 2026-02-22T23:26:18.499 INFO:teuthology.orchestra.run.trial045.stdout: "priority": 0, 2026-02-22T23:26:18.499 INFO:teuthology.orchestra.run.trial045.stdout: "weight": 0, 2026-02-22T23:26:18.499 INFO:teuthology.orchestra.run.trial045.stdout: "crush_location": "{}" 2026-02-22T23:26:18.499 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:26:18.499 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:26:18.499 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 4, 2026-02-22T23:26:18.499 INFO:teuthology.orchestra.run.trial045.stdout: "name": "c", 2026-02-22T23:26:18.499 INFO:teuthology.orchestra.run.trial045.stdout: "public_addrs": { 2026-02-22T23:26:18.499 INFO:teuthology.orchestra.run.trial045.stdout: "addrvec": [ 2026-02-22T23:26:18.499 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:26:18.499 INFO:teuthology.orchestra.run.trial045.stdout: "type": "v1", 2026-02-22T23:26:18.499 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6791", 2026-02-22T23:26:18.499 INFO:teuthology.orchestra.run.trial045.stdout: "nonce": 0 2026-02-22T23:26:18.499 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:26:18.499 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:26:18.499 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:26:18.500 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6791/0", 2026-02-22T23:26:18.500 INFO:teuthology.orchestra.run.trial045.stdout: "public_addr": "10.20.193.45:6791/0", 2026-02-22T23:26:18.500 INFO:teuthology.orchestra.run.trial045.stdout: "priority": 0, 2026-02-22T23:26:18.500 INFO:teuthology.orchestra.run.trial045.stdout: "weight": 0, 2026-02-22T23:26:18.500 INFO:teuthology.orchestra.run.trial045.stdout: "crush_location": "{}" 2026-02-22T23:26:18.500 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:26:18.500 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:26:18.500 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 5, 2026-02-22T23:26:18.500 INFO:teuthology.orchestra.run.trial045.stdout: "name": "h", 2026-02-22T23:26:18.500 INFO:teuthology.orchestra.run.trial045.stdout: "public_addrs": { 2026-02-22T23:26:18.500 INFO:teuthology.orchestra.run.trial045.stdout: "addrvec": [ 2026-02-22T23:26:18.500 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:26:18.500 INFO:teuthology.orchestra.run.trial045.stdout: "type": "v1", 2026-02-22T23:26:18.500 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.73:6791", 2026-02-22T23:26:18.500 INFO:teuthology.orchestra.run.trial045.stdout: "nonce": 0 2026-02-22T23:26:18.500 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:26:18.500 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:26:18.500 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:26:18.500 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.73:6791/0", 2026-02-22T23:26:18.500 INFO:teuthology.orchestra.run.trial045.stdout: "public_addr": "10.20.193.73:6791/0", 2026-02-22T23:26:18.501 INFO:teuthology.orchestra.run.trial045.stdout: "priority": 0, 2026-02-22T23:26:18.501 INFO:teuthology.orchestra.run.trial045.stdout: "weight": 0, 2026-02-22T23:26:18.501 INFO:teuthology.orchestra.run.trial045.stdout: "crush_location": "{}" 2026-02-22T23:26:18.501 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:26:18.501 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:26:18.501 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 6, 2026-02-22T23:26:18.501 INFO:teuthology.orchestra.run.trial045.stdout: "name": "d", 2026-02-22T23:26:18.501 INFO:teuthology.orchestra.run.trial045.stdout: "public_addrs": { 2026-02-22T23:26:18.501 INFO:teuthology.orchestra.run.trial045.stdout: "addrvec": [ 2026-02-22T23:26:18.501 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:26:18.501 INFO:teuthology.orchestra.run.trial045.stdout: "type": "v1", 2026-02-22T23:26:18.501 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6792", 2026-02-22T23:26:18.501 INFO:teuthology.orchestra.run.trial045.stdout: "nonce": 0 2026-02-22T23:26:18.501 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:26:18.501 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:26:18.501 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:26:18.501 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6792/0", 2026-02-22T23:26:18.501 INFO:teuthology.orchestra.run.trial045.stdout: "public_addr": "10.20.193.45:6792/0", 2026-02-22T23:26:18.501 INFO:teuthology.orchestra.run.trial045.stdout: "priority": 0, 2026-02-22T23:26:18.501 INFO:teuthology.orchestra.run.trial045.stdout: "weight": 0, 2026-02-22T23:26:18.502 INFO:teuthology.orchestra.run.trial045.stdout: "crush_location": "{}" 2026-02-22T23:26:18.502 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:26:18.502 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:26:18.502 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 7, 2026-02-22T23:26:18.502 INFO:teuthology.orchestra.run.trial045.stdout: "name": "i", 2026-02-22T23:26:18.502 INFO:teuthology.orchestra.run.trial045.stdout: "public_addrs": { 2026-02-22T23:26:18.502 INFO:teuthology.orchestra.run.trial045.stdout: "addrvec": [ 2026-02-22T23:26:18.502 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:26:18.502 INFO:teuthology.orchestra.run.trial045.stdout: "type": "v1", 2026-02-22T23:26:18.502 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.73:6792", 2026-02-22T23:26:18.502 INFO:teuthology.orchestra.run.trial045.stdout: "nonce": 0 2026-02-22T23:26:18.502 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:26:18.502 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:26:18.502 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:26:18.502 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.73:6792/0", 2026-02-22T23:26:18.502 INFO:teuthology.orchestra.run.trial045.stdout: "public_addr": "10.20.193.73:6792/0", 2026-02-22T23:26:18.502 INFO:teuthology.orchestra.run.trial045.stdout: "priority": 0, 2026-02-22T23:26:18.502 INFO:teuthology.orchestra.run.trial045.stdout: "weight": 0, 2026-02-22T23:26:18.502 INFO:teuthology.orchestra.run.trial045.stdout: "crush_location": "{}" 2026-02-22T23:26:18.502 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:26:18.502 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:26:18.502 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 8, 2026-02-22T23:26:18.503 INFO:teuthology.orchestra.run.trial045.stdout: "name": "e", 2026-02-22T23:26:18.503 INFO:teuthology.orchestra.run.trial045.stdout: "public_addrs": { 2026-02-22T23:26:18.503 INFO:teuthology.orchestra.run.trial045.stdout: "addrvec": [ 2026-02-22T23:26:18.503 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:26:18.503 INFO:teuthology.orchestra.run.trial045.stdout: "type": "v1", 2026-02-22T23:26:18.503 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6793", 2026-02-22T23:26:18.503 INFO:teuthology.orchestra.run.trial045.stdout: "nonce": 0 2026-02-22T23:26:18.503 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:26:18.503 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:26:18.503 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:26:18.503 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6793/0", 2026-02-22T23:26:18.503 INFO:teuthology.orchestra.run.trial045.stdout: "public_addr": "10.20.193.45:6793/0", 2026-02-22T23:26:18.503 INFO:teuthology.orchestra.run.trial045.stdout: "priority": 0, 2026-02-22T23:26:18.503 INFO:teuthology.orchestra.run.trial045.stdout: "weight": 0, 2026-02-22T23:26:18.503 INFO:teuthology.orchestra.run.trial045.stdout: "crush_location": "{}" 2026-02-22T23:26:18.503 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:26:18.503 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:26:18.503 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:26:18.503 INFO:teuthology.orchestra.run.trial045.stdout: "feature_map": { 2026-02-22T23:26:18.503 INFO:teuthology.orchestra.run.trial045.stdout: "mon": [ 2026-02-22T23:26:18.503 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:26:18.503 INFO:teuthology.orchestra.run.trial045.stdout: "features": "0x3f03cffffffdffff", 2026-02-22T23:26:18.504 INFO:teuthology.orchestra.run.trial045.stdout: "release": "squid", 2026-02-22T23:26:18.504 INFO:teuthology.orchestra.run.trial045.stdout: "num": 1 2026-02-22T23:26:18.504 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:26:18.504 INFO:teuthology.orchestra.run.trial045.stdout: ], 2026-02-22T23:26:18.504 INFO:teuthology.orchestra.run.trial045.stdout: "client": [ 2026-02-22T23:26:18.504 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:26:18.504 INFO:teuthology.orchestra.run.trial045.stdout: "features": "0x3f03cffffffdffff", 2026-02-22T23:26:18.504 INFO:teuthology.orchestra.run.trial045.stdout: "release": "squid", 2026-02-22T23:26:18.504 INFO:teuthology.orchestra.run.trial045.stdout: "num": 1 2026-02-22T23:26:18.504 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:26:18.504 INFO:teuthology.orchestra.run.trial045.stdout: ], 2026-02-22T23:26:18.504 INFO:teuthology.orchestra.run.trial045.stdout: "mgr": [ 2026-02-22T23:26:18.504 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:26:18.504 INFO:teuthology.orchestra.run.trial045.stdout: "features": "0x3f03cffffffdffff", 2026-02-22T23:26:18.504 INFO:teuthology.orchestra.run.trial045.stdout: "release": "squid", 2026-02-22T23:26:18.504 INFO:teuthology.orchestra.run.trial045.stdout: "num": 1 2026-02-22T23:26:18.504 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:26:18.504 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:26:18.504 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:26:18.504 INFO:teuthology.orchestra.run.trial045.stdout: "stretch_mode": false 2026-02-22T23:26:18.504 INFO:teuthology.orchestra.run.trial045.stdout:} 2026-02-22T23:26:18.505 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.474+0000 7fe779f40640 1 -- 10.20.193.45:0/4132545458 >> v1:10.20.193.73:6800/2222410180 conn(0x7fe74403f640 legacy=0x7fe744041b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:26:18.505 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.474+0000 7fe779f40640 10 monclient: shutdown 2026-02-22T23:26:18.505 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.474+0000 7fe779f40640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T23:26:18.505 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.474+0000 7fe779f40640 1 -- 10.20.193.45:0/4132545458 >> v1:10.20.193.45:6789/0 conn(0x7fe7740a3f10 legacy=0x7fe77413c3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:26:18.506 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.474+0000 7fe773fff640 1 -- 10.20.193.45:0/4132545458 reap_dead start 2026-02-22T23:26:18.506 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.474+0000 7fe773fff640 1 -- 10.20.193.45:0/4132545458 reap_dead start 2026-02-22T23:26:18.506 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.474+0000 7fe779f40640 1 -- 10.20.193.45:0/4132545458 shutdown_connections 2026-02-22T23:26:18.506 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.474+0000 7fe779f40640 1 -- 10.20.193.45:0/4132545458 >> 10.20.193.45:0/4132545458 conn(0x7fe7740a7f70 msgr2=0x7fe7740a9f50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:26:18.506 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.474+0000 7fe779f40640 1 -- 10.20.193.45:0/4132545458 shutdown_connections 2026-02-22T23:26:18.506 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:26:18.474+0000 7fe779f40640 1 -- 10.20.193.45:0/4132545458 wait complete. 2026-02-22T23:26:18.506 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 5 2026-02-22T23:26:18.506 INFO:tasks.mon_thrash.mon_thrasher:waiting for 90.0 secs before reviving monitors 2026-02-22T23:26:18.885 INFO:teuthology.orchestra.run.trial073.stdout:******************************* 2026-02-22T23:26:18.885 INFO:teuthology.orchestra.run.trial073.stdout:process_4_[46059]: starting. 2026-02-22T23:26:18.886 INFO:teuthology.orchestra.run.trial073.stdout:process_4_[46059]: deleting pool ceph_test_rados_delete_pools_parallel.trial073-46023 2026-02-22T23:26:18.886 INFO:teuthology.orchestra.run.trial073.stdout:process_4_[46059]: shutting down. 2026-02-22T23:26:18.886 INFO:teuthology.orchestra.run.trial073.stdout:******************************* 2026-02-22T23:26:18.886 INFO:teuthology.orchestra.run.trial073.stdout:******************************* 2026-02-22T23:26:18.887 INFO:teuthology.orchestra.run.trial073.stdout:******* SUCCESS ********** 2026-02-22T23:26:18.889 DEBUG:teuthology.run_tasks:Unwinding manager mon_thrash 2026-02-22T23:26:18.908 INFO:tasks.mon_thrash:joining mon_thrasher 2026-02-22T23:27:48.507 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2026-02-22T23:27:48.507 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.c 2026-02-22T23:27:48.507 INFO:tasks.ceph.mon.c:Restarting daemon 2026-02-22T23:27:48.507 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2026-02-22T23:27:48.601 INFO:tasks.ceph.mon.c:Started 2026-02-22T23:27:48.601 INFO:tasks.mon_thrash.mon_thrasher:killing mon.h 2026-02-22T23:27:48.601 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.h 2026-02-22T23:27:48.601 INFO:tasks.ceph.mon.h:Restarting daemon 2026-02-22T23:27:48.602 DEBUG:teuthology.orchestra.run.trial073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i h 2026-02-22T23:27:48.620 INFO:tasks.ceph.mon.h:Started 2026-02-22T23:27:48.620 INFO:tasks.mon_thrash.mon_thrasher:killing mon.d 2026-02-22T23:27:48.620 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.d 2026-02-22T23:27:48.620 INFO:tasks.ceph.mon.d:Restarting daemon 2026-02-22T23:27:48.620 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i d 2026-02-22T23:27:48.622 INFO:tasks.ceph.mon.d:Started 2026-02-22T23:27:48.623 INFO:tasks.mon_thrash.mon_thrasher:killing mon.f 2026-02-22T23:27:48.623 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.f 2026-02-22T23:27:48.623 INFO:tasks.ceph.mon.f:Restarting daemon 2026-02-22T23:27:48.623 DEBUG:teuthology.orchestra.run.trial073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i f 2026-02-22T23:27:48.625 INFO:tasks.ceph.mon.f:Started 2026-02-22T23:27:48.625 INFO:tasks.mon_thrash:Sending STOP to mon b 2026-02-22T23:27:48.626 INFO:tasks.ceph.mon.b:Sent signal 19 2026-02-22T23:27:48.626 INFO:tasks.mon_thrash.mon_thrasher:waiting for 15.0 secs to unfreeze mons 2026-02-22T23:28:03.626 INFO:tasks.mon_thrash:Sending CONT to mon b 2026-02-22T23:28:03.626 INFO:tasks.ceph.mon.b:Sent signal 18 2026-02-22T23:28:03.627 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 9 2026-02-22T23:28:03.627 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-22T23:28:03.698 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.696+0000 7f686a869640 10 monclient: get_monmap_and_config 2026-02-22T23:28:03.698 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.696+0000 7f686a869640 10 monclient: build_initial_monmap 2026-02-22T23:28:03.698 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.696+0000 7f686a869640 10 monclient: monmap: 2026-02-22T23:28:03.698 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-22T23:28:03.698 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:28:03.698 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:28:03.697925+0000 2026-02-22T23:28:03.698 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:28:03.697925+0000 2026-02-22T23:28:03.698 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-22T23:28:03.698 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:28:03.698 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-22T23:28:03.698 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.noname-f 2026-02-22T23:28:03.698 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.noname-b 2026-02-22T23:28:03.698 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.noname-g 2026-02-22T23:28:03.698 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.noname-c 2026-02-22T23:28:03.698 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.noname-h 2026-02-22T23:28:03.698 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.noname-d 2026-02-22T23:28:03.698 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.noname-i 2026-02-22T23:28:03.698 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.noname-e 2026-02-22T23:28:03.698 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:03.700 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.697+0000 7f686a869640 1 Processor -- start 2026-02-22T23:28:03.700 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.697+0000 7f686a869640 1 -- start start 2026-02-22T23:28:03.700 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.697+0000 7f686a869640 10 monclient: init 2026-02-22T23:28:03.700 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.697+0000 7f686a869640 10 monclient: _reopen_session rank -1 2026-02-22T23:28:03.700 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.697+0000 7f686a869640 10 monclient: _add_conns ranks=[0,1,7,5,8,6,3,2,4] 2026-02-22T23:28:03.700 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.697+0000 7f686a869640 10 monclient(hunting): picked mon.noname-a con 0x7f6864138e10 addr v1:10.20.193.45:6789/0 2026-02-22T23:28:03.700 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.697+0000 7f686a869640 10 monclient(hunting): picked mon.noname-f con 0x7f68640a3630 addr v1:10.20.193.73:6789/0 2026-02-22T23:28:03.700 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.697+0000 7f686a869640 10 monclient(hunting): picked mon.noname-i con 0x7f686413f310 addr v1:10.20.193.73:6792/0 2026-02-22T23:28:03.700 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.697+0000 7f686a869640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f68640a3210 con 0x7f6864138e10 2026-02-22T23:28:03.700 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.697+0000 7f686a869640 1 -- --> v1:10.20.193.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f68640a2970 con 0x7f68640a3630 2026-02-22T23:28:03.700 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.697+0000 7f686a869640 1 -- --> v1:10.20.193.73:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f68640a2260 con 0x7f686413f310 2026-02-22T23:28:03.700 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.697+0000 7f686a869640 10 monclient(hunting): _renew_subs 2026-02-22T23:28:03.700 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.697+0000 7f686a869640 10 monclient(hunting): authenticate will time out at 815.314479s 2026-02-22T23:28:03.700 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.697+0000 7f6863fff640 1 --1- >> v1:10.20.193.45:6789/0 conn(0x7f6864138e10 0x7f68641391f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.45:6789/0 says I am v1:10.20.193.45:38346/0 (socket says 10.20.193.45:38346) 2026-02-22T23:28:03.700 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.697+0000 7f6863fff640 1 -- 10.20.193.45:0/912180909 learned_addr learned my addr 10.20.193.45:0/912180909 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-22T23:28:03.700 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.697+0000 7f6862ffd640 1 -- 10.20.193.45:0/912180909 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1847417016 0 0) 0x7f68640a3210 con 0x7f6864138e10 2026-02-22T23:28:03.700 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.697+0000 7f6862ffd640 10 monclient(hunting): _negotiate 2026-02-22T23:28:03.700 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.697+0000 7f6862ffd640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:28:03.700 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.697+0000 7f6862ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:28:03.700 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.697+0000 7f6862ffd640 10 monclient(hunting): my global_id is 4545 2026-02-22T23:28:03.700 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.697+0000 7f6862ffd640 1 -- 10.20.193.45:0/912180909 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6848003620 con 0x7f6864138e10 2026-02-22T23:28:03.700 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.697+0000 7f6862ffd640 1 -- 10.20.193.45:0/912180909 <== mon.0 v1:10.20.193.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2452637202 0 0) 0x7f6848003620 con 0x7f6864138e10 2026-02-22T23:28:03.700 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.697+0000 7f6862ffd640 1 -- 10.20.193.45:0/912180909 >> v1:10.20.193.73:6792/0 conn(0x7f686413f310 legacy=0x7f6864141700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:03.700 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.697+0000 7f6862ffd640 1 -- 10.20.193.45:0/912180909 >> v1:10.20.193.73:6789/0 conn(0x7f68640a3630 legacy=0x7f686413dbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T23:28:03.700 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.697+0000 7f6862ffd640 10 monclient: _finish_hunting 0 2026-02-22T23:28:03.701 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.697+0000 7f6862ffd640 1 monclient: found mon.noname-a 2026-02-22T23:28:03.701 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.697+0000 7f6862ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T23:28:03.701 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.697+0000 7f6862ffd640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.45:6789/0 2026-02-22T23:28:03.701 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.697+0000 7f6862ffd640 1 -- 10.20.193.45:0/912180909 --> v1:10.20.193.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68640a4510 con 0x7f6864138e10 2026-02-22T23:28:03.701 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.697+0000 7f6862ffd640 10 monclient: _finish_auth 0 2026-02-22T23:28:03.701 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.697+0000 7f6862ffd640 10 monclient: _check_auth_tickets 2026-02-22T23:28:03.701 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.697+0000 7f6862ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T23:28:03.701 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.697+0000 7f6862ffd640 1 -- 10.20.193.45:0/912180909 <== mon.0 v1:10.20.193.45:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f6850003040 con 0x7f6864138e10 2026-02-22T23:28:03.701 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.697+0000 7f686a869640 5 monclient: authenticate success, global_id 4545 2026-02-22T23:28:03.701 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.697+0000 7f686a869640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-22T23:28:03.701 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.697+0000 7f6862ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:28:03.701 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.697+0000 7f6862ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T23:28:03.701 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.697+0000 7f6862ffd640 10 monclient: dump: 2026-02-22T23:28:03.701 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:28:03.701 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:28:03.701 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:03.701 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:03.701 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:28:03.701 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:28:03.701 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:28:03.701 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:28:03.701 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:28:03.701 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:28:03.701 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:28:03.701 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:28:03.701 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:28:03.701 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:28:03.701 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:28:03.701 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:03.701 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.697+0000 7f686a869640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-22T23:28:03.702 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.697+0000 7f6862ffd640 1 -- 10.20.193.45:0/912180909 <== mon.0 v1:10.20.193.45:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6850003310 con 0x7f6864138e10 2026-02-22T23:28:03.702 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.697+0000 7f6862ffd640 10 monclient: handle_config config(0 keys) 2026-02-22T23:28:03.702 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.697+0000 7f6862ffd640 1 -- 10.20.193.45:0/912180909 <== mon.0 v1:10.20.193.45:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f6850004ce0 con 0x7f6864138e10 2026-02-22T23:28:03.702 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.697+0000 7f686a869640 10 monclient: get_monmap_and_config success 2026-02-22T23:28:03.702 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.697+0000 7f686a869640 4 set_mon_vals no callback set 2026-02-22T23:28:03.702 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.697+0000 7f6862ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:28:03.702 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.697+0000 7f6862ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T23:28:03.702 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.697+0000 7f6862ffd640 10 monclient: dump: 2026-02-22T23:28:03.702 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:28:03.702 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:28:03.702 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:03.702 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:03.702 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:28:03.702 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:28:03.702 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:28:03.702 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:28:03.702 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:28:03.702 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:28:03.702 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:28:03.702 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:28:03.702 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:28:03.702 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:28:03.702 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:28:03.702 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:03.702 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.698+0000 7f686a869640 10 monclient: shutdown 2026-02-22T23:28:03.702 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.698+0000 7f686a869640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T23:28:03.702 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.698+0000 7f686a869640 1 -- 10.20.193.45:0/912180909 >> v1:10.20.193.45:6789/0 conn(0x7f6864138e10 legacy=0x7f68641391f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:03.702 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.698+0000 7f686a869640 1 -- 10.20.193.45:0/912180909 shutdown_connections 2026-02-22T23:28:03.702 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.698+0000 7f686a869640 1 -- 10.20.193.45:0/912180909 >> 10.20.193.45:0/912180909 conn(0x7f68640a7780 msgr2=0x7f68640a3b60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:28:03.702 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.698+0000 7f686a869640 1 -- 10.20.193.45:0/912180909 shutdown_connections 2026-02-22T23:28:03.702 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.698+0000 7f686a869640 1 -- 10.20.193.45:0/912180909 wait complete. 2026-02-22T23:28:03.703 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.698+0000 7f686a869640 10 monclient: build_initial_monmap 2026-02-22T23:28:03.703 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.698+0000 7f686a869640 10 monclient: monmap: 2026-02-22T23:28:03.703 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-22T23:28:03.703 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T23:28:03.703 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-22T23:28:03.703 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-22T23:28:03.703 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-22T23:28:03.703 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-22T23:28:03.703 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-22T23:28:03.703 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.noname-f 2026-02-22T23:28:03.703 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.noname-b 2026-02-22T23:28:03.703 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.noname-g 2026-02-22T23:28:03.703 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.noname-c 2026-02-22T23:28:03.703 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.noname-h 2026-02-22T23:28:03.703 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.noname-d 2026-02-22T23:28:03.703 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.noname-i 2026-02-22T23:28:03.703 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.noname-e 2026-02-22T23:28:03.703 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:03.703 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.698+0000 7f686a869640 1 Processor -- start 2026-02-22T23:28:03.703 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.698+0000 7f686a869640 1 -- start start 2026-02-22T23:28:03.703 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.698+0000 7f686a869640 10 monclient: init 2026-02-22T23:28:03.705 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.699+0000 7f686a869640 10 monclient: _reopen_session rank -1 2026-02-22T23:28:03.705 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.699+0000 7f686a869640 10 monclient: _add_conns ranks=[4,8,1,5,3,0,6,7,2] 2026-02-22T23:28:03.705 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.699+0000 7f686a869640 10 monclient(hunting): picked mon.noname-c con 0x7f68640a3630 addr v1:10.20.193.45:6791/0 2026-02-22T23:28:03.705 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.699+0000 7f686a869640 10 monclient(hunting): picked mon.noname-e con 0x7f6864138e10 addr v1:10.20.193.45:6793/0 2026-02-22T23:28:03.705 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.699+0000 7f686a869640 10 monclient(hunting): picked mon.noname-f con 0x7f686413f310 addr v1:10.20.193.73:6789/0 2026-02-22T23:28:03.705 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.699+0000 7f686a869640 1 -- --> v1:10.20.193.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f686413ebe0 con 0x7f686413f310 2026-02-22T23:28:03.705 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.699+0000 7f686a869640 1 -- --> v1:10.20.193.45:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f68640a0340 con 0x7f68640a3630 2026-02-22T23:28:03.705 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.699+0000 7f686a869640 1 -- --> v1:10.20.193.45:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f686413d8b0 con 0x7f6864138e10 2026-02-22T23:28:03.705 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.699+0000 7f686a869640 10 monclient(hunting): _renew_subs 2026-02-22T23:28:03.705 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.699+0000 7f686a869640 10 monclient(hunting): authenticate will time out at 815.316249s 2026-02-22T23:28:03.705 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.699+0000 7f6863fff640 1 --1- >> v1:10.20.193.45:6791/0 conn(0x7f68640a3630 0x7f6864139990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.45:6791/0 says I am v1:10.20.193.45:57662/0 (socket says 10.20.193.45:57662) 2026-02-22T23:28:03.705 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.699+0000 7f68637fe640 1 --1- >> v1:10.20.193.45:6793/0 conn(0x7f6864138e10 0x7f686413a0a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.45:6793/0 says I am v1:10.20.193.45:40952/0 (socket says 10.20.193.45:40952) 2026-02-22T23:28:03.705 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.699+0000 7f6863fff640 1 -- 10.20.193.45:0/1765734278 learned_addr learned my addr 10.20.193.45:0/1765734278 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-22T23:28:03.705 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.699+0000 7f6860ff9640 1 -- 10.20.193.45:0/1765734278 <== mon.8 v1:10.20.193.45:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1555841840 0 0) 0x7f686413d8b0 con 0x7f6864138e10 2026-02-22T23:28:03.705 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.699+0000 7f6860ff9640 10 monclient(hunting): _negotiate 2026-02-22T23:28:03.705 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.699+0000 7f6860ff9640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:28:03.705 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.699+0000 7f6860ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:28:03.705 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.699+0000 7f6860ff9640 10 monclient(hunting): my global_id is 4589 2026-02-22T23:28:03.706 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.699+0000 7f6860ff9640 1 -- 10.20.193.45:0/1765734278 --> v1:10.20.193.45:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6834003620 con 0x7f6864138e10 2026-02-22T23:28:03.706 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.699+0000 7f6860ff9640 1 -- 10.20.193.45:0/1765734278 <== mon.4 v1:10.20.193.45:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2352697123 0 0) 0x7f68640a4510 con 0x7f68640a3630 2026-02-22T23:28:03.706 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.699+0000 7f6860ff9640 10 monclient(hunting): _negotiate 2026-02-22T23:28:03.706 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.699+0000 7f6860ff9640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:28:03.706 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.699+0000 7f6860ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:28:03.706 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.699+0000 7f6860ff9640 10 monclient(hunting): my global_id is 114106 2026-02-22T23:28:03.706 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.699+0000 7f6860ff9640 1 -- 10.20.193.45:0/1765734278 --> v1:10.20.193.45:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f686413d8b0 con 0x7f68640a3630 2026-02-22T23:28:03.706 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.699+0000 7f6860ff9640 1 -- 10.20.193.45:0/1765734278 <== mon.8 v1:10.20.193.45:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3331187118 0 0) 0x7f6834003620 con 0x7f6864138e10 2026-02-22T23:28:03.706 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.699+0000 7f6860ff9640 1 -- 10.20.193.45:0/1765734278 --> v1:10.20.193.45:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f68640a4510 con 0x7f6864138e10 2026-02-22T23:28:03.706 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.699+0000 7f6860ff9640 1 -- 10.20.193.45:0/1765734278 <== mon.4 v1:10.20.193.45:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2537595833 0 0) 0x7f686413d8b0 con 0x7f68640a3630 2026-02-22T23:28:03.706 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.699+0000 7f6860ff9640 1 -- 10.20.193.45:0/1765734278 --> v1:10.20.193.45:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6834003620 con 0x7f68640a3630 2026-02-22T23:28:03.706 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.699+0000 7f6860ff9640 1 -- 10.20.193.45:0/1765734278 <== mon.8 v1:10.20.193.45:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f6854004260 con 0x7f6864138e10 2026-02-22T23:28:03.706 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.699+0000 7f6860ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-22T23:28:03.706 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.699+0000 7f6860ff9640 10 monclient(hunting): got monmap 1 from mon.noname-e (according to old e1) 2026-02-22T23:28:03.706 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.699+0000 7f6860ff9640 10 monclient(hunting): dump: 2026-02-22T23:28:03.706 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:28:03.706 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:28:03.706 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:03.706 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:03.706 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:28:03.706 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:28:03.706 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:28:03.706 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:28:03.706 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:28:03.706 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:28:03.706 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:28:03.706 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:28:03.706 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:28:03.706 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:28:03.706 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:28:03.707 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:03.707 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.699+0000 7f6860ff9640 10 monclient(hunting): _finish_auth 0 2026-02-22T23:28:03.707 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.699+0000 7f6860ff9640 1 -- 10.20.193.45:0/1765734278 <== mon.4 v1:10.20.193.45:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f6850003000 con 0x7f68640a3630 2026-02-22T23:28:03.707 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.699+0000 7f6860ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-22T23:28:03.707 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.699+0000 7f6860ff9640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-22T23:28:03.707 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.699+0000 7f6860ff9640 10 monclient(hunting): dump: 2026-02-22T23:28:03.707 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:28:03.707 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:28:03.707 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:03.707 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:03.707 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:28:03.707 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:28:03.707 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:28:03.707 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:28:03.707 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:28:03.707 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:28:03.707 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:28:03.707 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:28:03.707 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:28:03.707 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:28:03.707 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:28:03.707 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:03.707 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.699+0000 7f6860ff9640 1 -- 10.20.193.45:0/1765734278 <== mon.8 v1:10.20.193.45:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1194668473 0 0) 0x7f68640a4510 con 0x7f6864138e10 2026-02-22T23:28:03.707 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.699+0000 7f6860ff9640 1 -- 10.20.193.45:0/1765734278 >> v1:10.20.193.45:6791/0 conn(0x7f68640a3630 legacy=0x7f6864139990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:03.707 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.699+0000 7f6860ff9640 1 -- 10.20.193.45:0/1765734278 >> v1:10.20.193.73:6789/0 conn(0x7f686413f310 legacy=0x7f68641d7e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:03.707 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.699+0000 7f6860ff9640 10 monclient: _finish_hunting 0 2026-02-22T23:28:03.707 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.699+0000 7f6860ff9640 1 monclient: found mon.e 2026-02-22T23:28:03.707 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.699+0000 7f6860ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T23:28:03.707 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.699+0000 7f6860ff9640 10 monclient: _send_mon_message to mon.e at v1:10.20.193.45:6793/0 2026-02-22T23:28:03.707 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.699+0000 7f6860ff9640 1 -- 10.20.193.45:0/1765734278 --> v1:10.20.193.45:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f686413a7b0 con 0x7f6864138e10 2026-02-22T23:28:03.707 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.699+0000 7f6860ff9640 10 monclient: _finish_auth 0 2026-02-22T23:28:03.708 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.699+0000 7f6860ff9640 10 monclient: _check_auth_tickets 2026-02-22T23:28:03.708 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.699+0000 7f6860ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T23:28:03.708 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.699+0000 7f686a869640 5 monclient: authenticate success, global_id 4589 2026-02-22T23:28:03.708 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.699+0000 7f686a869640 10 monclient: _renew_subs 2026-02-22T23:28:03.708 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.699+0000 7f686a869640 10 monclient: _send_mon_message to mon.e at v1:10.20.193.45:6793/0 2026-02-22T23:28:03.708 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.699+0000 7f686a869640 1 -- 10.20.193.45:0/1765734278 --> v1:10.20.193.45:6793/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f686413d010 con 0x7f6864138e10 2026-02-22T23:28:03.708 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.699+0000 7f686a869640 10 monclient: _renew_subs 2026-02-22T23:28:03.708 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.699+0000 7f686a869640 10 monclient: _send_mon_message to mon.e at v1:10.20.193.45:6793/0 2026-02-22T23:28:03.708 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.699+0000 7f686a869640 1 -- 10.20.193.45:0/1765734278 --> v1:10.20.193.45:6793/0 -- mon_subscribe({osdmap=0}) -- 0x7f686413d5d0 con 0x7f6864138e10 2026-02-22T23:28:03.708 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.699+0000 7f6860ff9640 1 -- 10.20.193.45:0/1765734278 <== mon.8 v1:10.20.193.45:6793/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6854002990 con 0x7f6864138e10 2026-02-22T23:28:03.708 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.699+0000 7f6860ff9640 10 monclient: handle_config config(0 keys) 2026-02-22T23:28:03.708 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.699+0000 7f6860ff9640 1 -- 10.20.193.45:0/1765734278 <== mon.8 v1:10.20.193.45:6793/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f6854004400 con 0x7f6864138e10 2026-02-22T23:28:03.708 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.699+0000 7f6860ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:28:03.708 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.699+0000 7f68627fc640 4 set_mon_vals no callback set 2026-02-22T23:28:03.708 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.699+0000 7f6860ff9640 10 monclient: got monmap 1 from mon.e (according to old e1) 2026-02-22T23:28:03.708 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.699+0000 7f6860ff9640 10 monclient: dump: 2026-02-22T23:28:03.708 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:28:03.708 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:28:03.708 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:03.708 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:03.708 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:28:03.708 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:28:03.708 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:28:03.708 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:28:03.708 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:28:03.708 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:28:03.708 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:28:03.708 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:28:03.708 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:28:03.708 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:28:03.709 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:28:03.709 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:03.709 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.700+0000 7f686a869640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T23:28:03.709 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.700+0000 7f686a869640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T23:28:03.709 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.700+0000 7f686a869640 10 monclient: _send_mon_message to mon.e at v1:10.20.193.45:6793/0 2026-02-22T23:28:03.709 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.700+0000 7f686a869640 1 -- 10.20.193.45:0/1765734278 --> v1:10.20.193.45:6793/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f68640a24a0 con 0x7f6864138e10 2026-02-22T23:28:03.709 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.700+0000 7f6860ff9640 1 -- 10.20.193.45:0/1765734278 <== mon.8 v1:10.20.193.45:6793/0 7 ==== mgrmap(e 5) ==== 50225+0+0 (unknown 2330357642 0 0) 0x7f6854002fc0 con 0x7f6864138e10 2026-02-22T23:28:03.709 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.700+0000 7f6860ff9640 1 -- 10.20.193.45:0/1765734278 <== mon.8 v1:10.20.193.45:6793/0 8 ==== osd_map(25..25 src has 1..25) ==== 3502+0+0 (unknown 129690100 0 0) 0x7f685404dbd0 con 0x7f6864138e10 2026-02-22T23:28:03.709 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.700+0000 7f6863fff640 10 monclient: get_auth_request con 0x7f683403fdb0 auth_method 0 2026-02-22T23:28:03.709 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.702+0000 7f6860ff9640 1 -- 10.20.193.45:0/1765734278 <== mon.8 v1:10.20.193.45:6793/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (unknown 1092875540 0 2568732696) 0x7f68540177d0 con 0x7f6864138e10 2026-02-22T23:28:03.709 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.702+0000 7f6860ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T23:28:03.709 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.702+0000 7f6860ff9640 10 monclient: _finish_command 1 = system:0 2026-02-22T23:28:03.817 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.816+0000 7f686a869640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-22T23:28:03.818 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.816+0000 7f686a869640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-22T23:28:03.818 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.816+0000 7f686a869640 10 monclient: _send_mon_message to mon.e at v1:10.20.193.45:6793/0 2026-02-22T23:28:03.818 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.816+0000 7f686a869640 1 -- 10.20.193.45:0/1765734278 --> v1:10.20.193.45:6793/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f686413ae20 con 0x7f6864138e10 2026-02-22T23:28:03.818 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.816+0000 7f6860ff9640 1 -- 10.20.193.45:0/1765734278 <== mon.8 v1:10.20.193.45:6793/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+2713 (unknown 254746657 0 378307465) 0x7f68540170d0 con 0x7f6864138e10 2026-02-22T23:28:03.818 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.816+0000 7f6860ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-22T23:28:03.818 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.816+0000 7f6860ff9640 10 monclient: _finish_command 2 = system:0 2026-02-22T23:28:03.818 INFO:teuthology.orchestra.run.trial045.stdout:{"election_epoch":28,"quorum":[0,1,2,3,4,5,6,7,8],"quorum_names":["a","f","b","g","c","h","d","i","e"],"quorum_leader_name":"e","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"4b60f18f-6660-4731-b731-dc85c4078413","modified":"2026-02-22T23:24:52.393472Z","created":"2026-02-22T23:24:52.393472Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":3,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.45:6789","nonce":0}]},"addr":"10.20.193.45:6789/0","public_addr":"10.20.193.45:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.73:6789","nonce":0}]},"addr":"10.20.193.73:6789/0","public_addr":"10.20.193.73:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.45:6790","nonce":0}]},"addr":"10.20.193.45:6790/0","public_addr":"10.20.193.45:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.73:6790","nonce":0}]},"addr":"10.20.193.73:6790/0","public_addr":"10.20.193.73:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.45:6791","nonce":0}]},"addr":"10.20.193.45:6791/0","public_addr":"10.20.193.45:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.73:6791","nonce":0}]},"addr":"10.20.193.73:6791/0","public_addr":"10.20.193.73:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.45:6792","nonce":0}]},"addr":"10.20.193.45:6792/0","public_addr":"10.20.193.45:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.73:6792","nonce":0}]},"addr":"10.20.193.73:6792/0","public_addr":"10.20.193.73:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.45:6793","nonce":0}]},"addr":"10.20.193.45:6793/0","public_addr":"10.20.193.45:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-22T23:28:03.818 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.817+0000 7f686a869640 1 -- 10.20.193.45:0/1765734278 >> v1:10.20.193.73:6800/2222410180 conn(0x7f683403fdb0 legacy=0x7f6834042270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:03.818 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.817+0000 7f686a869640 10 monclient: shutdown 2026-02-22T23:28:03.818 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.817+0000 7f686a869640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T23:28:03.818 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.817+0000 7f686a869640 1 -- 10.20.193.45:0/1765734278 >> v1:10.20.193.45:6793/0 conn(0x7f6864138e10 legacy=0x7f686413a0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:03.819 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.817+0000 7f686a869640 1 -- 10.20.193.45:0/1765734278 shutdown_connections 2026-02-22T23:28:03.819 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.817+0000 7f686a869640 1 -- 10.20.193.45:0/1765734278 >> 10.20.193.45:0/1765734278 conn(0x7f68640a7780 msgr2=0x7f686409ce40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:28:03.819 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.817+0000 7f686a869640 1 -- 10.20.193.45:0/1765734278 shutdown_connections 2026-02-22T23:28:03.819 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.817+0000 7f686a869640 1 -- 10.20.193.45:0/1765734278 wait complete. 2026-02-22T23:28:03.826 INFO:tasks.mon_thrash.ceph_manager:quorum is size 9 2026-02-22T23:28:03.826 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon a 2026-02-22T23:28:03.827 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-22T23:28:03.906 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.894+0000 7fc4dde06640 10 monclient: get_monmap_and_config 2026-02-22T23:28:03.906 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.894+0000 7fc4dde06640 10 monclient: build_initial_monmap 2026-02-22T23:28:03.907 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.894+0000 7fc4dde06640 10 monclient: monmap: 2026-02-22T23:28:03.907 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-22T23:28:03.907 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:28:03.907 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:28:03.895625+0000 2026-02-22T23:28:03.907 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:28:03.895625+0000 2026-02-22T23:28:03.907 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-22T23:28:03.907 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:28:03.907 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-22T23:28:03.907 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.noname-f 2026-02-22T23:28:03.907 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.noname-b 2026-02-22T23:28:03.907 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.noname-g 2026-02-22T23:28:03.908 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.noname-c 2026-02-22T23:28:03.908 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.noname-h 2026-02-22T23:28:03.908 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.noname-d 2026-02-22T23:28:03.908 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.noname-i 2026-02-22T23:28:03.908 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.noname-e 2026-02-22T23:28:03.908 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:03.908 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.894+0000 7fc4dde06640 1 Processor -- start 2026-02-22T23:28:03.908 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.894+0000 7fc4dde06640 1 -- start start 2026-02-22T23:28:03.908 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.894+0000 7fc4dde06640 10 monclient: init 2026-02-22T23:28:03.908 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.895+0000 7fc4dde06640 10 monclient: _reopen_session rank -1 2026-02-22T23:28:03.908 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.895+0000 7fc4dde06640 10 monclient: _add_conns ranks=[8,2,3,5,0,6,4,1,7] 2026-02-22T23:28:03.908 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.895+0000 7fc4dde06640 10 monclient(hunting): picked mon.noname-e con 0x7fc4d809db40 addr v1:10.20.193.45:6793/0 2026-02-22T23:28:03.909 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.895+0000 7fc4dde06640 10 monclient(hunting): picked mon.noname-b con 0x7fc4d8138fb0 addr v1:10.20.193.45:6790/0 2026-02-22T23:28:03.909 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.895+0000 7fc4dde06640 10 monclient(hunting): picked mon.noname-g con 0x7fc4d81393f0 addr v1:10.20.193.73:6790/0 2026-02-22T23:28:03.909 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.895+0000 7fc4dde06640 1 -- --> v1:10.20.193.45:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc4d809bb20 con 0x7fc4d8138fb0 2026-02-22T23:28:03.909 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.895+0000 7fc4dde06640 1 -- --> v1:10.20.193.73:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc4d809bd90 con 0x7fc4d81393f0 2026-02-22T23:28:03.909 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.895+0000 7fc4dde06640 1 -- --> v1:10.20.193.45:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc4d809c070 con 0x7fc4d809db40 2026-02-22T23:28:03.909 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.895+0000 7fc4dde06640 10 monclient(hunting): _renew_subs 2026-02-22T23:28:03.909 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.895+0000 7fc4dde06640 10 monclient(hunting): authenticate will time out at 815.512154s 2026-02-22T23:28:03.909 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.895+0000 7fc4d77fe640 1 --1- >> v1:10.20.193.45:6793/0 conn(0x7fc4d809db40 0x7fc4d809df20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.45:6793/0 says I am v1:10.20.193.45:40964/0 (socket says 10.20.193.45:40964) 2026-02-22T23:28:03.909 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.895+0000 7fc4d77fe640 1 -- 10.20.193.45:0/3921067918 learned_addr learned my addr 10.20.193.45:0/3921067918 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-22T23:28:03.909 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.895+0000 7fc4d67fc640 1 -- 10.20.193.45:0/3921067918 <== mon.2 v1:10.20.193.45:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3566319580 0 0) 0x7fc4d809bb20 con 0x7fc4d8138fb0 2026-02-22T23:28:03.909 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.895+0000 7fc4d67fc640 10 monclient(hunting): _negotiate 2026-02-22T23:28:03.909 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.895+0000 7fc4d67fc640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:28:03.909 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.895+0000 7fc4d67fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:28:03.910 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.895+0000 7fc4d67fc640 10 monclient(hunting): my global_id is 4637 2026-02-22T23:28:03.910 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.895+0000 7fc4d67fc640 1 -- 10.20.193.45:0/3921067918 --> v1:10.20.193.45:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc4bc003620 con 0x7fc4d8138fb0 2026-02-22T23:28:03.910 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.895+0000 7fc4d67fc640 1 -- 10.20.193.45:0/3921067918 <== mon.8 v1:10.20.193.45:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3349203860 0 0) 0x7fc4d809c070 con 0x7fc4d809db40 2026-02-22T23:28:03.910 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.895+0000 7fc4d67fc640 10 monclient(hunting): _negotiate 2026-02-22T23:28:03.910 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.895+0000 7fc4d67fc640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:28:03.910 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.895+0000 7fc4d67fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:28:03.910 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.895+0000 7fc4d67fc640 10 monclient(hunting): my global_id is 4598 2026-02-22T23:28:03.910 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.895+0000 7fc4d67fc640 1 -- 10.20.193.45:0/3921067918 --> v1:10.20.193.45:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc4d809bb20 con 0x7fc4d809db40 2026-02-22T23:28:03.910 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.895+0000 7fc4d67fc640 1 -- 10.20.193.45:0/3921067918 <== mon.3 v1:10.20.193.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1586999839 0 0) 0x7fc4d809bd90 con 0x7fc4d81393f0 2026-02-22T23:28:03.910 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.895+0000 7fc4d67fc640 10 monclient(hunting): _negotiate 2026-02-22T23:28:03.910 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.895+0000 7fc4d67fc640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:28:03.910 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.895+0000 7fc4d67fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:28:03.911 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.895+0000 7fc4d67fc640 10 monclient(hunting): my global_id is 4557 2026-02-22T23:28:03.911 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.895+0000 7fc4d67fc640 1 -- 10.20.193.45:0/3921067918 --> v1:10.20.193.73:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc4d809c070 con 0x7fc4d81393f0 2026-02-22T23:28:03.911 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.895+0000 7fc4d67fc640 1 -- 10.20.193.45:0/3921067918 <== mon.2 v1:10.20.193.45:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 251373308 0 0) 0x7fc4bc003620 con 0x7fc4d8138fb0 2026-02-22T23:28:03.911 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.895+0000 7fc4d67fc640 1 -- 10.20.193.45:0/3921067918 >> v1:10.20.193.45:6793/0 conn(0x7fc4d809db40 legacy=0x7fc4d809df20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:03.911 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.895+0000 7fc4d67fc640 1 -- 10.20.193.45:0/3921067918 >> v1:10.20.193.73:6790/0 conn(0x7fc4d81393f0 legacy=0x7fc4d8141460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:03.911 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.895+0000 7fc4d67fc640 10 monclient: _finish_hunting 0 2026-02-22T23:28:03.911 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.895+0000 7fc4d67fc640 1 monclient: found mon.noname-b 2026-02-22T23:28:03.911 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.895+0000 7fc4d67fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T23:28:03.911 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.895+0000 7fc4d67fc640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.45:6790/0 2026-02-22T23:28:03.911 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.895+0000 7fc4d67fc640 1 -- 10.20.193.45:0/3921067918 --> v1:10.20.193.45:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4d809c350 con 0x7fc4d8138fb0 2026-02-22T23:28:03.911 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.895+0000 7fc4d67fc640 10 monclient: _finish_auth 0 2026-02-22T23:28:03.911 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.895+0000 7fc4d67fc640 10 monclient: _check_auth_tickets 2026-02-22T23:28:03.912 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.895+0000 7fc4d67fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T23:28:03.912 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.895+0000 7fc4dde06640 5 monclient: authenticate success, global_id 4637 2026-02-22T23:28:03.912 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.895+0000 7fc4d67fc640 1 -- 10.20.193.45:0/3921067918 <== mon.2 v1:10.20.193.45:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7fc4c8003040 con 0x7fc4d8138fb0 2026-02-22T23:28:03.912 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.895+0000 7fc4dde06640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-22T23:28:03.912 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.895+0000 7fc4d67fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:28:03.912 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.895+0000 7fc4d67fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-22T23:28:03.912 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.895+0000 7fc4d67fc640 10 monclient: dump: 2026-02-22T23:28:03.912 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:28:03.912 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:28:03.912 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:03.912 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:03.912 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:28:03.912 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:28:03.913 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:28:03.913 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:28:03.913 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:28:03.913 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:28:03.913 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:28:03.913 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:28:03.913 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:28:03.913 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:28:03.913 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:28:03.913 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:03.914 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.895+0000 7fc4dde06640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-22T23:28:03.914 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.895+0000 7fc4d67fc640 1 -- 10.20.193.45:0/3921067918 <== mon.2 v1:10.20.193.45:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc4c80031e0 con 0x7fc4d8138fb0 2026-02-22T23:28:03.914 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.895+0000 7fc4d67fc640 10 monclient: handle_config config(0 keys) 2026-02-22T23:28:03.914 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.895+0000 7fc4dde06640 10 monclient: get_monmap_and_config success 2026-02-22T23:28:03.914 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.895+0000 7fc4dde06640 4 set_mon_vals no callback set 2026-02-22T23:28:03.914 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.895+0000 7fc4d67fc640 1 -- 10.20.193.45:0/3921067918 <== mon.2 v1:10.20.193.45:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7fc4c8003a50 con 0x7fc4d8138fb0 2026-02-22T23:28:03.914 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.895+0000 7fc4d67fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:28:03.914 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.895+0000 7fc4d67fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-22T23:28:03.914 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.895+0000 7fc4d67fc640 10 monclient: dump: 2026-02-22T23:28:03.914 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:28:03.914 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:28:03.915 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:03.915 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:03.915 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:28:03.915 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:28:03.915 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:28:03.915 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:28:03.915 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:28:03.915 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:28:03.915 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:28:03.915 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:28:03.915 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:28:03.916 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:28:03.916 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:28:03.916 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:03.916 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.895+0000 7fc4dde06640 10 monclient: shutdown 2026-02-22T23:28:03.916 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.895+0000 7fc4dde06640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T23:28:03.916 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.895+0000 7fc4dde06640 1 -- 10.20.193.45:0/3921067918 >> v1:10.20.193.45:6790/0 conn(0x7fc4d8138fb0 legacy=0x7fc4d813dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:03.916 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.895+0000 7fc4dde06640 1 -- 10.20.193.45:0/3921067918 shutdown_connections 2026-02-22T23:28:03.916 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.895+0000 7fc4dde06640 1 -- 10.20.193.45:0/3921067918 >> 10.20.193.45:0/3921067918 conn(0x7fc4d80a4320 msgr2=0x7fc4d80a4730 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:28:03.916 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.895+0000 7fc4dde06640 1 -- 10.20.193.45:0/3921067918 shutdown_connections 2026-02-22T23:28:03.916 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.895+0000 7fc4dde06640 1 -- 10.20.193.45:0/3921067918 wait complete. 2026-02-22T23:28:03.916 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.896+0000 7fc4dde06640 10 monclient: build_initial_monmap 2026-02-22T23:28:03.917 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.896+0000 7fc4dde06640 10 monclient: monmap: 2026-02-22T23:28:03.917 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-22T23:28:03.917 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T23:28:03.917 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-22T23:28:03.917 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-22T23:28:03.917 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-22T23:28:03.917 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-22T23:28:03.917 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-22T23:28:03.917 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.noname-f 2026-02-22T23:28:03.917 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.noname-b 2026-02-22T23:28:03.917 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.noname-g 2026-02-22T23:28:03.917 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.noname-c 2026-02-22T23:28:03.917 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.noname-h 2026-02-22T23:28:03.918 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.noname-d 2026-02-22T23:28:03.918 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.noname-i 2026-02-22T23:28:03.918 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.noname-e 2026-02-22T23:28:03.918 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:03.918 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.896+0000 7fc4dde06640 1 Processor -- start 2026-02-22T23:28:03.918 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.896+0000 7fc4dde06640 1 -- start start 2026-02-22T23:28:03.918 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.896+0000 7fc4dde06640 10 monclient: init 2026-02-22T23:28:03.918 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.896+0000 7fc4dde06640 10 monclient: _reopen_session rank -1 2026-02-22T23:28:03.918 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.896+0000 7fc4dde06640 10 monclient: _add_conns ranks=[2,6,8,1,0,7,3,4,5] 2026-02-22T23:28:03.918 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.896+0000 7fc4dde06640 10 monclient(hunting): picked mon.noname-b con 0x7fc4d809db40 addr v1:10.20.193.45:6790/0 2026-02-22T23:28:03.918 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.896+0000 7fc4dde06640 10 monclient(hunting): picked mon.noname-d con 0x7fc4d8138fb0 addr v1:10.20.193.45:6792/0 2026-02-22T23:28:03.918 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.896+0000 7fc4dde06640 10 monclient(hunting): picked mon.noname-e con 0x7fc4d81393f0 addr v1:10.20.193.45:6793/0 2026-02-22T23:28:03.918 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.896+0000 7fc4dde06640 1 -- --> v1:10.20.193.45:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc4d80908b0 con 0x7fc4d809db40 2026-02-22T23:28:03.919 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.896+0000 7fc4dde06640 1 -- --> v1:10.20.193.45:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc4d808e8c0 con 0x7fc4d8138fb0 2026-02-22T23:28:03.919 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.896+0000 7fc4dde06640 1 -- --> v1:10.20.193.45:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc4d80a5940 con 0x7fc4d81393f0 2026-02-22T23:28:03.919 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.896+0000 7fc4dde06640 10 monclient(hunting): _renew_subs 2026-02-22T23:28:03.919 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.896+0000 7fc4dde06640 10 monclient(hunting): authenticate will time out at 815.513735s 2026-02-22T23:28:03.919 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.896+0000 7fc4d77fe640 1 --1- >> v1:10.20.193.45:6790/0 conn(0x7fc4d809db40 0x7fc4d81cff50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.45:6790/0 says I am v1:10.20.193.45:60076/0 (socket says 10.20.193.45:60076) 2026-02-22T23:28:03.919 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.896+0000 7fc4d77fe640 1 -- 10.20.193.45:0/2678507239 learned_addr learned my addr 10.20.193.45:0/2678507239 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-22T23:28:03.919 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.896+0000 7fc4b3fff640 1 -- 10.20.193.45:0/2678507239 <== mon.2 v1:10.20.193.45:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1722478607 0 0) 0x7fc4d80908b0 con 0x7fc4d809db40 2026-02-22T23:28:03.919 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.896+0000 7fc4b3fff640 10 monclient(hunting): _negotiate 2026-02-22T23:28:03.919 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.896+0000 7fc4b3fff640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:28:03.919 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.896+0000 7fc4b3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:28:03.919 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.896+0000 7fc4b3fff640 10 monclient(hunting): my global_id is 4646 2026-02-22T23:28:03.919 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.896+0000 7fc4b3fff640 1 -- 10.20.193.45:0/2678507239 --> v1:10.20.193.45:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc4a8003620 con 0x7fc4d809db40 2026-02-22T23:28:03.920 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.896+0000 7fc4b3fff640 1 -- 10.20.193.45:0/2678507239 <== mon.6 v1:10.20.193.45:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3620384330 0 0) 0x7fc4d808e8c0 con 0x7fc4d8138fb0 2026-02-22T23:28:03.920 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.896+0000 7fc4b3fff640 10 monclient(hunting): _negotiate 2026-02-22T23:28:03.920 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.896+0000 7fc4b3fff640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:28:03.920 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.896+0000 7fc4b3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:28:03.920 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.896+0000 7fc4b3fff640 10 monclient(hunting): my global_id is 114108 2026-02-22T23:28:03.920 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.896+0000 7fc4b3fff640 1 -- 10.20.193.45:0/2678507239 --> v1:10.20.193.45:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc4d80908b0 con 0x7fc4d8138fb0 2026-02-22T23:28:03.920 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.896+0000 7fc4b3fff640 1 -- 10.20.193.45:0/2678507239 <== mon.8 v1:10.20.193.45:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 781329007 0 0) 0x7fc4d80a5940 con 0x7fc4d81393f0 2026-02-22T23:28:03.920 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.896+0000 7fc4b3fff640 10 monclient(hunting): _negotiate 2026-02-22T23:28:03.920 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.896+0000 7fc4b3fff640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:28:03.920 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.896+0000 7fc4b3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:28:03.920 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.896+0000 7fc4b3fff640 10 monclient(hunting): my global_id is 4607 2026-02-22T23:28:03.920 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.896+0000 7fc4b3fff640 1 -- 10.20.193.45:0/2678507239 --> v1:10.20.193.45:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc4d808e8c0 con 0x7fc4d81393f0 2026-02-22T23:28:03.921 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.897+0000 7fc4b3fff640 1 -- 10.20.193.45:0/2678507239 <== mon.6 v1:10.20.193.45:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 237075378 0 0) 0x7fc4d80908b0 con 0x7fc4d8138fb0 2026-02-22T23:28:03.921 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.897+0000 7fc4b3fff640 1 -- 10.20.193.45:0/2678507239 --> v1:10.20.193.45:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc4d80a5940 con 0x7fc4d8138fb0 2026-02-22T23:28:03.921 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.897+0000 7fc4b3fff640 1 -- 10.20.193.45:0/2678507239 <== mon.2 v1:10.20.193.45:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2978715463 0 0) 0x7fc4a8003620 con 0x7fc4d809db40 2026-02-22T23:28:03.921 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.897+0000 7fc4b3fff640 1 -- 10.20.193.45:0/2678507239 --> v1:10.20.193.45:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc4d80908b0 con 0x7fc4d809db40 2026-02-22T23:28:03.921 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.897+0000 7fc4b3fff640 1 -- 10.20.193.45:0/2678507239 <== mon.6 v1:10.20.193.45:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7fc4c80036d0 con 0x7fc4d8138fb0 2026-02-22T23:28:03.921 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.897+0000 7fc4b3fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-22T23:28:03.921 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.897+0000 7fc4b3fff640 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2026-02-22T23:28:03.921 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.897+0000 7fc4b3fff640 10 monclient(hunting): dump: 2026-02-22T23:28:03.921 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:28:03.921 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:28:03.921 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:03.921 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:03.921 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:28:03.922 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:28:03.922 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:28:03.922 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:28:03.922 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:28:03.922 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:28:03.922 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:28:03.922 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:28:03.922 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:28:03.922 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:28:03.922 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:28:03.922 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:03.922 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.897+0000 7fc4b3fff640 10 monclient(hunting): _finish_auth 0 2026-02-22T23:28:03.922 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.897+0000 7fc4b3fff640 1 -- 10.20.193.45:0/2678507239 <== mon.8 v1:10.20.193.45:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2819429288 0 0) 0x7fc4d808e8c0 con 0x7fc4d81393f0 2026-02-22T23:28:03.923 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.897+0000 7fc4b3fff640 1 -- 10.20.193.45:0/2678507239 --> v1:10.20.193.45:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc4a8003620 con 0x7fc4d81393f0 2026-02-22T23:28:03.923 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.897+0000 7fc4b3fff640 1 -- 10.20.193.45:0/2678507239 <== mon.2 v1:10.20.193.45:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7fc4c4002e60 con 0x7fc4d809db40 2026-02-22T23:28:03.923 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.897+0000 7fc4b3fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-22T23:28:03.923 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.897+0000 7fc4b3fff640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-22T23:28:03.923 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.897+0000 7fc4b3fff640 10 monclient(hunting): dump: 2026-02-22T23:28:03.923 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:28:03.923 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:28:03.923 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:03.923 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:03.923 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:28:03.924 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:28:03.924 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:28:03.924 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:28:03.924 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:28:03.924 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:28:03.924 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:28:03.924 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:28:03.924 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:28:03.924 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:28:03.924 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:28:03.924 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:03.924 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.897+0000 7fc4b3fff640 1 -- 10.20.193.45:0/2678507239 <== mon.6 v1:10.20.193.45:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2416136562 0 0) 0x7fc4d80a5940 con 0x7fc4d8138fb0 2026-02-22T23:28:03.925 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.897+0000 7fc4b3fff640 1 -- 10.20.193.45:0/2678507239 >> v1:10.20.193.45:6793/0 conn(0x7fc4d81393f0 legacy=0x7fc4d81d8620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:03.925 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.897+0000 7fc4b3fff640 1 -- 10.20.193.45:0/2678507239 >> v1:10.20.193.45:6790/0 conn(0x7fc4d809db40 legacy=0x7fc4d81cff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:03.925 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.897+0000 7fc4b3fff640 10 monclient: _finish_hunting 0 2026-02-22T23:28:03.925 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.897+0000 7fc4b3fff640 1 monclient: found mon.d 2026-02-22T23:28:03.925 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.897+0000 7fc4b3fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T23:28:03.925 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.897+0000 7fc4b3fff640 10 monclient: _send_mon_message to mon.d at v1:10.20.193.45:6792/0 2026-02-22T23:28:03.925 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.897+0000 7fc4b3fff640 1 -- 10.20.193.45:0/2678507239 --> v1:10.20.193.45:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4d80905d0 con 0x7fc4d8138fb0 2026-02-22T23:28:03.925 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.897+0000 7fc4b3fff640 10 monclient: _finish_auth 0 2026-02-22T23:28:03.925 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.897+0000 7fc4b3fff640 10 monclient: _check_auth_tickets 2026-02-22T23:28:03.925 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.897+0000 7fc4b3fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T23:28:03.925 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.897+0000 7fc4dde06640 5 monclient: authenticate success, global_id 114108 2026-02-22T23:28:03.925 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.897+0000 7fc4dde06640 10 monclient: _renew_subs 2026-02-22T23:28:03.926 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.897+0000 7fc4dde06640 10 monclient: _send_mon_message to mon.d at v1:10.20.193.45:6792/0 2026-02-22T23:28:03.926 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.897+0000 7fc4dde06640 1 -- 10.20.193.45:0/2678507239 --> v1:10.20.193.45:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fc4d8090b90 con 0x7fc4d8138fb0 2026-02-22T23:28:03.926 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.897+0000 7fc4dde06640 10 monclient: _renew_subs 2026-02-22T23:28:03.926 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.897+0000 7fc4dde06640 10 monclient: _send_mon_message to mon.d at v1:10.20.193.45:6792/0 2026-02-22T23:28:03.926 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.897+0000 7fc4dde06640 1 -- 10.20.193.45:0/2678507239 --> v1:10.20.193.45:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7fc4d8090fb0 con 0x7fc4d8138fb0 2026-02-22T23:28:03.926 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.897+0000 7fc4b3fff640 1 -- 10.20.193.45:0/2678507239 <== mon.6 v1:10.20.193.45:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc4c8002930 con 0x7fc4d8138fb0 2026-02-22T23:28:03.926 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.897+0000 7fc4b3fff640 10 monclient: handle_config config(0 keys) 2026-02-22T23:28:03.926 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.897+0000 7fc4b3fff640 1 -- 10.20.193.45:0/2678507239 <== mon.6 v1:10.20.193.45:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7fc4c80030a0 con 0x7fc4d8138fb0 2026-02-22T23:28:03.926 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.897+0000 7fc4b3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:28:03.926 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.897+0000 7fc4b3fff640 10 monclient: got monmap 1 from mon.d (according to old e1) 2026-02-22T23:28:03.926 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.897+0000 7fc4d5ffb640 4 set_mon_vals no callback set 2026-02-22T23:28:03.926 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.897+0000 7fc4b3fff640 10 monclient: dump: 2026-02-22T23:28:03.926 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:28:03.927 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:28:03.927 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:03.927 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:03.927 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:28:03.927 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:28:03.927 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:28:03.927 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:28:03.927 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:28:03.927 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:28:03.927 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:28:03.927 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:28:03.927 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:28:03.927 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:28:03.928 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:28:03.928 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:03.928 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.897+0000 7fc4dde06640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T23:28:03.928 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.897+0000 7fc4dde06640 1 -- 10.20.193.45:0/2678507239 --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fc4d80a3110 con 0x7fc4d8142b80 2026-02-22T23:28:03.928 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.897+0000 7fc4b3fff640 1 -- 10.20.193.45:0/2678507239 <== mon.6 v1:10.20.193.45:6792/0 7 ==== mgrmap(e 5) ==== 50225+0+0 (unknown 2330357642 0 0) 0x7fc4c8010490 con 0x7fc4d8138fb0 2026-02-22T23:28:03.928 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.897+0000 7fc4b3fff640 1 -- 10.20.193.45:0/2678507239 <== mon.6 v1:10.20.193.45:6792/0 8 ==== osd_map(25..25 src has 1..25) ==== 3502+0+0 (unknown 129690100 0 0) 0x7fc4c804c790 con 0x7fc4d8138fb0 2026-02-22T23:28:03.928 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.897+0000 7fc4b3fff640 1 -- 10.20.193.45:0/2678507239 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 787946449 0 0) 0x7fc4d80908b0 con 0x7fc4d8142b80 2026-02-22T23:28:03.928 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.897+0000 7fc4b3fff640 10 monclient(hunting): _negotiate 2026-02-22T23:28:03.928 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.897+0000 7fc4b3fff640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:28:03.928 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.897+0000 7fc4b3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:28:03.928 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.897+0000 7fc4b3fff640 10 monclient(hunting): my global_id is 4554 2026-02-22T23:28:03.928 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.898+0000 7fc4b3fff640 1 -- 10.20.193.45:0/2678507239 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc4d80a5940 con 0x7fc4d8142b80 2026-02-22T23:28:03.928 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.898+0000 7fc4d7fff640 10 monclient: get_auth_request con 0x7fc4a80402e0 auth_method 0 2026-02-22T23:28:03.928 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.898+0000 7fc4b3fff640 1 -- 10.20.193.45:0/2678507239 <== mon.0 v1:10.20.193.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3648749895 0 0) 0x7fc4d80a5940 con 0x7fc4d8142b80 2026-02-22T23:28:03.928 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.898+0000 7fc4b3fff640 1 -- 10.20.193.45:0/2678507239 --> v1:10.20.193.45:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc4d80908b0 con 0x7fc4d8142b80 2026-02-22T23:28:03.928 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.898+0000 7fc4b3fff640 1 -- 10.20.193.45:0/2678507239 <== mon.0 v1:10.20.193.45:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7fc4c4004e10 con 0x7fc4d8142b80 2026-02-22T23:28:03.929 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.898+0000 7fc4b3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:28:03.929 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.898+0000 7fc4b3fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T23:28:03.929 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.898+0000 7fc4b3fff640 10 monclient: dump: 2026-02-22T23:28:03.929 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:28:03.929 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:28:03.929 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:03.929 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:03.929 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:28:03.929 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:28:03.929 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:28:03.929 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:28:03.929 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:28:03.929 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:28:03.929 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:28:03.929 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:28:03.929 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:28:03.929 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:28:03.929 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:28:03.929 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:03.929 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.898+0000 7fc4b3fff640 1 -- 10.20.193.45:0/2678507239 <== mon.0 v1:10.20.193.45:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3185349859 0 0) 0x7fc4d80908b0 con 0x7fc4d8142b80 2026-02-22T23:28:03.929 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.898+0000 7fc4b3fff640 1 -- 10.20.193.45:0/2678507239 --> v1:10.20.193.45:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc4d80744b0 con 0x7fc4d8142b80 2026-02-22T23:28:03.929 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.898+0000 7fc4b3fff640 1 -- 10.20.193.45:0/2678507239 <== mon.0 v1:10.20.193.45:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (unknown 0 0 2024835662) 0x7fc4c4005020 con 0x7fc4d8142b80 2026-02-22T23:28:03.929 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.898+0000 7fc4b3fff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T23:28:03.929 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.898+0000 7fc4b3fff640 10 monclient: _finish_command 1 = system:0 2026-02-22T23:28:03.929 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.898+0000 7fc4b3fff640 1 -- 10.20.193.45:0/2678507239 >> v1:10.20.193.45:6789/0 conn(0x7fc4d8142b80 legacy=0x7fc4d8095850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:03.929 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.898+0000 7fc4b3fff640 1 -- 10.20.193.45:0/2678507239 >> v1:10.20.193.45:6789/0 conn(0x7fc4d8142b80 legacy=0x7fc4d8095850 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T23:28:03.929 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.901+0000 7fc4dde06640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-22T23:28:03.929 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.901+0000 7fc4dde06640 1 -- 10.20.193.45:0/2678507239 --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fc4d809b100 con 0x7fc4d809ad20 2026-02-22T23:28:03.929 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.901+0000 7fc4b3fff640 1 -- 10.20.193.45:0/2678507239 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2028457902 0 0) 0x7fc4d809b100 con 0x7fc4d809ad20 2026-02-22T23:28:03.929 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.901+0000 7fc4b3fff640 10 monclient(hunting): _negotiate 2026-02-22T23:28:03.929 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.901+0000 7fc4b3fff640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:28:03.929 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.901+0000 7fc4b3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:28:03.929 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.901+0000 7fc4b3fff640 10 monclient(hunting): my global_id is 4563 2026-02-22T23:28:03.929 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.901+0000 7fc4b3fff640 1 -- 10.20.193.45:0/2678507239 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc4d80908b0 con 0x7fc4d809ad20 2026-02-22T23:28:03.930 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.901+0000 7fc4b3fff640 1 -- 10.20.193.45:0/2678507239 <== mon.0 v1:10.20.193.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3551133366 0 0) 0x7fc4d80908b0 con 0x7fc4d809ad20 2026-02-22T23:28:03.930 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.901+0000 7fc4b3fff640 1 -- 10.20.193.45:0/2678507239 --> v1:10.20.193.45:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc4d809b100 con 0x7fc4d809ad20 2026-02-22T23:28:03.930 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.901+0000 7fc4b3fff640 1 -- 10.20.193.45:0/2678507239 <== mon.0 v1:10.20.193.45:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7fc4c4005970 con 0x7fc4d809ad20 2026-02-22T23:28:03.930 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.901+0000 7fc4b3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:28:03.930 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.901+0000 7fc4b3fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T23:28:03.930 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.901+0000 7fc4b3fff640 10 monclient: dump: 2026-02-22T23:28:03.930 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:28:03.930 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:28:03.930 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:03.930 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:03.930 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:28:03.930 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:28:03.930 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:28:03.930 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:28:03.930 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:28:03.930 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:28:03.930 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:28:03.930 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:28:03.930 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:28:03.930 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:28:03.930 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:28:03.930 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:03.930 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.901+0000 7fc4b3fff640 1 -- 10.20.193.45:0/2678507239 <== mon.0 v1:10.20.193.45:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3853120417 0 0) 0x7fc4d809b100 con 0x7fc4d809ad20 2026-02-22T23:28:03.930 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.901+0000 7fc4b3fff640 1 -- 10.20.193.45:0/2678507239 --> v1:10.20.193.45:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fc4d80a74f0 con 0x7fc4d809ad20 2026-02-22T23:28:03.930 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.901+0000 7fc4b3fff640 1 -- 10.20.193.45:0/2678507239 <== mon.0 v1:10.20.193.45:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7528 (unknown 0 0 3086805937) 0x7fc4c4006e20 con 0x7fc4d809ad20 2026-02-22T23:28:03.930 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.901+0000 7fc4b3fff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-22T23:28:03.930 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.901+0000 7fc4b3fff640 10 monclient: _finish_command 2 = system:0 2026-02-22T23:28:03.930 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.901+0000 7fc4b3fff640 1 -- 10.20.193.45:0/2678507239 >> v1:10.20.193.45:6789/0 conn(0x7fc4d809ad20 legacy=0x7fc4d8095f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:03.930 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.901+0000 7fc4b3fff640 1 -- 10.20.193.45:0/2678507239 >> v1:10.20.193.45:6789/0 conn(0x7fc4d809ad20 legacy=0x7fc4d8095f60 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T23:28:03.930 INFO:teuthology.orchestra.run.trial045.stdout:{ 2026-02-22T23:28:03.931 INFO:teuthology.orchestra.run.trial045.stdout: "name": "a", 2026-02-22T23:28:03.931 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 0, 2026-02-22T23:28:03.931 INFO:teuthology.orchestra.run.trial045.stdout: "state": "peon", 2026-02-22T23:28:03.931 INFO:teuthology.orchestra.run.trial045.stdout: "election_epoch": 28, 2026-02-22T23:28:03.931 INFO:teuthology.orchestra.run.trial045.stdout: "uptime": 164058, 2026-02-22T23:28:03.931 INFO:teuthology.orchestra.run.trial045.stdout: "quorum": [ 2026-02-22T23:28:03.931 INFO:teuthology.orchestra.run.trial045.stdout: 0, 2026-02-22T23:28:03.931 INFO:teuthology.orchestra.run.trial045.stdout: 1, 2026-02-22T23:28:03.931 INFO:teuthology.orchestra.run.trial045.stdout: 2, 2026-02-22T23:28:03.931 INFO:teuthology.orchestra.run.trial045.stdout: 3, 2026-02-22T23:28:03.931 INFO:teuthology.orchestra.run.trial045.stdout: 4, 2026-02-22T23:28:03.931 INFO:teuthology.orchestra.run.trial045.stdout: 5, 2026-02-22T23:28:03.931 INFO:teuthology.orchestra.run.trial045.stdout: 6, 2026-02-22T23:28:03.931 INFO:teuthology.orchestra.run.trial045.stdout: 7, 2026-02-22T23:28:03.931 INFO:teuthology.orchestra.run.trial045.stdout: 8 2026-02-22T23:28:03.931 INFO:teuthology.orchestra.run.trial045.stdout: ], 2026-02-22T23:28:03.931 INFO:teuthology.orchestra.run.trial045.stdout: "quorum_age": 0, 2026-02-22T23:28:03.931 INFO:teuthology.orchestra.run.trial045.stdout: "features": { 2026-02-22T23:28:03.931 INFO:teuthology.orchestra.run.trial045.stdout: "required_con": "2450521708007866372", 2026-02-22T23:28:03.931 INFO:teuthology.orchestra.run.trial045.stdout: "required_mon": [ 2026-02-22T23:28:03.931 INFO:teuthology.orchestra.run.trial045.stdout: "kraken", 2026-02-22T23:28:03.931 INFO:teuthology.orchestra.run.trial045.stdout: "luminous", 2026-02-22T23:28:03.931 INFO:teuthology.orchestra.run.trial045.stdout: "mimic", 2026-02-22T23:28:03.931 INFO:teuthology.orchestra.run.trial045.stdout: "osdmap-prune", 2026-02-22T23:28:03.931 INFO:teuthology.orchestra.run.trial045.stdout: "nautilus", 2026-02-22T23:28:03.931 INFO:teuthology.orchestra.run.trial045.stdout: "octopus", 2026-02-22T23:28:03.931 INFO:teuthology.orchestra.run.trial045.stdout: "pacific", 2026-02-22T23:28:03.931 INFO:teuthology.orchestra.run.trial045.stdout: "elector-pinging", 2026-02-22T23:28:03.931 INFO:teuthology.orchestra.run.trial045.stdout: "quincy", 2026-02-22T23:28:03.931 INFO:teuthology.orchestra.run.trial045.stdout: "reef", 2026-02-22T23:28:03.931 INFO:teuthology.orchestra.run.trial045.stdout: "squid" 2026-02-22T23:28:03.931 INFO:teuthology.orchestra.run.trial045.stdout: ], 2026-02-22T23:28:03.932 INFO:teuthology.orchestra.run.trial045.stdout: "quorum_con": "4540701547738038271", 2026-02-22T23:28:03.932 INFO:teuthology.orchestra.run.trial045.stdout: "quorum_mon": [ 2026-02-22T23:28:03.932 INFO:teuthology.orchestra.run.trial045.stdout: "kraken", 2026-02-22T23:28:03.932 INFO:teuthology.orchestra.run.trial045.stdout: "luminous", 2026-02-22T23:28:03.932 INFO:teuthology.orchestra.run.trial045.stdout: "mimic", 2026-02-22T23:28:03.932 INFO:teuthology.orchestra.run.trial045.stdout: "osdmap-prune", 2026-02-22T23:28:03.932 INFO:teuthology.orchestra.run.trial045.stdout: "nautilus", 2026-02-22T23:28:03.932 INFO:teuthology.orchestra.run.trial045.stdout: "octopus", 2026-02-22T23:28:03.932 INFO:teuthology.orchestra.run.trial045.stdout: "pacific", 2026-02-22T23:28:03.932 INFO:teuthology.orchestra.run.trial045.stdout: "elector-pinging", 2026-02-22T23:28:03.932 INFO:teuthology.orchestra.run.trial045.stdout: "quincy", 2026-02-22T23:28:03.932 INFO:teuthology.orchestra.run.trial045.stdout: "reef", 2026-02-22T23:28:03.932 INFO:teuthology.orchestra.run.trial045.stdout: "squid" 2026-02-22T23:28:03.932 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:28:03.932 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:28:03.932 INFO:teuthology.orchestra.run.trial045.stdout: "outside_quorum": [], 2026-02-22T23:28:03.932 INFO:teuthology.orchestra.run.trial045.stdout: "extra_probe_peers": [], 2026-02-22T23:28:03.932 INFO:teuthology.orchestra.run.trial045.stdout: "sync_provider": [], 2026-02-22T23:28:03.932 INFO:teuthology.orchestra.run.trial045.stdout: "monmap": { 2026-02-22T23:28:03.932 INFO:teuthology.orchestra.run.trial045.stdout: "epoch": 1, 2026-02-22T23:28:03.932 INFO:teuthology.orchestra.run.trial045.stdout: "fsid": "4b60f18f-6660-4731-b731-dc85c4078413", 2026-02-22T23:28:03.932 INFO:teuthology.orchestra.run.trial045.stdout: "modified": "2026-02-22T23:24:52.393472Z", 2026-02-22T23:28:03.932 INFO:teuthology.orchestra.run.trial045.stdout: "created": "2026-02-22T23:24:52.393472Z", 2026-02-22T23:28:03.932 INFO:teuthology.orchestra.run.trial045.stdout: "min_mon_release": 19, 2026-02-22T23:28:03.932 INFO:teuthology.orchestra.run.trial045.stdout: "min_mon_release_name": "squid", 2026-02-22T23:28:03.932 INFO:teuthology.orchestra.run.trial045.stdout: "election_strategy": 3, 2026-02-22T23:28:03.932 INFO:teuthology.orchestra.run.trial045.stdout: "disallowed_leaders": "", 2026-02-22T23:28:03.932 INFO:teuthology.orchestra.run.trial045.stdout: "stretch_mode": false, 2026-02-22T23:28:03.932 INFO:teuthology.orchestra.run.trial045.stdout: "tiebreaker_mon": "", 2026-02-22T23:28:03.932 INFO:teuthology.orchestra.run.trial045.stdout: "removed_ranks": "", 2026-02-22T23:28:03.932 INFO:teuthology.orchestra.run.trial045.stdout: "features": { 2026-02-22T23:28:03.932 INFO:teuthology.orchestra.run.trial045.stdout: "persistent": [ 2026-02-22T23:28:03.932 INFO:teuthology.orchestra.run.trial045.stdout: "kraken", 2026-02-22T23:28:03.932 INFO:teuthology.orchestra.run.trial045.stdout: "luminous", 2026-02-22T23:28:03.932 INFO:teuthology.orchestra.run.trial045.stdout: "mimic", 2026-02-22T23:28:03.933 INFO:teuthology.orchestra.run.trial045.stdout: "osdmap-prune", 2026-02-22T23:28:03.933 INFO:teuthology.orchestra.run.trial045.stdout: "nautilus", 2026-02-22T23:28:03.933 INFO:teuthology.orchestra.run.trial045.stdout: "octopus", 2026-02-22T23:28:03.933 INFO:teuthology.orchestra.run.trial045.stdout: "pacific", 2026-02-22T23:28:03.933 INFO:teuthology.orchestra.run.trial045.stdout: "elector-pinging", 2026-02-22T23:28:03.933 INFO:teuthology.orchestra.run.trial045.stdout: "quincy", 2026-02-22T23:28:03.933 INFO:teuthology.orchestra.run.trial045.stdout: "reef", 2026-02-22T23:28:03.933 INFO:teuthology.orchestra.run.trial045.stdout: "squid" 2026-02-22T23:28:03.933 INFO:teuthology.orchestra.run.trial045.stdout: ], 2026-02-22T23:28:03.933 INFO:teuthology.orchestra.run.trial045.stdout: "optional": [] 2026-02-22T23:28:03.933 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:28:03.933 INFO:teuthology.orchestra.run.trial045.stdout: "mons": [ 2026-02-22T23:28:03.933 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:28:03.933 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 0, 2026-02-22T23:28:03.933 INFO:teuthology.orchestra.run.trial045.stdout: "name": "a", 2026-02-22T23:28:03.933 INFO:teuthology.orchestra.run.trial045.stdout: "public_addrs": { 2026-02-22T23:28:03.933 INFO:teuthology.orchestra.run.trial045.stdout: "addrvec": [ 2026-02-22T23:28:03.933 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:28:03.933 INFO:teuthology.orchestra.run.trial045.stdout: "type": "v1", 2026-02-22T23:28:03.933 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6789", 2026-02-22T23:28:03.933 INFO:teuthology.orchestra.run.trial045.stdout: "nonce": 0 2026-02-22T23:28:03.933 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:28:03.933 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:28:03.933 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:28:03.933 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6789/0", 2026-02-22T23:28:03.933 INFO:teuthology.orchestra.run.trial045.stdout: "public_addr": "10.20.193.45:6789/0", 2026-02-22T23:28:03.933 INFO:teuthology.orchestra.run.trial045.stdout: "priority": 0, 2026-02-22T23:28:03.933 INFO:teuthology.orchestra.run.trial045.stdout: "weight": 0, 2026-02-22T23:28:03.933 INFO:teuthology.orchestra.run.trial045.stdout: "crush_location": "{}" 2026-02-22T23:28:03.933 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:28:03.933 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:28:03.933 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 1, 2026-02-22T23:28:03.933 INFO:teuthology.orchestra.run.trial045.stdout: "name": "f", 2026-02-22T23:28:03.934 INFO:teuthology.orchestra.run.trial045.stdout: "public_addrs": { 2026-02-22T23:28:03.934 INFO:teuthology.orchestra.run.trial045.stdout: "addrvec": [ 2026-02-22T23:28:03.934 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:28:03.934 INFO:teuthology.orchestra.run.trial045.stdout: "type": "v1", 2026-02-22T23:28:03.934 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.73:6789", 2026-02-22T23:28:03.934 INFO:teuthology.orchestra.run.trial045.stdout: "nonce": 0 2026-02-22T23:28:03.934 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:28:03.934 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:28:03.934 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:28:03.934 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.73:6789/0", 2026-02-22T23:28:03.934 INFO:teuthology.orchestra.run.trial045.stdout: "public_addr": "10.20.193.73:6789/0", 2026-02-22T23:28:03.934 INFO:teuthology.orchestra.run.trial045.stdout: "priority": 0, 2026-02-22T23:28:03.934 INFO:teuthology.orchestra.run.trial045.stdout: "weight": 0, 2026-02-22T23:28:03.934 INFO:teuthology.orchestra.run.trial045.stdout: "crush_location": "{}" 2026-02-22T23:28:03.934 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:28:03.934 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:28:03.934 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 2, 2026-02-22T23:28:03.934 INFO:teuthology.orchestra.run.trial045.stdout: "name": "b", 2026-02-22T23:28:03.934 INFO:teuthology.orchestra.run.trial045.stdout: "public_addrs": { 2026-02-22T23:28:03.934 INFO:teuthology.orchestra.run.trial045.stdout: "addrvec": [ 2026-02-22T23:28:03.934 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:28:03.934 INFO:teuthology.orchestra.run.trial045.stdout: "type": "v1", 2026-02-22T23:28:03.934 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6790", 2026-02-22T23:28:03.934 INFO:teuthology.orchestra.run.trial045.stdout: "nonce": 0 2026-02-22T23:28:03.934 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:28:03.934 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:28:03.934 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:28:03.934 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6790/0", 2026-02-22T23:28:03.934 INFO:teuthology.orchestra.run.trial045.stdout: "public_addr": "10.20.193.45:6790/0", 2026-02-22T23:28:03.934 INFO:teuthology.orchestra.run.trial045.stdout: "priority": 0, 2026-02-22T23:28:03.934 INFO:teuthology.orchestra.run.trial045.stdout: "weight": 0, 2026-02-22T23:28:03.934 INFO:teuthology.orchestra.run.trial045.stdout: "crush_location": "{}" 2026-02-22T23:28:03.934 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:28:03.934 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:28:03.934 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 3, 2026-02-22T23:28:03.935 INFO:teuthology.orchestra.run.trial045.stdout: "name": "g", 2026-02-22T23:28:03.935 INFO:teuthology.orchestra.run.trial045.stdout: "public_addrs": { 2026-02-22T23:28:03.935 INFO:teuthology.orchestra.run.trial045.stdout: "addrvec": [ 2026-02-22T23:28:03.935 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:28:03.935 INFO:teuthology.orchestra.run.trial045.stdout: "type": "v1", 2026-02-22T23:28:03.935 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.73:6790", 2026-02-22T23:28:03.935 INFO:teuthology.orchestra.run.trial045.stdout: "nonce": 0 2026-02-22T23:28:03.935 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:28:03.935 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:28:03.935 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:28:03.935 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.73:6790/0", 2026-02-22T23:28:03.935 INFO:teuthology.orchestra.run.trial045.stdout: "public_addr": "10.20.193.73:6790/0", 2026-02-22T23:28:03.935 INFO:teuthology.orchestra.run.trial045.stdout: "priority": 0, 2026-02-22T23:28:03.935 INFO:teuthology.orchestra.run.trial045.stdout: "weight": 0, 2026-02-22T23:28:03.935 INFO:teuthology.orchestra.run.trial045.stdout: "crush_location": "{}" 2026-02-22T23:28:03.935 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:28:03.935 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:28:03.935 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 4, 2026-02-22T23:28:03.935 INFO:teuthology.orchestra.run.trial045.stdout: "name": "c", 2026-02-22T23:28:03.935 INFO:teuthology.orchestra.run.trial045.stdout: "public_addrs": { 2026-02-22T23:28:03.935 INFO:teuthology.orchestra.run.trial045.stdout: "addrvec": [ 2026-02-22T23:28:03.935 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:28:03.935 INFO:teuthology.orchestra.run.trial045.stdout: "type": "v1", 2026-02-22T23:28:03.935 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6791", 2026-02-22T23:28:03.935 INFO:teuthology.orchestra.run.trial045.stdout: "nonce": 0 2026-02-22T23:28:03.935 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:28:03.935 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:28:03.935 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:28:03.935 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6791/0", 2026-02-22T23:28:03.935 INFO:teuthology.orchestra.run.trial045.stdout: "public_addr": "10.20.193.45:6791/0", 2026-02-22T23:28:03.935 INFO:teuthology.orchestra.run.trial045.stdout: "priority": 0, 2026-02-22T23:28:03.935 INFO:teuthology.orchestra.run.trial045.stdout: "weight": 0, 2026-02-22T23:28:03.935 INFO:teuthology.orchestra.run.trial045.stdout: "crush_location": "{}" 2026-02-22T23:28:03.935 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:28:03.935 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:28:03.935 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 5, 2026-02-22T23:28:03.936 INFO:teuthology.orchestra.run.trial045.stdout: "name": "h", 2026-02-22T23:28:03.936 INFO:teuthology.orchestra.run.trial045.stdout: "public_addrs": { 2026-02-22T23:28:03.936 INFO:teuthology.orchestra.run.trial045.stdout: "addrvec": [ 2026-02-22T23:28:03.936 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:28:03.936 INFO:teuthology.orchestra.run.trial045.stdout: "type": "v1", 2026-02-22T23:28:03.936 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.73:6791", 2026-02-22T23:28:03.936 INFO:teuthology.orchestra.run.trial045.stdout: "nonce": 0 2026-02-22T23:28:03.936 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:28:03.936 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:28:03.936 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:28:03.936 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.73:6791/0", 2026-02-22T23:28:03.936 INFO:teuthology.orchestra.run.trial045.stdout: "public_addr": "10.20.193.73:6791/0", 2026-02-22T23:28:03.936 INFO:teuthology.orchestra.run.trial045.stdout: "priority": 0, 2026-02-22T23:28:03.936 INFO:teuthology.orchestra.run.trial045.stdout: "weight": 0, 2026-02-22T23:28:03.936 INFO:teuthology.orchestra.run.trial045.stdout: "crush_location": "{}" 2026-02-22T23:28:03.936 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:28:03.936 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:28:03.936 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 6, 2026-02-22T23:28:03.936 INFO:teuthology.orchestra.run.trial045.stdout: "name": "d", 2026-02-22T23:28:03.936 INFO:teuthology.orchestra.run.trial045.stdout: "public_addrs": { 2026-02-22T23:28:03.936 INFO:teuthology.orchestra.run.trial045.stdout: "addrvec": [ 2026-02-22T23:28:03.936 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:28:03.936 INFO:teuthology.orchestra.run.trial045.stdout: "type": "v1", 2026-02-22T23:28:03.936 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6792", 2026-02-22T23:28:03.936 INFO:teuthology.orchestra.run.trial045.stdout: "nonce": 0 2026-02-22T23:28:03.936 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:28:03.936 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:28:03.936 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:28:03.936 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6792/0", 2026-02-22T23:28:03.936 INFO:teuthology.orchestra.run.trial045.stdout: "public_addr": "10.20.193.45:6792/0", 2026-02-22T23:28:03.936 INFO:teuthology.orchestra.run.trial045.stdout: "priority": 0, 2026-02-22T23:28:03.936 INFO:teuthology.orchestra.run.trial045.stdout: "weight": 0, 2026-02-22T23:28:03.936 INFO:teuthology.orchestra.run.trial045.stdout: "crush_location": "{}" 2026-02-22T23:28:03.936 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:28:03.937 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:28:03.937 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 7, 2026-02-22T23:28:03.937 INFO:teuthology.orchestra.run.trial045.stdout: "name": "i", 2026-02-22T23:28:03.937 INFO:teuthology.orchestra.run.trial045.stdout: "public_addrs": { 2026-02-22T23:28:03.937 INFO:teuthology.orchestra.run.trial045.stdout: "addrvec": [ 2026-02-22T23:28:03.937 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:28:03.937 INFO:teuthology.orchestra.run.trial045.stdout: "type": "v1", 2026-02-22T23:28:03.937 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.73:6792", 2026-02-22T23:28:03.937 INFO:teuthology.orchestra.run.trial045.stdout: "nonce": 0 2026-02-22T23:28:03.937 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:28:03.937 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:28:03.937 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:28:03.937 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.73:6792/0", 2026-02-22T23:28:03.937 INFO:teuthology.orchestra.run.trial045.stdout: "public_addr": "10.20.193.73:6792/0", 2026-02-22T23:28:03.937 INFO:teuthology.orchestra.run.trial045.stdout: "priority": 0, 2026-02-22T23:28:03.937 INFO:teuthology.orchestra.run.trial045.stdout: "weight": 0, 2026-02-22T23:28:03.937 INFO:teuthology.orchestra.run.trial045.stdout: "crush_location": "{}" 2026-02-22T23:28:03.937 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:28:03.937 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:28:03.937 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 8, 2026-02-22T23:28:03.937 INFO:teuthology.orchestra.run.trial045.stdout: "name": "e", 2026-02-22T23:28:03.937 INFO:teuthology.orchestra.run.trial045.stdout: "public_addrs": { 2026-02-22T23:28:03.937 INFO:teuthology.orchestra.run.trial045.stdout: "addrvec": [ 2026-02-22T23:28:03.937 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:28:03.937 INFO:teuthology.orchestra.run.trial045.stdout: "type": "v1", 2026-02-22T23:28:03.937 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6793", 2026-02-22T23:28:03.937 INFO:teuthology.orchestra.run.trial045.stdout: "nonce": 0 2026-02-22T23:28:03.937 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:28:03.937 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:28:03.937 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:28:03.937 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6793/0", 2026-02-22T23:28:03.937 INFO:teuthology.orchestra.run.trial045.stdout: "public_addr": "10.20.193.45:6793/0", 2026-02-22T23:28:03.937 INFO:teuthology.orchestra.run.trial045.stdout: "priority": 0, 2026-02-22T23:28:03.937 INFO:teuthology.orchestra.run.trial045.stdout: "weight": 0, 2026-02-22T23:28:03.937 INFO:teuthology.orchestra.run.trial045.stdout: "crush_location": "{}" 2026-02-22T23:28:03.937 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:28:03.937 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:28:03.938 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:28:03.938 INFO:teuthology.orchestra.run.trial045.stdout: "feature_map": { 2026-02-22T23:28:03.938 INFO:teuthology.orchestra.run.trial045.stdout: "mon": [ 2026-02-22T23:28:03.938 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:28:03.938 INFO:teuthology.orchestra.run.trial045.stdout: "features": "0x3f03cffffffdffff", 2026-02-22T23:28:03.938 INFO:teuthology.orchestra.run.trial045.stdout: "release": "squid", 2026-02-22T23:28:03.938 INFO:teuthology.orchestra.run.trial045.stdout: "num": 1 2026-02-22T23:28:03.938 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:28:03.938 INFO:teuthology.orchestra.run.trial045.stdout: ], 2026-02-22T23:28:03.938 INFO:teuthology.orchestra.run.trial045.stdout: "client": [ 2026-02-22T23:28:03.938 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:28:03.938 INFO:teuthology.orchestra.run.trial045.stdout: "features": "0x3f03cffffffdffff", 2026-02-22T23:28:03.938 INFO:teuthology.orchestra.run.trial045.stdout: "release": "squid", 2026-02-22T23:28:03.938 INFO:teuthology.orchestra.run.trial045.stdout: "num": 1 2026-02-22T23:28:03.938 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:28:03.938 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:28:03.938 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:28:03.938 INFO:teuthology.orchestra.run.trial045.stdout: "stretch_mode": false 2026-02-22T23:28:03.938 INFO:teuthology.orchestra.run.trial045.stdout:} 2026-02-22T23:28:03.939 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.901+0000 7fc4dde06640 1 -- 10.20.193.45:0/2678507239 >> v1:10.20.193.73:6800/2222410180 conn(0x7fc4a80402e0 legacy=0x7fc4a80427a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:03.939 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.901+0000 7fc4dde06640 10 monclient: shutdown 2026-02-22T23:28:03.939 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.901+0000 7fc4dde06640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T23:28:03.939 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.901+0000 7fc4dde06640 1 -- 10.20.193.45:0/2678507239 >> v1:10.20.193.45:6792/0 conn(0x7fc4d8138fb0 legacy=0x7fc4d81d4ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:03.939 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.901+0000 7fc4d7fff640 1 -- 10.20.193.45:0/2678507239 reap_dead start 2026-02-22T23:28:03.939 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.902+0000 7fc4d7fff640 1 -- 10.20.193.45:0/2678507239 reap_dead start 2026-02-22T23:28:03.939 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.902+0000 7fc4dde06640 1 -- 10.20.193.45:0/2678507239 shutdown_connections 2026-02-22T23:28:03.939 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.902+0000 7fc4dde06640 1 -- 10.20.193.45:0/2678507239 >> 10.20.193.45:0/2678507239 conn(0x7fc4d80a4320 msgr2=0x7fc4d8094510 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:28:03.939 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.902+0000 7fc4dde06640 1 -- 10.20.193.45:0/2678507239 shutdown_connections 2026-02-22T23:28:03.939 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:03.902+0000 7fc4dde06640 1 -- 10.20.193.45:0/2678507239 wait complete. 2026-02-22T23:28:03.939 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2026-02-22T23:28:03.939 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon b 2026-02-22T23:28:03.939 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-22T23:28:04.012 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.005+0000 7f553da6d640 10 monclient: get_monmap_and_config 2026-02-22T23:28:04.012 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.005+0000 7f553da6d640 10 monclient: build_initial_monmap 2026-02-22T23:28:04.012 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.005+0000 7f553da6d640 10 monclient: monmap: 2026-02-22T23:28:04.012 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-22T23:28:04.012 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:28:04.012 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:28:04.006472+0000 2026-02-22T23:28:04.013 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:28:04.006472+0000 2026-02-22T23:28:04.013 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-22T23:28:04.013 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:28:04.013 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-22T23:28:04.013 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.noname-f 2026-02-22T23:28:04.013 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.noname-b 2026-02-22T23:28:04.013 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.noname-g 2026-02-22T23:28:04.013 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.noname-c 2026-02-22T23:28:04.013 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.noname-h 2026-02-22T23:28:04.013 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.noname-d 2026-02-22T23:28:04.013 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.noname-i 2026-02-22T23:28:04.013 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.noname-e 2026-02-22T23:28:04.013 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:04.013 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.005+0000 7f553da6d640 1 Processor -- start 2026-02-22T23:28:04.013 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.005+0000 7f553da6d640 1 -- start start 2026-02-22T23:28:04.013 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.005+0000 7f553da6d640 10 monclient: init 2026-02-22T23:28:04.014 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.006+0000 7f553da6d640 10 monclient: _reopen_session rank -1 2026-02-22T23:28:04.014 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.006+0000 7f553da6d640 10 monclient: _add_conns ranks=[2,3,5,6,0,8,7,1,4] 2026-02-22T23:28:04.014 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.006+0000 7f553da6d640 10 monclient(hunting): picked mon.noname-b con 0x7f5538138e10 addr v1:10.20.193.45:6790/0 2026-02-22T23:28:04.014 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.006+0000 7f553da6d640 10 monclient(hunting): picked mon.noname-g con 0x7f55380a3630 addr v1:10.20.193.73:6790/0 2026-02-22T23:28:04.014 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.006+0000 7f553da6d640 10 monclient(hunting): picked mon.noname-h con 0x7f553813f310 addr v1:10.20.193.73:6791/0 2026-02-22T23:28:04.014 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.006+0000 7f553da6d640 1 -- --> v1:10.20.193.45:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f55380a3210 con 0x7f5538138e10 2026-02-22T23:28:04.014 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.006+0000 7f553da6d640 1 -- --> v1:10.20.193.73:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f55380a2970 con 0x7f55380a3630 2026-02-22T23:28:04.014 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.006+0000 7f553da6d640 1 -- --> v1:10.20.193.73:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f55380a2260 con 0x7f553813f310 2026-02-22T23:28:04.014 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.006+0000 7f553da6d640 10 monclient(hunting): _renew_subs 2026-02-22T23:28:04.014 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.006+0000 7f553da6d640 10 monclient(hunting): authenticate will time out at 815.623073s 2026-02-22T23:28:04.014 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.006+0000 7f5536ffd640 1 --1- >> v1:10.20.193.45:6790/0 conn(0x7f5538138e10 0x7f55381391f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.45:6790/0 says I am v1:10.20.193.45:60082/0 (socket says 10.20.193.45:60082) 2026-02-22T23:28:04.014 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.006+0000 7f5536ffd640 1 -- 10.20.193.45:0/1216576967 learned_addr learned my addr 10.20.193.45:0/1216576967 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-22T23:28:04.014 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.006+0000 7f5535ffb640 1 -- 10.20.193.45:0/1216576967 <== mon.2 v1:10.20.193.45:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3459132910 0 0) 0x7f55380a3210 con 0x7f5538138e10 2026-02-22T23:28:04.014 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.006+0000 7f5535ffb640 10 monclient(hunting): _negotiate 2026-02-22T23:28:04.014 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.006+0000 7f5535ffb640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:28:04.014 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.006+0000 7f5535ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:28:04.015 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.006+0000 7f5535ffb640 10 monclient(hunting): my global_id is 4655 2026-02-22T23:28:04.015 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.006+0000 7f5535ffb640 1 -- 10.20.193.45:0/1216576967 --> v1:10.20.193.45:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5524003620 con 0x7f5538138e10 2026-02-22T23:28:04.015 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.006+0000 7f5535ffb640 1 -- 10.20.193.45:0/1216576967 <== mon.2 v1:10.20.193.45:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 85201045 0 0) 0x7f5524003620 con 0x7f5538138e10 2026-02-22T23:28:04.015 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.006+0000 7f5535ffb640 1 -- 10.20.193.45:0/1216576967 >> v1:10.20.193.73:6791/0 conn(0x7f553813f310 legacy=0x7f5538141700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T23:28:04.015 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.006+0000 7f5535ffb640 1 -- 10.20.193.45:0/1216576967 >> v1:10.20.193.73:6790/0 conn(0x7f55380a3630 legacy=0x7f553813dbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T23:28:04.015 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.006+0000 7f5535ffb640 10 monclient: _finish_hunting 0 2026-02-22T23:28:04.015 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.006+0000 7f5535ffb640 1 monclient: found mon.noname-b 2026-02-22T23:28:04.015 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.006+0000 7f5535ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T23:28:04.015 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.006+0000 7f5535ffb640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.45:6790/0 2026-02-22T23:28:04.015 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.006+0000 7f5535ffb640 1 -- 10.20.193.45:0/1216576967 --> v1:10.20.193.45:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55380a4510 con 0x7f5538138e10 2026-02-22T23:28:04.015 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.006+0000 7f5535ffb640 10 monclient: _finish_auth 0 2026-02-22T23:28:04.015 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.006+0000 7f5535ffb640 10 monclient: _check_auth_tickets 2026-02-22T23:28:04.015 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.006+0000 7f5535ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T23:28:04.016 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.006+0000 7f5535ffb640 1 -- 10.20.193.45:0/1216576967 <== mon.2 v1:10.20.193.45:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f552c003040 con 0x7f5538138e10 2026-02-22T23:28:04.016 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.006+0000 7f5535ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:28:04.016 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.006+0000 7f5535ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-22T23:28:04.016 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.006+0000 7f5535ffb640 10 monclient: dump: 2026-02-22T23:28:04.016 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:28:04.016 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:28:04.016 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:04.016 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:04.016 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:28:04.016 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:28:04.016 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:28:04.016 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:28:04.016 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:28:04.016 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:28:04.016 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:28:04.017 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:28:04.017 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:28:04.017 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:28:04.017 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:28:04.017 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:04.017 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.006+0000 7f553da6d640 5 monclient: authenticate success, global_id 4655 2026-02-22T23:28:04.017 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.006+0000 7f553da6d640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-22T23:28:04.017 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.006+0000 7f5535ffb640 1 -- 10.20.193.45:0/1216576967 <== mon.2 v1:10.20.193.45:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f552c0032e0 con 0x7f5538138e10 2026-02-22T23:28:04.017 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.006+0000 7f5535ffb640 10 monclient: handle_config config(0 keys) 2026-02-22T23:28:04.017 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.006+0000 7f5535ffb640 1 -- 10.20.193.45:0/1216576967 <== mon.2 v1:10.20.193.45:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f552c004ce0 con 0x7f5538138e10 2026-02-22T23:28:04.017 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.006+0000 7f553da6d640 10 monclient: get_monmap_and_config success 2026-02-22T23:28:04.017 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.006+0000 7f553da6d640 4 set_mon_vals no callback set 2026-02-22T23:28:04.017 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.006+0000 7f5535ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:28:04.017 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.006+0000 7f5535ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-22T23:28:04.017 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.006+0000 7f5535ffb640 10 monclient: dump: 2026-02-22T23:28:04.018 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:28:04.018 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:28:04.018 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:04.018 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:04.018 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:28:04.018 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:28:04.018 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:28:04.018 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:28:04.018 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:28:04.018 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:28:04.018 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:28:04.018 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:28:04.018 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:28:04.018 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:28:04.018 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:28:04.018 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:04.018 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.006+0000 7f553da6d640 10 monclient: shutdown 2026-02-22T23:28:04.018 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.006+0000 7f553da6d640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T23:28:04.019 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.006+0000 7f553da6d640 1 -- 10.20.193.45:0/1216576967 >> v1:10.20.193.45:6790/0 conn(0x7f5538138e10 legacy=0x7f55381391f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:04.019 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.006+0000 7f553da6d640 1 -- 10.20.193.45:0/1216576967 shutdown_connections 2026-02-22T23:28:04.019 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.006+0000 7f553da6d640 1 -- 10.20.193.45:0/1216576967 >> 10.20.193.45:0/1216576967 conn(0x7f55380a7780 msgr2=0x7f55380a3b60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:28:04.019 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.006+0000 7f553da6d640 1 -- 10.20.193.45:0/1216576967 shutdown_connections 2026-02-22T23:28:04.019 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.006+0000 7f553da6d640 1 -- 10.20.193.45:0/1216576967 wait complete. 2026-02-22T23:28:04.019 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.007+0000 7f553da6d640 10 monclient: build_initial_monmap 2026-02-22T23:28:04.019 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.007+0000 7f553da6d640 10 monclient: monmap: 2026-02-22T23:28:04.019 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-22T23:28:04.019 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T23:28:04.019 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-22T23:28:04.019 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-22T23:28:04.019 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-22T23:28:04.019 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-22T23:28:04.019 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-22T23:28:04.019 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.noname-f 2026-02-22T23:28:04.019 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.noname-b 2026-02-22T23:28:04.020 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.noname-g 2026-02-22T23:28:04.020 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.noname-c 2026-02-22T23:28:04.020 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.noname-h 2026-02-22T23:28:04.020 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.noname-d 2026-02-22T23:28:04.020 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.noname-i 2026-02-22T23:28:04.020 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.noname-e 2026-02-22T23:28:04.020 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:04.020 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.007+0000 7f553da6d640 1 Processor -- start 2026-02-22T23:28:04.020 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.007+0000 7f553da6d640 1 -- start start 2026-02-22T23:28:04.020 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.007+0000 7f553da6d640 10 monclient: init 2026-02-22T23:28:04.020 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.007+0000 7f553da6d640 10 monclient: _reopen_session rank -1 2026-02-22T23:28:04.020 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.007+0000 7f553da6d640 10 monclient: _add_conns ranks=[0,5,7,1,6,4,3,2,8] 2026-02-22T23:28:04.020 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.007+0000 7f553da6d640 10 monclient(hunting): picked mon.noname-a con 0x7f55380a3630 addr v1:10.20.193.45:6789/0 2026-02-22T23:28:04.020 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.007+0000 7f553da6d640 10 monclient(hunting): picked mon.noname-h con 0x7f5538138e10 addr v1:10.20.193.73:6791/0 2026-02-22T23:28:04.020 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.007+0000 7f553da6d640 10 monclient(hunting): picked mon.noname-i con 0x7f553813f310 addr v1:10.20.193.73:6792/0 2026-02-22T23:28:04.020 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.007+0000 7f553da6d640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f553809fbb0 con 0x7f55380a3630 2026-02-22T23:28:04.020 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.007+0000 7f553da6d640 1 -- --> v1:10.20.193.73:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f553813eda0 con 0x7f5538138e10 2026-02-22T23:28:04.021 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.007+0000 7f553da6d640 1 -- --> v1:10.20.193.73:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5538134b50 con 0x7f553813f310 2026-02-22T23:28:04.021 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.007+0000 7f553da6d640 10 monclient(hunting): _renew_subs 2026-02-22T23:28:04.021 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.007+0000 7f553da6d640 10 monclient(hunting): authenticate will time out at 815.624943s 2026-02-22T23:28:04.021 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.007+0000 7f5536ffd640 1 --1- >> v1:10.20.193.45:6789/0 conn(0x7f55380a3630 0x7f553813ce00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.45:6789/0 says I am v1:10.20.193.45:38374/0 (socket says 10.20.193.45:38374) 2026-02-22T23:28:04.021 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.007+0000 7f5536ffd640 1 -- 10.20.193.45:0/3900597386 learned_addr learned my addr 10.20.193.45:0/3900597386 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-22T23:28:04.021 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.008+0000 7f550ffff640 1 -- 10.20.193.45:0/3900597386 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2335580938 0 0) 0x7f553809fbb0 con 0x7f55380a3630 2026-02-22T23:28:04.021 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.008+0000 7f550ffff640 10 monclient(hunting): _negotiate 2026-02-22T23:28:04.021 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.008+0000 7f550ffff640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:28:04.021 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.008+0000 7f550ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:28:04.021 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.008+0000 7f550ffff640 10 monclient(hunting): my global_id is 4572 2026-02-22T23:28:04.021 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.008+0000 7f550ffff640 1 -- 10.20.193.45:0/3900597386 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5508003620 con 0x7f55380a3630 2026-02-22T23:28:04.021 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.008+0000 7f550ffff640 1 -- 10.20.193.45:0/3900597386 <== mon.0 v1:10.20.193.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2085219402 0 0) 0x7f5508003620 con 0x7f55380a3630 2026-02-22T23:28:04.021 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.008+0000 7f550ffff640 1 -- 10.20.193.45:0/3900597386 --> v1:10.20.193.45:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f553809fbb0 con 0x7f55380a3630 2026-02-22T23:28:04.021 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.008+0000 7f550ffff640 1 -- 10.20.193.45:0/3900597386 <== mon.0 v1:10.20.193.45:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f552c004c20 con 0x7f55380a3630 2026-02-22T23:28:04.021 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.008+0000 7f550ffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-22T23:28:04.021 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.008+0000 7f550ffff640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T23:28:04.021 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.008+0000 7f550ffff640 10 monclient(hunting): dump: 2026-02-22T23:28:04.022 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:28:04.022 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:28:04.022 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:04.022 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:04.022 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:28:04.022 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:28:04.022 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:28:04.022 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:28:04.022 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:28:04.022 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:28:04.022 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:28:04.022 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:28:04.022 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:28:04.022 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:28:04.022 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:28:04.022 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:04.022 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.008+0000 7f550ffff640 10 monclient(hunting): _finish_auth 0 2026-02-22T23:28:04.022 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.008+0000 7f550ffff640 1 -- 10.20.193.45:0/3900597386 <== mon.0 v1:10.20.193.45:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 171409280 0 0) 0x7f553809fbb0 con 0x7f55380a3630 2026-02-22T23:28:04.023 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.008+0000 7f550ffff640 1 -- 10.20.193.45:0/3900597386 >> v1:10.20.193.73:6792/0 conn(0x7f553813f310 legacy=0x7f55381d7e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:04.023 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.008+0000 7f550ffff640 1 -- 10.20.193.45:0/3900597386 >> v1:10.20.193.73:6791/0 conn(0x7f5538138e10 legacy=0x7f553813d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:04.023 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.008+0000 7f550ffff640 10 monclient: _finish_hunting 0 2026-02-22T23:28:04.023 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.008+0000 7f550ffff640 1 monclient: found mon.a 2026-02-22T23:28:04.023 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.008+0000 7f550ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T23:28:04.023 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.008+0000 7f550ffff640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-22T23:28:04.023 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.008+0000 7f550ffff640 1 -- 10.20.193.45:0/3900597386 --> v1:10.20.193.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5538133110 con 0x7f55380a3630 2026-02-22T23:28:04.023 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.008+0000 7f550ffff640 10 monclient: _finish_auth 0 2026-02-22T23:28:04.023 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.008+0000 7f550ffff640 10 monclient: _check_auth_tickets 2026-02-22T23:28:04.023 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.008+0000 7f550ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T23:28:04.023 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.008+0000 7f553da6d640 5 monclient: authenticate success, global_id 4572 2026-02-22T23:28:04.023 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.008+0000 7f553da6d640 10 monclient: _renew_subs 2026-02-22T23:28:04.023 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.008+0000 7f553da6d640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-22T23:28:04.023 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.008+0000 7f553da6d640 1 -- 10.20.193.45:0/3900597386 --> v1:10.20.193.45:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f553813e7e0 con 0x7f55380a3630 2026-02-22T23:28:04.023 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.008+0000 7f553da6d640 10 monclient: _renew_subs 2026-02-22T23:28:04.023 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.008+0000 7f553da6d640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-22T23:28:04.023 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.008+0000 7f553da6d640 1 -- 10.20.193.45:0/3900597386 --> v1:10.20.193.45:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f553813dc20 con 0x7f55380a3630 2026-02-22T23:28:04.023 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.008+0000 7f550ffff640 1 -- 10.20.193.45:0/3900597386 <== mon.0 v1:10.20.193.45:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f552c0034d0 con 0x7f55380a3630 2026-02-22T23:28:04.024 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.008+0000 7f550ffff640 10 monclient: handle_config config(0 keys) 2026-02-22T23:28:04.024 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.008+0000 7f550ffff640 1 -- 10.20.193.45:0/3900597386 <== mon.0 v1:10.20.193.45:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f552c005590 con 0x7f55380a3630 2026-02-22T23:28:04.024 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.008+0000 7f550ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:28:04.024 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.008+0000 7f55357fa640 4 set_mon_vals no callback set 2026-02-22T23:28:04.024 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.008+0000 7f550ffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T23:28:04.024 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.008+0000 7f550ffff640 10 monclient: dump: 2026-02-22T23:28:04.024 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:28:04.024 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:28:04.024 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:04.024 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:04.024 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:28:04.024 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:28:04.024 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:28:04.024 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:28:04.024 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:28:04.024 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:28:04.024 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:28:04.025 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:28:04.025 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:28:04.025 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:28:04.025 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:28:04.025 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:04.025 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.008+0000 7f553da6d640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T23:28:04.025 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.008+0000 7f553da6d640 1 -- 10.20.193.45:0/3900597386 --> v1:10.20.193.45:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f55380a24a0 con 0x7f55380630c0 2026-02-22T23:28:04.025 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.008+0000 7f550ffff640 1 -- 10.20.193.45:0/3900597386 <== mon.2 v1:10.20.193.45:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1344571930 0 0) 0x7f55380a24a0 con 0x7f55380630c0 2026-02-22T23:28:04.025 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.008+0000 7f550ffff640 10 monclient(hunting): _negotiate 2026-02-22T23:28:04.025 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.008+0000 7f550ffff640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:28:04.025 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.008+0000 7f550ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:28:04.025 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.008+0000 7f550ffff640 10 monclient(hunting): my global_id is 4664 2026-02-22T23:28:04.025 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.008+0000 7f550ffff640 1 -- 10.20.193.45:0/3900597386 --> v1:10.20.193.45:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f553809fbb0 con 0x7f55380630c0 2026-02-22T23:28:04.025 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.008+0000 7f550ffff640 1 -- 10.20.193.45:0/3900597386 <== mon.0 v1:10.20.193.45:6789/0 7 ==== mgrmap(e 5) ==== 50225+0+0 (unknown 2330357642 0 0) 0x7f552c005730 con 0x7f55380a3630 2026-02-22T23:28:04.026 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.009+0000 7f550ffff640 1 -- 10.20.193.45:0/3900597386 <== mon.0 v1:10.20.193.45:6789/0 8 ==== osd_map(25..25 src has 1..25) ==== 3502+0+0 (unknown 129690100 0 0) 0x7f552c04df20 con 0x7f55380a3630 2026-02-22T23:28:04.026 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.009+0000 7f550ffff640 1 -- 10.20.193.45:0/3900597386 <== mon.2 v1:10.20.193.45:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1807642768 0 0) 0x7f553809fbb0 con 0x7f55380630c0 2026-02-22T23:28:04.026 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.009+0000 7f550ffff640 1 -- 10.20.193.45:0/3900597386 --> v1:10.20.193.45:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f55380a24a0 con 0x7f55380630c0 2026-02-22T23:28:04.026 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.009+0000 7f550ffff640 1 -- 10.20.193.45:0/3900597386 <== mon.2 v1:10.20.193.45:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f5520002e20 con 0x7f55380630c0 2026-02-22T23:28:04.026 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.009+0000 7f550ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:28:04.026 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.009+0000 7f550ffff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-22T23:28:04.026 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.009+0000 7f550ffff640 10 monclient: dump: 2026-02-22T23:28:04.026 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:28:04.026 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:28:04.026 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:04.026 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:04.026 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:28:04.026 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:28:04.026 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:28:04.026 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:28:04.026 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:28:04.026 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:28:04.027 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:28:04.027 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:28:04.027 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:28:04.027 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:28:04.027 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:28:04.027 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:04.027 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.009+0000 7f55377fe640 10 monclient: get_auth_request con 0x7f550803f840 auth_method 0 2026-02-22T23:28:04.027 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.009+0000 7f550ffff640 1 -- 10.20.193.45:0/3900597386 <== mon.2 v1:10.20.193.45:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1268807006 0 0) 0x7f55380a24a0 con 0x7f55380630c0 2026-02-22T23:28:04.027 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.009+0000 7f550ffff640 1 -- 10.20.193.45:0/3900597386 --> v1:10.20.193.45:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f553813dfb0 con 0x7f55380630c0 2026-02-22T23:28:04.027 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.009+0000 7f550ffff640 1 -- 10.20.193.45:0/3900597386 <== mon.2 v1:10.20.193.45:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (unknown 0 0 2024835662) 0x7f55200030f0 con 0x7f55380630c0 2026-02-22T23:28:04.027 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.009+0000 7f550ffff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T23:28:04.027 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.009+0000 7f550ffff640 10 monclient: _finish_command 1 = system:0 2026-02-22T23:28:04.027 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.009+0000 7f550ffff640 1 -- 10.20.193.45:0/3900597386 >> v1:10.20.193.45:6790/0 conn(0x7f55380630c0 legacy=0x7f55380634a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:04.027 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.009+0000 7f550ffff640 1 -- 10.20.193.45:0/3900597386 >> v1:10.20.193.45:6790/0 conn(0x7f55380630c0 legacy=0x7f55380634a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T23:28:04.029 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.012+0000 7f553da6d640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-22T23:28:04.029 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.012+0000 7f553da6d640 1 -- 10.20.193.45:0/3900597386 --> v1:10.20.193.45:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f5538134470 con 0x7f5538063bb0 2026-02-22T23:28:04.029 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.012+0000 7f550ffff640 1 -- 10.20.193.45:0/3900597386 <== mon.2 v1:10.20.193.45:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 936725863 0 0) 0x7f5538134470 con 0x7f5538063bb0 2026-02-22T23:28:04.029 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.012+0000 7f550ffff640 10 monclient(hunting): _negotiate 2026-02-22T23:28:04.029 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.012+0000 7f550ffff640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:28:04.029 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.012+0000 7f550ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:28:04.029 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.012+0000 7f550ffff640 10 monclient(hunting): my global_id is 4673 2026-02-22T23:28:04.029 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.012+0000 7f550ffff640 1 -- 10.20.193.45:0/3900597386 --> v1:10.20.193.45:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f55380a24a0 con 0x7f5538063bb0 2026-02-22T23:28:04.029 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.012+0000 7f550ffff640 1 -- 10.20.193.45:0/3900597386 <== mon.2 v1:10.20.193.45:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3693033895 0 0) 0x7f55380a24a0 con 0x7f5538063bb0 2026-02-22T23:28:04.029 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.012+0000 7f550ffff640 1 -- 10.20.193.45:0/3900597386 --> v1:10.20.193.45:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5538134470 con 0x7f5538063bb0 2026-02-22T23:28:04.029 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.012+0000 7f550ffff640 1 -- 10.20.193.45:0/3900597386 <== mon.2 v1:10.20.193.45:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f5520003b80 con 0x7f5538063bb0 2026-02-22T23:28:04.030 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.012+0000 7f550ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:28:04.030 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.012+0000 7f550ffff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-22T23:28:04.030 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.012+0000 7f550ffff640 10 monclient: dump: 2026-02-22T23:28:04.030 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:28:04.030 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:28:04.030 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:04.030 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:04.030 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:28:04.030 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:28:04.030 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:28:04.030 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:28:04.030 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:28:04.030 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:28:04.030 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:28:04.030 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:28:04.030 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:28:04.030 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:28:04.031 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:28:04.031 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:04.031 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.012+0000 7f550ffff640 1 -- 10.20.193.45:0/3900597386 <== mon.2 v1:10.20.193.45:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2746088447 0 0) 0x7f5538134470 con 0x7f5538063bb0 2026-02-22T23:28:04.031 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.012+0000 7f550ffff640 1 -- 10.20.193.45:0/3900597386 --> v1:10.20.193.45:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f553806ce10 con 0x7f5538063bb0 2026-02-22T23:28:04.031 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.012+0000 7f550ffff640 1 -- 10.20.193.45:0/3900597386 <== mon.2 v1:10.20.193.45:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7695 (unknown 0 0 3644259905) 0x7f5520005e20 con 0x7f5538063bb0 2026-02-22T23:28:04.031 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.012+0000 7f550ffff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-22T23:28:04.031 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.012+0000 7f550ffff640 10 monclient: _finish_command 2 = system:0 2026-02-22T23:28:04.031 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.012+0000 7f550ffff640 1 -- 10.20.193.45:0/3900597386 >> v1:10.20.193.45:6790/0 conn(0x7f5538063bb0 legacy=0x7f55381de570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:04.031 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.012+0000 7f550ffff640 1 -- 10.20.193.45:0/3900597386 >> v1:10.20.193.45:6790/0 conn(0x7f5538063bb0 legacy=0x7f55381de570 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T23:28:04.031 INFO:teuthology.orchestra.run.trial045.stdout:{ 2026-02-22T23:28:04.031 INFO:teuthology.orchestra.run.trial045.stdout: "name": "b", 2026-02-22T23:28:04.031 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 2, 2026-02-22T23:28:04.032 INFO:teuthology.orchestra.run.trial045.stdout: "state": "peon", 2026-02-22T23:28:04.032 INFO:teuthology.orchestra.run.trial045.stdout: "election_epoch": 28, 2026-02-22T23:28:04.032 INFO:teuthology.orchestra.run.trial045.stdout: "uptime": 164165, 2026-02-22T23:28:04.032 INFO:teuthology.orchestra.run.trial045.stdout: "quorum": [ 2026-02-22T23:28:04.032 INFO:teuthology.orchestra.run.trial045.stdout: 0, 2026-02-22T23:28:04.032 INFO:teuthology.orchestra.run.trial045.stdout: 1, 2026-02-22T23:28:04.032 INFO:teuthology.orchestra.run.trial045.stdout: 2, 2026-02-22T23:28:04.032 INFO:teuthology.orchestra.run.trial045.stdout: 3, 2026-02-22T23:28:04.032 INFO:teuthology.orchestra.run.trial045.stdout: 4, 2026-02-22T23:28:04.032 INFO:teuthology.orchestra.run.trial045.stdout: 5, 2026-02-22T23:28:04.032 INFO:teuthology.orchestra.run.trial045.stdout: 6, 2026-02-22T23:28:04.032 INFO:teuthology.orchestra.run.trial045.stdout: 7, 2026-02-22T23:28:04.032 INFO:teuthology.orchestra.run.trial045.stdout: 8 2026-02-22T23:28:04.032 INFO:teuthology.orchestra.run.trial045.stdout: ], 2026-02-22T23:28:04.032 INFO:teuthology.orchestra.run.trial045.stdout: "quorum_age": 0, 2026-02-22T23:28:04.032 INFO:teuthology.orchestra.run.trial045.stdout: "features": { 2026-02-22T23:28:04.033 INFO:teuthology.orchestra.run.trial045.stdout: "required_con": "2450521708007866372", 2026-02-22T23:28:04.033 INFO:teuthology.orchestra.run.trial045.stdout: "required_mon": [ 2026-02-22T23:28:04.033 INFO:teuthology.orchestra.run.trial045.stdout: "kraken", 2026-02-22T23:28:04.033 INFO:teuthology.orchestra.run.trial045.stdout: "luminous", 2026-02-22T23:28:04.033 INFO:teuthology.orchestra.run.trial045.stdout: "mimic", 2026-02-22T23:28:04.033 INFO:teuthology.orchestra.run.trial045.stdout: "osdmap-prune", 2026-02-22T23:28:04.033 INFO:teuthology.orchestra.run.trial045.stdout: "nautilus", 2026-02-22T23:28:04.033 INFO:teuthology.orchestra.run.trial045.stdout: "octopus", 2026-02-22T23:28:04.033 INFO:teuthology.orchestra.run.trial045.stdout: "pacific", 2026-02-22T23:28:04.033 INFO:teuthology.orchestra.run.trial045.stdout: "elector-pinging", 2026-02-22T23:28:04.033 INFO:teuthology.orchestra.run.trial045.stdout: "quincy", 2026-02-22T23:28:04.033 INFO:teuthology.orchestra.run.trial045.stdout: "reef", 2026-02-22T23:28:04.033 INFO:teuthology.orchestra.run.trial045.stdout: "squid" 2026-02-22T23:28:04.033 INFO:teuthology.orchestra.run.trial045.stdout: ], 2026-02-22T23:28:04.033 INFO:teuthology.orchestra.run.trial045.stdout: "quorum_con": "4540701547738038271", 2026-02-22T23:28:04.033 INFO:teuthology.orchestra.run.trial045.stdout: "quorum_mon": [ 2026-02-22T23:28:04.034 INFO:teuthology.orchestra.run.trial045.stdout: "kraken", 2026-02-22T23:28:04.034 INFO:teuthology.orchestra.run.trial045.stdout: "luminous", 2026-02-22T23:28:04.034 INFO:teuthology.orchestra.run.trial045.stdout: "mimic", 2026-02-22T23:28:04.034 INFO:teuthology.orchestra.run.trial045.stdout: "osdmap-prune", 2026-02-22T23:28:04.034 INFO:teuthology.orchestra.run.trial045.stdout: "nautilus", 2026-02-22T23:28:04.034 INFO:teuthology.orchestra.run.trial045.stdout: "octopus", 2026-02-22T23:28:04.034 INFO:teuthology.orchestra.run.trial045.stdout: "pacific", 2026-02-22T23:28:04.034 INFO:teuthology.orchestra.run.trial045.stdout: "elector-pinging", 2026-02-22T23:28:04.034 INFO:teuthology.orchestra.run.trial045.stdout: "quincy", 2026-02-22T23:28:04.034 INFO:teuthology.orchestra.run.trial045.stdout: "reef", 2026-02-22T23:28:04.034 INFO:teuthology.orchestra.run.trial045.stdout: "squid" 2026-02-22T23:28:04.034 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:28:04.034 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:28:04.034 INFO:teuthology.orchestra.run.trial045.stdout: "outside_quorum": [], 2026-02-22T23:28:04.034 INFO:teuthology.orchestra.run.trial045.stdout: "extra_probe_peers": [], 2026-02-22T23:28:04.034 INFO:teuthology.orchestra.run.trial045.stdout: "sync_provider": [], 2026-02-22T23:28:04.034 INFO:teuthology.orchestra.run.trial045.stdout: "monmap": { 2026-02-22T23:28:04.035 INFO:teuthology.orchestra.run.trial045.stdout: "epoch": 1, 2026-02-22T23:28:04.035 INFO:teuthology.orchestra.run.trial045.stdout: "fsid": "4b60f18f-6660-4731-b731-dc85c4078413", 2026-02-22T23:28:04.035 INFO:teuthology.orchestra.run.trial045.stdout: "modified": "2026-02-22T23:24:52.393472Z", 2026-02-22T23:28:04.035 INFO:teuthology.orchestra.run.trial045.stdout: "created": "2026-02-22T23:24:52.393472Z", 2026-02-22T23:28:04.035 INFO:teuthology.orchestra.run.trial045.stdout: "min_mon_release": 19, 2026-02-22T23:28:04.035 INFO:teuthology.orchestra.run.trial045.stdout: "min_mon_release_name": "squid", 2026-02-22T23:28:04.035 INFO:teuthology.orchestra.run.trial045.stdout: "election_strategy": 3, 2026-02-22T23:28:04.035 INFO:teuthology.orchestra.run.trial045.stdout: "disallowed_leaders": "", 2026-02-22T23:28:04.035 INFO:teuthology.orchestra.run.trial045.stdout: "stretch_mode": false, 2026-02-22T23:28:04.035 INFO:teuthology.orchestra.run.trial045.stdout: "tiebreaker_mon": "", 2026-02-22T23:28:04.035 INFO:teuthology.orchestra.run.trial045.stdout: "removed_ranks": "", 2026-02-22T23:28:04.035 INFO:teuthology.orchestra.run.trial045.stdout: "features": { 2026-02-22T23:28:04.035 INFO:teuthology.orchestra.run.trial045.stdout: "persistent": [ 2026-02-22T23:28:04.035 INFO:teuthology.orchestra.run.trial045.stdout: "kraken", 2026-02-22T23:28:04.036 INFO:teuthology.orchestra.run.trial045.stdout: "luminous", 2026-02-22T23:28:04.036 INFO:teuthology.orchestra.run.trial045.stdout: "mimic", 2026-02-22T23:28:04.036 INFO:teuthology.orchestra.run.trial045.stdout: "osdmap-prune", 2026-02-22T23:28:04.036 INFO:teuthology.orchestra.run.trial045.stdout: "nautilus", 2026-02-22T23:28:04.036 INFO:teuthology.orchestra.run.trial045.stdout: "octopus", 2026-02-22T23:28:04.036 INFO:teuthology.orchestra.run.trial045.stdout: "pacific", 2026-02-22T23:28:04.036 INFO:teuthology.orchestra.run.trial045.stdout: "elector-pinging", 2026-02-22T23:28:04.036 INFO:teuthology.orchestra.run.trial045.stdout: "quincy", 2026-02-22T23:28:04.036 INFO:teuthology.orchestra.run.trial045.stdout: "reef", 2026-02-22T23:28:04.036 INFO:teuthology.orchestra.run.trial045.stdout: "squid" 2026-02-22T23:28:04.036 INFO:teuthology.orchestra.run.trial045.stdout: ], 2026-02-22T23:28:04.036 INFO:teuthology.orchestra.run.trial045.stdout: "optional": [] 2026-02-22T23:28:04.036 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:28:04.036 INFO:teuthology.orchestra.run.trial045.stdout: "mons": [ 2026-02-22T23:28:04.036 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:28:04.037 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 0, 2026-02-22T23:28:04.037 INFO:teuthology.orchestra.run.trial045.stdout: "name": "a", 2026-02-22T23:28:04.037 INFO:teuthology.orchestra.run.trial045.stdout: "public_addrs": { 2026-02-22T23:28:04.037 INFO:teuthology.orchestra.run.trial045.stdout: "addrvec": [ 2026-02-22T23:28:04.037 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:28:04.037 INFO:teuthology.orchestra.run.trial045.stdout: "type": "v1", 2026-02-22T23:28:04.037 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6789", 2026-02-22T23:28:04.037 INFO:teuthology.orchestra.run.trial045.stdout: "nonce": 0 2026-02-22T23:28:04.037 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:28:04.037 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:28:04.037 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:28:04.037 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6789/0", 2026-02-22T23:28:04.037 INFO:teuthology.orchestra.run.trial045.stdout: "public_addr": "10.20.193.45:6789/0", 2026-02-22T23:28:04.037 INFO:teuthology.orchestra.run.trial045.stdout: "priority": 0, 2026-02-22T23:28:04.037 INFO:teuthology.orchestra.run.trial045.stdout: "weight": 0, 2026-02-22T23:28:04.037 INFO:teuthology.orchestra.run.trial045.stdout: "crush_location": "{}" 2026-02-22T23:28:04.038 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:28:04.038 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:28:04.038 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 1, 2026-02-22T23:28:04.038 INFO:teuthology.orchestra.run.trial045.stdout: "name": "f", 2026-02-22T23:28:04.038 INFO:teuthology.orchestra.run.trial045.stdout: "public_addrs": { 2026-02-22T23:28:04.038 INFO:teuthology.orchestra.run.trial045.stdout: "addrvec": [ 2026-02-22T23:28:04.038 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:28:04.038 INFO:teuthology.orchestra.run.trial045.stdout: "type": "v1", 2026-02-22T23:28:04.038 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.73:6789", 2026-02-22T23:28:04.038 INFO:teuthology.orchestra.run.trial045.stdout: "nonce": 0 2026-02-22T23:28:04.038 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:28:04.038 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:28:04.038 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:28:04.038 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.73:6789/0", 2026-02-22T23:28:04.038 INFO:teuthology.orchestra.run.trial045.stdout: "public_addr": "10.20.193.73:6789/0", 2026-02-22T23:28:04.038 INFO:teuthology.orchestra.run.trial045.stdout: "priority": 0, 2026-02-22T23:28:04.038 INFO:teuthology.orchestra.run.trial045.stdout: "weight": 0, 2026-02-22T23:28:04.038 INFO:teuthology.orchestra.run.trial045.stdout: "crush_location": "{}" 2026-02-22T23:28:04.038 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:28:04.039 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:28:04.039 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 2, 2026-02-22T23:28:04.039 INFO:teuthology.orchestra.run.trial045.stdout: "name": "b", 2026-02-22T23:28:04.039 INFO:teuthology.orchestra.run.trial045.stdout: "public_addrs": { 2026-02-22T23:28:04.039 INFO:teuthology.orchestra.run.trial045.stdout: "addrvec": [ 2026-02-22T23:28:04.039 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:28:04.039 INFO:teuthology.orchestra.run.trial045.stdout: "type": "v1", 2026-02-22T23:28:04.039 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6790", 2026-02-22T23:28:04.039 INFO:teuthology.orchestra.run.trial045.stdout: "nonce": 0 2026-02-22T23:28:04.039 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:28:04.039 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:28:04.039 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:28:04.039 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6790/0", 2026-02-22T23:28:04.039 INFO:teuthology.orchestra.run.trial045.stdout: "public_addr": "10.20.193.45:6790/0", 2026-02-22T23:28:04.039 INFO:teuthology.orchestra.run.trial045.stdout: "priority": 0, 2026-02-22T23:28:04.039 INFO:teuthology.orchestra.run.trial045.stdout: "weight": 0, 2026-02-22T23:28:04.039 INFO:teuthology.orchestra.run.trial045.stdout: "crush_location": "{}" 2026-02-22T23:28:04.039 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:28:04.040 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:28:04.040 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 3, 2026-02-22T23:28:04.040 INFO:teuthology.orchestra.run.trial045.stdout: "name": "g", 2026-02-22T23:28:04.040 INFO:teuthology.orchestra.run.trial045.stdout: "public_addrs": { 2026-02-22T23:28:04.040 INFO:teuthology.orchestra.run.trial045.stdout: "addrvec": [ 2026-02-22T23:28:04.040 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:28:04.040 INFO:teuthology.orchestra.run.trial045.stdout: "type": "v1", 2026-02-22T23:28:04.040 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.73:6790", 2026-02-22T23:28:04.040 INFO:teuthology.orchestra.run.trial045.stdout: "nonce": 0 2026-02-22T23:28:04.040 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:28:04.040 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:28:04.040 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:28:04.040 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.73:6790/0", 2026-02-22T23:28:04.040 INFO:teuthology.orchestra.run.trial045.stdout: "public_addr": "10.20.193.73:6790/0", 2026-02-22T23:28:04.040 INFO:teuthology.orchestra.run.trial045.stdout: "priority": 0, 2026-02-22T23:28:04.040 INFO:teuthology.orchestra.run.trial045.stdout: "weight": 0, 2026-02-22T23:28:04.040 INFO:teuthology.orchestra.run.trial045.stdout: "crush_location": "{}" 2026-02-22T23:28:04.040 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:28:04.040 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:28:04.040 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 4, 2026-02-22T23:28:04.041 INFO:teuthology.orchestra.run.trial045.stdout: "name": "c", 2026-02-22T23:28:04.041 INFO:teuthology.orchestra.run.trial045.stdout: "public_addrs": { 2026-02-22T23:28:04.041 INFO:teuthology.orchestra.run.trial045.stdout: "addrvec": [ 2026-02-22T23:28:04.041 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:28:04.041 INFO:teuthology.orchestra.run.trial045.stdout: "type": "v1", 2026-02-22T23:28:04.041 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6791", 2026-02-22T23:28:04.041 INFO:teuthology.orchestra.run.trial045.stdout: "nonce": 0 2026-02-22T23:28:04.041 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:28:04.041 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:28:04.041 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:28:04.041 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6791/0", 2026-02-22T23:28:04.041 INFO:teuthology.orchestra.run.trial045.stdout: "public_addr": "10.20.193.45:6791/0", 2026-02-22T23:28:04.041 INFO:teuthology.orchestra.run.trial045.stdout: "priority": 0, 2026-02-22T23:28:04.041 INFO:teuthology.orchestra.run.trial045.stdout: "weight": 0, 2026-02-22T23:28:04.041 INFO:teuthology.orchestra.run.trial045.stdout: "crush_location": "{}" 2026-02-22T23:28:04.041 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:28:04.041 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:28:04.041 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 5, 2026-02-22T23:28:04.041 INFO:teuthology.orchestra.run.trial045.stdout: "name": "h", 2026-02-22T23:28:04.041 INFO:teuthology.orchestra.run.trial045.stdout: "public_addrs": { 2026-02-22T23:28:04.042 INFO:teuthology.orchestra.run.trial045.stdout: "addrvec": [ 2026-02-22T23:28:04.042 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:28:04.042 INFO:teuthology.orchestra.run.trial045.stdout: "type": "v1", 2026-02-22T23:28:04.042 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.73:6791", 2026-02-22T23:28:04.042 INFO:teuthology.orchestra.run.trial045.stdout: "nonce": 0 2026-02-22T23:28:04.042 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:28:04.042 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:28:04.042 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:28:04.042 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.73:6791/0", 2026-02-22T23:28:04.042 INFO:teuthology.orchestra.run.trial045.stdout: "public_addr": "10.20.193.73:6791/0", 2026-02-22T23:28:04.042 INFO:teuthology.orchestra.run.trial045.stdout: "priority": 0, 2026-02-22T23:28:04.042 INFO:teuthology.orchestra.run.trial045.stdout: "weight": 0, 2026-02-22T23:28:04.042 INFO:teuthology.orchestra.run.trial045.stdout: "crush_location": "{}" 2026-02-22T23:28:04.042 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:28:04.042 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:28:04.042 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 6, 2026-02-22T23:28:04.042 INFO:teuthology.orchestra.run.trial045.stdout: "name": "d", 2026-02-22T23:28:04.042 INFO:teuthology.orchestra.run.trial045.stdout: "public_addrs": { 2026-02-22T23:28:04.042 INFO:teuthology.orchestra.run.trial045.stdout: "addrvec": [ 2026-02-22T23:28:04.042 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:28:04.043 INFO:teuthology.orchestra.run.trial045.stdout: "type": "v1", 2026-02-22T23:28:04.043 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6792", 2026-02-22T23:28:04.043 INFO:teuthology.orchestra.run.trial045.stdout: "nonce": 0 2026-02-22T23:28:04.043 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:28:04.043 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:28:04.043 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:28:04.043 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6792/0", 2026-02-22T23:28:04.043 INFO:teuthology.orchestra.run.trial045.stdout: "public_addr": "10.20.193.45:6792/0", 2026-02-22T23:28:04.043 INFO:teuthology.orchestra.run.trial045.stdout: "priority": 0, 2026-02-22T23:28:04.043 INFO:teuthology.orchestra.run.trial045.stdout: "weight": 0, 2026-02-22T23:28:04.043 INFO:teuthology.orchestra.run.trial045.stdout: "crush_location": "{}" 2026-02-22T23:28:04.043 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:28:04.043 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:28:04.043 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 7, 2026-02-22T23:28:04.043 INFO:teuthology.orchestra.run.trial045.stdout: "name": "i", 2026-02-22T23:28:04.043 INFO:teuthology.orchestra.run.trial045.stdout: "public_addrs": { 2026-02-22T23:28:04.043 INFO:teuthology.orchestra.run.trial045.stdout: "addrvec": [ 2026-02-22T23:28:04.043 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:28:04.043 INFO:teuthology.orchestra.run.trial045.stdout: "type": "v1", 2026-02-22T23:28:04.043 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.73:6792", 2026-02-22T23:28:04.043 INFO:teuthology.orchestra.run.trial045.stdout: "nonce": 0 2026-02-22T23:28:04.044 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:28:04.044 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:28:04.044 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:28:04.044 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.73:6792/0", 2026-02-22T23:28:04.044 INFO:teuthology.orchestra.run.trial045.stdout: "public_addr": "10.20.193.73:6792/0", 2026-02-22T23:28:04.044 INFO:teuthology.orchestra.run.trial045.stdout: "priority": 0, 2026-02-22T23:28:04.044 INFO:teuthology.orchestra.run.trial045.stdout: "weight": 0, 2026-02-22T23:28:04.044 INFO:teuthology.orchestra.run.trial045.stdout: "crush_location": "{}" 2026-02-22T23:28:04.044 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:28:04.044 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:28:04.044 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 8, 2026-02-22T23:28:04.044 INFO:teuthology.orchestra.run.trial045.stdout: "name": "e", 2026-02-22T23:28:04.044 INFO:teuthology.orchestra.run.trial045.stdout: "public_addrs": { 2026-02-22T23:28:04.044 INFO:teuthology.orchestra.run.trial045.stdout: "addrvec": [ 2026-02-22T23:28:04.044 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:28:04.044 INFO:teuthology.orchestra.run.trial045.stdout: "type": "v1", 2026-02-22T23:28:04.044 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6793", 2026-02-22T23:28:04.044 INFO:teuthology.orchestra.run.trial045.stdout: "nonce": 0 2026-02-22T23:28:04.044 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:28:04.044 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:28:04.045 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:28:04.045 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6793/0", 2026-02-22T23:28:04.045 INFO:teuthology.orchestra.run.trial045.stdout: "public_addr": "10.20.193.45:6793/0", 2026-02-22T23:28:04.045 INFO:teuthology.orchestra.run.trial045.stdout: "priority": 0, 2026-02-22T23:28:04.045 INFO:teuthology.orchestra.run.trial045.stdout: "weight": 0, 2026-02-22T23:28:04.045 INFO:teuthology.orchestra.run.trial045.stdout: "crush_location": "{}" 2026-02-22T23:28:04.045 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:28:04.045 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:28:04.045 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:28:04.045 INFO:teuthology.orchestra.run.trial045.stdout: "feature_map": { 2026-02-22T23:28:04.045 INFO:teuthology.orchestra.run.trial045.stdout: "mon": [ 2026-02-22T23:28:04.045 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:28:04.045 INFO:teuthology.orchestra.run.trial045.stdout: "features": "0x3f03cffffffdffff", 2026-02-22T23:28:04.045 INFO:teuthology.orchestra.run.trial045.stdout: "release": "squid", 2026-02-22T23:28:04.045 INFO:teuthology.orchestra.run.trial045.stdout: "num": 1 2026-02-22T23:28:04.045 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:28:04.045 INFO:teuthology.orchestra.run.trial045.stdout: ], 2026-02-22T23:28:04.045 INFO:teuthology.orchestra.run.trial045.stdout: "osd": [ 2026-02-22T23:28:04.045 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:28:04.045 INFO:teuthology.orchestra.run.trial045.stdout: "features": "0x3f03cffffffdffff", 2026-02-22T23:28:04.045 INFO:teuthology.orchestra.run.trial045.stdout: "release": "squid", 2026-02-22T23:28:04.046 INFO:teuthology.orchestra.run.trial045.stdout: "num": 5 2026-02-22T23:28:04.046 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:28:04.046 INFO:teuthology.orchestra.run.trial045.stdout: ], 2026-02-22T23:28:04.046 INFO:teuthology.orchestra.run.trial045.stdout: "client": [ 2026-02-22T23:28:04.046 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:28:04.046 INFO:teuthology.orchestra.run.trial045.stdout: "features": "0x3f03cffffffdffff", 2026-02-22T23:28:04.046 INFO:teuthology.orchestra.run.trial045.stdout: "release": "squid", 2026-02-22T23:28:04.046 INFO:teuthology.orchestra.run.trial045.stdout: "num": 1 2026-02-22T23:28:04.046 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:28:04.046 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:28:04.046 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:28:04.046 INFO:teuthology.orchestra.run.trial045.stdout: "stretch_mode": false 2026-02-22T23:28:04.046 INFO:teuthology.orchestra.run.trial045.stdout:} 2026-02-22T23:28:04.047 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.013+0000 7f553da6d640 1 -- 10.20.193.45:0/3900597386 >> v1:10.20.193.73:6800/2222410180 conn(0x7f550803f840 legacy=0x7f5508041d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:04.047 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.013+0000 7f553da6d640 10 monclient: shutdown 2026-02-22T23:28:04.047 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.013+0000 7f553da6d640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T23:28:04.047 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.013+0000 7f553da6d640 1 -- 10.20.193.45:0/3900597386 >> v1:10.20.193.45:6789/0 conn(0x7f55380a3630 legacy=0x7f553813ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:04.047 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.013+0000 7f55377fe640 1 -- 10.20.193.45:0/3900597386 reap_dead start 2026-02-22T23:28:04.047 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.013+0000 7f55377fe640 1 -- 10.20.193.45:0/3900597386 reap_dead start 2026-02-22T23:28:04.048 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.013+0000 7f553da6d640 1 -- 10.20.193.45:0/3900597386 shutdown_connections 2026-02-22T23:28:04.048 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.013+0000 7f553da6d640 1 -- 10.20.193.45:0/3900597386 >> 10.20.193.45:0/3900597386 conn(0x7f55380a7780 msgr2=0x7f55380a5c20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:28:04.048 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.013+0000 7f553da6d640 1 -- 10.20.193.45:0/3900597386 shutdown_connections 2026-02-22T23:28:04.048 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.013+0000 7f553da6d640 1 -- 10.20.193.45:0/3900597386 wait complete. 2026-02-22T23:28:04.048 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2026-02-22T23:28:04.048 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon c 2026-02-22T23:28:04.048 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-22T23:28:04.115 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.114+0000 7f5362f03640 10 monclient: get_monmap_and_config 2026-02-22T23:28:04.116 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.114+0000 7f5362f03640 10 monclient: build_initial_monmap 2026-02-22T23:28:04.116 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.114+0000 7f5362f03640 10 monclient: monmap: 2026-02-22T23:28:04.116 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-22T23:28:04.116 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:28:04.116 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:28:04.115642+0000 2026-02-22T23:28:04.116 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:28:04.115642+0000 2026-02-22T23:28:04.116 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-22T23:28:04.116 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:28:04.116 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-22T23:28:04.116 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.noname-f 2026-02-22T23:28:04.116 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.noname-b 2026-02-22T23:28:04.116 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.noname-g 2026-02-22T23:28:04.116 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.noname-c 2026-02-22T23:28:04.117 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.noname-h 2026-02-22T23:28:04.117 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.noname-d 2026-02-22T23:28:04.117 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.noname-i 2026-02-22T23:28:04.117 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.noname-e 2026-02-22T23:28:04.117 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:04.124 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.114+0000 7f5362f03640 1 Processor -- start 2026-02-22T23:28:04.124 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.114+0000 7f5362f03640 1 -- start start 2026-02-22T23:28:04.125 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.114+0000 7f5362f03640 10 monclient: init 2026-02-22T23:28:04.125 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.115+0000 7f5362f03640 10 monclient: _reopen_session rank -1 2026-02-22T23:28:04.125 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.115+0000 7f5362f03640 10 monclient: _add_conns ranks=[2,3,4,6,1,5,7,8,0] 2026-02-22T23:28:04.125 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.115+0000 7f5362f03640 10 monclient(hunting): picked mon.noname-b con 0x7f535c0a1a60 addr v1:10.20.193.45:6790/0 2026-02-22T23:28:04.125 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.115+0000 7f5362f03640 10 monclient(hunting): picked mon.noname-g con 0x7f535c06f1e0 addr v1:10.20.193.73:6790/0 2026-02-22T23:28:04.125 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.115+0000 7f5362f03640 10 monclient(hunting): picked mon.noname-c con 0x7f535c0a0980 addr v1:10.20.193.45:6791/0 2026-02-22T23:28:04.125 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.115+0000 7f5362f03640 1 -- --> v1:10.20.193.45:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f535c09df00 con 0x7f535c0a1a60 2026-02-22T23:28:04.125 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.115+0000 7f5362f03640 1 -- --> v1:10.20.193.73:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f535c137660 con 0x7f535c06f1e0 2026-02-22T23:28:04.125 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.115+0000 7f5362f03640 1 -- --> v1:10.20.193.45:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f535c0a4510 con 0x7f535c0a0980 2026-02-22T23:28:04.125 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.115+0000 7f5362f03640 10 monclient(hunting): _renew_subs 2026-02-22T23:28:04.125 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.115+0000 7f5362f03640 10 monclient(hunting): authenticate will time out at 815.732244s 2026-02-22T23:28:04.125 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.115+0000 7f5360c78640 1 --1- >> v1:10.20.193.45:6790/0 conn(0x7f535c0a1a60 0x7f535c136840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.45:6790/0 says I am v1:10.20.193.45:60106/0 (socket says 10.20.193.45:60106) 2026-02-22T23:28:04.125 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.115+0000 7f5360c78640 1 -- 10.20.193.45:0/2816241472 learned_addr learned my addr 10.20.193.45:0/2816241472 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-22T23:28:04.125 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.115+0000 7f5361479640 1 --1- 10.20.193.45:0/2816241472 >> v1:10.20.193.45:6791/0 conn(0x7f535c0a0980 0x7f535c13ecb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.45:6791/0 says I am v1:10.20.193.45:57668/0 (socket says 10.20.193.45:57668) 2026-02-22T23:28:04.125 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.115+0000 7f53537fe640 1 -- 10.20.193.45:0/2816241472 <== mon.2 v1:10.20.193.45:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4098724474 0 0) 0x7f534c002920 con 0x7f535c0a1a60 2026-02-22T23:28:04.126 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.115+0000 7f53537fe640 10 monclient(hunting): _negotiate 2026-02-22T23:28:04.126 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.115+0000 7f53537fe640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:28:04.126 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.115+0000 7f53537fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:28:04.126 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.115+0000 7f53537fe640 10 monclient(hunting): my global_id is 4682 2026-02-22T23:28:04.126 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.115+0000 7f53537fe640 1 -- 10.20.193.45:0/2816241472 --> v1:10.20.193.45:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5348003620 con 0x7f535c0a1a60 2026-02-22T23:28:04.126 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.115+0000 7f53537fe640 1 -- 10.20.193.45:0/2816241472 <== mon.4 v1:10.20.193.45:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3012170268 0 0) 0x7f535c0a4510 con 0x7f535c0a0980 2026-02-22T23:28:04.126 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.115+0000 7f53537fe640 10 monclient(hunting): _negotiate 2026-02-22T23:28:04.126 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.115+0000 7f53537fe640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:28:04.126 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.115+0000 7f53537fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:28:04.126 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.115+0000 7f53537fe640 10 monclient(hunting): my global_id is 114115 2026-02-22T23:28:04.126 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.115+0000 7f53537fe640 1 -- 10.20.193.45:0/2816241472 --> v1:10.20.193.45:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f534c002920 con 0x7f535c0a0980 2026-02-22T23:28:04.126 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.115+0000 7f53537fe640 1 -- 10.20.193.45:0/2816241472 <== mon.4 v1:10.20.193.45:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4044057899 0 0) 0x7f534c002920 con 0x7f535c0a0980 2026-02-22T23:28:04.126 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.115+0000 7f53537fe640 1 -- 10.20.193.45:0/2816241472 >> v1:10.20.193.73:6790/0 conn(0x7f535c06f1e0 legacy=0x7f535c136f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:04.126 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.115+0000 7f53537fe640 1 -- 10.20.193.45:0/2816241472 >> v1:10.20.193.45:6790/0 conn(0x7f535c0a1a60 legacy=0x7f535c136840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:04.126 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.115+0000 7f53537fe640 10 monclient: _finish_hunting 0 2026-02-22T23:28:04.126 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.115+0000 7f53537fe640 1 monclient: found mon.noname-c 2026-02-22T23:28:04.127 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.115+0000 7f53537fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T23:28:04.127 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.115+0000 7f53537fe640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.45:6791/0 2026-02-22T23:28:04.127 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.115+0000 7f53537fe640 1 -- 10.20.193.45:0/2816241472 --> v1:10.20.193.45:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f535c143400 con 0x7f535c0a0980 2026-02-22T23:28:04.127 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.115+0000 7f53537fe640 10 monclient: _finish_auth 0 2026-02-22T23:28:04.127 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.115+0000 7f53537fe640 10 monclient: _check_auth_tickets 2026-02-22T23:28:04.127 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.115+0000 7f53537fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T23:28:04.127 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.115+0000 7f53537fe640 1 -- 10.20.193.45:0/2816241472 <== mon.4 v1:10.20.193.45:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f53580033a0 con 0x7f535c0a0980 2026-02-22T23:28:04.127 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.115+0000 7f53537fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:28:04.127 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.115+0000 7f53537fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-22T23:28:04.127 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.115+0000 7f53537fe640 10 monclient: dump: 2026-02-22T23:28:04.127 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:28:04.127 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:28:04.127 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:04.127 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:04.127 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:28:04.127 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:28:04.127 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:28:04.128 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:28:04.128 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:28:04.128 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:28:04.128 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:28:04.128 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:28:04.128 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:28:04.128 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:28:04.128 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:28:04.128 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:04.128 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.115+0000 7f5362f03640 5 monclient: authenticate success, global_id 114115 2026-02-22T23:28:04.128 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.115+0000 7f5362f03640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-22T23:28:04.128 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.115+0000 7f53537fe640 1 -- 10.20.193.45:0/2816241472 <== mon.4 v1:10.20.193.45:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f53580035c0 con 0x7f535c0a0980 2026-02-22T23:28:04.128 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.115+0000 7f53537fe640 10 monclient: handle_config config(0 keys) 2026-02-22T23:28:04.128 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.115+0000 7f53537fe640 1 -- 10.20.193.45:0/2816241472 <== mon.4 v1:10.20.193.45:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f5358004fa0 con 0x7f535c0a0980 2026-02-22T23:28:04.128 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.115+0000 7f5362f03640 10 monclient: get_monmap_and_config success 2026-02-22T23:28:04.128 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.115+0000 7f5362f03640 4 set_mon_vals no callback set 2026-02-22T23:28:04.128 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.115+0000 7f53537fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:28:04.129 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.115+0000 7f53537fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T23:28:04.129 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.115+0000 7f53537fe640 10 monclient: dump: 2026-02-22T23:28:04.129 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:28:04.129 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:28:04.129 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:04.129 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:04.129 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:28:04.129 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:28:04.129 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:28:04.129 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:28:04.129 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:28:04.129 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:28:04.129 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:28:04.129 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:28:04.129 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:28:04.129 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:28:04.129 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:28:04.129 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:04.130 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.115+0000 7f5362f03640 10 monclient: shutdown 2026-02-22T23:28:04.130 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.116+0000 7f5362f03640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T23:28:04.130 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.116+0000 7f5362f03640 1 -- 10.20.193.45:0/2816241472 >> v1:10.20.193.45:6791/0 conn(0x7f535c0a0980 legacy=0x7f535c13ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:04.130 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.116+0000 7f5362f03640 1 -- 10.20.193.45:0/2816241472 shutdown_connections 2026-02-22T23:28:04.130 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.116+0000 7f5362f03640 1 -- 10.20.193.45:0/2816241472 >> 10.20.193.45:0/2816241472 conn(0x7f535c0a7780 msgr2=0x7f535c0a3b60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:28:04.130 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.116+0000 7f5362f03640 1 -- 10.20.193.45:0/2816241472 shutdown_connections 2026-02-22T23:28:04.130 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.116+0000 7f5362f03640 1 -- 10.20.193.45:0/2816241472 wait complete. 2026-02-22T23:28:04.130 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.116+0000 7f5362f03640 10 monclient: build_initial_monmap 2026-02-22T23:28:04.130 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.116+0000 7f5362f03640 10 monclient: monmap: 2026-02-22T23:28:04.130 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-22T23:28:04.130 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T23:28:04.130 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-22T23:28:04.130 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-22T23:28:04.130 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-22T23:28:04.130 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-22T23:28:04.130 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-22T23:28:04.131 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.noname-f 2026-02-22T23:28:04.131 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.noname-b 2026-02-22T23:28:04.131 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.noname-g 2026-02-22T23:28:04.131 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.noname-c 2026-02-22T23:28:04.131 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.noname-h 2026-02-22T23:28:04.131 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.noname-d 2026-02-22T23:28:04.131 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.noname-i 2026-02-22T23:28:04.131 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.noname-e 2026-02-22T23:28:04.131 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:04.131 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.116+0000 7f5362f03640 1 Processor -- start 2026-02-22T23:28:04.131 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.116+0000 7f5362f03640 1 -- start start 2026-02-22T23:28:04.131 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.116+0000 7f5362f03640 10 monclient: init 2026-02-22T23:28:04.131 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.116+0000 7f5362f03640 10 monclient: _reopen_session rank -1 2026-02-22T23:28:04.131 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.116+0000 7f5362f03640 10 monclient: _add_conns ranks=[1,3,5,4,8,0,7,2,6] 2026-02-22T23:28:04.131 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.116+0000 7f5362f03640 10 monclient(hunting): picked mon.noname-f con 0x7f535c0a0980 addr v1:10.20.193.73:6789/0 2026-02-22T23:28:04.131 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.116+0000 7f5362f03640 10 monclient(hunting): picked mon.noname-g con 0x7f535c0a1a60 addr v1:10.20.193.73:6790/0 2026-02-22T23:28:04.131 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.116+0000 7f5362f03640 10 monclient(hunting): picked mon.noname-h con 0x7f535c136e50 addr v1:10.20.193.73:6791/0 2026-02-22T23:28:04.131 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.116+0000 7f5362f03640 1 -- --> v1:10.20.193.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f535c13c5b0 con 0x7f535c0a0980 2026-02-22T23:28:04.132 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.116+0000 7f5362f03640 1 -- --> v1:10.20.193.73:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f535c13e8a0 con 0x7f535c0a1a60 2026-02-22T23:28:04.132 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.116+0000 7f5362f03640 1 -- --> v1:10.20.193.73:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f535c140060 con 0x7f535c136e50 2026-02-22T23:28:04.132 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.116+0000 7f5362f03640 10 monclient(hunting): _renew_subs 2026-02-22T23:28:04.132 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.116+0000 7f5362f03640 10 monclient(hunting): authenticate will time out at 815.733852s 2026-02-22T23:28:04.132 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.116+0000 7f5360c78640 1 --1- >> v1:10.20.193.73:6789/0 conn(0x7f535c0a0980 0x7f535c13f180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.73:6789/0 says I am v1:10.20.193.45:47858/0 (socket says 10.20.193.45:47858) 2026-02-22T23:28:04.132 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.116+0000 7f5353fff640 1 --1- >> v1:10.20.193.73:6790/0 conn(0x7f535c0a1a60 0x7f535c1d2280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.73:6790/0 says I am v1:10.20.193.45:36042/0 (socket says 10.20.193.45:36042) 2026-02-22T23:28:04.132 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.116+0000 7f5360c78640 1 -- 10.20.193.45:0/587382788 learned_addr learned my addr 10.20.193.45:0/587382788 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-22T23:28:04.132 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.117+0000 7f53517fa640 1 -- 10.20.193.45:0/587382788 <== mon.3 v1:10.20.193.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3198736958 0 0) 0x7f535c13e8a0 con 0x7f535c0a1a60 2026-02-22T23:28:04.132 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.117+0000 7f53517fa640 10 monclient(hunting): _negotiate 2026-02-22T23:28:04.132 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.117+0000 7f53517fa640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:28:04.132 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.117+0000 7f53517fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:28:04.132 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.117+0000 7f53517fa640 10 monclient(hunting): my global_id is 4575 2026-02-22T23:28:04.132 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.117+0000 7f53517fa640 1 -- 10.20.193.45:0/587382788 --> v1:10.20.193.73:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f532c003620 con 0x7f535c0a1a60 2026-02-22T23:28:04.132 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.117+0000 7f53517fa640 1 -- 10.20.193.45:0/587382788 <== mon.1 v1:10.20.193.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1066650068 0 0) 0x7f535c13c5b0 con 0x7f535c0a0980 2026-02-22T23:28:04.132 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.117+0000 7f53517fa640 10 monclient(hunting): _negotiate 2026-02-22T23:28:04.132 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.117+0000 7f53517fa640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:28:04.133 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.117+0000 7f53517fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:28:04.133 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.117+0000 7f53517fa640 10 monclient(hunting): my global_id is 114112 2026-02-22T23:28:04.133 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.117+0000 7f53517fa640 1 -- 10.20.193.45:0/587382788 --> v1:10.20.193.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f535c13e8a0 con 0x7f535c0a0980 2026-02-22T23:28:04.133 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.117+0000 7f53517fa640 1 -- 10.20.193.45:0/587382788 <== mon.5 v1:10.20.193.73:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4209687349 0 0) 0x7f535c140060 con 0x7f535c136e50 2026-02-22T23:28:04.133 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.117+0000 7f53517fa640 10 monclient(hunting): _negotiate 2026-02-22T23:28:04.133 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.117+0000 7f53517fa640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:28:04.133 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.117+0000 7f53517fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:28:04.133 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.117+0000 7f53517fa640 10 monclient(hunting): my global_id is 114107 2026-02-22T23:28:04.133 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.117+0000 7f53517fa640 1 -- 10.20.193.45:0/587382788 --> v1:10.20.193.73:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f535c13c5b0 con 0x7f535c136e50 2026-02-22T23:28:04.133 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.117+0000 7f53517fa640 1 -- 10.20.193.45:0/587382788 <== mon.3 v1:10.20.193.73:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2413881146 0 0) 0x7f532c003620 con 0x7f535c0a1a60 2026-02-22T23:28:04.133 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.117+0000 7f53517fa640 1 -- 10.20.193.45:0/587382788 --> v1:10.20.193.73:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f535c140060 con 0x7f535c0a1a60 2026-02-22T23:28:04.133 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.117+0000 7f53517fa640 1 -- 10.20.193.45:0/587382788 <== mon.3 v1:10.20.193.73:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f5344003360 con 0x7f535c0a1a60 2026-02-22T23:28:04.133 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.117+0000 7f53517fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-22T23:28:04.133 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.117+0000 7f53517fa640 10 monclient(hunting): got monmap 1 from mon.noname-g (according to old e1) 2026-02-22T23:28:04.133 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.117+0000 7f53517fa640 10 monclient(hunting): dump: 2026-02-22T23:28:04.133 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:28:04.133 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:28:04.134 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:04.134 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:04.134 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:28:04.134 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:28:04.134 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:28:04.134 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:28:04.134 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:28:04.134 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:28:04.134 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:28:04.134 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:28:04.134 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:28:04.134 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:28:04.134 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:28:04.134 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:04.134 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.117+0000 7f53517fa640 10 monclient(hunting): _finish_auth 0 2026-02-22T23:28:04.134 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.117+0000 7f53517fa640 1 -- 10.20.193.45:0/587382788 <== mon.1 v1:10.20.193.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3172569749 0 0) 0x7f535c13e8a0 con 0x7f535c0a0980 2026-02-22T23:28:04.134 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.117+0000 7f53517fa640 1 -- 10.20.193.45:0/587382788 --> v1:10.20.193.73:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f532c003620 con 0x7f535c0a0980 2026-02-22T23:28:04.134 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.117+0000 7f53517fa640 1 -- 10.20.193.45:0/587382788 <== mon.1 v1:10.20.193.73:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f534c003190 con 0x7f535c0a0980 2026-02-22T23:28:04.135 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.117+0000 7f53517fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-22T23:28:04.135 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.117+0000 7f53517fa640 10 monclient(hunting): got monmap 1 from mon.f (according to old e1) 2026-02-22T23:28:04.135 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.117+0000 7f53517fa640 10 monclient(hunting): dump: 2026-02-22T23:28:04.135 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:28:04.135 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:28:04.135 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:04.135 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:04.135 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:28:04.135 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:28:04.135 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:28:04.135 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:28:04.135 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:28:04.135 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:28:04.135 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:28:04.135 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:28:04.135 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:28:04.135 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:28:04.136 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:28:04.136 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:04.136 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.117+0000 7f53517fa640 1 -- 10.20.193.45:0/587382788 <== mon.5 v1:10.20.193.73:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1850878723 0 0) 0x7f535c13c5b0 con 0x7f535c136e50 2026-02-22T23:28:04.136 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.117+0000 7f53517fa640 1 -- 10.20.193.45:0/587382788 --> v1:10.20.193.73:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f535c13e8a0 con 0x7f535c136e50 2026-02-22T23:28:04.136 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.117+0000 7f53517fa640 1 -- 10.20.193.45:0/587382788 <== mon.3 v1:10.20.193.73:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2140416375 0 0) 0x7f535c140060 con 0x7f535c0a1a60 2026-02-22T23:28:04.136 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.117+0000 7f53517fa640 1 -- 10.20.193.45:0/587382788 >> v1:10.20.193.73:6791/0 conn(0x7f535c136e50 legacy=0x7f535c1d59b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:04.136 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.117+0000 7f53517fa640 1 -- 10.20.193.45:0/587382788 >> v1:10.20.193.73:6789/0 conn(0x7f535c0a0980 legacy=0x7f535c13f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:04.136 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.117+0000 7f53517fa640 10 monclient: _finish_hunting 0 2026-02-22T23:28:04.136 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.117+0000 7f53517fa640 1 monclient: found mon.g 2026-02-22T23:28:04.136 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.117+0000 7f53517fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T23:28:04.136 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.117+0000 7f53517fa640 10 monclient: _send_mon_message to mon.g at v1:10.20.193.73:6790/0 2026-02-22T23:28:04.136 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.117+0000 7f53517fa640 1 -- 10.20.193.45:0/587382788 --> v1:10.20.193.73:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f535c09d870 con 0x7f535c0a1a60 2026-02-22T23:28:04.136 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.117+0000 7f53517fa640 10 monclient: _finish_auth 0 2026-02-22T23:28:04.136 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.117+0000 7f53517fa640 10 monclient: _check_auth_tickets 2026-02-22T23:28:04.136 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.117+0000 7f53517fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T23:28:04.136 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.117+0000 7f5362f03640 5 monclient: authenticate success, global_id 4575 2026-02-22T23:28:04.136 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.117+0000 7f5362f03640 10 monclient: _renew_subs 2026-02-22T23:28:04.137 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.117+0000 7f5362f03640 10 monclient: _send_mon_message to mon.g at v1:10.20.193.73:6790/0 2026-02-22T23:28:04.137 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.117+0000 7f5362f03640 1 -- 10.20.193.45:0/587382788 --> v1:10.20.193.73:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f535c13e5c0 con 0x7f535c0a1a60 2026-02-22T23:28:04.137 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.117+0000 7f5362f03640 10 monclient: _renew_subs 2026-02-22T23:28:04.137 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.117+0000 7f5362f03640 10 monclient: _send_mon_message to mon.g at v1:10.20.193.73:6790/0 2026-02-22T23:28:04.137 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.117+0000 7f5362f03640 1 -- 10.20.193.45:0/587382788 --> v1:10.20.193.73:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f535c13fc60 con 0x7f535c0a1a60 2026-02-22T23:28:04.137 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.117+0000 7f53517fa640 1 -- 10.20.193.45:0/587382788 <== mon.3 v1:10.20.193.73:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5344003500 con 0x7f535c0a1a60 2026-02-22T23:28:04.137 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.117+0000 7f53517fa640 10 monclient: handle_config config(0 keys) 2026-02-22T23:28:04.137 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.117+0000 7f53517fa640 1 -- 10.20.193.45:0/587382788 <== mon.3 v1:10.20.193.73:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f5344003d80 con 0x7f535c0a1a60 2026-02-22T23:28:04.137 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.117+0000 7f53517fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:28:04.137 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.117+0000 7f53517fa640 10 monclient: got monmap 1 from mon.g (according to old e1) 2026-02-22T23:28:04.137 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.117+0000 7f5352ffd640 4 set_mon_vals no callback set 2026-02-22T23:28:04.137 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.117+0000 7f53517fa640 10 monclient: dump: 2026-02-22T23:28:04.137 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:28:04.137 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:28:04.137 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:04.137 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:04.137 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:28:04.138 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:28:04.138 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:28:04.138 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:28:04.138 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:28:04.138 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:28:04.138 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:28:04.138 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:28:04.138 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:28:04.138 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:28:04.138 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:28:04.138 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:04.138 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.118+0000 7f5362f03640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T23:28:04.138 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.118+0000 7f5362f03640 1 -- 10.20.193.45:0/587382788 --> v1:10.20.193.45:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f535c09d490 con 0x7f535c06f1e0 2026-02-22T23:28:04.138 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.118+0000 7f53517fa640 1 -- 10.20.193.45:0/587382788 <== mon.4 v1:10.20.193.45:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3523076390 0 0) 0x7f532c003620 con 0x7f535c06f1e0 2026-02-22T23:28:04.138 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.118+0000 7f53517fa640 10 monclient(hunting): _negotiate 2026-02-22T23:28:04.138 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.118+0000 7f53517fa640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:28:04.138 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.118+0000 7f53517fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:28:04.138 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.118+0000 7f53517fa640 10 monclient(hunting): my global_id is 114124 2026-02-22T23:28:04.139 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.118+0000 7f53517fa640 1 -- 10.20.193.45:0/587382788 --> v1:10.20.193.45:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f535c140060 con 0x7f535c06f1e0 2026-02-22T23:28:04.139 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.118+0000 7f53517fa640 1 -- 10.20.193.45:0/587382788 <== mon.3 v1:10.20.193.73:6790/0 7 ==== mgrmap(e 5) ==== 50225+0+0 (unknown 2330357642 0 0) 0x7f5344003f20 con 0x7f535c0a1a60 2026-02-22T23:28:04.139 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.118+0000 7f53517fa640 1 -- 10.20.193.45:0/587382788 <== mon.3 v1:10.20.193.73:6790/0 8 ==== osd_map(25..25 src has 1..25) ==== 3502+0+0 (unknown 129690100 0 0) 0x7f534404db10 con 0x7f535c0a1a60 2026-02-22T23:28:04.139 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.118+0000 7f53517fa640 1 -- 10.20.193.45:0/587382788 <== mon.4 v1:10.20.193.45:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 835894004 0 0) 0x7f535c140060 con 0x7f535c06f1e0 2026-02-22T23:28:04.139 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.118+0000 7f53517fa640 1 -- 10.20.193.45:0/587382788 --> v1:10.20.193.45:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f532c003620 con 0x7f535c06f1e0 2026-02-22T23:28:04.139 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.118+0000 7f53517fa640 1 -- 10.20.193.45:0/587382788 <== mon.4 v1:10.20.193.45:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f534c004c20 con 0x7f535c06f1e0 2026-02-22T23:28:04.139 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.118+0000 7f53517fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:28:04.139 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.118+0000 7f53517fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T23:28:04.139 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.118+0000 7f53517fa640 10 monclient: dump: 2026-02-22T23:28:04.139 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:28:04.139 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:28:04.139 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:04.139 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:04.139 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:28:04.139 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:28:04.139 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:28:04.139 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:28:04.140 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:28:04.140 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:28:04.140 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:28:04.140 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:28:04.140 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:28:04.140 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:28:04.140 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:28:04.140 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:04.140 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.118+0000 7f5361479640 10 monclient: get_auth_request con 0x7f532c0402a0 auth_method 0 2026-02-22T23:28:04.140 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.118+0000 7f53517fa640 1 -- 10.20.193.45:0/587382788 <== mon.4 v1:10.20.193.45:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1450475637 0 0) 0x7f532c003620 con 0x7f535c06f1e0 2026-02-22T23:28:04.140 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.118+0000 7f53517fa640 1 -- 10.20.193.45:0/587382788 --> v1:10.20.193.45:6791/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f535c0008d0 con 0x7f535c06f1e0 2026-02-22T23:28:04.140 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.118+0000 7f53517fa640 1 -- 10.20.193.45:0/587382788 <== mon.4 v1:10.20.193.45:6791/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (unknown 0 0 2024835662) 0x7f534c007590 con 0x7f535c06f1e0 2026-02-22T23:28:04.140 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.118+0000 7f53517fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T23:28:04.140 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.118+0000 7f53517fa640 10 monclient: _finish_command 1 = system:0 2026-02-22T23:28:04.140 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.118+0000 7f53517fa640 1 -- 10.20.193.45:0/587382788 >> v1:10.20.193.45:6791/0 conn(0x7f535c06f1e0 legacy=0x7f535c0725f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:04.140 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.118+0000 7f53517fa640 1 -- 10.20.193.45:0/587382788 >> v1:10.20.193.45:6791/0 conn(0x7f535c06f1e0 legacy=0x7f535c0725f0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T23:28:04.140 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.122+0000 7f5362f03640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-22T23:28:04.140 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.122+0000 7f5362f03640 1 -- 10.20.193.45:0/587382788 --> v1:10.20.193.45:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f535c073410 con 0x7f535c140620 2026-02-22T23:28:04.141 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.122+0000 7f53517fa640 1 -- 10.20.193.45:0/587382788 <== mon.4 v1:10.20.193.45:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3156119449 0 0) 0x7f535c073410 con 0x7f535c140620 2026-02-22T23:28:04.141 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.122+0000 7f53517fa640 10 monclient(hunting): _negotiate 2026-02-22T23:28:04.141 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.122+0000 7f53517fa640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:28:04.141 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.122+0000 7f53517fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:28:04.141 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.122+0000 7f53517fa640 10 monclient(hunting): my global_id is 114133 2026-02-22T23:28:04.141 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.122+0000 7f53517fa640 1 -- 10.20.193.45:0/587382788 --> v1:10.20.193.45:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f532c003620 con 0x7f535c140620 2026-02-22T23:28:04.141 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.122+0000 7f53517fa640 1 -- 10.20.193.45:0/587382788 <== mon.4 v1:10.20.193.45:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2379710024 0 0) 0x7f532c003620 con 0x7f535c140620 2026-02-22T23:28:04.141 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.122+0000 7f53517fa640 1 -- 10.20.193.45:0/587382788 --> v1:10.20.193.45:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f535c073410 con 0x7f535c140620 2026-02-22T23:28:04.141 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.122+0000 7f53517fa640 1 -- 10.20.193.45:0/587382788 <== mon.4 v1:10.20.193.45:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f534c005340 con 0x7f535c140620 2026-02-22T23:28:04.141 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.122+0000 7f53517fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:28:04.141 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.122+0000 7f53517fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T23:28:04.141 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.122+0000 7f53517fa640 10 monclient: dump: 2026-02-22T23:28:04.141 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:28:04.141 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:28:04.141 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:04.141 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:04.141 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:28:04.142 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:28:04.142 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:28:04.142 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:28:04.142 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:28:04.142 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:28:04.142 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:28:04.142 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:28:04.142 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:28:04.142 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:28:04.142 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:28:04.142 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:04.142 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.122+0000 7f53517fa640 1 -- 10.20.193.45:0/587382788 <== mon.4 v1:10.20.193.45:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1483546813 0 0) 0x7f535c073410 con 0x7f535c140620 2026-02-22T23:28:04.142 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.122+0000 7f53517fa640 1 -- 10.20.193.45:0/587382788 --> v1:10.20.193.45:6791/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f535c0735e0 con 0x7f535c140620 2026-02-22T23:28:04.142 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.122+0000 7f53517fa640 1 -- 10.20.193.45:0/587382788 <== mon.4 v1:10.20.193.45:6791/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7527 (unknown 0 0 2507213720) 0x7f534c007740 con 0x7f535c140620 2026-02-22T23:28:04.142 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.122+0000 7f53517fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-22T23:28:04.142 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.122+0000 7f53517fa640 10 monclient: _finish_command 2 = system:0 2026-02-22T23:28:04.142 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.122+0000 7f53517fa640 1 -- 10.20.193.45:0/587382788 >> v1:10.20.193.45:6791/0 conn(0x7f535c140620 legacy=0x7f535c072d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:04.142 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.122+0000 7f53517fa640 1 -- 10.20.193.45:0/587382788 >> v1:10.20.193.45:6791/0 conn(0x7f535c140620 legacy=0x7f535c072d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T23:28:04.143 INFO:teuthology.orchestra.run.trial045.stdout:{ 2026-02-22T23:28:04.143 INFO:teuthology.orchestra.run.trial045.stdout: "name": "c", 2026-02-22T23:28:04.143 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 4, 2026-02-22T23:28:04.143 INFO:teuthology.orchestra.run.trial045.stdout: "state": "peon", 2026-02-22T23:28:04.143 INFO:teuthology.orchestra.run.trial045.stdout: "election_epoch": 28, 2026-02-22T23:28:04.143 INFO:teuthology.orchestra.run.trial045.stdout: "uptime": 15461, 2026-02-22T23:28:04.143 INFO:teuthology.orchestra.run.trial045.stdout: "quorum": [ 2026-02-22T23:28:04.143 INFO:teuthology.orchestra.run.trial045.stdout: 0, 2026-02-22T23:28:04.143 INFO:teuthology.orchestra.run.trial045.stdout: 1, 2026-02-22T23:28:04.144 INFO:teuthology.orchestra.run.trial045.stdout: 2, 2026-02-22T23:28:04.144 INFO:teuthology.orchestra.run.trial045.stdout: 3, 2026-02-22T23:28:04.144 INFO:teuthology.orchestra.run.trial045.stdout: 4, 2026-02-22T23:28:04.144 INFO:teuthology.orchestra.run.trial045.stdout: 5, 2026-02-22T23:28:04.144 INFO:teuthology.orchestra.run.trial045.stdout: 6, 2026-02-22T23:28:04.144 INFO:teuthology.orchestra.run.trial045.stdout: 7, 2026-02-22T23:28:04.144 INFO:teuthology.orchestra.run.trial045.stdout: 8 2026-02-22T23:28:04.144 INFO:teuthology.orchestra.run.trial045.stdout: ], 2026-02-22T23:28:04.144 INFO:teuthology.orchestra.run.trial045.stdout: "quorum_age": 0, 2026-02-22T23:28:04.144 INFO:teuthology.orchestra.run.trial045.stdout: "features": { 2026-02-22T23:28:04.144 INFO:teuthology.orchestra.run.trial045.stdout: "required_con": "2450521708007866372", 2026-02-22T23:28:04.144 INFO:teuthology.orchestra.run.trial045.stdout: "required_mon": [ 2026-02-22T23:28:04.144 INFO:teuthology.orchestra.run.trial045.stdout: "kraken", 2026-02-22T23:28:04.144 INFO:teuthology.orchestra.run.trial045.stdout: "luminous", 2026-02-22T23:28:04.144 INFO:teuthology.orchestra.run.trial045.stdout: "mimic", 2026-02-22T23:28:04.144 INFO:teuthology.orchestra.run.trial045.stdout: "osdmap-prune", 2026-02-22T23:28:04.144 INFO:teuthology.orchestra.run.trial045.stdout: "nautilus", 2026-02-22T23:28:04.145 INFO:teuthology.orchestra.run.trial045.stdout: "octopus", 2026-02-22T23:28:04.145 INFO:teuthology.orchestra.run.trial045.stdout: "pacific", 2026-02-22T23:28:04.145 INFO:teuthology.orchestra.run.trial045.stdout: "elector-pinging", 2026-02-22T23:28:04.145 INFO:teuthology.orchestra.run.trial045.stdout: "quincy", 2026-02-22T23:28:04.145 INFO:teuthology.orchestra.run.trial045.stdout: "reef", 2026-02-22T23:28:04.145 INFO:teuthology.orchestra.run.trial045.stdout: "squid" 2026-02-22T23:28:04.145 INFO:teuthology.orchestra.run.trial045.stdout: ], 2026-02-22T23:28:04.145 INFO:teuthology.orchestra.run.trial045.stdout: "quorum_con": "4540701547738038271", 2026-02-22T23:28:04.145 INFO:teuthology.orchestra.run.trial045.stdout: "quorum_mon": [ 2026-02-22T23:28:04.145 INFO:teuthology.orchestra.run.trial045.stdout: "kraken", 2026-02-22T23:28:04.145 INFO:teuthology.orchestra.run.trial045.stdout: "luminous", 2026-02-22T23:28:04.145 INFO:teuthology.orchestra.run.trial045.stdout: "mimic", 2026-02-22T23:28:04.145 INFO:teuthology.orchestra.run.trial045.stdout: "osdmap-prune", 2026-02-22T23:28:04.145 INFO:teuthology.orchestra.run.trial045.stdout: "nautilus", 2026-02-22T23:28:04.145 INFO:teuthology.orchestra.run.trial045.stdout: "octopus", 2026-02-22T23:28:04.145 INFO:teuthology.orchestra.run.trial045.stdout: "pacific", 2026-02-22T23:28:04.146 INFO:teuthology.orchestra.run.trial045.stdout: "elector-pinging", 2026-02-22T23:28:04.146 INFO:teuthology.orchestra.run.trial045.stdout: "quincy", 2026-02-22T23:28:04.146 INFO:teuthology.orchestra.run.trial045.stdout: "reef", 2026-02-22T23:28:04.146 INFO:teuthology.orchestra.run.trial045.stdout: "squid" 2026-02-22T23:28:04.146 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:28:04.146 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:28:04.146 INFO:teuthology.orchestra.run.trial045.stdout: "outside_quorum": [], 2026-02-22T23:28:04.146 INFO:teuthology.orchestra.run.trial045.stdout: "extra_probe_peers": [], 2026-02-22T23:28:04.146 INFO:teuthology.orchestra.run.trial045.stdout: "sync_provider": [], 2026-02-22T23:28:04.146 INFO:teuthology.orchestra.run.trial045.stdout: "monmap": { 2026-02-22T23:28:04.146 INFO:teuthology.orchestra.run.trial045.stdout: "epoch": 1, 2026-02-22T23:28:04.146 INFO:teuthology.orchestra.run.trial045.stdout: "fsid": "4b60f18f-6660-4731-b731-dc85c4078413", 2026-02-22T23:28:04.146 INFO:teuthology.orchestra.run.trial045.stdout: "modified": "2026-02-22T23:24:52.393472Z", 2026-02-22T23:28:04.146 INFO:teuthology.orchestra.run.trial045.stdout: "created": "2026-02-22T23:24:52.393472Z", 2026-02-22T23:28:04.146 INFO:teuthology.orchestra.run.trial045.stdout: "min_mon_release": 19, 2026-02-22T23:28:04.146 INFO:teuthology.orchestra.run.trial045.stdout: "min_mon_release_name": "squid", 2026-02-22T23:28:04.146 INFO:teuthology.orchestra.run.trial045.stdout: "election_strategy": 3, 2026-02-22T23:28:04.146 INFO:teuthology.orchestra.run.trial045.stdout: "disallowed_leaders": "", 2026-02-22T23:28:04.146 INFO:teuthology.orchestra.run.trial045.stdout: "stretch_mode": false, 2026-02-22T23:28:04.147 INFO:teuthology.orchestra.run.trial045.stdout: "tiebreaker_mon": "", 2026-02-22T23:28:04.147 INFO:teuthology.orchestra.run.trial045.stdout: "removed_ranks": "", 2026-02-22T23:28:04.147 INFO:teuthology.orchestra.run.trial045.stdout: "features": { 2026-02-22T23:28:04.147 INFO:teuthology.orchestra.run.trial045.stdout: "persistent": [ 2026-02-22T23:28:04.147 INFO:teuthology.orchestra.run.trial045.stdout: "kraken", 2026-02-22T23:28:04.147 INFO:teuthology.orchestra.run.trial045.stdout: "luminous", 2026-02-22T23:28:04.147 INFO:teuthology.orchestra.run.trial045.stdout: "mimic", 2026-02-22T23:28:04.147 INFO:teuthology.orchestra.run.trial045.stdout: "osdmap-prune", 2026-02-22T23:28:04.147 INFO:teuthology.orchestra.run.trial045.stdout: "nautilus", 2026-02-22T23:28:04.147 INFO:teuthology.orchestra.run.trial045.stdout: "octopus", 2026-02-22T23:28:04.147 INFO:teuthology.orchestra.run.trial045.stdout: "pacific", 2026-02-22T23:28:04.147 INFO:teuthology.orchestra.run.trial045.stdout: "elector-pinging", 2026-02-22T23:28:04.147 INFO:teuthology.orchestra.run.trial045.stdout: "quincy", 2026-02-22T23:28:04.147 INFO:teuthology.orchestra.run.trial045.stdout: "reef", 2026-02-22T23:28:04.147 INFO:teuthology.orchestra.run.trial045.stdout: "squid" 2026-02-22T23:28:04.147 INFO:teuthology.orchestra.run.trial045.stdout: ], 2026-02-22T23:28:04.147 INFO:teuthology.orchestra.run.trial045.stdout: "optional": [] 2026-02-22T23:28:04.147 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:28:04.148 INFO:teuthology.orchestra.run.trial045.stdout: "mons": [ 2026-02-22T23:28:04.148 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:28:04.148 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 0, 2026-02-22T23:28:04.148 INFO:teuthology.orchestra.run.trial045.stdout: "name": "a", 2026-02-22T23:28:04.148 INFO:teuthology.orchestra.run.trial045.stdout: "public_addrs": { 2026-02-22T23:28:04.148 INFO:teuthology.orchestra.run.trial045.stdout: "addrvec": [ 2026-02-22T23:28:04.148 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:28:04.148 INFO:teuthology.orchestra.run.trial045.stdout: "type": "v1", 2026-02-22T23:28:04.148 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6789", 2026-02-22T23:28:04.148 INFO:teuthology.orchestra.run.trial045.stdout: "nonce": 0 2026-02-22T23:28:04.148 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:28:04.148 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:28:04.148 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:28:04.148 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6789/0", 2026-02-22T23:28:04.148 INFO:teuthology.orchestra.run.trial045.stdout: "public_addr": "10.20.193.45:6789/0", 2026-02-22T23:28:04.148 INFO:teuthology.orchestra.run.trial045.stdout: "priority": 0, 2026-02-22T23:28:04.148 INFO:teuthology.orchestra.run.trial045.stdout: "weight": 0, 2026-02-22T23:28:04.148 INFO:teuthology.orchestra.run.trial045.stdout: "crush_location": "{}" 2026-02-22T23:28:04.148 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:28:04.149 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:28:04.149 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 1, 2026-02-22T23:28:04.149 INFO:teuthology.orchestra.run.trial045.stdout: "name": "f", 2026-02-22T23:28:04.149 INFO:teuthology.orchestra.run.trial045.stdout: "public_addrs": { 2026-02-22T23:28:04.149 INFO:teuthology.orchestra.run.trial045.stdout: "addrvec": [ 2026-02-22T23:28:04.149 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:28:04.149 INFO:teuthology.orchestra.run.trial045.stdout: "type": "v1", 2026-02-22T23:28:04.149 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.73:6789", 2026-02-22T23:28:04.149 INFO:teuthology.orchestra.run.trial045.stdout: "nonce": 0 2026-02-22T23:28:04.149 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:28:04.149 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:28:04.149 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:28:04.149 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.73:6789/0", 2026-02-22T23:28:04.149 INFO:teuthology.orchestra.run.trial045.stdout: "public_addr": "10.20.193.73:6789/0", 2026-02-22T23:28:04.149 INFO:teuthology.orchestra.run.trial045.stdout: "priority": 0, 2026-02-22T23:28:04.149 INFO:teuthology.orchestra.run.trial045.stdout: "weight": 0, 2026-02-22T23:28:04.149 INFO:teuthology.orchestra.run.trial045.stdout: "crush_location": "{}" 2026-02-22T23:28:04.149 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:28:04.149 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:28:04.149 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 2, 2026-02-22T23:28:04.149 INFO:teuthology.orchestra.run.trial045.stdout: "name": "b", 2026-02-22T23:28:04.150 INFO:teuthology.orchestra.run.trial045.stdout: "public_addrs": { 2026-02-22T23:28:04.150 INFO:teuthology.orchestra.run.trial045.stdout: "addrvec": [ 2026-02-22T23:28:04.150 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:28:04.150 INFO:teuthology.orchestra.run.trial045.stdout: "type": "v1", 2026-02-22T23:28:04.150 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6790", 2026-02-22T23:28:04.150 INFO:teuthology.orchestra.run.trial045.stdout: "nonce": 0 2026-02-22T23:28:04.150 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:28:04.150 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:28:04.150 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:28:04.150 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6790/0", 2026-02-22T23:28:04.150 INFO:teuthology.orchestra.run.trial045.stdout: "public_addr": "10.20.193.45:6790/0", 2026-02-22T23:28:04.150 INFO:teuthology.orchestra.run.trial045.stdout: "priority": 0, 2026-02-22T23:28:04.150 INFO:teuthology.orchestra.run.trial045.stdout: "weight": 0, 2026-02-22T23:28:04.150 INFO:teuthology.orchestra.run.trial045.stdout: "crush_location": "{}" 2026-02-22T23:28:04.150 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:28:04.150 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:28:04.150 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 3, 2026-02-22T23:28:04.150 INFO:teuthology.orchestra.run.trial045.stdout: "name": "g", 2026-02-22T23:28:04.150 INFO:teuthology.orchestra.run.trial045.stdout: "public_addrs": { 2026-02-22T23:28:04.150 INFO:teuthology.orchestra.run.trial045.stdout: "addrvec": [ 2026-02-22T23:28:04.150 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:28:04.151 INFO:teuthology.orchestra.run.trial045.stdout: "type": "v1", 2026-02-22T23:28:04.151 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.73:6790", 2026-02-22T23:28:04.151 INFO:teuthology.orchestra.run.trial045.stdout: "nonce": 0 2026-02-22T23:28:04.151 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:28:04.151 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:28:04.151 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:28:04.151 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.73:6790/0", 2026-02-22T23:28:04.151 INFO:teuthology.orchestra.run.trial045.stdout: "public_addr": "10.20.193.73:6790/0", 2026-02-22T23:28:04.151 INFO:teuthology.orchestra.run.trial045.stdout: "priority": 0, 2026-02-22T23:28:04.151 INFO:teuthology.orchestra.run.trial045.stdout: "weight": 0, 2026-02-22T23:28:04.151 INFO:teuthology.orchestra.run.trial045.stdout: "crush_location": "{}" 2026-02-22T23:28:04.151 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:28:04.151 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:28:04.151 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 4, 2026-02-22T23:28:04.151 INFO:teuthology.orchestra.run.trial045.stdout: "name": "c", 2026-02-22T23:28:04.151 INFO:teuthology.orchestra.run.trial045.stdout: "public_addrs": { 2026-02-22T23:28:04.151 INFO:teuthology.orchestra.run.trial045.stdout: "addrvec": [ 2026-02-22T23:28:04.151 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:28:04.151 INFO:teuthology.orchestra.run.trial045.stdout: "type": "v1", 2026-02-22T23:28:04.151 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6791", 2026-02-22T23:28:04.151 INFO:teuthology.orchestra.run.trial045.stdout: "nonce": 0 2026-02-22T23:28:04.151 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:28:04.151 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:28:04.152 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:28:04.152 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6791/0", 2026-02-22T23:28:04.152 INFO:teuthology.orchestra.run.trial045.stdout: "public_addr": "10.20.193.45:6791/0", 2026-02-22T23:28:04.152 INFO:teuthology.orchestra.run.trial045.stdout: "priority": 0, 2026-02-22T23:28:04.152 INFO:teuthology.orchestra.run.trial045.stdout: "weight": 0, 2026-02-22T23:28:04.152 INFO:teuthology.orchestra.run.trial045.stdout: "crush_location": "{}" 2026-02-22T23:28:04.152 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:28:04.152 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:28:04.152 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 5, 2026-02-22T23:28:04.152 INFO:teuthology.orchestra.run.trial045.stdout: "name": "h", 2026-02-22T23:28:04.152 INFO:teuthology.orchestra.run.trial045.stdout: "public_addrs": { 2026-02-22T23:28:04.152 INFO:teuthology.orchestra.run.trial045.stdout: "addrvec": [ 2026-02-22T23:28:04.152 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:28:04.152 INFO:teuthology.orchestra.run.trial045.stdout: "type": "v1", 2026-02-22T23:28:04.152 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.73:6791", 2026-02-22T23:28:04.152 INFO:teuthology.orchestra.run.trial045.stdout: "nonce": 0 2026-02-22T23:28:04.152 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:28:04.152 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:28:04.152 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:28:04.152 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.73:6791/0", 2026-02-22T23:28:04.152 INFO:teuthology.orchestra.run.trial045.stdout: "public_addr": "10.20.193.73:6791/0", 2026-02-22T23:28:04.152 INFO:teuthology.orchestra.run.trial045.stdout: "priority": 0, 2026-02-22T23:28:04.153 INFO:teuthology.orchestra.run.trial045.stdout: "weight": 0, 2026-02-22T23:28:04.153 INFO:teuthology.orchestra.run.trial045.stdout: "crush_location": "{}" 2026-02-22T23:28:04.153 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:28:04.153 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:28:04.153 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 6, 2026-02-22T23:28:04.153 INFO:teuthology.orchestra.run.trial045.stdout: "name": "d", 2026-02-22T23:28:04.153 INFO:teuthology.orchestra.run.trial045.stdout: "public_addrs": { 2026-02-22T23:28:04.153 INFO:teuthology.orchestra.run.trial045.stdout: "addrvec": [ 2026-02-22T23:28:04.153 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:28:04.153 INFO:teuthology.orchestra.run.trial045.stdout: "type": "v1", 2026-02-22T23:28:04.153 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6792", 2026-02-22T23:28:04.153 INFO:teuthology.orchestra.run.trial045.stdout: "nonce": 0 2026-02-22T23:28:04.153 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:28:04.153 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:28:04.153 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:28:04.153 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6792/0", 2026-02-22T23:28:04.153 INFO:teuthology.orchestra.run.trial045.stdout: "public_addr": "10.20.193.45:6792/0", 2026-02-22T23:28:04.153 INFO:teuthology.orchestra.run.trial045.stdout: "priority": 0, 2026-02-22T23:28:04.153 INFO:teuthology.orchestra.run.trial045.stdout: "weight": 0, 2026-02-22T23:28:04.153 INFO:teuthology.orchestra.run.trial045.stdout: "crush_location": "{}" 2026-02-22T23:28:04.153 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:28:04.153 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:28:04.154 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 7, 2026-02-22T23:28:04.154 INFO:teuthology.orchestra.run.trial045.stdout: "name": "i", 2026-02-22T23:28:04.154 INFO:teuthology.orchestra.run.trial045.stdout: "public_addrs": { 2026-02-22T23:28:04.154 INFO:teuthology.orchestra.run.trial045.stdout: "addrvec": [ 2026-02-22T23:28:04.154 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:28:04.154 INFO:teuthology.orchestra.run.trial045.stdout: "type": "v1", 2026-02-22T23:28:04.154 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.73:6792", 2026-02-22T23:28:04.154 INFO:teuthology.orchestra.run.trial045.stdout: "nonce": 0 2026-02-22T23:28:04.154 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:28:04.154 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:28:04.154 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:28:04.154 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.73:6792/0", 2026-02-22T23:28:04.154 INFO:teuthology.orchestra.run.trial045.stdout: "public_addr": "10.20.193.73:6792/0", 2026-02-22T23:28:04.154 INFO:teuthology.orchestra.run.trial045.stdout: "priority": 0, 2026-02-22T23:28:04.154 INFO:teuthology.orchestra.run.trial045.stdout: "weight": 0, 2026-02-22T23:28:04.154 INFO:teuthology.orchestra.run.trial045.stdout: "crush_location": "{}" 2026-02-22T23:28:04.154 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:28:04.154 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:28:04.154 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 8, 2026-02-22T23:28:04.154 INFO:teuthology.orchestra.run.trial045.stdout: "name": "e", 2026-02-22T23:28:04.154 INFO:teuthology.orchestra.run.trial045.stdout: "public_addrs": { 2026-02-22T23:28:04.154 INFO:teuthology.orchestra.run.trial045.stdout: "addrvec": [ 2026-02-22T23:28:04.154 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:28:04.155 INFO:teuthology.orchestra.run.trial045.stdout: "type": "v1", 2026-02-22T23:28:04.155 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6793", 2026-02-22T23:28:04.155 INFO:teuthology.orchestra.run.trial045.stdout: "nonce": 0 2026-02-22T23:28:04.155 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:28:04.155 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:28:04.155 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:28:04.155 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6793/0", 2026-02-22T23:28:04.155 INFO:teuthology.orchestra.run.trial045.stdout: "public_addr": "10.20.193.45:6793/0", 2026-02-22T23:28:04.155 INFO:teuthology.orchestra.run.trial045.stdout: "priority": 0, 2026-02-22T23:28:04.155 INFO:teuthology.orchestra.run.trial045.stdout: "weight": 0, 2026-02-22T23:28:04.155 INFO:teuthology.orchestra.run.trial045.stdout: "crush_location": "{}" 2026-02-22T23:28:04.155 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:28:04.155 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:28:04.155 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:28:04.155 INFO:teuthology.orchestra.run.trial045.stdout: "feature_map": { 2026-02-22T23:28:04.155 INFO:teuthology.orchestra.run.trial045.stdout: "mon": [ 2026-02-22T23:28:04.155 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:28:04.155 INFO:teuthology.orchestra.run.trial045.stdout: "features": "0x3f03cffffffdffff", 2026-02-22T23:28:04.155 INFO:teuthology.orchestra.run.trial045.stdout: "release": "squid", 2026-02-22T23:28:04.155 INFO:teuthology.orchestra.run.trial045.stdout: "num": 1 2026-02-22T23:28:04.155 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:28:04.156 INFO:teuthology.orchestra.run.trial045.stdout: ], 2026-02-22T23:28:04.156 INFO:teuthology.orchestra.run.trial045.stdout: "client": [ 2026-02-22T23:28:04.156 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:28:04.156 INFO:teuthology.orchestra.run.trial045.stdout: "features": "0x3f03cffffffdffff", 2026-02-22T23:28:04.156 INFO:teuthology.orchestra.run.trial045.stdout: "release": "squid", 2026-02-22T23:28:04.156 INFO:teuthology.orchestra.run.trial045.stdout: "num": 1 2026-02-22T23:28:04.156 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:28:04.156 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:28:04.156 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:28:04.156 INFO:teuthology.orchestra.run.trial045.stdout: "stretch_mode": false 2026-02-22T23:28:04.156 INFO:teuthology.orchestra.run.trial045.stdout:} 2026-02-22T23:28:04.157 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.122+0000 7f5362f03640 1 -- 10.20.193.45:0/587382788 >> v1:10.20.193.73:6800/2222410180 conn(0x7f532c0402a0 legacy=0x7f532c042760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:04.157 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.122+0000 7f5362f03640 10 monclient: shutdown 2026-02-22T23:28:04.157 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.122+0000 7f5362f03640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T23:28:04.157 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.122+0000 7f5362f03640 1 -- 10.20.193.45:0/587382788 >> v1:10.20.193.73:6790/0 conn(0x7f535c0a1a60 legacy=0x7f535c1d2280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:04.157 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.122+0000 7f5361479640 1 -- 10.20.193.45:0/587382788 reap_dead start 2026-02-22T23:28:04.157 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.122+0000 7f5361479640 1 -- 10.20.193.45:0/587382788 reap_dead start 2026-02-22T23:28:04.157 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.122+0000 7f5362f03640 1 -- 10.20.193.45:0/587382788 shutdown_connections 2026-02-22T23:28:04.157 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.122+0000 7f5362f03640 1 -- 10.20.193.45:0/587382788 >> 10.20.193.45:0/587382788 conn(0x7f535c0a7780 msgr2=0x7f535c140f70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:28:04.157 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.122+0000 7f5362f03640 1 -- 10.20.193.45:0/587382788 shutdown_connections 2026-02-22T23:28:04.157 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.122+0000 7f5362f03640 1 -- 10.20.193.45:0/587382788 wait complete. 2026-02-22T23:28:04.158 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2026-02-22T23:28:04.158 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon d 2026-02-22T23:28:04.158 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.d mon_status 2026-02-22T23:28:04.224 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.222+0000 7f661bf96640 10 monclient: get_monmap_and_config 2026-02-22T23:28:04.224 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.222+0000 7f661bf96640 10 monclient: build_initial_monmap 2026-02-22T23:28:04.224 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.223+0000 7f661bf96640 10 monclient: monmap: 2026-02-22T23:28:04.224 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-22T23:28:04.224 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:28:04.224 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:28:04.224198+0000 2026-02-22T23:28:04.224 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:28:04.224198+0000 2026-02-22T23:28:04.224 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-22T23:28:04.224 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:28:04.225 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-22T23:28:04.225 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.noname-f 2026-02-22T23:28:04.225 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.noname-b 2026-02-22T23:28:04.225 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.noname-g 2026-02-22T23:28:04.225 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.noname-c 2026-02-22T23:28:04.225 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.noname-h 2026-02-22T23:28:04.225 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.noname-d 2026-02-22T23:28:04.225 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.noname-i 2026-02-22T23:28:04.225 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.noname-e 2026-02-22T23:28:04.225 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:04.232 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.223+0000 7f661bf96640 1 Processor -- start 2026-02-22T23:28:04.232 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.223+0000 7f661bf96640 1 -- start start 2026-02-22T23:28:04.232 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.223+0000 7f661bf96640 10 monclient: init 2026-02-22T23:28:04.233 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.223+0000 7f661bf96640 10 monclient: _reopen_session rank -1 2026-02-22T23:28:04.233 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.223+0000 7f661bf96640 10 monclient: _add_conns ranks=[6,5,3,4,2,7,0,8,1] 2026-02-22T23:28:04.233 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.223+0000 7f661bf96640 10 monclient(hunting): picked mon.noname-d con 0x7f66140a5e00 addr v1:10.20.193.45:6792/0 2026-02-22T23:28:04.233 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.223+0000 7f661bf96640 10 monclient(hunting): picked mon.noname-h con 0x7f66140a68f0 addr v1:10.20.193.73:6791/0 2026-02-22T23:28:04.233 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.223+0000 7f661bf96640 10 monclient(hunting): picked mon.noname-g con 0x7f66140a6d00 addr v1:10.20.193.73:6790/0 2026-02-22T23:28:04.233 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.223+0000 7f661bf96640 1 -- --> v1:10.20.193.73:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f66140a2d00 con 0x7f66140a6d00 2026-02-22T23:28:04.233 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.223+0000 7f661bf96640 1 -- --> v1:10.20.193.73:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f66140a2fe0 con 0x7f66140a68f0 2026-02-22T23:28:04.233 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.223+0000 7f661bf96640 1 -- --> v1:10.20.193.45:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f66140a32c0 con 0x7f66140a5e00 2026-02-22T23:28:04.233 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.223+0000 7f661bf96640 10 monclient(hunting): _renew_subs 2026-02-22T23:28:04.233 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.223+0000 7f661bf96640 10 monclient(hunting): authenticate will time out at 815.840769s 2026-02-22T23:28:04.233 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.223+0000 7f6619d0b640 1 --1- >> v1:10.20.193.45:6792/0 conn(0x7f66140a5e00 0x7f66140a61e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.45:6792/0 says I am v1:10.20.193.45:36726/0 (socket says 10.20.193.45:36726) 2026-02-22T23:28:04.233 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.223+0000 7f6619d0b640 1 -- 10.20.193.45:0/1074452605 learned_addr learned my addr 10.20.193.45:0/1074452605 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-22T23:28:04.233 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.224+0000 7f6618d09640 1 -- 10.20.193.45:0/1074452605 <== mon.6 v1:10.20.193.45:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1395004045 0 0) 0x7f66140a32c0 con 0x7f66140a5e00 2026-02-22T23:28:04.233 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.224+0000 7f6618d09640 10 monclient(hunting): _negotiate 2026-02-22T23:28:04.233 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.224+0000 7f6618d09640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:28:04.234 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.224+0000 7f6618d09640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:28:04.234 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.224+0000 7f6618d09640 10 monclient(hunting): my global_id is 114117 2026-02-22T23:28:04.234 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.224+0000 7f6618d09640 1 -- 10.20.193.45:0/1074452605 --> v1:10.20.193.45:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f65fc003620 con 0x7f66140a5e00 2026-02-22T23:28:04.234 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.224+0000 7f6618d09640 1 -- 10.20.193.45:0/1074452605 <== mon.5 v1:10.20.193.73:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1931079370 0 0) 0x7f66140a2fe0 con 0x7f66140a68f0 2026-02-22T23:28:04.234 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.224+0000 7f6618d09640 10 monclient(hunting): _negotiate 2026-02-22T23:28:04.234 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.224+0000 7f6618d09640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:28:04.234 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.224+0000 7f6618d09640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:28:04.234 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.224+0000 7f6618d09640 10 monclient(hunting): my global_id is 114116 2026-02-22T23:28:04.234 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.224+0000 7f6618d09640 1 -- 10.20.193.45:0/1074452605 --> v1:10.20.193.73:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f66140a32c0 con 0x7f66140a68f0 2026-02-22T23:28:04.234 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.224+0000 7f6618d09640 1 -- 10.20.193.45:0/1074452605 <== mon.6 v1:10.20.193.45:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2552511264 0 0) 0x7f65fc003620 con 0x7f66140a5e00 2026-02-22T23:28:04.234 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.224+0000 7f6618d09640 1 -- 10.20.193.45:0/1074452605 >> v1:10.20.193.73:6791/0 conn(0x7f66140a68f0 legacy=0x7f661413e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:04.234 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.224+0000 7f6618d09640 1 -- 10.20.193.45:0/1074452605 >> v1:10.20.193.73:6790/0 conn(0x7f66140a6d00 legacy=0x7f66141417b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:04.234 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.224+0000 7f6618d09640 10 monclient: _finish_hunting 0 2026-02-22T23:28:04.234 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.224+0000 7f6618d09640 1 monclient: found mon.noname-d 2026-02-22T23:28:04.234 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.224+0000 7f6618d09640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T23:28:04.234 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.224+0000 7f6618d09640 10 monclient: _send_mon_message to mon.noname-d at v1:10.20.193.45:6792/0 2026-02-22T23:28:04.234 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.224+0000 7f6618d09640 1 -- 10.20.193.45:0/1074452605 --> v1:10.20.193.45:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66140a35a0 con 0x7f66140a5e00 2026-02-22T23:28:04.235 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.224+0000 7f6618d09640 10 monclient: _finish_auth 0 2026-02-22T23:28:04.235 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.224+0000 7f6618d09640 10 monclient: _check_auth_tickets 2026-02-22T23:28:04.235 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.224+0000 7f6618d09640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T23:28:04.235 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.224+0000 7f6618d09640 1 -- 10.20.193.45:0/1074452605 <== mon.6 v1:10.20.193.45:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f6604003040 con 0x7f66140a5e00 2026-02-22T23:28:04.235 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.224+0000 7f6618d09640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:28:04.235 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.224+0000 7f6618d09640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2026-02-22T23:28:04.235 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.224+0000 7f6618d09640 10 monclient: dump: 2026-02-22T23:28:04.235 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:28:04.235 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:28:04.235 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:04.235 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:04.235 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:28:04.235 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:28:04.235 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:28:04.235 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:28:04.235 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:28:04.235 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:28:04.236 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:28:04.236 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:28:04.236 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:28:04.236 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:28:04.236 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:28:04.236 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:04.236 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.224+0000 7f661bf96640 5 monclient: authenticate success, global_id 114117 2026-02-22T23:28:04.236 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.224+0000 7f661bf96640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-22T23:28:04.236 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.224+0000 7f6618d09640 1 -- 10.20.193.45:0/1074452605 <== mon.6 v1:10.20.193.45:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f66040031e0 con 0x7f66140a5e00 2026-02-22T23:28:04.236 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.224+0000 7f6618d09640 10 monclient: handle_config config(0 keys) 2026-02-22T23:28:04.236 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.224+0000 7f6618d09640 1 -- 10.20.193.45:0/1074452605 <== mon.6 v1:10.20.193.45:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f6604004ce0 con 0x7f66140a5e00 2026-02-22T23:28:04.236 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.224+0000 7f661bf96640 10 monclient: get_monmap_and_config success 2026-02-22T23:28:04.236 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.224+0000 7f661bf96640 4 set_mon_vals no callback set 2026-02-22T23:28:04.236 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.224+0000 7f6618d09640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:28:04.236 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.224+0000 7f6618d09640 10 monclient: got monmap 1 from mon.d (according to old e1) 2026-02-22T23:28:04.236 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.224+0000 7f6618d09640 10 monclient: dump: 2026-02-22T23:28:04.236 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:28:04.237 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:28:04.237 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:04.237 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:04.237 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:28:04.237 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:28:04.237 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:28:04.237 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:28:04.237 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:28:04.237 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:28:04.237 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:28:04.237 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:28:04.237 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:28:04.237 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:28:04.237 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:28:04.237 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:04.237 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.224+0000 7f661bf96640 10 monclient: shutdown 2026-02-22T23:28:04.237 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.224+0000 7f661bf96640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T23:28:04.237 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.224+0000 7f661bf96640 1 -- 10.20.193.45:0/1074452605 >> v1:10.20.193.45:6792/0 conn(0x7f66140a5e00 legacy=0x7f66140a61e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:04.238 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.224+0000 7f661bf96640 1 -- 10.20.193.45:0/1074452605 shutdown_connections 2026-02-22T23:28:04.238 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.224+0000 7f661bf96640 1 -- 10.20.193.45:0/1074452605 >> 10.20.193.45:0/1074452605 conn(0x7f66140abb50 msgr2=0x7f66140a7f00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:28:04.238 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.224+0000 7f661bf96640 1 -- 10.20.193.45:0/1074452605 shutdown_connections 2026-02-22T23:28:04.238 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.224+0000 7f661bf96640 1 -- 10.20.193.45:0/1074452605 wait complete. 2026-02-22T23:28:04.238 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.224+0000 7f661bf96640 10 monclient: build_initial_monmap 2026-02-22T23:28:04.238 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.224+0000 7f661bf96640 10 monclient: monmap: 2026-02-22T23:28:04.238 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-22T23:28:04.238 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T23:28:04.238 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-22T23:28:04.238 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-22T23:28:04.238 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-22T23:28:04.238 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-22T23:28:04.238 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-22T23:28:04.238 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.noname-f 2026-02-22T23:28:04.238 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.noname-b 2026-02-22T23:28:04.238 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.noname-g 2026-02-22T23:28:04.238 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.noname-c 2026-02-22T23:28:04.239 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.noname-h 2026-02-22T23:28:04.239 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.noname-d 2026-02-22T23:28:04.239 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.noname-i 2026-02-22T23:28:04.239 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.noname-e 2026-02-22T23:28:04.239 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:04.239 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.225+0000 7f661bf96640 1 Processor -- start 2026-02-22T23:28:04.239 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.225+0000 7f661bf96640 1 -- start start 2026-02-22T23:28:04.239 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.225+0000 7f661bf96640 10 monclient: init 2026-02-22T23:28:04.239 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.225+0000 7f661bf96640 10 monclient: _reopen_session rank -1 2026-02-22T23:28:04.239 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.225+0000 7f661bf96640 10 monclient: _add_conns ranks=[7,0,6,8,3,1,4,5,2] 2026-02-22T23:28:04.239 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.225+0000 7f661bf96640 10 monclient(hunting): picked mon.noname-i con 0x7f66140a5e00 addr v1:10.20.193.73:6792/0 2026-02-22T23:28:04.239 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.225+0000 7f661bf96640 10 monclient(hunting): picked mon.noname-a con 0x7f66140a68f0 addr v1:10.20.193.45:6789/0 2026-02-22T23:28:04.239 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.225+0000 7f661bf96640 10 monclient(hunting): picked mon.noname-d con 0x7f66140a6d00 addr v1:10.20.193.45:6792/0 2026-02-22T23:28:04.239 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.225+0000 7f661bf96640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f66141294b0 con 0x7f66140a68f0 2026-02-22T23:28:04.239 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.225+0000 7f661bf96640 1 -- --> v1:10.20.193.45:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f66140aa3f0 con 0x7f66140a6d00 2026-02-22T23:28:04.239 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.225+0000 7f661bf96640 1 -- --> v1:10.20.193.73:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f66140a9ea0 con 0x7f66140a5e00 2026-02-22T23:28:04.239 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.225+0000 7f661bf96640 10 monclient(hunting): _renew_subs 2026-02-22T23:28:04.239 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.225+0000 7f661bf96640 10 monclient(hunting): authenticate will time out at 815.842371s 2026-02-22T23:28:04.240 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.225+0000 7f661950a640 1 --1- >> v1:10.20.193.45:6789/0 conn(0x7f66140a68f0 0x7f6614125ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.45:6789/0 says I am v1:10.20.193.45:38378/0 (socket says 10.20.193.45:38378) 2026-02-22T23:28:04.240 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.225+0000 7f661950a640 1 -- 10.20.193.45:0/65764988 learned_addr learned my addr 10.20.193.45:0/65764988 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-22T23:28:04.240 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.225+0000 7f661a50c640 1 --1- >> v1:10.20.193.45:6792/0 conn(0x7f66140a6d00 0x7f66141d7d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.45:6792/0 says I am v1:10.20.193.45:36740/0 (socket says 10.20.193.45:36740) 2026-02-22T23:28:04.240 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.225+0000 7f66027fc640 1 -- 10.20.193.45:0/65764988 <== mon.6 v1:10.20.193.45:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2898470931 0 0) 0x7f66140aa3f0 con 0x7f66140a6d00 2026-02-22T23:28:04.240 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.225+0000 7f66027fc640 10 monclient(hunting): _negotiate 2026-02-22T23:28:04.240 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.225+0000 7f66027fc640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:28:04.240 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.225+0000 7f66027fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:28:04.240 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.225+0000 7f66027fc640 10 monclient(hunting): my global_id is 114126 2026-02-22T23:28:04.240 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.225+0000 7f66027fc640 1 -- 10.20.193.45:0/65764988 --> v1:10.20.193.45:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f65e4003620 con 0x7f66140a6d00 2026-02-22T23:28:04.240 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.225+0000 7f66027fc640 1 -- 10.20.193.45:0/65764988 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 352746725 0 0) 0x7f66141294b0 con 0x7f66140a68f0 2026-02-22T23:28:04.240 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.225+0000 7f66027fc640 10 monclient(hunting): _negotiate 2026-02-22T23:28:04.240 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.225+0000 7f66027fc640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:28:04.240 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.225+0000 7f66027fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:28:04.240 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.225+0000 7f66027fc640 10 monclient(hunting): my global_id is 4581 2026-02-22T23:28:04.240 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.225+0000 7f66027fc640 1 -- 10.20.193.45:0/65764988 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f66140aa3f0 con 0x7f66140a68f0 2026-02-22T23:28:04.240 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.225+0000 7f66027fc640 1 -- 10.20.193.45:0/65764988 <== mon.6 v1:10.20.193.45:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1902719716 0 0) 0x7f65e4003620 con 0x7f66140a6d00 2026-02-22T23:28:04.240 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.225+0000 7f66027fc640 1 -- 10.20.193.45:0/65764988 --> v1:10.20.193.45:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f66141294b0 con 0x7f66140a6d00 2026-02-22T23:28:04.241 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.225+0000 7f66027fc640 1 -- 10.20.193.45:0/65764988 <== mon.6 v1:10.20.193.45:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f6610003620 con 0x7f66140a6d00 2026-02-22T23:28:04.241 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.225+0000 7f66027fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-22T23:28:04.241 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.225+0000 7f66027fc640 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2026-02-22T23:28:04.241 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.225+0000 7f66027fc640 10 monclient(hunting): dump: 2026-02-22T23:28:04.241 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:28:04.241 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:28:04.241 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:04.241 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:04.241 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:28:04.241 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:28:04.241 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:28:04.241 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:28:04.241 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:28:04.241 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:28:04.241 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:28:04.241 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:28:04.241 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:28:04.242 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:28:04.242 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:28:04.242 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:04.242 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.225+0000 7f66027fc640 10 monclient(hunting): _finish_auth 0 2026-02-22T23:28:04.242 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.225+0000 7f66027fc640 1 -- 10.20.193.45:0/65764988 <== mon.0 v1:10.20.193.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3107858114 0 0) 0x7f66140aa3f0 con 0x7f66140a68f0 2026-02-22T23:28:04.242 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.225+0000 7f66027fc640 1 -- 10.20.193.45:0/65764988 --> v1:10.20.193.45:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f65e4003620 con 0x7f66140a68f0 2026-02-22T23:28:04.242 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.225+0000 7f66027fc640 1 -- 10.20.193.45:0/65764988 <== mon.0 v1:10.20.193.45:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f6608003420 con 0x7f66140a68f0 2026-02-22T23:28:04.242 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.225+0000 7f66027fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-22T23:28:04.242 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.225+0000 7f66027fc640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-22T23:28:04.242 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.225+0000 7f66027fc640 10 monclient(hunting): dump: 2026-02-22T23:28:04.242 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:28:04.242 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:28:04.242 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:04.242 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:04.242 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:28:04.242 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:28:04.242 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:28:04.243 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:28:04.243 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:28:04.243 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:28:04.243 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:28:04.243 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:28:04.243 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:28:04.243 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:28:04.243 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:28:04.243 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:04.243 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.225+0000 7f66027fc640 1 -- 10.20.193.45:0/65764988 <== mon.6 v1:10.20.193.45:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 617268882 0 0) 0x7f66141294b0 con 0x7f66140a6d00 2026-02-22T23:28:04.243 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.225+0000 7f66027fc640 1 -- 10.20.193.45:0/65764988 >> v1:10.20.193.73:6792/0 conn(0x7f66140a5e00 legacy=0x7f6614125790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:04.243 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.225+0000 7f66027fc640 1 -- 10.20.193.45:0/65764988 >> v1:10.20.193.45:6789/0 conn(0x7f66140a68f0 legacy=0x7f6614125ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:04.243 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.225+0000 7f66027fc640 10 monclient: _finish_hunting 0 2026-02-22T23:28:04.243 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.225+0000 7f66027fc640 1 monclient: found mon.d 2026-02-22T23:28:04.243 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.225+0000 7f66027fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T23:28:04.243 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.225+0000 7f66027fc640 10 monclient: _send_mon_message to mon.d at v1:10.20.193.45:6792/0 2026-02-22T23:28:04.243 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.225+0000 7f66027fc640 1 -- 10.20.193.45:0/65764988 --> v1:10.20.193.45:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6614127a70 con 0x7f66140a6d00 2026-02-22T23:28:04.243 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.225+0000 7f66027fc640 10 monclient: _finish_auth 0 2026-02-22T23:28:04.244 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.225+0000 7f66027fc640 10 monclient: _check_auth_tickets 2026-02-22T23:28:04.244 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.225+0000 7f66027fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T23:28:04.244 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.225+0000 7f661bf96640 5 monclient: authenticate success, global_id 114126 2026-02-22T23:28:04.244 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.225+0000 7f661bf96640 10 monclient: _renew_subs 2026-02-22T23:28:04.244 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.225+0000 7f661bf96640 10 monclient: _send_mon_message to mon.d at v1:10.20.193.45:6792/0 2026-02-22T23:28:04.244 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.225+0000 7f661bf96640 1 -- 10.20.193.45:0/65764988 --> v1:10.20.193.45:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f6614128ef0 con 0x7f66140a6d00 2026-02-22T23:28:04.244 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.225+0000 7f661bf96640 10 monclient: _renew_subs 2026-02-22T23:28:04.244 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.225+0000 7f661bf96640 10 monclient: _send_mon_message to mon.d at v1:10.20.193.45:6792/0 2026-02-22T23:28:04.244 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.225+0000 7f661bf96640 1 -- 10.20.193.45:0/65764988 --> v1:10.20.193.45:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7f66141265b0 con 0x7f66140a6d00 2026-02-22T23:28:04.244 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.225+0000 7f66027fc640 1 -- 10.20.193.45:0/65764988 <== mon.6 v1:10.20.193.45:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6610003d40 con 0x7f66140a6d00 2026-02-22T23:28:04.244 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.225+0000 7f66027fc640 10 monclient: handle_config config(0 keys) 2026-02-22T23:28:04.244 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.225+0000 7f66027fc640 1 -- 10.20.193.45:0/65764988 <== mon.6 v1:10.20.193.45:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f6610004330 con 0x7f66140a6d00 2026-02-22T23:28:04.244 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.225+0000 7f66027fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:28:04.244 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.225+0000 7f66027fc640 10 monclient: got monmap 1 from mon.d (according to old e1) 2026-02-22T23:28:04.244 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.225+0000 7f6603fff640 4 set_mon_vals no callback set 2026-02-22T23:28:04.244 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.225+0000 7f66027fc640 10 monclient: dump: 2026-02-22T23:28:04.244 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:28:04.245 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:28:04.245 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:04.245 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:04.245 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:28:04.245 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:28:04.245 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:28:04.245 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:28:04.245 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:28:04.245 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:28:04.245 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:28:04.245 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:28:04.245 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:28:04.245 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:28:04.245 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:28:04.245 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:04.245 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.226+0000 7f661bf96640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T23:28:04.245 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.226+0000 7f661bf96640 1 -- 10.20.193.45:0/65764988 --> v1:10.20.193.45:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f66140008d0 con 0x7f6614121a50 2026-02-22T23:28:04.246 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.226+0000 7f66027fc640 1 -- 10.20.193.45:0/65764988 <== mon.6 v1:10.20.193.45:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3937782779 0 0) 0x7f66140008d0 con 0x7f6614121a50 2026-02-22T23:28:04.246 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.226+0000 7f66027fc640 10 monclient(hunting): _negotiate 2026-02-22T23:28:04.246 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.226+0000 7f66027fc640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:28:04.246 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.226+0000 7f66027fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:28:04.246 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.226+0000 7f66027fc640 10 monclient(hunting): my global_id is 114135 2026-02-22T23:28:04.246 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.226+0000 7f66027fc640 1 -- 10.20.193.45:0/65764988 --> v1:10.20.193.45:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f66141294b0 con 0x7f6614121a50 2026-02-22T23:28:04.246 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.226+0000 7f66027fc640 1 -- 10.20.193.45:0/65764988 <== mon.6 v1:10.20.193.45:6792/0 7 ==== mgrmap(e 5) ==== 50225+0+0 (unknown 2330357642 0 0) 0x7f66100044d0 con 0x7f66140a6d00 2026-02-22T23:28:04.246 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.226+0000 7f66027fc640 1 -- 10.20.193.45:0/65764988 <== mon.6 v1:10.20.193.45:6792/0 8 ==== osd_map(25..25 src has 1..25) ==== 3502+0+0 (unknown 129690100 0 0) 0x7f661004de90 con 0x7f66140a6d00 2026-02-22T23:28:04.246 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.226+0000 7f66027fc640 1 -- 10.20.193.45:0/65764988 <== mon.6 v1:10.20.193.45:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 994418004 0 0) 0x7f66141294b0 con 0x7f6614121a50 2026-02-22T23:28:04.246 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.226+0000 7f66027fc640 1 -- 10.20.193.45:0/65764988 --> v1:10.20.193.45:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f66140008d0 con 0x7f6614121a50 2026-02-22T23:28:04.246 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.226+0000 7f66027fc640 1 -- 10.20.193.45:0/65764988 <== mon.6 v1:10.20.193.45:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f6604002de0 con 0x7f6614121a50 2026-02-22T23:28:04.246 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.226+0000 7f66027fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:28:04.246 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.226+0000 7f66027fc640 10 monclient: got monmap 1 from mon.d (according to old e1) 2026-02-22T23:28:04.246 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.226+0000 7f66027fc640 10 monclient: dump: 2026-02-22T23:28:04.246 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:28:04.246 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:28:04.246 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:04.247 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:04.247 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:28:04.247 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:28:04.247 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:28:04.247 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:28:04.247 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:28:04.247 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:28:04.247 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:28:04.247 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:28:04.247 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:28:04.247 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:28:04.247 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:28:04.247 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:04.247 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.226+0000 7f661950a640 10 monclient: get_auth_request con 0x7f65e403fdc0 auth_method 0 2026-02-22T23:28:04.247 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.226+0000 7f66027fc640 1 -- 10.20.193.45:0/65764988 <== mon.6 v1:10.20.193.45:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1280584982 0 0) 0x7f66140008d0 con 0x7f6614121a50 2026-02-22T23:28:04.247 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.226+0000 7f66027fc640 1 -- 10.20.193.45:0/65764988 --> v1:10.20.193.45:6792/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6614126890 con 0x7f6614121a50 2026-02-22T23:28:04.247 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.227+0000 7f66027fc640 1 -- 10.20.193.45:0/65764988 <== mon.6 v1:10.20.193.45:6792/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (unknown 0 0 2024835662) 0x7f6604003110 con 0x7f6614121a50 2026-02-22T23:28:04.247 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.227+0000 7f66027fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T23:28:04.248 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.227+0000 7f66027fc640 10 monclient: _finish_command 1 = system:0 2026-02-22T23:28:04.248 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.227+0000 7f66027fc640 1 -- 10.20.193.45:0/65764988 >> v1:10.20.193.45:6792/0 conn(0x7f6614121a50 legacy=0x7f6614121e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:04.248 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.227+0000 7f66027fc640 1 -- 10.20.193.45:0/65764988 >> v1:10.20.193.45:6792/0 conn(0x7f6614121a50 legacy=0x7f6614121e30 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T23:28:04.248 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.230+0000 7f661bf96640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-22T23:28:04.248 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.230+0000 7f661bf96640 1 -- 10.20.193.45:0/65764988 --> v1:10.20.193.45:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f6614122920 con 0x7f6614122540 2026-02-22T23:28:04.248 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.230+0000 7f66027fc640 1 -- 10.20.193.45:0/65764988 <== mon.6 v1:10.20.193.45:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3614442170 0 0) 0x7f6614122920 con 0x7f6614122540 2026-02-22T23:28:04.248 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.230+0000 7f66027fc640 10 monclient(hunting): _negotiate 2026-02-22T23:28:04.248 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.230+0000 7f66027fc640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:28:04.248 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.230+0000 7f66027fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:28:04.248 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.230+0000 7f66027fc640 10 monclient(hunting): my global_id is 114144 2026-02-22T23:28:04.248 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.230+0000 7f66027fc640 1 -- 10.20.193.45:0/65764988 --> v1:10.20.193.45:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f66140008d0 con 0x7f6614122540 2026-02-22T23:28:04.248 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.230+0000 7f66027fc640 1 -- 10.20.193.45:0/65764988 <== mon.6 v1:10.20.193.45:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 814851057 0 0) 0x7f66140008d0 con 0x7f6614122540 2026-02-22T23:28:04.248 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.230+0000 7f66027fc640 1 -- 10.20.193.45:0/65764988 --> v1:10.20.193.45:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6614122920 con 0x7f6614122540 2026-02-22T23:28:04.248 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.230+0000 7f66027fc640 1 -- 10.20.193.45:0/65764988 <== mon.6 v1:10.20.193.45:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f6604004c20 con 0x7f6614122540 2026-02-22T23:28:04.248 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.230+0000 7f66027fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:28:04.248 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.230+0000 7f66027fc640 10 monclient: got monmap 1 from mon.d (according to old e1) 2026-02-22T23:28:04.248 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.230+0000 7f66027fc640 10 monclient: dump: 2026-02-22T23:28:04.249 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:28:04.249 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:28:04.249 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:04.249 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:04.249 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:28:04.249 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:28:04.249 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:28:04.249 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:28:04.249 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:28:04.249 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:28:04.249 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:28:04.249 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:28:04.249 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:28:04.249 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:28:04.249 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:28:04.249 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:04.249 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.230+0000 7f66027fc640 1 -- 10.20.193.45:0/65764988 <== mon.6 v1:10.20.193.45:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 672714886 0 0) 0x7f6614122920 con 0x7f6614122540 2026-02-22T23:28:04.249 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.230+0000 7f66027fc640 1 -- 10.20.193.45:0/65764988 --> v1:10.20.193.45:6792/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f66140a5770 con 0x7f6614122540 2026-02-22T23:28:04.250 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.230+0000 7f66027fc640 1 -- 10.20.193.45:0/65764988 <== mon.6 v1:10.20.193.45:6792/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7527 (unknown 0 0 1807356539) 0x7f6604006d70 con 0x7f6614122540 2026-02-22T23:28:04.250 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.230+0000 7f66027fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-22T23:28:04.250 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.230+0000 7f66027fc640 10 monclient: _finish_command 2 = system:0 2026-02-22T23:28:04.250 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.230+0000 7f66027fc640 1 -- 10.20.193.45:0/65764988 >> v1:10.20.193.45:6792/0 conn(0x7f6614122540 legacy=0x7f66141de4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:04.250 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.230+0000 7f66027fc640 1 -- 10.20.193.45:0/65764988 >> v1:10.20.193.45:6792/0 conn(0x7f6614122540 legacy=0x7f66141de4a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T23:28:04.250 INFO:teuthology.orchestra.run.trial045.stdout:{ 2026-02-22T23:28:04.250 INFO:teuthology.orchestra.run.trial045.stdout: "name": "d", 2026-02-22T23:28:04.250 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 6, 2026-02-22T23:28:04.250 INFO:teuthology.orchestra.run.trial045.stdout: "state": "peon", 2026-02-22T23:28:04.250 INFO:teuthology.orchestra.run.trial045.stdout: "election_epoch": 28, 2026-02-22T23:28:04.250 INFO:teuthology.orchestra.run.trial045.stdout: "uptime": 15550, 2026-02-22T23:28:04.251 INFO:teuthology.orchestra.run.trial045.stdout: "quorum": [ 2026-02-22T23:28:04.251 INFO:teuthology.orchestra.run.trial045.stdout: 0, 2026-02-22T23:28:04.251 INFO:teuthology.orchestra.run.trial045.stdout: 1, 2026-02-22T23:28:04.251 INFO:teuthology.orchestra.run.trial045.stdout: 2, 2026-02-22T23:28:04.251 INFO:teuthology.orchestra.run.trial045.stdout: 3, 2026-02-22T23:28:04.251 INFO:teuthology.orchestra.run.trial045.stdout: 4, 2026-02-22T23:28:04.251 INFO:teuthology.orchestra.run.trial045.stdout: 5, 2026-02-22T23:28:04.251 INFO:teuthology.orchestra.run.trial045.stdout: 6, 2026-02-22T23:28:04.251 INFO:teuthology.orchestra.run.trial045.stdout: 7, 2026-02-22T23:28:04.251 INFO:teuthology.orchestra.run.trial045.stdout: 8 2026-02-22T23:28:04.251 INFO:teuthology.orchestra.run.trial045.stdout: ], 2026-02-22T23:28:04.251 INFO:teuthology.orchestra.run.trial045.stdout: "quorum_age": 0, 2026-02-22T23:28:04.251 INFO:teuthology.orchestra.run.trial045.stdout: "features": { 2026-02-22T23:28:04.251 INFO:teuthology.orchestra.run.trial045.stdout: "required_con": "2450521708007866372", 2026-02-22T23:28:04.251 INFO:teuthology.orchestra.run.trial045.stdout: "required_mon": [ 2026-02-22T23:28:04.251 INFO:teuthology.orchestra.run.trial045.stdout: "kraken", 2026-02-22T23:28:04.252 INFO:teuthology.orchestra.run.trial045.stdout: "luminous", 2026-02-22T23:28:04.252 INFO:teuthology.orchestra.run.trial045.stdout: "mimic", 2026-02-22T23:28:04.252 INFO:teuthology.orchestra.run.trial045.stdout: "osdmap-prune", 2026-02-22T23:28:04.252 INFO:teuthology.orchestra.run.trial045.stdout: "nautilus", 2026-02-22T23:28:04.252 INFO:teuthology.orchestra.run.trial045.stdout: "octopus", 2026-02-22T23:28:04.252 INFO:teuthology.orchestra.run.trial045.stdout: "pacific", 2026-02-22T23:28:04.252 INFO:teuthology.orchestra.run.trial045.stdout: "elector-pinging", 2026-02-22T23:28:04.252 INFO:teuthology.orchestra.run.trial045.stdout: "quincy", 2026-02-22T23:28:04.252 INFO:teuthology.orchestra.run.trial045.stdout: "reef", 2026-02-22T23:28:04.252 INFO:teuthology.orchestra.run.trial045.stdout: "squid" 2026-02-22T23:28:04.252 INFO:teuthology.orchestra.run.trial045.stdout: ], 2026-02-22T23:28:04.252 INFO:teuthology.orchestra.run.trial045.stdout: "quorum_con": "4540701547738038271", 2026-02-22T23:28:04.252 INFO:teuthology.orchestra.run.trial045.stdout: "quorum_mon": [ 2026-02-22T23:28:04.252 INFO:teuthology.orchestra.run.trial045.stdout: "kraken", 2026-02-22T23:28:04.252 INFO:teuthology.orchestra.run.trial045.stdout: "luminous", 2026-02-22T23:28:04.252 INFO:teuthology.orchestra.run.trial045.stdout: "mimic", 2026-02-22T23:28:04.252 INFO:teuthology.orchestra.run.trial045.stdout: "osdmap-prune", 2026-02-22T23:28:04.253 INFO:teuthology.orchestra.run.trial045.stdout: "nautilus", 2026-02-22T23:28:04.253 INFO:teuthology.orchestra.run.trial045.stdout: "octopus", 2026-02-22T23:28:04.253 INFO:teuthology.orchestra.run.trial045.stdout: "pacific", 2026-02-22T23:28:04.253 INFO:teuthology.orchestra.run.trial045.stdout: "elector-pinging", 2026-02-22T23:28:04.253 INFO:teuthology.orchestra.run.trial045.stdout: "quincy", 2026-02-22T23:28:04.253 INFO:teuthology.orchestra.run.trial045.stdout: "reef", 2026-02-22T23:28:04.253 INFO:teuthology.orchestra.run.trial045.stdout: "squid" 2026-02-22T23:28:04.253 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:28:04.253 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:28:04.253 INFO:teuthology.orchestra.run.trial045.stdout: "outside_quorum": [], 2026-02-22T23:28:04.253 INFO:teuthology.orchestra.run.trial045.stdout: "extra_probe_peers": [], 2026-02-22T23:28:04.253 INFO:teuthology.orchestra.run.trial045.stdout: "sync_provider": [], 2026-02-22T23:28:04.253 INFO:teuthology.orchestra.run.trial045.stdout: "monmap": { 2026-02-22T23:28:04.253 INFO:teuthology.orchestra.run.trial045.stdout: "epoch": 1, 2026-02-22T23:28:04.253 INFO:teuthology.orchestra.run.trial045.stdout: "fsid": "4b60f18f-6660-4731-b731-dc85c4078413", 2026-02-22T23:28:04.253 INFO:teuthology.orchestra.run.trial045.stdout: "modified": "2026-02-22T23:24:52.393472Z", 2026-02-22T23:28:04.253 INFO:teuthology.orchestra.run.trial045.stdout: "created": "2026-02-22T23:24:52.393472Z", 2026-02-22T23:28:04.253 INFO:teuthology.orchestra.run.trial045.stdout: "min_mon_release": 19, 2026-02-22T23:28:04.254 INFO:teuthology.orchestra.run.trial045.stdout: "min_mon_release_name": "squid", 2026-02-22T23:28:04.254 INFO:teuthology.orchestra.run.trial045.stdout: "election_strategy": 3, 2026-02-22T23:28:04.254 INFO:teuthology.orchestra.run.trial045.stdout: "disallowed_leaders": "", 2026-02-22T23:28:04.254 INFO:teuthology.orchestra.run.trial045.stdout: "stretch_mode": false, 2026-02-22T23:28:04.254 INFO:teuthology.orchestra.run.trial045.stdout: "tiebreaker_mon": "", 2026-02-22T23:28:04.254 INFO:teuthology.orchestra.run.trial045.stdout: "removed_ranks": "", 2026-02-22T23:28:04.254 INFO:teuthology.orchestra.run.trial045.stdout: "features": { 2026-02-22T23:28:04.254 INFO:teuthology.orchestra.run.trial045.stdout: "persistent": [ 2026-02-22T23:28:04.254 INFO:teuthology.orchestra.run.trial045.stdout: "kraken", 2026-02-22T23:28:04.254 INFO:teuthology.orchestra.run.trial045.stdout: "luminous", 2026-02-22T23:28:04.254 INFO:teuthology.orchestra.run.trial045.stdout: "mimic", 2026-02-22T23:28:04.254 INFO:teuthology.orchestra.run.trial045.stdout: "osdmap-prune", 2026-02-22T23:28:04.254 INFO:teuthology.orchestra.run.trial045.stdout: "nautilus", 2026-02-22T23:28:04.254 INFO:teuthology.orchestra.run.trial045.stdout: "octopus", 2026-02-22T23:28:04.254 INFO:teuthology.orchestra.run.trial045.stdout: "pacific", 2026-02-22T23:28:04.254 INFO:teuthology.orchestra.run.trial045.stdout: "elector-pinging", 2026-02-22T23:28:04.254 INFO:teuthology.orchestra.run.trial045.stdout: "quincy", 2026-02-22T23:28:04.254 INFO:teuthology.orchestra.run.trial045.stdout: "reef", 2026-02-22T23:28:04.254 INFO:teuthology.orchestra.run.trial045.stdout: "squid" 2026-02-22T23:28:04.255 INFO:teuthology.orchestra.run.trial045.stdout: ], 2026-02-22T23:28:04.255 INFO:teuthology.orchestra.run.trial045.stdout: "optional": [] 2026-02-22T23:28:04.255 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:28:04.255 INFO:teuthology.orchestra.run.trial045.stdout: "mons": [ 2026-02-22T23:28:04.255 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:28:04.255 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 0, 2026-02-22T23:28:04.255 INFO:teuthology.orchestra.run.trial045.stdout: "name": "a", 2026-02-22T23:28:04.255 INFO:teuthology.orchestra.run.trial045.stdout: "public_addrs": { 2026-02-22T23:28:04.255 INFO:teuthology.orchestra.run.trial045.stdout: "addrvec": [ 2026-02-22T23:28:04.255 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:28:04.255 INFO:teuthology.orchestra.run.trial045.stdout: "type": "v1", 2026-02-22T23:28:04.255 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6789", 2026-02-22T23:28:04.255 INFO:teuthology.orchestra.run.trial045.stdout: "nonce": 0 2026-02-22T23:28:04.255 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:28:04.255 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:28:04.255 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:28:04.255 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6789/0", 2026-02-22T23:28:04.255 INFO:teuthology.orchestra.run.trial045.stdout: "public_addr": "10.20.193.45:6789/0", 2026-02-22T23:28:04.255 INFO:teuthology.orchestra.run.trial045.stdout: "priority": 0, 2026-02-22T23:28:04.256 INFO:teuthology.orchestra.run.trial045.stdout: "weight": 0, 2026-02-22T23:28:04.256 INFO:teuthology.orchestra.run.trial045.stdout: "crush_location": "{}" 2026-02-22T23:28:04.256 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:28:04.256 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:28:04.256 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 1, 2026-02-22T23:28:04.256 INFO:teuthology.orchestra.run.trial045.stdout: "name": "f", 2026-02-22T23:28:04.256 INFO:teuthology.orchestra.run.trial045.stdout: "public_addrs": { 2026-02-22T23:28:04.256 INFO:teuthology.orchestra.run.trial045.stdout: "addrvec": [ 2026-02-22T23:28:04.256 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:28:04.256 INFO:teuthology.orchestra.run.trial045.stdout: "type": "v1", 2026-02-22T23:28:04.256 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.73:6789", 2026-02-22T23:28:04.256 INFO:teuthology.orchestra.run.trial045.stdout: "nonce": 0 2026-02-22T23:28:04.256 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:28:04.256 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:28:04.256 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:28:04.256 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.73:6789/0", 2026-02-22T23:28:04.256 INFO:teuthology.orchestra.run.trial045.stdout: "public_addr": "10.20.193.73:6789/0", 2026-02-22T23:28:04.256 INFO:teuthology.orchestra.run.trial045.stdout: "priority": 0, 2026-02-22T23:28:04.256 INFO:teuthology.orchestra.run.trial045.stdout: "weight": 0, 2026-02-22T23:28:04.257 INFO:teuthology.orchestra.run.trial045.stdout: "crush_location": "{}" 2026-02-22T23:28:04.257 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:28:04.257 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:28:04.257 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 2, 2026-02-22T23:28:04.257 INFO:teuthology.orchestra.run.trial045.stdout: "name": "b", 2026-02-22T23:28:04.257 INFO:teuthology.orchestra.run.trial045.stdout: "public_addrs": { 2026-02-22T23:28:04.257 INFO:teuthology.orchestra.run.trial045.stdout: "addrvec": [ 2026-02-22T23:28:04.257 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:28:04.257 INFO:teuthology.orchestra.run.trial045.stdout: "type": "v1", 2026-02-22T23:28:04.257 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6790", 2026-02-22T23:28:04.257 INFO:teuthology.orchestra.run.trial045.stdout: "nonce": 0 2026-02-22T23:28:04.257 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:28:04.257 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:28:04.257 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:28:04.257 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6790/0", 2026-02-22T23:28:04.257 INFO:teuthology.orchestra.run.trial045.stdout: "public_addr": "10.20.193.45:6790/0", 2026-02-22T23:28:04.257 INFO:teuthology.orchestra.run.trial045.stdout: "priority": 0, 2026-02-22T23:28:04.257 INFO:teuthology.orchestra.run.trial045.stdout: "weight": 0, 2026-02-22T23:28:04.257 INFO:teuthology.orchestra.run.trial045.stdout: "crush_location": "{}" 2026-02-22T23:28:04.258 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:28:04.258 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:28:04.258 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 3, 2026-02-22T23:28:04.258 INFO:teuthology.orchestra.run.trial045.stdout: "name": "g", 2026-02-22T23:28:04.258 INFO:teuthology.orchestra.run.trial045.stdout: "public_addrs": { 2026-02-22T23:28:04.258 INFO:teuthology.orchestra.run.trial045.stdout: "addrvec": [ 2026-02-22T23:28:04.258 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:28:04.258 INFO:teuthology.orchestra.run.trial045.stdout: "type": "v1", 2026-02-22T23:28:04.258 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.73:6790", 2026-02-22T23:28:04.258 INFO:teuthology.orchestra.run.trial045.stdout: "nonce": 0 2026-02-22T23:28:04.258 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:28:04.258 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:28:04.258 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:28:04.258 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.73:6790/0", 2026-02-22T23:28:04.258 INFO:teuthology.orchestra.run.trial045.stdout: "public_addr": "10.20.193.73:6790/0", 2026-02-22T23:28:04.258 INFO:teuthology.orchestra.run.trial045.stdout: "priority": 0, 2026-02-22T23:28:04.258 INFO:teuthology.orchestra.run.trial045.stdout: "weight": 0, 2026-02-22T23:28:04.258 INFO:teuthology.orchestra.run.trial045.stdout: "crush_location": "{}" 2026-02-22T23:28:04.258 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:28:04.258 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:28:04.259 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 4, 2026-02-22T23:28:04.259 INFO:teuthology.orchestra.run.trial045.stdout: "name": "c", 2026-02-22T23:28:04.259 INFO:teuthology.orchestra.run.trial045.stdout: "public_addrs": { 2026-02-22T23:28:04.259 INFO:teuthology.orchestra.run.trial045.stdout: "addrvec": [ 2026-02-22T23:28:04.259 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:28:04.259 INFO:teuthology.orchestra.run.trial045.stdout: "type": "v1", 2026-02-22T23:28:04.259 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6791", 2026-02-22T23:28:04.259 INFO:teuthology.orchestra.run.trial045.stdout: "nonce": 0 2026-02-22T23:28:04.259 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:28:04.259 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:28:04.259 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:28:04.259 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6791/0", 2026-02-22T23:28:04.259 INFO:teuthology.orchestra.run.trial045.stdout: "public_addr": "10.20.193.45:6791/0", 2026-02-22T23:28:04.259 INFO:teuthology.orchestra.run.trial045.stdout: "priority": 0, 2026-02-22T23:28:04.259 INFO:teuthology.orchestra.run.trial045.stdout: "weight": 0, 2026-02-22T23:28:04.259 INFO:teuthology.orchestra.run.trial045.stdout: "crush_location": "{}" 2026-02-22T23:28:04.259 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:28:04.259 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:28:04.259 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 5, 2026-02-22T23:28:04.259 INFO:teuthology.orchestra.run.trial045.stdout: "name": "h", 2026-02-22T23:28:04.260 INFO:teuthology.orchestra.run.trial045.stdout: "public_addrs": { 2026-02-22T23:28:04.260 INFO:teuthology.orchestra.run.trial045.stdout: "addrvec": [ 2026-02-22T23:28:04.260 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:28:04.260 INFO:teuthology.orchestra.run.trial045.stdout: "type": "v1", 2026-02-22T23:28:04.260 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.73:6791", 2026-02-22T23:28:04.260 INFO:teuthology.orchestra.run.trial045.stdout: "nonce": 0 2026-02-22T23:28:04.260 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:28:04.260 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:28:04.260 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:28:04.260 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.73:6791/0", 2026-02-22T23:28:04.260 INFO:teuthology.orchestra.run.trial045.stdout: "public_addr": "10.20.193.73:6791/0", 2026-02-22T23:28:04.260 INFO:teuthology.orchestra.run.trial045.stdout: "priority": 0, 2026-02-22T23:28:04.260 INFO:teuthology.orchestra.run.trial045.stdout: "weight": 0, 2026-02-22T23:28:04.260 INFO:teuthology.orchestra.run.trial045.stdout: "crush_location": "{}" 2026-02-22T23:28:04.260 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:28:04.260 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:28:04.260 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 6, 2026-02-22T23:28:04.260 INFO:teuthology.orchestra.run.trial045.stdout: "name": "d", 2026-02-22T23:28:04.260 INFO:teuthology.orchestra.run.trial045.stdout: "public_addrs": { 2026-02-22T23:28:04.260 INFO:teuthology.orchestra.run.trial045.stdout: "addrvec": [ 2026-02-22T23:28:04.261 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:28:04.261 INFO:teuthology.orchestra.run.trial045.stdout: "type": "v1", 2026-02-22T23:28:04.261 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6792", 2026-02-22T23:28:04.261 INFO:teuthology.orchestra.run.trial045.stdout: "nonce": 0 2026-02-22T23:28:04.261 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:28:04.261 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:28:04.261 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:28:04.261 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6792/0", 2026-02-22T23:28:04.261 INFO:teuthology.orchestra.run.trial045.stdout: "public_addr": "10.20.193.45:6792/0", 2026-02-22T23:28:04.261 INFO:teuthology.orchestra.run.trial045.stdout: "priority": 0, 2026-02-22T23:28:04.261 INFO:teuthology.orchestra.run.trial045.stdout: "weight": 0, 2026-02-22T23:28:04.261 INFO:teuthology.orchestra.run.trial045.stdout: "crush_location": "{}" 2026-02-22T23:28:04.261 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:28:04.261 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:28:04.261 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 7, 2026-02-22T23:28:04.261 INFO:teuthology.orchestra.run.trial045.stdout: "name": "i", 2026-02-22T23:28:04.261 INFO:teuthology.orchestra.run.trial045.stdout: "public_addrs": { 2026-02-22T23:28:04.261 INFO:teuthology.orchestra.run.trial045.stdout: "addrvec": [ 2026-02-22T23:28:04.261 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:28:04.261 INFO:teuthology.orchestra.run.trial045.stdout: "type": "v1", 2026-02-22T23:28:04.261 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.73:6792", 2026-02-22T23:28:04.261 INFO:teuthology.orchestra.run.trial045.stdout: "nonce": 0 2026-02-22T23:28:04.261 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:28:04.262 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:28:04.262 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:28:04.262 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.73:6792/0", 2026-02-22T23:28:04.262 INFO:teuthology.orchestra.run.trial045.stdout: "public_addr": "10.20.193.73:6792/0", 2026-02-22T23:28:04.262 INFO:teuthology.orchestra.run.trial045.stdout: "priority": 0, 2026-02-22T23:28:04.262 INFO:teuthology.orchestra.run.trial045.stdout: "weight": 0, 2026-02-22T23:28:04.262 INFO:teuthology.orchestra.run.trial045.stdout: "crush_location": "{}" 2026-02-22T23:28:04.262 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:28:04.262 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:28:04.262 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 8, 2026-02-22T23:28:04.262 INFO:teuthology.orchestra.run.trial045.stdout: "name": "e", 2026-02-22T23:28:04.262 INFO:teuthology.orchestra.run.trial045.stdout: "public_addrs": { 2026-02-22T23:28:04.262 INFO:teuthology.orchestra.run.trial045.stdout: "addrvec": [ 2026-02-22T23:28:04.262 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:28:04.262 INFO:teuthology.orchestra.run.trial045.stdout: "type": "v1", 2026-02-22T23:28:04.262 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6793", 2026-02-22T23:28:04.262 INFO:teuthology.orchestra.run.trial045.stdout: "nonce": 0 2026-02-22T23:28:04.262 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:28:04.262 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:28:04.262 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:28:04.262 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6793/0", 2026-02-22T23:28:04.262 INFO:teuthology.orchestra.run.trial045.stdout: "public_addr": "10.20.193.45:6793/0", 2026-02-22T23:28:04.263 INFO:teuthology.orchestra.run.trial045.stdout: "priority": 0, 2026-02-22T23:28:04.263 INFO:teuthology.orchestra.run.trial045.stdout: "weight": 0, 2026-02-22T23:28:04.263 INFO:teuthology.orchestra.run.trial045.stdout: "crush_location": "{}" 2026-02-22T23:28:04.263 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:28:04.263 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:28:04.263 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:28:04.263 INFO:teuthology.orchestra.run.trial045.stdout: "feature_map": { 2026-02-22T23:28:04.263 INFO:teuthology.orchestra.run.trial045.stdout: "mon": [ 2026-02-22T23:28:04.263 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:28:04.263 INFO:teuthology.orchestra.run.trial045.stdout: "features": "0x3f03cffffffdffff", 2026-02-22T23:28:04.263 INFO:teuthology.orchestra.run.trial045.stdout: "release": "squid", 2026-02-22T23:28:04.263 INFO:teuthology.orchestra.run.trial045.stdout: "num": 1 2026-02-22T23:28:04.263 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:28:04.263 INFO:teuthology.orchestra.run.trial045.stdout: ], 2026-02-22T23:28:04.263 INFO:teuthology.orchestra.run.trial045.stdout: "client": [ 2026-02-22T23:28:04.263 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:28:04.263 INFO:teuthology.orchestra.run.trial045.stdout: "features": "0x3f03cffffffdffff", 2026-02-22T23:28:04.263 INFO:teuthology.orchestra.run.trial045.stdout: "release": "squid", 2026-02-22T23:28:04.263 INFO:teuthology.orchestra.run.trial045.stdout: "num": 2 2026-02-22T23:28:04.263 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:28:04.263 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:28:04.263 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:28:04.263 INFO:teuthology.orchestra.run.trial045.stdout: "stretch_mode": false 2026-02-22T23:28:04.264 INFO:teuthology.orchestra.run.trial045.stdout:} 2026-02-22T23:28:04.264 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.231+0000 7f661bf96640 1 -- 10.20.193.45:0/65764988 >> v1:10.20.193.73:6800/2222410180 conn(0x7f65e403fdc0 legacy=0x7f65e4042280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:04.264 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.231+0000 7f661bf96640 10 monclient: shutdown 2026-02-22T23:28:04.264 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.231+0000 7f661bf96640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T23:28:04.265 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.231+0000 7f661bf96640 1 -- 10.20.193.45:0/65764988 >> v1:10.20.193.45:6792/0 conn(0x7f66140a6d00 legacy=0x7f66141d7d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:04.265 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.231+0000 7f661a50c640 1 -- 10.20.193.45:0/65764988 reap_dead start 2026-02-22T23:28:04.265 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.231+0000 7f661bf96640 1 -- 10.20.193.45:0/65764988 shutdown_connections 2026-02-22T23:28:04.265 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.231+0000 7f661bf96640 1 -- 10.20.193.45:0/65764988 >> 10.20.193.45:0/65764988 conn(0x7f66140abb50 msgr2=0x7f66140a4010 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:28:04.265 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.231+0000 7f661bf96640 1 -- 10.20.193.45:0/65764988 shutdown_connections 2026-02-22T23:28:04.265 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.231+0000 7f661bf96640 1 -- 10.20.193.45:0/65764988 wait complete. 2026-02-22T23:28:04.265 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2026-02-22T23:28:04.265 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon e 2026-02-22T23:28:04.265 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.e mon_status 2026-02-22T23:28:04.334 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.332+0000 7fbd39503640 10 monclient: get_monmap_and_config 2026-02-22T23:28:04.334 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.332+0000 7fbd39503640 10 monclient: build_initial_monmap 2026-02-22T23:28:04.334 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.332+0000 7fbd39503640 10 monclient: monmap: 2026-02-22T23:28:04.334 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-22T23:28:04.334 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:28:04.334 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:28:04.334024+0000 2026-02-22T23:28:04.334 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:28:04.334024+0000 2026-02-22T23:28:04.334 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-22T23:28:04.334 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:28:04.334 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-22T23:28:04.334 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.noname-f 2026-02-22T23:28:04.334 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.noname-b 2026-02-22T23:28:04.334 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.noname-g 2026-02-22T23:28:04.334 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.noname-c 2026-02-22T23:28:04.335 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.noname-h 2026-02-22T23:28:04.335 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.noname-d 2026-02-22T23:28:04.335 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.noname-i 2026-02-22T23:28:04.335 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.noname-e 2026-02-22T23:28:04.335 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:04.340 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.333+0000 7fbd39503640 1 Processor -- start 2026-02-22T23:28:04.340 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.333+0000 7fbd39503640 1 -- start start 2026-02-22T23:28:04.340 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.333+0000 7fbd39503640 10 monclient: init 2026-02-22T23:28:04.340 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.333+0000 7fbd39503640 10 monclient: _reopen_session rank -1 2026-02-22T23:28:04.340 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.333+0000 7fbd39503640 10 monclient: _add_conns ranks=[1,3,2,5,4,6,7,8,0] 2026-02-22T23:28:04.341 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.333+0000 7fbd39503640 10 monclient(hunting): picked mon.noname-f con 0x7fbd340a1a60 addr v1:10.20.193.73:6789/0 2026-02-22T23:28:04.341 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.333+0000 7fbd39503640 10 monclient(hunting): picked mon.noname-g con 0x7fbd3406f1e0 addr v1:10.20.193.73:6790/0 2026-02-22T23:28:04.341 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.333+0000 7fbd39503640 10 monclient(hunting): picked mon.noname-b con 0x7fbd340a0980 addr v1:10.20.193.45:6790/0 2026-02-22T23:28:04.341 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.333+0000 7fbd39503640 1 -- --> v1:10.20.193.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbd3409df00 con 0x7fbd340a1a60 2026-02-22T23:28:04.341 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.333+0000 7fbd39503640 1 -- --> v1:10.20.193.45:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbd34137660 con 0x7fbd340a0980 2026-02-22T23:28:04.341 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.333+0000 7fbd39503640 1 -- --> v1:10.20.193.73:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbd340a4510 con 0x7fbd3406f1e0 2026-02-22T23:28:04.341 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.333+0000 7fbd39503640 10 monclient(hunting): _renew_subs 2026-02-22T23:28:04.341 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.333+0000 7fbd39503640 10 monclient(hunting): authenticate will time out at 815.950574s 2026-02-22T23:28:04.341 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.333+0000 7fbd337fe640 1 --1- >> v1:10.20.193.45:6790/0 conn(0x7fbd340a0980 0x7fbd3413ecb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.45:6790/0 says I am v1:10.20.193.45:60120/0 (socket says 10.20.193.45:60120) 2026-02-22T23:28:04.341 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.333+0000 7fbd337fe640 1 -- 10.20.193.45:0/2409595480 learned_addr learned my addr 10.20.193.45:0/2409595480 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-22T23:28:04.341 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.333+0000 7fbd31ffb640 1 -- 10.20.193.45:0/2409595480 <== mon.2 v1:10.20.193.45:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1564573253 0 0) 0x7fbd34137660 con 0x7fbd340a0980 2026-02-22T23:28:04.341 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.333+0000 7fbd31ffb640 10 monclient(hunting): _negotiate 2026-02-22T23:28:04.341 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.333+0000 7fbd31ffb640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:28:04.341 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.333+0000 7fbd31ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:28:04.341 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.333+0000 7fbd31ffb640 10 monclient(hunting): my global_id is 4691 2026-02-22T23:28:04.341 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.333+0000 7fbd31ffb640 1 -- 10.20.193.45:0/2409595480 --> v1:10.20.193.45:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbd20003620 con 0x7fbd340a0980 2026-02-22T23:28:04.342 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.333+0000 7fbd31ffb640 1 -- 10.20.193.45:0/2409595480 <== mon.2 v1:10.20.193.45:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 835506278 0 0) 0x7fbd20003620 con 0x7fbd340a0980 2026-02-22T23:28:04.342 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.333+0000 7fbd31ffb640 1 -- 10.20.193.45:0/2409595480 >> v1:10.20.193.73:6790/0 conn(0x7fbd3406f1e0 legacy=0x7fbd34136f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:04.342 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.333+0000 7fbd31ffb640 1 -- 10.20.193.45:0/2409595480 >> v1:10.20.193.73:6789/0 conn(0x7fbd340a1a60 legacy=0x7fbd34136840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:04.342 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.333+0000 7fbd31ffb640 10 monclient: _finish_hunting 0 2026-02-22T23:28:04.342 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.333+0000 7fbd31ffb640 1 monclient: found mon.noname-b 2026-02-22T23:28:04.342 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.333+0000 7fbd31ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T23:28:04.342 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.333+0000 7fbd31ffb640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.45:6790/0 2026-02-22T23:28:04.342 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.333+0000 7fbd31ffb640 1 -- 10.20.193.45:0/2409595480 --> v1:10.20.193.45:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd34143400 con 0x7fbd340a0980 2026-02-22T23:28:04.342 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.333+0000 7fbd31ffb640 10 monclient: _finish_auth 0 2026-02-22T23:28:04.342 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.333+0000 7fbd31ffb640 10 monclient: _check_auth_tickets 2026-02-22T23:28:04.342 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.333+0000 7fbd31ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T23:28:04.342 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.333+0000 7fbd31ffb640 1 -- 10.20.193.45:0/2409595480 <== mon.2 v1:10.20.193.45:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7fbd240033c0 con 0x7fbd340a0980 2026-02-22T23:28:04.342 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.333+0000 7fbd31ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:28:04.342 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.333+0000 7fbd31ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-22T23:28:04.342 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.333+0000 7fbd31ffb640 10 monclient: dump: 2026-02-22T23:28:04.342 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:28:04.343 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:28:04.343 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:04.343 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:04.343 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:28:04.343 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:28:04.343 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:28:04.343 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:28:04.343 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:28:04.343 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:28:04.343 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:28:04.343 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:28:04.343 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:28:04.343 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:28:04.343 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:28:04.343 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:04.343 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.333+0000 7fbd39503640 5 monclient: authenticate success, global_id 4691 2026-02-22T23:28:04.343 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.333+0000 7fbd39503640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-22T23:28:04.344 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.333+0000 7fbd31ffb640 1 -- 10.20.193.45:0/2409595480 <== mon.2 v1:10.20.193.45:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fbd24003620 con 0x7fbd340a0980 2026-02-22T23:28:04.344 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.333+0000 7fbd31ffb640 10 monclient: handle_config config(0 keys) 2026-02-22T23:28:04.344 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.333+0000 7fbd31ffb640 1 -- 10.20.193.45:0/2409595480 <== mon.2 v1:10.20.193.45:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7fbd24005060 con 0x7fbd340a0980 2026-02-22T23:28:04.344 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.334+0000 7fbd31ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:28:04.344 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.334+0000 7fbd31ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-22T23:28:04.344 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.334+0000 7fbd31ffb640 10 monclient: dump: 2026-02-22T23:28:04.344 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:28:04.344 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:28:04.344 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:04.344 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:04.344 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:28:04.344 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:28:04.344 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:28:04.344 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:28:04.344 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:28:04.344 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:28:04.344 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:28:04.345 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:28:04.345 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:28:04.345 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:28:04.345 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:28:04.345 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:04.345 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.334+0000 7fbd39503640 10 monclient: get_monmap_and_config success 2026-02-22T23:28:04.345 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.334+0000 7fbd39503640 4 set_mon_vals no callback set 2026-02-22T23:28:04.345 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.334+0000 7fbd39503640 10 monclient: shutdown 2026-02-22T23:28:04.345 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.334+0000 7fbd39503640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T23:28:04.345 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.334+0000 7fbd39503640 1 -- 10.20.193.45:0/2409595480 >> v1:10.20.193.45:6790/0 conn(0x7fbd340a0980 legacy=0x7fbd3413ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:04.345 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.334+0000 7fbd39503640 1 -- 10.20.193.45:0/2409595480 shutdown_connections 2026-02-22T23:28:04.345 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.334+0000 7fbd39503640 1 -- 10.20.193.45:0/2409595480 >> 10.20.193.45:0/2409595480 conn(0x7fbd340a7780 msgr2=0x7fbd340a3b60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:28:04.345 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.334+0000 7fbd39503640 1 -- 10.20.193.45:0/2409595480 shutdown_connections 2026-02-22T23:28:04.345 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.334+0000 7fbd39503640 1 -- 10.20.193.45:0/2409595480 wait complete. 2026-02-22T23:28:04.345 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.334+0000 7fbd39503640 10 monclient: build_initial_monmap 2026-02-22T23:28:04.345 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.334+0000 7fbd39503640 10 monclient: monmap: 2026-02-22T23:28:04.346 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-22T23:28:04.346 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T23:28:04.346 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-22T23:28:04.346 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-22T23:28:04.346 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-22T23:28:04.346 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-22T23:28:04.346 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-22T23:28:04.346 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.noname-f 2026-02-22T23:28:04.346 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.noname-b 2026-02-22T23:28:04.346 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.noname-g 2026-02-22T23:28:04.346 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.noname-c 2026-02-22T23:28:04.346 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.noname-h 2026-02-22T23:28:04.346 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.noname-d 2026-02-22T23:28:04.346 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.noname-i 2026-02-22T23:28:04.346 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.noname-e 2026-02-22T23:28:04.346 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:04.346 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.335+0000 7fbd39503640 1 Processor -- start 2026-02-22T23:28:04.346 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.335+0000 7fbd39503640 1 -- start start 2026-02-22T23:28:04.347 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.335+0000 7fbd39503640 10 monclient: init 2026-02-22T23:28:04.347 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.335+0000 7fbd39503640 10 monclient: _reopen_session rank -1 2026-02-22T23:28:04.347 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.335+0000 7fbd39503640 10 monclient: _add_conns ranks=[6,3,1,7,5,4,8,0,2] 2026-02-22T23:28:04.347 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.335+0000 7fbd39503640 10 monclient(hunting): picked mon.noname-d con 0x7fbd340a0980 addr v1:10.20.193.45:6792/0 2026-02-22T23:28:04.347 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.335+0000 7fbd39503640 10 monclient(hunting): picked mon.noname-g con 0x7fbd340a1a60 addr v1:10.20.193.73:6790/0 2026-02-22T23:28:04.347 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.335+0000 7fbd39503640 10 monclient(hunting): picked mon.noname-f con 0x7fbd34121620 addr v1:10.20.193.73:6789/0 2026-02-22T23:28:04.347 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.335+0000 7fbd39503640 1 -- --> v1:10.20.193.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbd34124010 con 0x7fbd34121620 2026-02-22T23:28:04.347 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.335+0000 7fbd39503640 1 -- --> v1:10.20.193.73:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbd34122e40 con 0x7fbd340a1a60 2026-02-22T23:28:04.347 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.335+0000 7fbd39503640 1 -- --> v1:10.20.193.45:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbd341242f0 con 0x7fbd340a0980 2026-02-22T23:28:04.347 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.335+0000 7fbd39503640 10 monclient(hunting): _renew_subs 2026-02-22T23:28:04.347 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.335+0000 7fbd39503640 10 monclient(hunting): authenticate will time out at 815.952419s 2026-02-22T23:28:04.347 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.335+0000 7fbd32ffd640 1 --1- >> v1:10.20.193.45:6792/0 conn(0x7fbd340a0980 0x7fbd3413cad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.45:6792/0 says I am v1:10.20.193.45:36772/0 (socket says 10.20.193.45:36772) 2026-02-22T23:28:04.347 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.335+0000 7fbd32ffd640 1 -- 10.20.193.45:0/362798670 learned_addr learned my addr 10.20.193.45:0/362798670 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-22T23:28:04.347 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.335+0000 7fbd137fe640 1 -- 10.20.193.45:0/362798670 <== mon.6 v1:10.20.193.45:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3194088584 0 0) 0x7fbd341242f0 con 0x7fbd340a0980 2026-02-22T23:28:04.347 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.335+0000 7fbd137fe640 10 monclient(hunting): _negotiate 2026-02-22T23:28:04.347 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.335+0000 7fbd137fe640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:28:04.348 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.335+0000 7fbd137fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:28:04.348 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.335+0000 7fbd137fe640 10 monclient(hunting): my global_id is 114153 2026-02-22T23:28:04.348 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.335+0000 7fbd137fe640 1 -- 10.20.193.45:0/362798670 --> v1:10.20.193.45:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbd00003620 con 0x7fbd340a0980 2026-02-22T23:28:04.348 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.335+0000 7fbd137fe640 1 -- 10.20.193.45:0/362798670 <== mon.6 v1:10.20.193.45:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1763115944 0 0) 0x7fbd00003620 con 0x7fbd340a0980 2026-02-22T23:28:04.348 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.335+0000 7fbd137fe640 1 -- 10.20.193.45:0/362798670 --> v1:10.20.193.45:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fbd341242f0 con 0x7fbd340a0980 2026-02-22T23:28:04.348 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.335+0000 7fbd137fe640 1 -- 10.20.193.45:0/362798670 <== mon.6 v1:10.20.193.45:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7fbd28003300 con 0x7fbd340a0980 2026-02-22T23:28:04.348 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.335+0000 7fbd137fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-22T23:28:04.348 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.335+0000 7fbd137fe640 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2026-02-22T23:28:04.348 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.335+0000 7fbd137fe640 10 monclient(hunting): dump: 2026-02-22T23:28:04.348 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:28:04.348 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:28:04.348 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:04.348 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:04.348 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:28:04.348 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:28:04.348 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:28:04.348 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:28:04.349 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:28:04.349 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:28:04.349 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:28:04.349 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:28:04.349 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:28:04.349 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:28:04.349 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:28:04.349 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:04.349 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.335+0000 7fbd137fe640 10 monclient(hunting): _finish_auth 0 2026-02-22T23:28:04.349 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.335+0000 7fbd137fe640 1 -- 10.20.193.45:0/362798670 <== mon.6 v1:10.20.193.45:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3782083202 0 0) 0x7fbd341242f0 con 0x7fbd340a0980 2026-02-22T23:28:04.349 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.335+0000 7fbd137fe640 1 -- 10.20.193.45:0/362798670 >> v1:10.20.193.73:6790/0 conn(0x7fbd340a1a60 legacy=0x7fbd341d2500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:04.349 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.335+0000 7fbd137fe640 1 -- 10.20.193.45:0/362798670 >> v1:10.20.193.73:6789/0 conn(0x7fbd34121620 legacy=0x7fbd341d5c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:04.349 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.335+0000 7fbd137fe640 10 monclient: _finish_hunting 0 2026-02-22T23:28:04.349 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.335+0000 7fbd137fe640 1 monclient: found mon.d 2026-02-22T23:28:04.349 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.335+0000 7fbd137fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T23:28:04.349 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.335+0000 7fbd137fe640 10 monclient: _send_mon_message to mon.d at v1:10.20.193.45:6792/0 2026-02-22T23:28:04.349 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.335+0000 7fbd137fe640 1 -- 10.20.193.45:0/362798670 --> v1:10.20.193.45:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd340a5f70 con 0x7fbd340a0980 2026-02-22T23:28:04.350 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.335+0000 7fbd137fe640 10 monclient: _finish_auth 0 2026-02-22T23:28:04.350 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.335+0000 7fbd137fe640 10 monclient: _check_auth_tickets 2026-02-22T23:28:04.350 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.335+0000 7fbd137fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T23:28:04.350 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.335+0000 7fbd39503640 5 monclient: authenticate success, global_id 114153 2026-02-22T23:28:04.350 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.335+0000 7fbd39503640 10 monclient: _renew_subs 2026-02-22T23:28:04.350 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.335+0000 7fbd39503640 10 monclient: _send_mon_message to mon.d at v1:10.20.193.45:6792/0 2026-02-22T23:28:04.350 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.335+0000 7fbd39503640 1 -- 10.20.193.45:0/362798670 --> v1:10.20.193.45:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fbd34122b90 con 0x7fbd340a0980 2026-02-22T23:28:04.350 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.335+0000 7fbd39503640 10 monclient: _renew_subs 2026-02-22T23:28:04.350 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.335+0000 7fbd39503640 10 monclient: _send_mon_message to mon.d at v1:10.20.193.45:6792/0 2026-02-22T23:28:04.350 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.335+0000 7fbd39503640 1 -- 10.20.193.45:0/362798670 --> v1:10.20.193.45:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7fbd3413d1e0 con 0x7fbd340a0980 2026-02-22T23:28:04.350 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.335+0000 7fbd137fe640 1 -- 10.20.193.45:0/362798670 <== mon.6 v1:10.20.193.45:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fbd280039c0 con 0x7fbd340a0980 2026-02-22T23:28:04.350 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.335+0000 7fbd137fe640 10 monclient: handle_config config(0 keys) 2026-02-22T23:28:04.350 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.335+0000 7fbd137fe640 1 -- 10.20.193.45:0/362798670 <== mon.6 v1:10.20.193.45:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7fbd28003fb0 con 0x7fbd340a0980 2026-02-22T23:28:04.350 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.335+0000 7fbd137fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:28:04.350 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.335+0000 7fbd137fe640 10 monclient: got monmap 1 from mon.d (according to old e1) 2026-02-22T23:28:04.350 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.335+0000 7fbd317fa640 4 set_mon_vals no callback set 2026-02-22T23:28:04.350 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.335+0000 7fbd137fe640 10 monclient: dump: 2026-02-22T23:28:04.350 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:28:04.351 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:28:04.351 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:04.351 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:04.351 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:28:04.351 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:28:04.351 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:28:04.351 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:28:04.351 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:28:04.351 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:28:04.351 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:28:04.351 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:28:04.351 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:28:04.351 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:28:04.351 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:28:04.351 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:04.351 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.336+0000 7fbd39503640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T23:28:04.351 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.336+0000 7fbd39503640 1 -- 10.20.193.45:0/362798670 --> v1:10.20.193.45:6793/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fbd34121b00 con 0x7fbd3406f1e0 2026-02-22T23:28:04.352 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.336+0000 7fbd137fe640 1 -- 10.20.193.45:0/362798670 <== mon.6 v1:10.20.193.45:6792/0 7 ==== mgrmap(e 5) ==== 50225+0+0 (unknown 2330357642 0 0) 0x7fbd28004150 con 0x7fbd340a0980 2026-02-22T23:28:04.352 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.336+0000 7fbd137fe640 1 -- 10.20.193.45:0/362798670 <== mon.6 v1:10.20.193.45:6792/0 8 ==== osd_map(25..25 src has 1..25) ==== 3502+0+0 (unknown 129690100 0 0) 0x7fbd2804dbd0 con 0x7fbd340a0980 2026-02-22T23:28:04.352 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.336+0000 7fbd137fe640 1 -- 10.20.193.45:0/362798670 <== mon.8 v1:10.20.193.45:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2575228754 0 0) 0x7fbd34122e40 con 0x7fbd3406f1e0 2026-02-22T23:28:04.352 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.336+0000 7fbd137fe640 10 monclient(hunting): _negotiate 2026-02-22T23:28:04.352 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.336+0000 7fbd137fe640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:28:04.352 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.336+0000 7fbd137fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:28:04.352 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.336+0000 7fbd137fe640 10 monclient(hunting): my global_id is 4616 2026-02-22T23:28:04.352 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.336+0000 7fbd137fe640 1 -- 10.20.193.45:0/362798670 --> v1:10.20.193.45:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbd341242f0 con 0x7fbd3406f1e0 2026-02-22T23:28:04.352 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.336+0000 7fbd137fe640 1 -- 10.20.193.45:0/362798670 <== mon.8 v1:10.20.193.45:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3668676699 0 0) 0x7fbd341242f0 con 0x7fbd3406f1e0 2026-02-22T23:28:04.352 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.336+0000 7fbd137fe640 1 -- 10.20.193.45:0/362798670 --> v1:10.20.193.45:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fbd34122e40 con 0x7fbd3406f1e0 2026-02-22T23:28:04.352 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.336+0000 7fbd137fe640 1 -- 10.20.193.45:0/362798670 <== mon.8 v1:10.20.193.45:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7fbd1c002fa0 con 0x7fbd3406f1e0 2026-02-22T23:28:04.352 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.336+0000 7fbd137fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:28:04.352 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.336+0000 7fbd137fe640 10 monclient: got monmap 1 from mon.e (according to old e1) 2026-02-22T23:28:04.352 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.336+0000 7fbd137fe640 10 monclient: dump: 2026-02-22T23:28:04.352 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:28:04.352 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:28:04.352 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:04.353 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:04.353 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:28:04.353 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:28:04.353 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:28:04.353 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:28:04.353 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:28:04.353 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:28:04.353 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:28:04.353 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:28:04.353 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:28:04.353 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:28:04.353 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:28:04.353 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:04.353 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.336+0000 7fbd337fe640 10 monclient: get_auth_request con 0x7fbd0003f650 auth_method 0 2026-02-22T23:28:04.353 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.336+0000 7fbd137fe640 1 -- 10.20.193.45:0/362798670 <== mon.8 v1:10.20.193.45:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2291619319 0 0) 0x7fbd34122e40 con 0x7fbd3406f1e0 2026-02-22T23:28:04.353 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.336+0000 7fbd137fe640 1 -- 10.20.193.45:0/362798670 --> v1:10.20.193.45:6793/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fbd340008d0 con 0x7fbd3406f1e0 2026-02-22T23:28:04.353 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.337+0000 7fbd137fe640 1 -- 10.20.193.45:0/362798670 <== mon.8 v1:10.20.193.45:6793/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (unknown 0 0 2024835662) 0x7fbd1c003420 con 0x7fbd3406f1e0 2026-02-22T23:28:04.354 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.337+0000 7fbd137fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T23:28:04.354 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.337+0000 7fbd137fe640 10 monclient: _finish_command 1 = system:0 2026-02-22T23:28:04.354 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.337+0000 7fbd137fe640 1 -- 10.20.193.45:0/362798670 >> v1:10.20.193.45:6793/0 conn(0x7fbd3406f1e0 legacy=0x7fbd34072760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:04.354 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.337+0000 7fbd137fe640 1 -- 10.20.193.45:0/362798670 >> v1:10.20.193.45:6793/0 conn(0x7fbd3406f1e0 legacy=0x7fbd34072760 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T23:28:04.355 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.339+0000 7fbd39503640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-22T23:28:04.355 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.339+0000 7fbd39503640 1 -- 10.20.193.45:0/362798670 --> v1:10.20.193.45:6793/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fbd340724b0 con 0x7fbd34140620 2026-02-22T23:28:04.355 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.340+0000 7fbd137fe640 1 -- 10.20.193.45:0/362798670 <== mon.8 v1:10.20.193.45:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1035838087 0 0) 0x7fbd340724b0 con 0x7fbd34140620 2026-02-22T23:28:04.355 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.340+0000 7fbd137fe640 10 monclient(hunting): _negotiate 2026-02-22T23:28:04.355 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.340+0000 7fbd137fe640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:28:04.356 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.340+0000 7fbd137fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:28:04.356 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.340+0000 7fbd137fe640 10 monclient(hunting): my global_id is 4625 2026-02-22T23:28:04.356 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.340+0000 7fbd137fe640 1 -- 10.20.193.45:0/362798670 --> v1:10.20.193.45:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbd34122e40 con 0x7fbd34140620 2026-02-22T23:28:04.356 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.340+0000 7fbd137fe640 1 -- 10.20.193.45:0/362798670 <== mon.8 v1:10.20.193.45:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1351422806 0 0) 0x7fbd34122e40 con 0x7fbd34140620 2026-02-22T23:28:04.356 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.340+0000 7fbd137fe640 1 -- 10.20.193.45:0/362798670 --> v1:10.20.193.45:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fbd340724b0 con 0x7fbd34140620 2026-02-22T23:28:04.356 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.340+0000 7fbd137fe640 1 -- 10.20.193.45:0/362798670 <== mon.8 v1:10.20.193.45:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7fbd1c003d80 con 0x7fbd34140620 2026-02-22T23:28:04.356 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.340+0000 7fbd137fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:28:04.356 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.340+0000 7fbd137fe640 10 monclient: got monmap 1 from mon.e (according to old e1) 2026-02-22T23:28:04.356 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.340+0000 7fbd137fe640 10 monclient: dump: 2026-02-22T23:28:04.356 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:28:04.356 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:28:04.356 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:04.356 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:04.356 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:28:04.356 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:28:04.356 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:28:04.356 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:28:04.357 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:28:04.357 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:28:04.357 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:28:04.357 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:28:04.357 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:28:04.357 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:28:04.357 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:28:04.357 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:04.357 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.340+0000 7fbd137fe640 1 -- 10.20.193.45:0/362798670 <== mon.8 v1:10.20.193.45:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 4292306721 0 0) 0x7fbd340724b0 con 0x7fbd34140620 2026-02-22T23:28:04.357 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.340+0000 7fbd137fe640 1 -- 10.20.193.45:0/362798670 --> v1:10.20.193.45:6793/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fbd341de3a0 con 0x7fbd34140620 2026-02-22T23:28:04.357 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.340+0000 7fbd137fe640 1 -- 10.20.193.45:0/362798670 <== mon.8 v1:10.20.193.45:6793/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7530 (unknown 0 0 1068286977) 0x7fbd1c004740 con 0x7fbd34140620 2026-02-22T23:28:04.357 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.340+0000 7fbd137fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-22T23:28:04.357 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.340+0000 7fbd137fe640 10 monclient: _finish_command 2 = system:0 2026-02-22T23:28:04.357 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.340+0000 7fbd137fe640 1 -- 10.20.193.45:0/362798670 >> v1:10.20.193.45:6793/0 conn(0x7fbd34140620 legacy=0x7fbd34071da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:04.357 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.340+0000 7fbd137fe640 1 -- 10.20.193.45:0/362798670 >> v1:10.20.193.45:6793/0 conn(0x7fbd34140620 legacy=0x7fbd34071da0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T23:28:04.358 INFO:teuthology.orchestra.run.trial045.stdout:{ 2026-02-22T23:28:04.358 INFO:teuthology.orchestra.run.trial045.stdout: "name": "e", 2026-02-22T23:28:04.358 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 8, 2026-02-22T23:28:04.358 INFO:teuthology.orchestra.run.trial045.stdout: "state": "leader", 2026-02-22T23:28:04.358 INFO:teuthology.orchestra.run.trial045.stdout: "election_epoch": 28, 2026-02-22T23:28:04.358 INFO:teuthology.orchestra.run.trial045.stdout: "uptime": 164487, 2026-02-22T23:28:04.358 INFO:teuthology.orchestra.run.trial045.stdout: "quorum": [ 2026-02-22T23:28:04.358 INFO:teuthology.orchestra.run.trial045.stdout: 0, 2026-02-22T23:28:04.358 INFO:teuthology.orchestra.run.trial045.stdout: 1, 2026-02-22T23:28:04.358 INFO:teuthology.orchestra.run.trial045.stdout: 2, 2026-02-22T23:28:04.358 INFO:teuthology.orchestra.run.trial045.stdout: 3, 2026-02-22T23:28:04.358 INFO:teuthology.orchestra.run.trial045.stdout: 4, 2026-02-22T23:28:04.358 INFO:teuthology.orchestra.run.trial045.stdout: 5, 2026-02-22T23:28:04.358 INFO:teuthology.orchestra.run.trial045.stdout: 6, 2026-02-22T23:28:04.359 INFO:teuthology.orchestra.run.trial045.stdout: 7, 2026-02-22T23:28:04.359 INFO:teuthology.orchestra.run.trial045.stdout: 8 2026-02-22T23:28:04.359 INFO:teuthology.orchestra.run.trial045.stdout: ], 2026-02-22T23:28:04.359 INFO:teuthology.orchestra.run.trial045.stdout: "quorum_age": 0, 2026-02-22T23:28:04.359 INFO:teuthology.orchestra.run.trial045.stdout: "features": { 2026-02-22T23:28:04.359 INFO:teuthology.orchestra.run.trial045.stdout: "required_con": "2450521708007866372", 2026-02-22T23:28:04.359 INFO:teuthology.orchestra.run.trial045.stdout: "required_mon": [ 2026-02-22T23:28:04.359 INFO:teuthology.orchestra.run.trial045.stdout: "kraken", 2026-02-22T23:28:04.359 INFO:teuthology.orchestra.run.trial045.stdout: "luminous", 2026-02-22T23:28:04.359 INFO:teuthology.orchestra.run.trial045.stdout: "mimic", 2026-02-22T23:28:04.359 INFO:teuthology.orchestra.run.trial045.stdout: "osdmap-prune", 2026-02-22T23:28:04.359 INFO:teuthology.orchestra.run.trial045.stdout: "nautilus", 2026-02-22T23:28:04.359 INFO:teuthology.orchestra.run.trial045.stdout: "octopus", 2026-02-22T23:28:04.359 INFO:teuthology.orchestra.run.trial045.stdout: "pacific", 2026-02-22T23:28:04.359 INFO:teuthology.orchestra.run.trial045.stdout: "elector-pinging", 2026-02-22T23:28:04.359 INFO:teuthology.orchestra.run.trial045.stdout: "quincy", 2026-02-22T23:28:04.360 INFO:teuthology.orchestra.run.trial045.stdout: "reef", 2026-02-22T23:28:04.360 INFO:teuthology.orchestra.run.trial045.stdout: "squid" 2026-02-22T23:28:04.360 INFO:teuthology.orchestra.run.trial045.stdout: ], 2026-02-22T23:28:04.360 INFO:teuthology.orchestra.run.trial045.stdout: "quorum_con": "4540701547738038271", 2026-02-22T23:28:04.360 INFO:teuthology.orchestra.run.trial045.stdout: "quorum_mon": [ 2026-02-22T23:28:04.360 INFO:teuthology.orchestra.run.trial045.stdout: "kraken", 2026-02-22T23:28:04.360 INFO:teuthology.orchestra.run.trial045.stdout: "luminous", 2026-02-22T23:28:04.360 INFO:teuthology.orchestra.run.trial045.stdout: "mimic", 2026-02-22T23:28:04.360 INFO:teuthology.orchestra.run.trial045.stdout: "osdmap-prune", 2026-02-22T23:28:04.360 INFO:teuthology.orchestra.run.trial045.stdout: "nautilus", 2026-02-22T23:28:04.360 INFO:teuthology.orchestra.run.trial045.stdout: "octopus", 2026-02-22T23:28:04.360 INFO:teuthology.orchestra.run.trial045.stdout: "pacific", 2026-02-22T23:28:04.360 INFO:teuthology.orchestra.run.trial045.stdout: "elector-pinging", 2026-02-22T23:28:04.360 INFO:teuthology.orchestra.run.trial045.stdout: "quincy", 2026-02-22T23:28:04.360 INFO:teuthology.orchestra.run.trial045.stdout: "reef", 2026-02-22T23:28:04.360 INFO:teuthology.orchestra.run.trial045.stdout: "squid" 2026-02-22T23:28:04.360 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:28:04.361 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:28:04.361 INFO:teuthology.orchestra.run.trial045.stdout: "outside_quorum": [], 2026-02-22T23:28:04.361 INFO:teuthology.orchestra.run.trial045.stdout: "extra_probe_peers": [], 2026-02-22T23:28:04.361 INFO:teuthology.orchestra.run.trial045.stdout: "sync_provider": [], 2026-02-22T23:28:04.361 INFO:teuthology.orchestra.run.trial045.stdout: "monmap": { 2026-02-22T23:28:04.361 INFO:teuthology.orchestra.run.trial045.stdout: "epoch": 1, 2026-02-22T23:28:04.361 INFO:teuthology.orchestra.run.trial045.stdout: "fsid": "4b60f18f-6660-4731-b731-dc85c4078413", 2026-02-22T23:28:04.361 INFO:teuthology.orchestra.run.trial045.stdout: "modified": "2026-02-22T23:24:52.393472Z", 2026-02-22T23:28:04.361 INFO:teuthology.orchestra.run.trial045.stdout: "created": "2026-02-22T23:24:52.393472Z", 2026-02-22T23:28:04.361 INFO:teuthology.orchestra.run.trial045.stdout: "min_mon_release": 19, 2026-02-22T23:28:04.361 INFO:teuthology.orchestra.run.trial045.stdout: "min_mon_release_name": "squid", 2026-02-22T23:28:04.361 INFO:teuthology.orchestra.run.trial045.stdout: "election_strategy": 3, 2026-02-22T23:28:04.361 INFO:teuthology.orchestra.run.trial045.stdout: "disallowed_leaders": "", 2026-02-22T23:28:04.361 INFO:teuthology.orchestra.run.trial045.stdout: "stretch_mode": false, 2026-02-22T23:28:04.361 INFO:teuthology.orchestra.run.trial045.stdout: "tiebreaker_mon": "", 2026-02-22T23:28:04.362 INFO:teuthology.orchestra.run.trial045.stdout: "removed_ranks": "", 2026-02-22T23:28:04.362 INFO:teuthology.orchestra.run.trial045.stdout: "features": { 2026-02-22T23:28:04.362 INFO:teuthology.orchestra.run.trial045.stdout: "persistent": [ 2026-02-22T23:28:04.362 INFO:teuthology.orchestra.run.trial045.stdout: "kraken", 2026-02-22T23:28:04.362 INFO:teuthology.orchestra.run.trial045.stdout: "luminous", 2026-02-22T23:28:04.362 INFO:teuthology.orchestra.run.trial045.stdout: "mimic", 2026-02-22T23:28:04.362 INFO:teuthology.orchestra.run.trial045.stdout: "osdmap-prune", 2026-02-22T23:28:04.362 INFO:teuthology.orchestra.run.trial045.stdout: "nautilus", 2026-02-22T23:28:04.362 INFO:teuthology.orchestra.run.trial045.stdout: "octopus", 2026-02-22T23:28:04.362 INFO:teuthology.orchestra.run.trial045.stdout: "pacific", 2026-02-22T23:28:04.362 INFO:teuthology.orchestra.run.trial045.stdout: "elector-pinging", 2026-02-22T23:28:04.362 INFO:teuthology.orchestra.run.trial045.stdout: "quincy", 2026-02-22T23:28:04.362 INFO:teuthology.orchestra.run.trial045.stdout: "reef", 2026-02-22T23:28:04.362 INFO:teuthology.orchestra.run.trial045.stdout: "squid" 2026-02-22T23:28:04.362 INFO:teuthology.orchestra.run.trial045.stdout: ], 2026-02-22T23:28:04.362 INFO:teuthology.orchestra.run.trial045.stdout: "optional": [] 2026-02-22T23:28:04.362 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:28:04.363 INFO:teuthology.orchestra.run.trial045.stdout: "mons": [ 2026-02-22T23:28:04.363 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:28:04.363 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 0, 2026-02-22T23:28:04.363 INFO:teuthology.orchestra.run.trial045.stdout: "name": "a", 2026-02-22T23:28:04.363 INFO:teuthology.orchestra.run.trial045.stdout: "public_addrs": { 2026-02-22T23:28:04.363 INFO:teuthology.orchestra.run.trial045.stdout: "addrvec": [ 2026-02-22T23:28:04.363 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:28:04.363 INFO:teuthology.orchestra.run.trial045.stdout: "type": "v1", 2026-02-22T23:28:04.363 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6789", 2026-02-22T23:28:04.363 INFO:teuthology.orchestra.run.trial045.stdout: "nonce": 0 2026-02-22T23:28:04.363 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:28:04.363 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:28:04.363 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:28:04.363 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6789/0", 2026-02-22T23:28:04.363 INFO:teuthology.orchestra.run.trial045.stdout: "public_addr": "10.20.193.45:6789/0", 2026-02-22T23:28:04.363 INFO:teuthology.orchestra.run.trial045.stdout: "priority": 0, 2026-02-22T23:28:04.363 INFO:teuthology.orchestra.run.trial045.stdout: "weight": 0, 2026-02-22T23:28:04.363 INFO:teuthology.orchestra.run.trial045.stdout: "crush_location": "{}" 2026-02-22T23:28:04.364 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:28:04.364 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:28:04.364 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 1, 2026-02-22T23:28:04.364 INFO:teuthology.orchestra.run.trial045.stdout: "name": "f", 2026-02-22T23:28:04.364 INFO:teuthology.orchestra.run.trial045.stdout: "public_addrs": { 2026-02-22T23:28:04.364 INFO:teuthology.orchestra.run.trial045.stdout: "addrvec": [ 2026-02-22T23:28:04.364 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:28:04.364 INFO:teuthology.orchestra.run.trial045.stdout: "type": "v1", 2026-02-22T23:28:04.364 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.73:6789", 2026-02-22T23:28:04.364 INFO:teuthology.orchestra.run.trial045.stdout: "nonce": 0 2026-02-22T23:28:04.364 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:28:04.364 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:28:04.364 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:28:04.364 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.73:6789/0", 2026-02-22T23:28:04.364 INFO:teuthology.orchestra.run.trial045.stdout: "public_addr": "10.20.193.73:6789/0", 2026-02-22T23:28:04.364 INFO:teuthology.orchestra.run.trial045.stdout: "priority": 0, 2026-02-22T23:28:04.364 INFO:teuthology.orchestra.run.trial045.stdout: "weight": 0, 2026-02-22T23:28:04.364 INFO:teuthology.orchestra.run.trial045.stdout: "crush_location": "{}" 2026-02-22T23:28:04.364 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:28:04.365 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:28:04.365 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 2, 2026-02-22T23:28:04.365 INFO:teuthology.orchestra.run.trial045.stdout: "name": "b", 2026-02-22T23:28:04.365 INFO:teuthology.orchestra.run.trial045.stdout: "public_addrs": { 2026-02-22T23:28:04.365 INFO:teuthology.orchestra.run.trial045.stdout: "addrvec": [ 2026-02-22T23:28:04.365 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:28:04.365 INFO:teuthology.orchestra.run.trial045.stdout: "type": "v1", 2026-02-22T23:28:04.365 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6790", 2026-02-22T23:28:04.365 INFO:teuthology.orchestra.run.trial045.stdout: "nonce": 0 2026-02-22T23:28:04.365 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:28:04.365 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:28:04.365 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:28:04.365 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6790/0", 2026-02-22T23:28:04.365 INFO:teuthology.orchestra.run.trial045.stdout: "public_addr": "10.20.193.45:6790/0", 2026-02-22T23:28:04.365 INFO:teuthology.orchestra.run.trial045.stdout: "priority": 0, 2026-02-22T23:28:04.365 INFO:teuthology.orchestra.run.trial045.stdout: "weight": 0, 2026-02-22T23:28:04.365 INFO:teuthology.orchestra.run.trial045.stdout: "crush_location": "{}" 2026-02-22T23:28:04.365 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:28:04.366 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:28:04.366 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 3, 2026-02-22T23:28:04.366 INFO:teuthology.orchestra.run.trial045.stdout: "name": "g", 2026-02-22T23:28:04.366 INFO:teuthology.orchestra.run.trial045.stdout: "public_addrs": { 2026-02-22T23:28:04.366 INFO:teuthology.orchestra.run.trial045.stdout: "addrvec": [ 2026-02-22T23:28:04.366 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:28:04.366 INFO:teuthology.orchestra.run.trial045.stdout: "type": "v1", 2026-02-22T23:28:04.366 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.73:6790", 2026-02-22T23:28:04.366 INFO:teuthology.orchestra.run.trial045.stdout: "nonce": 0 2026-02-22T23:28:04.366 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:28:04.366 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:28:04.366 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:28:04.366 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.73:6790/0", 2026-02-22T23:28:04.366 INFO:teuthology.orchestra.run.trial045.stdout: "public_addr": "10.20.193.73:6790/0", 2026-02-22T23:28:04.366 INFO:teuthology.orchestra.run.trial045.stdout: "priority": 0, 2026-02-22T23:28:04.366 INFO:teuthology.orchestra.run.trial045.stdout: "weight": 0, 2026-02-22T23:28:04.366 INFO:teuthology.orchestra.run.trial045.stdout: "crush_location": "{}" 2026-02-22T23:28:04.366 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:28:04.366 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:28:04.366 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 4, 2026-02-22T23:28:04.367 INFO:teuthology.orchestra.run.trial045.stdout: "name": "c", 2026-02-22T23:28:04.367 INFO:teuthology.orchestra.run.trial045.stdout: "public_addrs": { 2026-02-22T23:28:04.367 INFO:teuthology.orchestra.run.trial045.stdout: "addrvec": [ 2026-02-22T23:28:04.367 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:28:04.367 INFO:teuthology.orchestra.run.trial045.stdout: "type": "v1", 2026-02-22T23:28:04.367 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6791", 2026-02-22T23:28:04.367 INFO:teuthology.orchestra.run.trial045.stdout: "nonce": 0 2026-02-22T23:28:04.367 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:28:04.367 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:28:04.367 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:28:04.367 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6791/0", 2026-02-22T23:28:04.367 INFO:teuthology.orchestra.run.trial045.stdout: "public_addr": "10.20.193.45:6791/0", 2026-02-22T23:28:04.367 INFO:teuthology.orchestra.run.trial045.stdout: "priority": 0, 2026-02-22T23:28:04.367 INFO:teuthology.orchestra.run.trial045.stdout: "weight": 0, 2026-02-22T23:28:04.367 INFO:teuthology.orchestra.run.trial045.stdout: "crush_location": "{}" 2026-02-22T23:28:04.367 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:28:04.367 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:28:04.367 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 5, 2026-02-22T23:28:04.367 INFO:teuthology.orchestra.run.trial045.stdout: "name": "h", 2026-02-22T23:28:04.367 INFO:teuthology.orchestra.run.trial045.stdout: "public_addrs": { 2026-02-22T23:28:04.367 INFO:teuthology.orchestra.run.trial045.stdout: "addrvec": [ 2026-02-22T23:28:04.368 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:28:04.368 INFO:teuthology.orchestra.run.trial045.stdout: "type": "v1", 2026-02-22T23:28:04.368 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.73:6791", 2026-02-22T23:28:04.368 INFO:teuthology.orchestra.run.trial045.stdout: "nonce": 0 2026-02-22T23:28:04.368 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:28:04.368 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:28:04.368 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:28:04.368 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.73:6791/0", 2026-02-22T23:28:04.368 INFO:teuthology.orchestra.run.trial045.stdout: "public_addr": "10.20.193.73:6791/0", 2026-02-22T23:28:04.368 INFO:teuthology.orchestra.run.trial045.stdout: "priority": 0, 2026-02-22T23:28:04.368 INFO:teuthology.orchestra.run.trial045.stdout: "weight": 0, 2026-02-22T23:28:04.368 INFO:teuthology.orchestra.run.trial045.stdout: "crush_location": "{}" 2026-02-22T23:28:04.368 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:28:04.368 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:28:04.368 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 6, 2026-02-22T23:28:04.368 INFO:teuthology.orchestra.run.trial045.stdout: "name": "d", 2026-02-22T23:28:04.368 INFO:teuthology.orchestra.run.trial045.stdout: "public_addrs": { 2026-02-22T23:28:04.368 INFO:teuthology.orchestra.run.trial045.stdout: "addrvec": [ 2026-02-22T23:28:04.368 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:28:04.368 INFO:teuthology.orchestra.run.trial045.stdout: "type": "v1", 2026-02-22T23:28:04.369 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6792", 2026-02-22T23:28:04.369 INFO:teuthology.orchestra.run.trial045.stdout: "nonce": 0 2026-02-22T23:28:04.369 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:28:04.369 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:28:04.369 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:28:04.369 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6792/0", 2026-02-22T23:28:04.369 INFO:teuthology.orchestra.run.trial045.stdout: "public_addr": "10.20.193.45:6792/0", 2026-02-22T23:28:04.369 INFO:teuthology.orchestra.run.trial045.stdout: "priority": 0, 2026-02-22T23:28:04.369 INFO:teuthology.orchestra.run.trial045.stdout: "weight": 0, 2026-02-22T23:28:04.369 INFO:teuthology.orchestra.run.trial045.stdout: "crush_location": "{}" 2026-02-22T23:28:04.369 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:28:04.369 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:28:04.369 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 7, 2026-02-22T23:28:04.369 INFO:teuthology.orchestra.run.trial045.stdout: "name": "i", 2026-02-22T23:28:04.369 INFO:teuthology.orchestra.run.trial045.stdout: "public_addrs": { 2026-02-22T23:28:04.369 INFO:teuthology.orchestra.run.trial045.stdout: "addrvec": [ 2026-02-22T23:28:04.369 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:28:04.369 INFO:teuthology.orchestra.run.trial045.stdout: "type": "v1", 2026-02-22T23:28:04.369 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.73:6792", 2026-02-22T23:28:04.369 INFO:teuthology.orchestra.run.trial045.stdout: "nonce": 0 2026-02-22T23:28:04.370 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:28:04.370 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:28:04.370 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:28:04.370 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.73:6792/0", 2026-02-22T23:28:04.370 INFO:teuthology.orchestra.run.trial045.stdout: "public_addr": "10.20.193.73:6792/0", 2026-02-22T23:28:04.370 INFO:teuthology.orchestra.run.trial045.stdout: "priority": 0, 2026-02-22T23:28:04.370 INFO:teuthology.orchestra.run.trial045.stdout: "weight": 0, 2026-02-22T23:28:04.370 INFO:teuthology.orchestra.run.trial045.stdout: "crush_location": "{}" 2026-02-22T23:28:04.370 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:28:04.370 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:28:04.370 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 8, 2026-02-22T23:28:04.370 INFO:teuthology.orchestra.run.trial045.stdout: "name": "e", 2026-02-22T23:28:04.370 INFO:teuthology.orchestra.run.trial045.stdout: "public_addrs": { 2026-02-22T23:28:04.370 INFO:teuthology.orchestra.run.trial045.stdout: "addrvec": [ 2026-02-22T23:28:04.370 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:28:04.370 INFO:teuthology.orchestra.run.trial045.stdout: "type": "v1", 2026-02-22T23:28:04.370 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6793", 2026-02-22T23:28:04.370 INFO:teuthology.orchestra.run.trial045.stdout: "nonce": 0 2026-02-22T23:28:04.370 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:28:04.370 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:28:04.370 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:28:04.371 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6793/0", 2026-02-22T23:28:04.371 INFO:teuthology.orchestra.run.trial045.stdout: "public_addr": "10.20.193.45:6793/0", 2026-02-22T23:28:04.371 INFO:teuthology.orchestra.run.trial045.stdout: "priority": 0, 2026-02-22T23:28:04.371 INFO:teuthology.orchestra.run.trial045.stdout: "weight": 0, 2026-02-22T23:28:04.371 INFO:teuthology.orchestra.run.trial045.stdout: "crush_location": "{}" 2026-02-22T23:28:04.371 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:28:04.371 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:28:04.371 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:28:04.371 INFO:teuthology.orchestra.run.trial045.stdout: "feature_map": { 2026-02-22T23:28:04.371 INFO:teuthology.orchestra.run.trial045.stdout: "mon": [ 2026-02-22T23:28:04.371 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:28:04.371 INFO:teuthology.orchestra.run.trial045.stdout: "features": "0x3f03cffffffdffff", 2026-02-22T23:28:04.371 INFO:teuthology.orchestra.run.trial045.stdout: "release": "squid", 2026-02-22T23:28:04.371 INFO:teuthology.orchestra.run.trial045.stdout: "num": 1 2026-02-22T23:28:04.371 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:28:04.371 INFO:teuthology.orchestra.run.trial045.stdout: ], 2026-02-22T23:28:04.371 INFO:teuthology.orchestra.run.trial045.stdout: "client": [ 2026-02-22T23:28:04.371 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:28:04.371 INFO:teuthology.orchestra.run.trial045.stdout: "features": "0x3f03cffffffdffff", 2026-02-22T23:28:04.371 INFO:teuthology.orchestra.run.trial045.stdout: "release": "squid", 2026-02-22T23:28:04.371 INFO:teuthology.orchestra.run.trial045.stdout: "num": 1 2026-02-22T23:28:04.372 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:28:04.372 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:28:04.372 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:28:04.372 INFO:teuthology.orchestra.run.trial045.stdout: "stretch_mode": false 2026-02-22T23:28:04.372 INFO:teuthology.orchestra.run.trial045.stdout:} 2026-02-22T23:28:04.373 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.340+0000 7fbd39503640 1 -- 10.20.193.45:0/362798670 >> v1:10.20.193.73:6800/2222410180 conn(0x7fbd0003f650 legacy=0x7fbd00041b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:04.373 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.340+0000 7fbd39503640 10 monclient: shutdown 2026-02-22T23:28:04.373 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.340+0000 7fbd39503640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T23:28:04.373 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.340+0000 7fbd39503640 1 -- 10.20.193.45:0/362798670 >> v1:10.20.193.45:6792/0 conn(0x7fbd340a0980 legacy=0x7fbd3413cad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:04.373 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.340+0000 7fbd337fe640 1 -- 10.20.193.45:0/362798670 reap_dead start 2026-02-22T23:28:04.373 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.340+0000 7fbd337fe640 1 -- 10.20.193.45:0/362798670 reap_dead start 2026-02-22T23:28:04.373 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.340+0000 7fbd39503640 1 -- 10.20.193.45:0/362798670 shutdown_connections 2026-02-22T23:28:04.373 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.340+0000 7fbd39503640 1 -- 10.20.193.45:0/362798670 >> 10.20.193.45:0/362798670 conn(0x7fbd340a7780 msgr2=0x7fbd34141750 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:28:04.373 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.340+0000 7fbd39503640 1 -- 10.20.193.45:0/362798670 shutdown_connections 2026-02-22T23:28:04.373 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.340+0000 7fbd39503640 1 -- 10.20.193.45:0/362798670 wait complete. 2026-02-22T23:28:04.373 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2026-02-22T23:28:04.374 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon f 2026-02-22T23:28:04.374 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.f mon_status 2026-02-22T23:28:04.441 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.439+0000 7fdf624ea640 10 monclient: get_monmap_and_config 2026-02-22T23:28:04.441 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.439+0000 7fdf624ea640 10 monclient: build_initial_monmap 2026-02-22T23:28:04.441 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.439+0000 7fdf624ea640 10 monclient: monmap: 2026-02-22T23:28:04.441 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-22T23:28:04.441 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:28:04.441 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:28:04.440921+0000 2026-02-22T23:28:04.441 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:28:04.440921+0000 2026-02-22T23:28:04.441 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-22T23:28:04.441 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:28:04.441 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-22T23:28:04.441 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.noname-f 2026-02-22T23:28:04.441 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.noname-b 2026-02-22T23:28:04.441 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.noname-g 2026-02-22T23:28:04.442 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.noname-c 2026-02-22T23:28:04.442 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.noname-h 2026-02-22T23:28:04.442 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.noname-d 2026-02-22T23:28:04.442 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.noname-i 2026-02-22T23:28:04.442 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.noname-e 2026-02-22T23:28:04.442 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:04.448 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.440+0000 7fdf624ea640 1 Processor -- start 2026-02-22T23:28:04.449 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.440+0000 7fdf624ea640 1 -- start start 2026-02-22T23:28:04.449 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.440+0000 7fdf624ea640 10 monclient: init 2026-02-22T23:28:04.449 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.440+0000 7fdf624ea640 10 monclient: _reopen_session rank -1 2026-02-22T23:28:04.449 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.440+0000 7fdf624ea640 10 monclient: _add_conns ranks=[3,2,4,5,0,8,7,1,6] 2026-02-22T23:28:04.449 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.440+0000 7fdf624ea640 10 monclient(hunting): picked mon.noname-g con 0x7fdf5c0a1a60 addr v1:10.20.193.73:6790/0 2026-02-22T23:28:04.449 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.440+0000 7fdf624ea640 10 monclient(hunting): picked mon.noname-b con 0x7fdf5c06f1e0 addr v1:10.20.193.45:6790/0 2026-02-22T23:28:04.449 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.440+0000 7fdf624ea640 10 monclient(hunting): picked mon.noname-c con 0x7fdf5c0a0980 addr v1:10.20.193.45:6791/0 2026-02-22T23:28:04.449 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.440+0000 7fdf624ea640 1 -- --> v1:10.20.193.45:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdf5c09df00 con 0x7fdf5c06f1e0 2026-02-22T23:28:04.449 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.440+0000 7fdf624ea640 1 -- --> v1:10.20.193.73:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdf5c137660 con 0x7fdf5c0a1a60 2026-02-22T23:28:04.449 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.440+0000 7fdf624ea640 1 -- --> v1:10.20.193.45:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdf5c0a4510 con 0x7fdf5c0a0980 2026-02-22T23:28:04.449 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.440+0000 7fdf624ea640 10 monclient(hunting): _renew_subs 2026-02-22T23:28:04.449 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.440+0000 7fdf624ea640 10 monclient(hunting): authenticate will time out at 816.057484s 2026-02-22T23:28:04.449 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.440+0000 7fdf5b7fe640 1 --1- >> v1:10.20.193.45:6790/0 conn(0x7fdf5c06f1e0 0x7fdf5c136f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.45:6790/0 says I am v1:10.20.193.45:60132/0 (socket says 10.20.193.45:60132) 2026-02-22T23:28:04.449 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.440+0000 7fdf5b7fe640 1 -- 10.20.193.45:0/1682546612 learned_addr learned my addr 10.20.193.45:0/1682546612 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-22T23:28:04.449 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.440+0000 7fdf60a60640 1 --1- 10.20.193.45:0/1682546612 >> v1:10.20.193.45:6791/0 conn(0x7fdf5c0a0980 0x7fdf5c13ecb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.45:6791/0 says I am v1:10.20.193.45:57712/0 (socket says 10.20.193.45:57712) 2026-02-22T23:28:04.449 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.440+0000 7fdf5affd640 1 -- 10.20.193.45:0/1682546612 <== mon.2 v1:10.20.193.45:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 995024924 0 0) 0x7fdf4c002920 con 0x7fdf5c06f1e0 2026-02-22T23:28:04.450 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.440+0000 7fdf5affd640 10 monclient(hunting): _negotiate 2026-02-22T23:28:04.450 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.440+0000 7fdf5affd640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:28:04.450 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.440+0000 7fdf5affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:28:04.450 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.440+0000 7fdf5affd640 10 monclient(hunting): my global_id is 4700 2026-02-22T23:28:04.450 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.440+0000 7fdf5affd640 1 -- 10.20.193.45:0/1682546612 --> v1:10.20.193.45:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdf40003620 con 0x7fdf5c06f1e0 2026-02-22T23:28:04.450 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.440+0000 7fdf5affd640 1 -- 10.20.193.45:0/1682546612 <== mon.4 v1:10.20.193.45:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4081796432 0 0) 0x7fdf5c0a4510 con 0x7fdf5c0a0980 2026-02-22T23:28:04.450 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.440+0000 7fdf5affd640 10 monclient(hunting): _negotiate 2026-02-22T23:28:04.450 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.440+0000 7fdf5affd640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:28:04.450 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.440+0000 7fdf5affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:28:04.450 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.440+0000 7fdf5affd640 10 monclient(hunting): my global_id is 114142 2026-02-22T23:28:04.450 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.440+0000 7fdf5affd640 1 -- 10.20.193.45:0/1682546612 --> v1:10.20.193.45:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdf4c002920 con 0x7fdf5c0a0980 2026-02-22T23:28:04.450 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.440+0000 7fdf5affd640 1 -- 10.20.193.45:0/1682546612 <== mon.3 v1:10.20.193.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3892615740 0 0) 0x7fdf5c137660 con 0x7fdf5c0a1a60 2026-02-22T23:28:04.450 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.440+0000 7fdf5affd640 10 monclient(hunting): _negotiate 2026-02-22T23:28:04.450 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.440+0000 7fdf5affd640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:28:04.450 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.440+0000 7fdf5affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:28:04.450 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.440+0000 7fdf5affd640 10 monclient(hunting): my global_id is 4602 2026-02-22T23:28:04.451 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.440+0000 7fdf5affd640 1 -- 10.20.193.45:0/1682546612 --> v1:10.20.193.73:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdf5c0a4510 con 0x7fdf5c0a1a60 2026-02-22T23:28:04.451 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.440+0000 7fdf5affd640 1 -- 10.20.193.45:0/1682546612 <== mon.2 v1:10.20.193.45:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3132399956 0 0) 0x7fdf40003620 con 0x7fdf5c06f1e0 2026-02-22T23:28:04.451 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.440+0000 7fdf5affd640 1 -- 10.20.193.45:0/1682546612 >> v1:10.20.193.45:6791/0 conn(0x7fdf5c0a0980 legacy=0x7fdf5c13ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:04.451 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.440+0000 7fdf5affd640 1 -- 10.20.193.45:0/1682546612 >> v1:10.20.193.73:6790/0 conn(0x7fdf5c0a1a60 legacy=0x7fdf5c136840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:04.451 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.440+0000 7fdf5affd640 10 monclient: _finish_hunting 0 2026-02-22T23:28:04.451 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.440+0000 7fdf5affd640 1 monclient: found mon.noname-b 2026-02-22T23:28:04.451 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.440+0000 7fdf5affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T23:28:04.451 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.440+0000 7fdf5affd640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.45:6790/0 2026-02-22T23:28:04.451 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.440+0000 7fdf5affd640 1 -- 10.20.193.45:0/1682546612 --> v1:10.20.193.45:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf5c143400 con 0x7fdf5c06f1e0 2026-02-22T23:28:04.451 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.440+0000 7fdf5affd640 10 monclient: _finish_auth 0 2026-02-22T23:28:04.451 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.440+0000 7fdf5affd640 10 monclient: _check_auth_tickets 2026-02-22T23:28:04.451 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.440+0000 7fdf5affd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T23:28:04.451 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.440+0000 7fdf5affd640 1 -- 10.20.193.45:0/1682546612 <== mon.2 v1:10.20.193.45:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7fdf4c003210 con 0x7fdf5c06f1e0 2026-02-22T23:28:04.451 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.440+0000 7fdf5affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:28:04.451 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.440+0000 7fdf5affd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-22T23:28:04.451 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.440+0000 7fdf5affd640 10 monclient: dump: 2026-02-22T23:28:04.451 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:28:04.452 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:28:04.452 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:04.452 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:04.452 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:28:04.452 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:28:04.452 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:28:04.452 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:28:04.452 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:28:04.452 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:28:04.452 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:28:04.452 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:28:04.452 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:28:04.452 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:28:04.452 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:28:04.452 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:04.452 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.440+0000 7fdf624ea640 5 monclient: authenticate success, global_id 4700 2026-02-22T23:28:04.452 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.440+0000 7fdf624ea640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-22T23:28:04.452 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.440+0000 7fdf5affd640 1 -- 10.20.193.45:0/1682546612 <== mon.2 v1:10.20.193.45:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fdf4c003430 con 0x7fdf5c06f1e0 2026-02-22T23:28:04.453 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.440+0000 7fdf5affd640 10 monclient: handle_config config(0 keys) 2026-02-22T23:28:04.453 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.440+0000 7fdf5affd640 1 -- 10.20.193.45:0/1682546612 <== mon.2 v1:10.20.193.45:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7fdf4c004ce0 con 0x7fdf5c06f1e0 2026-02-22T23:28:04.453 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.440+0000 7fdf5affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:28:04.453 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.440+0000 7fdf5affd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-22T23:28:04.453 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.440+0000 7fdf5affd640 10 monclient: dump: 2026-02-22T23:28:04.453 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:28:04.453 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:28:04.453 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:04.453 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:04.453 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:28:04.453 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:28:04.453 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:28:04.453 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:28:04.453 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:28:04.453 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:28:04.453 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:28:04.453 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:28:04.454 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:28:04.454 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:28:04.454 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:28:04.454 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:04.454 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.440+0000 7fdf624ea640 10 monclient: get_monmap_and_config success 2026-02-22T23:28:04.454 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.440+0000 7fdf624ea640 4 set_mon_vals no callback set 2026-02-22T23:28:04.454 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.441+0000 7fdf624ea640 10 monclient: shutdown 2026-02-22T23:28:04.454 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.441+0000 7fdf624ea640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T23:28:04.454 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.441+0000 7fdf624ea640 1 -- 10.20.193.45:0/1682546612 >> v1:10.20.193.45:6790/0 conn(0x7fdf5c06f1e0 legacy=0x7fdf5c136f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:04.454 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.441+0000 7fdf624ea640 1 -- 10.20.193.45:0/1682546612 shutdown_connections 2026-02-22T23:28:04.454 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.441+0000 7fdf624ea640 1 -- 10.20.193.45:0/1682546612 >> 10.20.193.45:0/1682546612 conn(0x7fdf5c0a7780 msgr2=0x7fdf5c0a3b60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:28:04.454 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.441+0000 7fdf624ea640 1 -- 10.20.193.45:0/1682546612 shutdown_connections 2026-02-22T23:28:04.454 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.441+0000 7fdf624ea640 1 -- 10.20.193.45:0/1682546612 wait complete. 2026-02-22T23:28:04.454 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.441+0000 7fdf624ea640 10 monclient: build_initial_monmap 2026-02-22T23:28:04.454 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.441+0000 7fdf624ea640 10 monclient: monmap: 2026-02-22T23:28:04.454 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-22T23:28:04.454 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T23:28:04.455 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-22T23:28:04.455 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-22T23:28:04.455 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-22T23:28:04.455 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-22T23:28:04.455 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-22T23:28:04.455 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.noname-f 2026-02-22T23:28:04.455 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.noname-b 2026-02-22T23:28:04.455 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.noname-g 2026-02-22T23:28:04.455 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.noname-c 2026-02-22T23:28:04.455 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.noname-h 2026-02-22T23:28:04.455 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.noname-d 2026-02-22T23:28:04.455 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.noname-i 2026-02-22T23:28:04.455 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.noname-e 2026-02-22T23:28:04.455 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:04.455 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.441+0000 7fdf624ea640 1 Processor -- start 2026-02-22T23:28:04.455 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.441+0000 7fdf624ea640 1 -- start start 2026-02-22T23:28:04.455 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.441+0000 7fdf624ea640 10 monclient: init 2026-02-22T23:28:04.456 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.441+0000 7fdf624ea640 10 monclient: _reopen_session rank -1 2026-02-22T23:28:04.456 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.441+0000 7fdf624ea640 10 monclient: _add_conns ranks=[5,1,8,0,7,4,6,3,2] 2026-02-22T23:28:04.456 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.441+0000 7fdf624ea640 10 monclient(hunting): picked mon.noname-h con 0x7fdf5c0a0980 addr v1:10.20.193.73:6791/0 2026-02-22T23:28:04.456 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.441+0000 7fdf624ea640 10 monclient(hunting): picked mon.noname-f con 0x7fdf5c0a1a60 addr v1:10.20.193.73:6789/0 2026-02-22T23:28:04.456 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.441+0000 7fdf624ea640 10 monclient(hunting): picked mon.noname-e con 0x7fdf5c1cf3e0 addr v1:10.20.193.45:6793/0 2026-02-22T23:28:04.456 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.441+0000 7fdf624ea640 1 -- --> v1:10.20.193.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdf5c1d0300 con 0x7fdf5c0a1a60 2026-02-22T23:28:04.456 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.442+0000 7fdf624ea640 1 -- --> v1:10.20.193.73:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdf5c13f550 con 0x7fdf5c0a0980 2026-02-22T23:28:04.456 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.442+0000 7fdf624ea640 1 -- --> v1:10.20.193.45:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdf5c1267a0 con 0x7fdf5c1cf3e0 2026-02-22T23:28:04.456 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.442+0000 7fdf624ea640 10 monclient(hunting): _renew_subs 2026-02-22T23:28:04.456 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.442+0000 7fdf624ea640 10 monclient(hunting): authenticate will time out at 816.059015s 2026-02-22T23:28:04.456 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.442+0000 7fdf60a60640 1 --1- >> v1:10.20.193.45:6793/0 conn(0x7fdf5c1cf3e0 0x7fdf5c1d7e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.45:6793/0 says I am v1:10.20.193.45:41006/0 (socket says 10.20.193.45:41006) 2026-02-22T23:28:04.456 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.442+0000 7fdf60a60640 1 -- 10.20.193.45:0/2389754676 learned_addr learned my addr 10.20.193.45:0/2389754676 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-22T23:28:04.456 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.442+0000 7fdf58ff9640 1 -- 10.20.193.45:0/2389754676 <== mon.8 v1:10.20.193.45:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3525524710 0 0) 0x7fdf5c1267a0 con 0x7fdf5c1cf3e0 2026-02-22T23:28:04.456 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.442+0000 7fdf58ff9640 10 monclient(hunting): _negotiate 2026-02-22T23:28:04.456 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.442+0000 7fdf58ff9640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:28:04.456 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.442+0000 7fdf58ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:28:04.456 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.442+0000 7fdf58ff9640 10 monclient(hunting): my global_id is 4634 2026-02-22T23:28:04.457 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.442+0000 7fdf58ff9640 1 -- 10.20.193.45:0/2389754676 --> v1:10.20.193.45:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdf2c003620 con 0x7fdf5c1cf3e0 2026-02-22T23:28:04.457 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.442+0000 7fdf58ff9640 1 -- 10.20.193.45:0/2389754676 <== mon.5 v1:10.20.193.73:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2100441912 0 0) 0x7fdf5c13f550 con 0x7fdf5c0a0980 2026-02-22T23:28:04.457 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.442+0000 7fdf58ff9640 10 monclient(hunting): _negotiate 2026-02-22T23:28:04.457 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.442+0000 7fdf58ff9640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:28:04.457 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.442+0000 7fdf58ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:28:04.457 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.442+0000 7fdf58ff9640 10 monclient(hunting): my global_id is 114125 2026-02-22T23:28:04.457 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.442+0000 7fdf58ff9640 1 -- 10.20.193.45:0/2389754676 --> v1:10.20.193.73:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdf5c1267a0 con 0x7fdf5c0a0980 2026-02-22T23:28:04.457 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.442+0000 7fdf58ff9640 1 -- 10.20.193.45:0/2389754676 <== mon.8 v1:10.20.193.45:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1719827932 0 0) 0x7fdf2c003620 con 0x7fdf5c1cf3e0 2026-02-22T23:28:04.457 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.442+0000 7fdf58ff9640 1 -- 10.20.193.45:0/2389754676 --> v1:10.20.193.45:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fdf5c13f550 con 0x7fdf5c1cf3e0 2026-02-22T23:28:04.457 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.442+0000 7fdf58ff9640 1 -- 10.20.193.45:0/2389754676 <== mon.8 v1:10.20.193.45:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7fdf50003620 con 0x7fdf5c1cf3e0 2026-02-22T23:28:04.457 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.442+0000 7fdf58ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-22T23:28:04.457 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.442+0000 7fdf58ff9640 10 monclient(hunting): got monmap 1 from mon.noname-e (according to old e1) 2026-02-22T23:28:04.457 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.442+0000 7fdf58ff9640 10 monclient(hunting): dump: 2026-02-22T23:28:04.457 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:28:04.457 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:28:04.457 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:04.457 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:04.457 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:28:04.458 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:28:04.458 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:28:04.458 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:28:04.458 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:28:04.458 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:28:04.458 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:28:04.458 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:28:04.458 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:28:04.458 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:28:04.458 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:28:04.458 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:04.458 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.442+0000 7fdf58ff9640 10 monclient(hunting): _finish_auth 0 2026-02-22T23:28:04.458 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.442+0000 7fdf58ff9640 1 -- 10.20.193.45:0/2389754676 <== mon.1 v1:10.20.193.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4118600401 0 0) 0x7fdf5c1d0300 con 0x7fdf5c0a1a60 2026-02-22T23:28:04.458 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.442+0000 7fdf58ff9640 10 monclient(hunting): _negotiate 2026-02-22T23:28:04.458 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.442+0000 7fdf58ff9640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:28:04.458 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.442+0000 7fdf58ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:28:04.458 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.442+0000 7fdf58ff9640 10 monclient(hunting): my global_id is 114139 2026-02-22T23:28:04.458 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.442+0000 7fdf58ff9640 1 -- 10.20.193.45:0/2389754676 --> v1:10.20.193.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdf2c003620 con 0x7fdf5c0a1a60 2026-02-22T23:28:04.459 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.442+0000 7fdf58ff9640 1 -- 10.20.193.45:0/2389754676 <== mon.8 v1:10.20.193.45:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2455713956 0 0) 0x7fdf5c13f550 con 0x7fdf5c1cf3e0 2026-02-22T23:28:04.459 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.442+0000 7fdf58ff9640 1 -- 10.20.193.45:0/2389754676 >> v1:10.20.193.73:6791/0 conn(0x7fdf5c0a0980 legacy=0x7fdf5c13ee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:04.459 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.442+0000 7fdf58ff9640 1 -- 10.20.193.45:0/2389754676 >> v1:10.20.193.73:6789/0 conn(0x7fdf5c0a1a60 legacy=0x7fdf5c1d4700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:04.459 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.442+0000 7fdf58ff9640 10 monclient: _finish_hunting 0 2026-02-22T23:28:04.459 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.442+0000 7fdf58ff9640 1 monclient: found mon.e 2026-02-22T23:28:04.459 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.442+0000 7fdf58ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T23:28:04.459 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.442+0000 7fdf58ff9640 10 monclient: _send_mon_message to mon.e at v1:10.20.193.45:6793/0 2026-02-22T23:28:04.459 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.442+0000 7fdf58ff9640 1 -- 10.20.193.45:0/2389754676 --> v1:10.20.193.45:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf5c1261e0 con 0x7fdf5c1cf3e0 2026-02-22T23:28:04.459 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.442+0000 7fdf58ff9640 10 monclient: _finish_auth 0 2026-02-22T23:28:04.459 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.442+0000 7fdf58ff9640 10 monclient: _check_auth_tickets 2026-02-22T23:28:04.459 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.442+0000 7fdf58ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T23:28:04.459 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.442+0000 7fdf624ea640 5 monclient: authenticate success, global_id 4634 2026-02-22T23:28:04.459 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.442+0000 7fdf624ea640 10 monclient: _renew_subs 2026-02-22T23:28:04.459 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.442+0000 7fdf624ea640 10 monclient: _send_mon_message to mon.e at v1:10.20.193.45:6793/0 2026-02-22T23:28:04.459 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.442+0000 7fdf624ea640 1 -- 10.20.193.45:0/2389754676 --> v1:10.20.193.45:6793/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fdf5c1264c0 con 0x7fdf5c1cf3e0 2026-02-22T23:28:04.459 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.442+0000 7fdf624ea640 10 monclient: _renew_subs 2026-02-22T23:28:04.459 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.442+0000 7fdf624ea640 10 monclient: _send_mon_message to mon.e at v1:10.20.193.45:6793/0 2026-02-22T23:28:04.460 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.442+0000 7fdf624ea640 1 -- 10.20.193.45:0/2389754676 --> v1:10.20.193.45:6793/0 -- mon_subscribe({osdmap=0}) -- 0x7fdf5c1d9550 con 0x7fdf5c1cf3e0 2026-02-22T23:28:04.460 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.442+0000 7fdf58ff9640 1 -- 10.20.193.45:0/2389754676 <== mon.8 v1:10.20.193.45:6793/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fdf50004f10 con 0x7fdf5c1cf3e0 2026-02-22T23:28:04.460 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.442+0000 7fdf58ff9640 10 monclient: handle_config config(0 keys) 2026-02-22T23:28:04.460 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.442+0000 7fdf58ff9640 1 -- 10.20.193.45:0/2389754676 <== mon.8 v1:10.20.193.45:6793/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7fdf50005400 con 0x7fdf5c1cf3e0 2026-02-22T23:28:04.460 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.442+0000 7fdf58ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:28:04.460 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.442+0000 7fdf5a7fc640 4 set_mon_vals no callback set 2026-02-22T23:28:04.460 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.442+0000 7fdf58ff9640 10 monclient: got monmap 1 from mon.e (according to old e1) 2026-02-22T23:28:04.460 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.442+0000 7fdf58ff9640 10 monclient: dump: 2026-02-22T23:28:04.460 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:28:04.460 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:28:04.460 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:04.460 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:04.460 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:28:04.460 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:28:04.460 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:28:04.460 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:28:04.460 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:28:04.460 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:28:04.461 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:28:04.461 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:28:04.461 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:28:04.461 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:28:04.461 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:28:04.461 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:04.461 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.442+0000 7fdf624ea640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T23:28:04.461 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.442+0000 7fdf624ea640 1 -- 10.20.193.45:0/2389754676 --> v1:10.20.193.73:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fdf5c13ff60 con 0x7fdf5c06f1e0 2026-02-22T23:28:04.461 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.442+0000 7fdf58ff9640 1 -- 10.20.193.45:0/2389754676 <== mon.8 v1:10.20.193.45:6793/0 7 ==== mgrmap(e 5) ==== 50225+0+0 (unknown 2330357642 0 0) 0x7fdf500119e0 con 0x7fdf5c1cf3e0 2026-02-22T23:28:04.461 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.443+0000 7fdf58ff9640 1 -- 10.20.193.45:0/2389754676 <== mon.8 v1:10.20.193.45:6793/0 8 ==== osd_map(25..25 src has 1..25) ==== 3502+0+0 (unknown 129690100 0 0) 0x7fdf5004de70 con 0x7fdf5c1cf3e0 2026-02-22T23:28:04.461 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.443+0000 7fdf5b7fe640 10 monclient: get_auth_request con 0x7fdf2c03f9d0 auth_method 0 2026-02-22T23:28:04.461 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.443+0000 7fdf58ff9640 1 -- 10.20.193.45:0/2389754676 <== mon.1 v1:10.20.193.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2429555623 0 0) 0x7fdf5c13ff60 con 0x7fdf5c06f1e0 2026-02-22T23:28:04.461 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.443+0000 7fdf58ff9640 10 monclient(hunting): _negotiate 2026-02-22T23:28:04.461 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.443+0000 7fdf58ff9640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:28:04.461 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.443+0000 7fdf58ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:28:04.461 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.443+0000 7fdf58ff9640 10 monclient(hunting): my global_id is 114148 2026-02-22T23:28:04.461 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.443+0000 7fdf58ff9640 1 -- 10.20.193.45:0/2389754676 --> v1:10.20.193.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdf5c13f550 con 0x7fdf5c06f1e0 2026-02-22T23:28:04.462 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.443+0000 7fdf58ff9640 1 -- 10.20.193.45:0/2389754676 <== mon.1 v1:10.20.193.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1880171197 0 0) 0x7fdf5c13f550 con 0x7fdf5c06f1e0 2026-02-22T23:28:04.462 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.443+0000 7fdf58ff9640 1 -- 10.20.193.45:0/2389754676 --> v1:10.20.193.73:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fdf5c13ff60 con 0x7fdf5c06f1e0 2026-02-22T23:28:04.462 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.443+0000 7fdf58ff9640 1 -- 10.20.193.45:0/2389754676 <== mon.1 v1:10.20.193.73:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7fdf48004170 con 0x7fdf5c06f1e0 2026-02-22T23:28:04.462 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.443+0000 7fdf58ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:28:04.462 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.443+0000 7fdf58ff9640 10 monclient: got monmap 1 from mon.f (according to old e1) 2026-02-22T23:28:04.462 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.443+0000 7fdf58ff9640 10 monclient: dump: 2026-02-22T23:28:04.462 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:28:04.462 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:28:04.462 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:04.462 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:04.462 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:28:04.462 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:28:04.462 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:28:04.462 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:28:04.462 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:28:04.462 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:28:04.462 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:28:04.462 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:28:04.463 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:28:04.463 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:28:04.463 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:28:04.463 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:04.463 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.443+0000 7fdf58ff9640 1 -- 10.20.193.45:0/2389754676 <== mon.1 v1:10.20.193.73:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 24868036 0 0) 0x7fdf5c13ff60 con 0x7fdf5c06f1e0 2026-02-22T23:28:04.463 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.443+0000 7fdf58ff9640 1 -- 10.20.193.45:0/2389754676 --> v1:10.20.193.73:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fdf5c0008d0 con 0x7fdf5c06f1e0 2026-02-22T23:28:04.463 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.444+0000 7fdf58ff9640 1 -- 10.20.193.45:0/2389754676 <== mon.1 v1:10.20.193.73:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (unknown 0 0 2024835662) 0x7fdf48004550 con 0x7fdf5c06f1e0 2026-02-22T23:28:04.463 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.444+0000 7fdf58ff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T23:28:04.463 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.444+0000 7fdf58ff9640 10 monclient: _finish_command 1 = system:0 2026-02-22T23:28:04.463 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.444+0000 7fdf58ff9640 1 -- 10.20.193.45:0/2389754676 >> v1:10.20.193.73:6789/0 conn(0x7fdf5c06f1e0 legacy=0x7fdf5c072760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:04.463 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.444+0000 7fdf58ff9640 1 -- 10.20.193.45:0/2389754676 >> v1:10.20.193.73:6789/0 conn(0x7fdf5c06f1e0 legacy=0x7fdf5c072760 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T23:28:04.463 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.447+0000 7fdf624ea640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-22T23:28:04.463 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.447+0000 7fdf624ea640 1 -- 10.20.193.45:0/2389754676 --> v1:10.20.193.73:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fdf5c0724b0 con 0x7fdf5c140620 2026-02-22T23:28:04.464 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.447+0000 7fdf58ff9640 1 -- 10.20.193.45:0/2389754676 <== mon.1 v1:10.20.193.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3030411 0 0) 0x7fdf5c0724b0 con 0x7fdf5c140620 2026-02-22T23:28:04.464 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.447+0000 7fdf58ff9640 10 monclient(hunting): _negotiate 2026-02-22T23:28:04.464 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.447+0000 7fdf58ff9640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:28:04.464 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.447+0000 7fdf58ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:28:04.465 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.447+0000 7fdf58ff9640 10 monclient(hunting): my global_id is 114157 2026-02-22T23:28:04.465 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.447+0000 7fdf58ff9640 1 -- 10.20.193.45:0/2389754676 --> v1:10.20.193.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdf5c13ff60 con 0x7fdf5c140620 2026-02-22T23:28:04.465 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.447+0000 7fdf58ff9640 1 -- 10.20.193.45:0/2389754676 <== mon.1 v1:10.20.193.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 4187900022 0 0) 0x7fdf5c13ff60 con 0x7fdf5c140620 2026-02-22T23:28:04.465 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.447+0000 7fdf58ff9640 1 -- 10.20.193.45:0/2389754676 --> v1:10.20.193.73:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fdf5c0724b0 con 0x7fdf5c140620 2026-02-22T23:28:04.465 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.447+0000 7fdf58ff9640 1 -- 10.20.193.45:0/2389754676 <== mon.1 v1:10.20.193.73:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7fdf480030a0 con 0x7fdf5c140620 2026-02-22T23:28:04.465 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.447+0000 7fdf58ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:28:04.465 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.447+0000 7fdf58ff9640 10 monclient: got monmap 1 from mon.f (according to old e1) 2026-02-22T23:28:04.465 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.447+0000 7fdf58ff9640 10 monclient: dump: 2026-02-22T23:28:04.465 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:28:04.465 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:28:04.465 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:04.465 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:04.465 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:28:04.465 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:28:04.465 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:28:04.465 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:28:04.465 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:28:04.466 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:28:04.466 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:28:04.466 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:28:04.466 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:28:04.466 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:28:04.466 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:28:04.466 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:04.466 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.448+0000 7fdf58ff9640 1 -- 10.20.193.45:0/2389754676 <== mon.1 v1:10.20.193.73:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1848687665 0 0) 0x7fdf5c0724b0 con 0x7fdf5c140620 2026-02-22T23:28:04.466 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.448+0000 7fdf58ff9640 1 -- 10.20.193.45:0/2389754676 --> v1:10.20.193.73:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fdf5c1e0770 con 0x7fdf5c140620 2026-02-22T23:28:04.466 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.448+0000 7fdf58ff9640 1 -- 10.20.193.45:0/2389754676 <== mon.1 v1:10.20.193.73:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7527 (unknown 0 0 2067883625) 0x7fdf48003300 con 0x7fdf5c140620 2026-02-22T23:28:04.466 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.448+0000 7fdf58ff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-22T23:28:04.466 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.448+0000 7fdf58ff9640 10 monclient: _finish_command 2 = system:0 2026-02-22T23:28:04.466 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.448+0000 7fdf58ff9640 1 -- 10.20.193.45:0/2389754676 >> v1:10.20.193.73:6789/0 conn(0x7fdf5c140620 legacy=0x7fdf5c071da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:04.466 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.448+0000 7fdf58ff9640 1 -- 10.20.193.45:0/2389754676 >> v1:10.20.193.73:6789/0 conn(0x7fdf5c140620 legacy=0x7fdf5c071da0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T23:28:04.467 INFO:teuthology.orchestra.run.trial045.stdout:{ 2026-02-22T23:28:04.467 INFO:teuthology.orchestra.run.trial045.stdout: "name": "f", 2026-02-22T23:28:04.467 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 1, 2026-02-22T23:28:04.467 INFO:teuthology.orchestra.run.trial045.stdout: "state": "peon", 2026-02-22T23:28:04.467 INFO:teuthology.orchestra.run.trial045.stdout: "election_epoch": 28, 2026-02-22T23:28:04.467 INFO:teuthology.orchestra.run.trial045.stdout: "uptime": 15767, 2026-02-22T23:28:04.467 INFO:teuthology.orchestra.run.trial045.stdout: "quorum": [ 2026-02-22T23:28:04.467 INFO:teuthology.orchestra.run.trial045.stdout: 0, 2026-02-22T23:28:04.467 INFO:teuthology.orchestra.run.trial045.stdout: 1, 2026-02-22T23:28:04.467 INFO:teuthology.orchestra.run.trial045.stdout: 2, 2026-02-22T23:28:04.467 INFO:teuthology.orchestra.run.trial045.stdout: 3, 2026-02-22T23:28:04.467 INFO:teuthology.orchestra.run.trial045.stdout: 4, 2026-02-22T23:28:04.467 INFO:teuthology.orchestra.run.trial045.stdout: 5, 2026-02-22T23:28:04.467 INFO:teuthology.orchestra.run.trial045.stdout: 6, 2026-02-22T23:28:04.467 INFO:teuthology.orchestra.run.trial045.stdout: 7, 2026-02-22T23:28:04.467 INFO:teuthology.orchestra.run.trial045.stdout: 8 2026-02-22T23:28:04.468 INFO:teuthology.orchestra.run.trial045.stdout: ], 2026-02-22T23:28:04.468 INFO:teuthology.orchestra.run.trial045.stdout: "quorum_age": 0, 2026-02-22T23:28:04.468 INFO:teuthology.orchestra.run.trial045.stdout: "features": { 2026-02-22T23:28:04.468 INFO:teuthology.orchestra.run.trial045.stdout: "required_con": "2450521708007866372", 2026-02-22T23:28:04.468 INFO:teuthology.orchestra.run.trial045.stdout: "required_mon": [ 2026-02-22T23:28:04.468 INFO:teuthology.orchestra.run.trial045.stdout: "kraken", 2026-02-22T23:28:04.468 INFO:teuthology.orchestra.run.trial045.stdout: "luminous", 2026-02-22T23:28:04.468 INFO:teuthology.orchestra.run.trial045.stdout: "mimic", 2026-02-22T23:28:04.468 INFO:teuthology.orchestra.run.trial045.stdout: "osdmap-prune", 2026-02-22T23:28:04.468 INFO:teuthology.orchestra.run.trial045.stdout: "nautilus", 2026-02-22T23:28:04.468 INFO:teuthology.orchestra.run.trial045.stdout: "octopus", 2026-02-22T23:28:04.468 INFO:teuthology.orchestra.run.trial045.stdout: "pacific", 2026-02-22T23:28:04.468 INFO:teuthology.orchestra.run.trial045.stdout: "elector-pinging", 2026-02-22T23:28:04.468 INFO:teuthology.orchestra.run.trial045.stdout: "quincy", 2026-02-22T23:28:04.468 INFO:teuthology.orchestra.run.trial045.stdout: "reef", 2026-02-22T23:28:04.468 INFO:teuthology.orchestra.run.trial045.stdout: "squid" 2026-02-22T23:28:04.468 INFO:teuthology.orchestra.run.trial045.stdout: ], 2026-02-22T23:28:04.468 INFO:teuthology.orchestra.run.trial045.stdout: "quorum_con": "4540701547738038271", 2026-02-22T23:28:04.469 INFO:teuthology.orchestra.run.trial045.stdout: "quorum_mon": [ 2026-02-22T23:28:04.469 INFO:teuthology.orchestra.run.trial045.stdout: "kraken", 2026-02-22T23:28:04.469 INFO:teuthology.orchestra.run.trial045.stdout: "luminous", 2026-02-22T23:28:04.469 INFO:teuthology.orchestra.run.trial045.stdout: "mimic", 2026-02-22T23:28:04.469 INFO:teuthology.orchestra.run.trial045.stdout: "osdmap-prune", 2026-02-22T23:28:04.469 INFO:teuthology.orchestra.run.trial045.stdout: "nautilus", 2026-02-22T23:28:04.469 INFO:teuthology.orchestra.run.trial045.stdout: "octopus", 2026-02-22T23:28:04.469 INFO:teuthology.orchestra.run.trial045.stdout: "pacific", 2026-02-22T23:28:04.469 INFO:teuthology.orchestra.run.trial045.stdout: "elector-pinging", 2026-02-22T23:28:04.469 INFO:teuthology.orchestra.run.trial045.stdout: "quincy", 2026-02-22T23:28:04.469 INFO:teuthology.orchestra.run.trial045.stdout: "reef", 2026-02-22T23:28:04.469 INFO:teuthology.orchestra.run.trial045.stdout: "squid" 2026-02-22T23:28:04.469 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:28:04.469 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:28:04.469 INFO:teuthology.orchestra.run.trial045.stdout: "outside_quorum": [], 2026-02-22T23:28:04.469 INFO:teuthology.orchestra.run.trial045.stdout: "extra_probe_peers": [], 2026-02-22T23:28:04.469 INFO:teuthology.orchestra.run.trial045.stdout: "sync_provider": [], 2026-02-22T23:28:04.469 INFO:teuthology.orchestra.run.trial045.stdout: "monmap": { 2026-02-22T23:28:04.470 INFO:teuthology.orchestra.run.trial045.stdout: "epoch": 1, 2026-02-22T23:28:04.470 INFO:teuthology.orchestra.run.trial045.stdout: "fsid": "4b60f18f-6660-4731-b731-dc85c4078413", 2026-02-22T23:28:04.470 INFO:teuthology.orchestra.run.trial045.stdout: "modified": "2026-02-22T23:24:52.393472Z", 2026-02-22T23:28:04.470 INFO:teuthology.orchestra.run.trial045.stdout: "created": "2026-02-22T23:24:52.393472Z", 2026-02-22T23:28:04.470 INFO:teuthology.orchestra.run.trial045.stdout: "min_mon_release": 19, 2026-02-22T23:28:04.470 INFO:teuthology.orchestra.run.trial045.stdout: "min_mon_release_name": "squid", 2026-02-22T23:28:04.470 INFO:teuthology.orchestra.run.trial045.stdout: "election_strategy": 3, 2026-02-22T23:28:04.470 INFO:teuthology.orchestra.run.trial045.stdout: "disallowed_leaders": "", 2026-02-22T23:28:04.470 INFO:teuthology.orchestra.run.trial045.stdout: "stretch_mode": false, 2026-02-22T23:28:04.470 INFO:teuthology.orchestra.run.trial045.stdout: "tiebreaker_mon": "", 2026-02-22T23:28:04.470 INFO:teuthology.orchestra.run.trial045.stdout: "removed_ranks": "", 2026-02-22T23:28:04.470 INFO:teuthology.orchestra.run.trial045.stdout: "features": { 2026-02-22T23:28:04.470 INFO:teuthology.orchestra.run.trial045.stdout: "persistent": [ 2026-02-22T23:28:04.470 INFO:teuthology.orchestra.run.trial045.stdout: "kraken", 2026-02-22T23:28:04.470 INFO:teuthology.orchestra.run.trial045.stdout: "luminous", 2026-02-22T23:28:04.470 INFO:teuthology.orchestra.run.trial045.stdout: "mimic", 2026-02-22T23:28:04.470 INFO:teuthology.orchestra.run.trial045.stdout: "osdmap-prune", 2026-02-22T23:28:04.470 INFO:teuthology.orchestra.run.trial045.stdout: "nautilus", 2026-02-22T23:28:04.470 INFO:teuthology.orchestra.run.trial045.stdout: "octopus", 2026-02-22T23:28:04.470 INFO:teuthology.orchestra.run.trial045.stdout: "pacific", 2026-02-22T23:28:04.470 INFO:teuthology.orchestra.run.trial045.stdout: "elector-pinging", 2026-02-22T23:28:04.471 INFO:teuthology.orchestra.run.trial045.stdout: "quincy", 2026-02-22T23:28:04.471 INFO:teuthology.orchestra.run.trial045.stdout: "reef", 2026-02-22T23:28:04.471 INFO:teuthology.orchestra.run.trial045.stdout: "squid" 2026-02-22T23:28:04.471 INFO:teuthology.orchestra.run.trial045.stdout: ], 2026-02-22T23:28:04.471 INFO:teuthology.orchestra.run.trial045.stdout: "optional": [] 2026-02-22T23:28:04.471 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:28:04.471 INFO:teuthology.orchestra.run.trial045.stdout: "mons": [ 2026-02-22T23:28:04.471 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:28:04.471 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 0, 2026-02-22T23:28:04.471 INFO:teuthology.orchestra.run.trial045.stdout: "name": "a", 2026-02-22T23:28:04.471 INFO:teuthology.orchestra.run.trial045.stdout: "public_addrs": { 2026-02-22T23:28:04.471 INFO:teuthology.orchestra.run.trial045.stdout: "addrvec": [ 2026-02-22T23:28:04.471 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:28:04.471 INFO:teuthology.orchestra.run.trial045.stdout: "type": "v1", 2026-02-22T23:28:04.471 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6789", 2026-02-22T23:28:04.471 INFO:teuthology.orchestra.run.trial045.stdout: "nonce": 0 2026-02-22T23:28:04.471 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:28:04.471 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:28:04.471 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:28:04.471 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6789/0", 2026-02-22T23:28:04.472 INFO:teuthology.orchestra.run.trial045.stdout: "public_addr": "10.20.193.45:6789/0", 2026-02-22T23:28:04.472 INFO:teuthology.orchestra.run.trial045.stdout: "priority": 0, 2026-02-22T23:28:04.472 INFO:teuthology.orchestra.run.trial045.stdout: "weight": 0, 2026-02-22T23:28:04.472 INFO:teuthology.orchestra.run.trial045.stdout: "crush_location": "{}" 2026-02-22T23:28:04.472 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:28:04.472 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:28:04.472 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 1, 2026-02-22T23:28:04.472 INFO:teuthology.orchestra.run.trial045.stdout: "name": "f", 2026-02-22T23:28:04.472 INFO:teuthology.orchestra.run.trial045.stdout: "public_addrs": { 2026-02-22T23:28:04.472 INFO:teuthology.orchestra.run.trial045.stdout: "addrvec": [ 2026-02-22T23:28:04.472 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:28:04.472 INFO:teuthology.orchestra.run.trial045.stdout: "type": "v1", 2026-02-22T23:28:04.472 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.73:6789", 2026-02-22T23:28:04.472 INFO:teuthology.orchestra.run.trial045.stdout: "nonce": 0 2026-02-22T23:28:04.472 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:28:04.472 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:28:04.472 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:28:04.472 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.73:6789/0", 2026-02-22T23:28:04.472 INFO:teuthology.orchestra.run.trial045.stdout: "public_addr": "10.20.193.73:6789/0", 2026-02-22T23:28:04.472 INFO:teuthology.orchestra.run.trial045.stdout: "priority": 0, 2026-02-22T23:28:04.472 INFO:teuthology.orchestra.run.trial045.stdout: "weight": 0, 2026-02-22T23:28:04.473 INFO:teuthology.orchestra.run.trial045.stdout: "crush_location": "{}" 2026-02-22T23:28:04.473 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:28:04.473 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:28:04.473 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 2, 2026-02-22T23:28:04.473 INFO:teuthology.orchestra.run.trial045.stdout: "name": "b", 2026-02-22T23:28:04.473 INFO:teuthology.orchestra.run.trial045.stdout: "public_addrs": { 2026-02-22T23:28:04.473 INFO:teuthology.orchestra.run.trial045.stdout: "addrvec": [ 2026-02-22T23:28:04.473 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:28:04.473 INFO:teuthology.orchestra.run.trial045.stdout: "type": "v1", 2026-02-22T23:28:04.473 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6790", 2026-02-22T23:28:04.473 INFO:teuthology.orchestra.run.trial045.stdout: "nonce": 0 2026-02-22T23:28:04.473 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:28:04.473 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:28:04.473 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:28:04.473 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6790/0", 2026-02-22T23:28:04.473 INFO:teuthology.orchestra.run.trial045.stdout: "public_addr": "10.20.193.45:6790/0", 2026-02-22T23:28:04.473 INFO:teuthology.orchestra.run.trial045.stdout: "priority": 0, 2026-02-22T23:28:04.473 INFO:teuthology.orchestra.run.trial045.stdout: "weight": 0, 2026-02-22T23:28:04.473 INFO:teuthology.orchestra.run.trial045.stdout: "crush_location": "{}" 2026-02-22T23:28:04.473 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:28:04.473 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:28:04.473 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 3, 2026-02-22T23:28:04.474 INFO:teuthology.orchestra.run.trial045.stdout: "name": "g", 2026-02-22T23:28:04.474 INFO:teuthology.orchestra.run.trial045.stdout: "public_addrs": { 2026-02-22T23:28:04.474 INFO:teuthology.orchestra.run.trial045.stdout: "addrvec": [ 2026-02-22T23:28:04.474 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:28:04.474 INFO:teuthology.orchestra.run.trial045.stdout: "type": "v1", 2026-02-22T23:28:04.474 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.73:6790", 2026-02-22T23:28:04.474 INFO:teuthology.orchestra.run.trial045.stdout: "nonce": 0 2026-02-22T23:28:04.474 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:28:04.474 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:28:04.474 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:28:04.474 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.73:6790/0", 2026-02-22T23:28:04.474 INFO:teuthology.orchestra.run.trial045.stdout: "public_addr": "10.20.193.73:6790/0", 2026-02-22T23:28:04.474 INFO:teuthology.orchestra.run.trial045.stdout: "priority": 0, 2026-02-22T23:28:04.474 INFO:teuthology.orchestra.run.trial045.stdout: "weight": 0, 2026-02-22T23:28:04.474 INFO:teuthology.orchestra.run.trial045.stdout: "crush_location": "{}" 2026-02-22T23:28:04.474 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:28:04.474 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:28:04.474 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 4, 2026-02-22T23:28:04.474 INFO:teuthology.orchestra.run.trial045.stdout: "name": "c", 2026-02-22T23:28:04.474 INFO:teuthology.orchestra.run.trial045.stdout: "public_addrs": { 2026-02-22T23:28:04.474 INFO:teuthology.orchestra.run.trial045.stdout: "addrvec": [ 2026-02-22T23:28:04.474 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:28:04.475 INFO:teuthology.orchestra.run.trial045.stdout: "type": "v1", 2026-02-22T23:28:04.475 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6791", 2026-02-22T23:28:04.475 INFO:teuthology.orchestra.run.trial045.stdout: "nonce": 0 2026-02-22T23:28:04.475 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:28:04.475 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:28:04.475 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:28:04.475 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6791/0", 2026-02-22T23:28:04.475 INFO:teuthology.orchestra.run.trial045.stdout: "public_addr": "10.20.193.45:6791/0", 2026-02-22T23:28:04.475 INFO:teuthology.orchestra.run.trial045.stdout: "priority": 0, 2026-02-22T23:28:04.475 INFO:teuthology.orchestra.run.trial045.stdout: "weight": 0, 2026-02-22T23:28:04.475 INFO:teuthology.orchestra.run.trial045.stdout: "crush_location": "{}" 2026-02-22T23:28:04.475 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:28:04.475 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:28:04.475 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 5, 2026-02-22T23:28:04.475 INFO:teuthology.orchestra.run.trial045.stdout: "name": "h", 2026-02-22T23:28:04.475 INFO:teuthology.orchestra.run.trial045.stdout: "public_addrs": { 2026-02-22T23:28:04.475 INFO:teuthology.orchestra.run.trial045.stdout: "addrvec": [ 2026-02-22T23:28:04.475 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:28:04.475 INFO:teuthology.orchestra.run.trial045.stdout: "type": "v1", 2026-02-22T23:28:04.475 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.73:6791", 2026-02-22T23:28:04.475 INFO:teuthology.orchestra.run.trial045.stdout: "nonce": 0 2026-02-22T23:28:04.475 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:28:04.476 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:28:04.476 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:28:04.476 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.73:6791/0", 2026-02-22T23:28:04.476 INFO:teuthology.orchestra.run.trial045.stdout: "public_addr": "10.20.193.73:6791/0", 2026-02-22T23:28:04.476 INFO:teuthology.orchestra.run.trial045.stdout: "priority": 0, 2026-02-22T23:28:04.476 INFO:teuthology.orchestra.run.trial045.stdout: "weight": 0, 2026-02-22T23:28:04.476 INFO:teuthology.orchestra.run.trial045.stdout: "crush_location": "{}" 2026-02-22T23:28:04.476 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:28:04.476 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:28:04.476 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 6, 2026-02-22T23:28:04.476 INFO:teuthology.orchestra.run.trial045.stdout: "name": "d", 2026-02-22T23:28:04.476 INFO:teuthology.orchestra.run.trial045.stdout: "public_addrs": { 2026-02-22T23:28:04.476 INFO:teuthology.orchestra.run.trial045.stdout: "addrvec": [ 2026-02-22T23:28:04.476 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:28:04.476 INFO:teuthology.orchestra.run.trial045.stdout: "type": "v1", 2026-02-22T23:28:04.476 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6792", 2026-02-22T23:28:04.476 INFO:teuthology.orchestra.run.trial045.stdout: "nonce": 0 2026-02-22T23:28:04.476 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:28:04.476 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:28:04.476 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:28:04.476 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6792/0", 2026-02-22T23:28:04.476 INFO:teuthology.orchestra.run.trial045.stdout: "public_addr": "10.20.193.45:6792/0", 2026-02-22T23:28:04.477 INFO:teuthology.orchestra.run.trial045.stdout: "priority": 0, 2026-02-22T23:28:04.477 INFO:teuthology.orchestra.run.trial045.stdout: "weight": 0, 2026-02-22T23:28:04.477 INFO:teuthology.orchestra.run.trial045.stdout: "crush_location": "{}" 2026-02-22T23:28:04.477 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:28:04.477 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:28:04.477 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 7, 2026-02-22T23:28:04.477 INFO:teuthology.orchestra.run.trial045.stdout: "name": "i", 2026-02-22T23:28:04.477 INFO:teuthology.orchestra.run.trial045.stdout: "public_addrs": { 2026-02-22T23:28:04.477 INFO:teuthology.orchestra.run.trial045.stdout: "addrvec": [ 2026-02-22T23:28:04.477 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:28:04.477 INFO:teuthology.orchestra.run.trial045.stdout: "type": "v1", 2026-02-22T23:28:04.477 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.73:6792", 2026-02-22T23:28:04.477 INFO:teuthology.orchestra.run.trial045.stdout: "nonce": 0 2026-02-22T23:28:04.477 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:28:04.477 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:28:04.477 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:28:04.477 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.73:6792/0", 2026-02-22T23:28:04.477 INFO:teuthology.orchestra.run.trial045.stdout: "public_addr": "10.20.193.73:6792/0", 2026-02-22T23:28:04.477 INFO:teuthology.orchestra.run.trial045.stdout: "priority": 0, 2026-02-22T23:28:04.477 INFO:teuthology.orchestra.run.trial045.stdout: "weight": 0, 2026-02-22T23:28:04.477 INFO:teuthology.orchestra.run.trial045.stdout: "crush_location": "{}" 2026-02-22T23:28:04.477 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:28:04.477 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:28:04.477 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 8, 2026-02-22T23:28:04.478 INFO:teuthology.orchestra.run.trial045.stdout: "name": "e", 2026-02-22T23:28:04.478 INFO:teuthology.orchestra.run.trial045.stdout: "public_addrs": { 2026-02-22T23:28:04.478 INFO:teuthology.orchestra.run.trial045.stdout: "addrvec": [ 2026-02-22T23:28:04.478 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:28:04.478 INFO:teuthology.orchestra.run.trial045.stdout: "type": "v1", 2026-02-22T23:28:04.478 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6793", 2026-02-22T23:28:04.478 INFO:teuthology.orchestra.run.trial045.stdout: "nonce": 0 2026-02-22T23:28:04.478 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:28:04.478 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:28:04.478 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:28:04.478 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6793/0", 2026-02-22T23:28:04.478 INFO:teuthology.orchestra.run.trial045.stdout: "public_addr": "10.20.193.45:6793/0", 2026-02-22T23:28:04.478 INFO:teuthology.orchestra.run.trial045.stdout: "priority": 0, 2026-02-22T23:28:04.478 INFO:teuthology.orchestra.run.trial045.stdout: "weight": 0, 2026-02-22T23:28:04.478 INFO:teuthology.orchestra.run.trial045.stdout: "crush_location": "{}" 2026-02-22T23:28:04.478 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:28:04.478 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:28:04.478 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:28:04.478 INFO:teuthology.orchestra.run.trial045.stdout: "feature_map": { 2026-02-22T23:28:04.478 INFO:teuthology.orchestra.run.trial045.stdout: "mon": [ 2026-02-22T23:28:04.478 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:28:04.478 INFO:teuthology.orchestra.run.trial045.stdout: "features": "0x3f03cffffffdffff", 2026-02-22T23:28:04.478 INFO:teuthology.orchestra.run.trial045.stdout: "release": "squid", 2026-02-22T23:28:04.478 INFO:teuthology.orchestra.run.trial045.stdout: "num": 1 2026-02-22T23:28:04.479 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:28:04.479 INFO:teuthology.orchestra.run.trial045.stdout: ], 2026-02-22T23:28:04.479 INFO:teuthology.orchestra.run.trial045.stdout: "client": [ 2026-02-22T23:28:04.479 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:28:04.479 INFO:teuthology.orchestra.run.trial045.stdout: "features": "0x3f03cffffffdffff", 2026-02-22T23:28:04.479 INFO:teuthology.orchestra.run.trial045.stdout: "release": "squid", 2026-02-22T23:28:04.479 INFO:teuthology.orchestra.run.trial045.stdout: "num": 1 2026-02-22T23:28:04.479 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:28:04.479 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:28:04.479 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:28:04.479 INFO:teuthology.orchestra.run.trial045.stdout: "stretch_mode": false 2026-02-22T23:28:04.479 INFO:teuthology.orchestra.run.trial045.stdout:} 2026-02-22T23:28:04.480 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.448+0000 7fdf624ea640 1 -- 10.20.193.45:0/2389754676 >> v1:10.20.193.73:6800/2222410180 conn(0x7fdf2c03f9d0 legacy=0x7fdf2c041e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:04.480 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.448+0000 7fdf624ea640 10 monclient: shutdown 2026-02-22T23:28:04.480 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.448+0000 7fdf624ea640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T23:28:04.480 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.448+0000 7fdf624ea640 1 -- 10.20.193.45:0/2389754676 >> v1:10.20.193.45:6793/0 conn(0x7fdf5c1cf3e0 legacy=0x7fdf5c1d7e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:04.480 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.448+0000 7fdf60a60640 1 -- 10.20.193.45:0/2389754676 reap_dead start 2026-02-22T23:28:04.480 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.448+0000 7fdf624ea640 1 -- 10.20.193.45:0/2389754676 shutdown_connections 2026-02-22T23:28:04.480 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.448+0000 7fdf624ea640 1 -- 10.20.193.45:0/2389754676 >> 10.20.193.45:0/2389754676 conn(0x7fdf5c0a7780 msgr2=0x7fdf5c141850 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:28:04.480 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.448+0000 7fdf624ea640 1 -- 10.20.193.45:0/2389754676 shutdown_connections 2026-02-22T23:28:04.480 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.448+0000 7fdf624ea640 1 -- 10.20.193.45:0/2389754676 wait complete. 2026-02-22T23:28:04.480 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2026-02-22T23:28:04.480 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon g 2026-02-22T23:28:04.481 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.g mon_status 2026-02-22T23:28:04.549 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.548+0000 7f562b4da640 10 monclient: get_monmap_and_config 2026-02-22T23:28:04.549 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.548+0000 7f562b4da640 10 monclient: build_initial_monmap 2026-02-22T23:28:04.549 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.548+0000 7f562b4da640 10 monclient: monmap: 2026-02-22T23:28:04.549 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-22T23:28:04.549 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:28:04.549 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:28:04.549250+0000 2026-02-22T23:28:04.549 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:28:04.549250+0000 2026-02-22T23:28:04.549 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-22T23:28:04.549 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:28:04.549 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-22T23:28:04.550 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.noname-f 2026-02-22T23:28:04.550 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.noname-b 2026-02-22T23:28:04.550 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.noname-g 2026-02-22T23:28:04.550 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.noname-c 2026-02-22T23:28:04.550 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.noname-h 2026-02-22T23:28:04.550 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.noname-d 2026-02-22T23:28:04.550 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.noname-i 2026-02-22T23:28:04.550 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.noname-e 2026-02-22T23:28:04.550 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:04.557 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.548+0000 7f562b4da640 1 Processor -- start 2026-02-22T23:28:04.558 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.548+0000 7f562b4da640 1 -- start start 2026-02-22T23:28:04.558 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.548+0000 7f562b4da640 10 monclient: init 2026-02-22T23:28:04.558 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.548+0000 7f562b4da640 10 monclient: _reopen_session rank -1 2026-02-22T23:28:04.558 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.548+0000 7f562b4da640 10 monclient: _add_conns ranks=[7,2,8,5,4,0,1,3,6] 2026-02-22T23:28:04.558 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.548+0000 7f562b4da640 10 monclient(hunting): picked mon.noname-i con 0x7f5624138e10 addr v1:10.20.193.73:6792/0 2026-02-22T23:28:04.558 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.548+0000 7f562b4da640 10 monclient(hunting): picked mon.noname-b con 0x7f56240a3630 addr v1:10.20.193.45:6790/0 2026-02-22T23:28:04.558 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.548+0000 7f562b4da640 10 monclient(hunting): picked mon.noname-e con 0x7f562413f310 addr v1:10.20.193.45:6793/0 2026-02-22T23:28:04.558 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.548+0000 7f562b4da640 1 -- --> v1:10.20.193.45:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f56240a3210 con 0x7f56240a3630 2026-02-22T23:28:04.558 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.548+0000 7f562b4da640 1 -- --> v1:10.20.193.73:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f56240a2970 con 0x7f5624138e10 2026-02-22T23:28:04.558 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.548+0000 7f562b4da640 1 -- --> v1:10.20.193.45:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f56240a2260 con 0x7f562413f310 2026-02-22T23:28:04.558 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.548+0000 7f562b4da640 10 monclient(hunting): _renew_subs 2026-02-22T23:28:04.558 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.548+0000 7f562b4da640 10 monclient(hunting): authenticate will time out at 816.165826s 2026-02-22T23:28:04.558 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.548+0000 7f5629a50640 1 --1- >> v1:10.20.193.45:6793/0 conn(0x7f562413f310 0x7f5624141700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.45:6793/0 says I am v1:10.20.193.45:41016/0 (socket says 10.20.193.45:41016) 2026-02-22T23:28:04.558 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.548+0000 7f5629a50640 1 -- 10.20.193.45:0/849269017 learned_addr learned my addr 10.20.193.45:0/849269017 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-22T23:28:04.559 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.549+0000 7f5613fff640 1 -- 10.20.193.45:0/849269017 <== mon.2 v1:10.20.193.45:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 567633382 0 0) 0x7f56240a3210 con 0x7f56240a3630 2026-02-22T23:28:04.559 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.549+0000 7f5613fff640 10 monclient(hunting): _negotiate 2026-02-22T23:28:04.559 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.549+0000 7f5613fff640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:28:04.559 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.549+0000 7f5613fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:28:04.559 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.549+0000 7f5613fff640 10 monclient(hunting): my global_id is 4709 2026-02-22T23:28:04.559 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.549+0000 7f5613fff640 1 -- 10.20.193.45:0/849269017 --> v1:10.20.193.45:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f560c003620 con 0x7f56240a3630 2026-02-22T23:28:04.559 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.549+0000 7f5613fff640 1 -- 10.20.193.45:0/849269017 <== mon.8 v1:10.20.193.45:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1579596686 0 0) 0x7f56240a2260 con 0x7f562413f310 2026-02-22T23:28:04.559 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.549+0000 7f5613fff640 10 monclient(hunting): _negotiate 2026-02-22T23:28:04.559 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.549+0000 7f5613fff640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:28:04.559 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.549+0000 7f5613fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:28:04.559 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.549+0000 7f5613fff640 10 monclient(hunting): my global_id is 4643 2026-02-22T23:28:04.559 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.549+0000 7f5613fff640 1 -- 10.20.193.45:0/849269017 --> v1:10.20.193.45:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f56240a3210 con 0x7f562413f310 2026-02-22T23:28:04.559 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.549+0000 7f5613fff640 1 -- 10.20.193.45:0/849269017 <== mon.7 v1:10.20.193.73:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 727410879 0 0) 0x7f56240a2970 con 0x7f5624138e10 2026-02-22T23:28:04.559 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.549+0000 7f5613fff640 10 monclient(hunting): _negotiate 2026-02-22T23:28:04.559 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.549+0000 7f5613fff640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:28:04.559 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.549+0000 7f5613fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:28:04.560 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.549+0000 7f5613fff640 10 monclient(hunting): my global_id is 4525 2026-02-22T23:28:04.560 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.549+0000 7f5613fff640 1 -- 10.20.193.45:0/849269017 --> v1:10.20.193.73:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f56240a2260 con 0x7f5624138e10 2026-02-22T23:28:04.560 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.549+0000 7f5613fff640 1 -- 10.20.193.45:0/849269017 <== mon.2 v1:10.20.193.45:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1753187515 0 0) 0x7f560c003620 con 0x7f56240a3630 2026-02-22T23:28:04.560 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.549+0000 7f5613fff640 1 -- 10.20.193.45:0/849269017 >> v1:10.20.193.45:6793/0 conn(0x7f562413f310 legacy=0x7f5624141700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:04.560 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.549+0000 7f5613fff640 1 -- 10.20.193.45:0/849269017 >> v1:10.20.193.73:6792/0 conn(0x7f5624138e10 legacy=0x7f56241391f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:04.560 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.549+0000 7f5613fff640 10 monclient: _finish_hunting 0 2026-02-22T23:28:04.560 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.549+0000 7f5613fff640 1 monclient: found mon.noname-b 2026-02-22T23:28:04.560 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.549+0000 7f5613fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T23:28:04.560 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.549+0000 7f5613fff640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.45:6790/0 2026-02-22T23:28:04.560 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.549+0000 7f5613fff640 1 -- 10.20.193.45:0/849269017 --> v1:10.20.193.45:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56240a4510 con 0x7f56240a3630 2026-02-22T23:28:04.560 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.549+0000 7f5613fff640 10 monclient: _finish_auth 0 2026-02-22T23:28:04.560 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.549+0000 7f5613fff640 10 monclient: _check_auth_tickets 2026-02-22T23:28:04.560 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.549+0000 7f5613fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T23:28:04.560 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.549+0000 7f5613fff640 1 -- 10.20.193.45:0/849269017 <== mon.2 v1:10.20.193.45:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f5618003040 con 0x7f56240a3630 2026-02-22T23:28:04.560 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.549+0000 7f5613fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:28:04.560 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.549+0000 7f5613fff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-22T23:28:04.560 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.549+0000 7f5613fff640 10 monclient: dump: 2026-02-22T23:28:04.561 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:28:04.561 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:28:04.561 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:04.561 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:04.561 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:28:04.561 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:28:04.561 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:28:04.561 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:28:04.561 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:28:04.561 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:28:04.561 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:28:04.561 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:28:04.561 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:28:04.561 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:28:04.561 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:28:04.561 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:04.561 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.549+0000 7f562b4da640 5 monclient: authenticate success, global_id 4709 2026-02-22T23:28:04.562 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.549+0000 7f562b4da640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-22T23:28:04.562 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.549+0000 7f5613fff640 1 -- 10.20.193.45:0/849269017 <== mon.2 v1:10.20.193.45:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f56180031e0 con 0x7f56240a3630 2026-02-22T23:28:04.562 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.549+0000 7f5613fff640 10 monclient: handle_config config(0 keys) 2026-02-22T23:28:04.562 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.549+0000 7f5613fff640 1 -- 10.20.193.45:0/849269017 <== mon.2 v1:10.20.193.45:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f5618003a50 con 0x7f56240a3630 2026-02-22T23:28:04.562 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.549+0000 7f5613fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:28:04.562 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.549+0000 7f5613fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-22T23:28:04.562 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.549+0000 7f5613fff640 10 monclient: dump: 2026-02-22T23:28:04.562 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:28:04.562 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:28:04.562 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:04.562 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:04.562 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:28:04.562 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:28:04.562 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:28:04.562 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:28:04.562 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:28:04.562 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:28:04.562 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:28:04.563 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:28:04.563 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:28:04.563 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:28:04.563 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:28:04.563 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:04.563 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.549+0000 7f562b4da640 10 monclient: get_monmap_and_config success 2026-02-22T23:28:04.563 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.549+0000 7f562b4da640 4 set_mon_vals no callback set 2026-02-22T23:28:04.563 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.549+0000 7f562b4da640 10 monclient: shutdown 2026-02-22T23:28:04.563 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.549+0000 7f562b4da640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T23:28:04.563 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.549+0000 7f562b4da640 1 -- 10.20.193.45:0/849269017 >> v1:10.20.193.45:6790/0 conn(0x7f56240a3630 legacy=0x7f562413dbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:04.563 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.549+0000 7f562b4da640 1 -- 10.20.193.45:0/849269017 shutdown_connections 2026-02-22T23:28:04.563 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.549+0000 7f562b4da640 1 -- 10.20.193.45:0/849269017 >> 10.20.193.45:0/849269017 conn(0x7f56240a7780 msgr2=0x7f56240a3b60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:28:04.563 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.549+0000 7f562b4da640 1 -- 10.20.193.45:0/849269017 shutdown_connections 2026-02-22T23:28:04.563 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.549+0000 7f562b4da640 1 -- 10.20.193.45:0/849269017 wait complete. 2026-02-22T23:28:04.563 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.549+0000 7f562b4da640 10 monclient: build_initial_monmap 2026-02-22T23:28:04.563 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.549+0000 7f562b4da640 10 monclient: monmap: 2026-02-22T23:28:04.563 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-22T23:28:04.564 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T23:28:04.564 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-22T23:28:04.564 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-22T23:28:04.564 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-22T23:28:04.564 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-22T23:28:04.564 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-22T23:28:04.564 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.noname-f 2026-02-22T23:28:04.564 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.noname-b 2026-02-22T23:28:04.564 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.noname-g 2026-02-22T23:28:04.564 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.noname-c 2026-02-22T23:28:04.564 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.noname-h 2026-02-22T23:28:04.564 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.noname-d 2026-02-22T23:28:04.564 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.noname-i 2026-02-22T23:28:04.564 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.noname-e 2026-02-22T23:28:04.564 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:04.564 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.550+0000 7f562b4da640 1 Processor -- start 2026-02-22T23:28:04.564 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.550+0000 7f562b4da640 1 -- start start 2026-02-22T23:28:04.565 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.550+0000 7f562b4da640 10 monclient: init 2026-02-22T23:28:04.565 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.550+0000 7f562b4da640 10 monclient: _reopen_session rank -1 2026-02-22T23:28:04.565 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.550+0000 7f562b4da640 10 monclient: _add_conns ranks=[0,6,8,1,7,4,2,5,3] 2026-02-22T23:28:04.565 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.550+0000 7f562b4da640 10 monclient(hunting): picked mon.noname-a con 0x7f56240a3630 addr v1:10.20.193.45:6789/0 2026-02-22T23:28:04.565 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.550+0000 7f562b4da640 10 monclient(hunting): picked mon.noname-d con 0x7f5624138e10 addr v1:10.20.193.45:6792/0 2026-02-22T23:28:04.565 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.550+0000 7f562b4da640 10 monclient(hunting): picked mon.noname-e con 0x7f562413f310 addr v1:10.20.193.45:6793/0 2026-02-22T23:28:04.565 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.550+0000 7f562b4da640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5624137f20 con 0x7f56240a3630 2026-02-22T23:28:04.565 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.550+0000 7f562b4da640 1 -- --> v1:10.20.193.45:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f56240a69c0 con 0x7f5624138e10 2026-02-22T23:28:04.565 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.550+0000 7f562b4da640 1 -- --> v1:10.20.193.45:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f56240a6470 con 0x7f562413f310 2026-02-22T23:28:04.565 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.550+0000 7f562b4da640 10 monclient(hunting): _renew_subs 2026-02-22T23:28:04.565 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.550+0000 7f562b4da640 10 monclient(hunting): authenticate will time out at 816.167359s 2026-02-22T23:28:04.565 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.550+0000 7f5629a50640 1 --1- >> v1:10.20.193.45:6793/0 conn(0x7f562413f310 0x7f56241d87b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.45:6793/0 says I am v1:10.20.193.45:41032/0 (socket says 10.20.193.45:41032) 2026-02-22T23:28:04.565 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.550+0000 7f562924f640 1 --1- >> v1:10.20.193.45:6789/0 conn(0x7f56240a3630 0x7f56241d0040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.45:6789/0 says I am v1:10.20.193.45:38390/0 (socket says 10.20.193.45:38390) 2026-02-22T23:28:04.565 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.550+0000 7f5629a50640 1 -- 10.20.193.45:0/950299195 learned_addr learned my addr 10.20.193.45:0/950299195 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-22T23:28:04.565 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.550+0000 7f5628a4e640 1 --1- >> v1:10.20.193.45:6792/0 conn(0x7f5624138e10 0x7f56241d5080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.45:6792/0 says I am v1:10.20.193.45:36788/0 (socket says 10.20.193.45:36788) 2026-02-22T23:28:04.565 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.550+0000 7f5611ffb640 1 -- 10.20.193.45:0/950299195 <== mon.8 v1:10.20.193.45:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 681098498 0 0) 0x7f56240a6470 con 0x7f562413f310 2026-02-22T23:28:04.565 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.550+0000 7f5611ffb640 10 monclient(hunting): _negotiate 2026-02-22T23:28:04.565 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.550+0000 7f5611ffb640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:28:04.566 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.550+0000 7f5611ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:28:04.566 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.550+0000 7f5611ffb640 10 monclient(hunting): my global_id is 4652 2026-02-22T23:28:04.566 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.550+0000 7f5611ffb640 1 -- 10.20.193.45:0/950299195 --> v1:10.20.193.45:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f55f4003620 con 0x7f562413f310 2026-02-22T23:28:04.566 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.550+0000 7f5611ffb640 1 -- 10.20.193.45:0/950299195 <== mon.6 v1:10.20.193.45:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2553592626 0 0) 0x7f56240a69c0 con 0x7f5624138e10 2026-02-22T23:28:04.566 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.550+0000 7f5611ffb640 10 monclient(hunting): _negotiate 2026-02-22T23:28:04.566 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.550+0000 7f5611ffb640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:28:04.566 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.550+0000 7f5611ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:28:04.566 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.550+0000 7f5611ffb640 10 monclient(hunting): my global_id is 114162 2026-02-22T23:28:04.566 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.550+0000 7f5611ffb640 1 -- 10.20.193.45:0/950299195 --> v1:10.20.193.45:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f56240a6470 con 0x7f5624138e10 2026-02-22T23:28:04.566 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.550+0000 7f5611ffb640 1 -- 10.20.193.45:0/950299195 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2757191114 0 0) 0x7f5624137f20 con 0x7f56240a3630 2026-02-22T23:28:04.566 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.550+0000 7f5611ffb640 10 monclient(hunting): _negotiate 2026-02-22T23:28:04.566 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.550+0000 7f5611ffb640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:28:04.566 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.550+0000 7f5611ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:28:04.566 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.550+0000 7f5611ffb640 10 monclient(hunting): my global_id is 4590 2026-02-22T23:28:04.566 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.550+0000 7f5611ffb640 1 -- 10.20.193.45:0/950299195 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f56240a69c0 con 0x7f56240a3630 2026-02-22T23:28:04.566 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.550+0000 7f5611ffb640 1 -- 10.20.193.45:0/950299195 <== mon.8 v1:10.20.193.45:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 756414719 0 0) 0x7f55f4003620 con 0x7f562413f310 2026-02-22T23:28:04.566 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.550+0000 7f5611ffb640 1 -- 10.20.193.45:0/950299195 --> v1:10.20.193.45:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5624137f20 con 0x7f562413f310 2026-02-22T23:28:04.566 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.550+0000 7f5611ffb640 1 -- 10.20.193.45:0/950299195 <== mon.8 v1:10.20.193.45:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f5620003620 con 0x7f562413f310 2026-02-22T23:28:04.567 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.550+0000 7f5611ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-22T23:28:04.567 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.550+0000 7f5611ffb640 10 monclient(hunting): got monmap 1 from mon.noname-e (according to old e1) 2026-02-22T23:28:04.567 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.550+0000 7f5611ffb640 10 monclient(hunting): dump: 2026-02-22T23:28:04.567 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:28:04.567 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:28:04.567 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:04.567 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:04.567 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:28:04.567 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:28:04.567 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:28:04.567 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:28:04.567 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:28:04.567 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:28:04.567 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:28:04.567 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:28:04.567 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:28:04.567 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:28:04.567 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:28:04.568 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:04.568 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.550+0000 7f5611ffb640 10 monclient(hunting): _finish_auth 0 2026-02-22T23:28:04.568 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.550+0000 7f5611ffb640 1 -- 10.20.193.45:0/950299195 <== mon.6 v1:10.20.193.45:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 230420958 0 0) 0x7f56240a6470 con 0x7f5624138e10 2026-02-22T23:28:04.568 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.550+0000 7f5611ffb640 1 -- 10.20.193.45:0/950299195 --> v1:10.20.193.45:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f55f4003620 con 0x7f5624138e10 2026-02-22T23:28:04.568 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.550+0000 7f5611ffb640 1 -- 10.20.193.45:0/950299195 <== mon.0 v1:10.20.193.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1172191832 0 0) 0x7f56240a69c0 con 0x7f56240a3630 2026-02-22T23:28:04.568 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.550+0000 7f5611ffb640 1 -- 10.20.193.45:0/950299195 --> v1:10.20.193.45:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f56240a6470 con 0x7f56240a3630 2026-02-22T23:28:04.568 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.550+0000 7f5611ffb640 1 -- 10.20.193.45:0/950299195 <== mon.6 v1:10.20.193.45:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f56180036d0 con 0x7f5624138e10 2026-02-22T23:28:04.568 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.550+0000 7f5611ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-22T23:28:04.568 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.550+0000 7f5611ffb640 10 monclient(hunting): got monmap 1 from mon.d (according to old e1) 2026-02-22T23:28:04.568 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.550+0000 7f5611ffb640 10 monclient(hunting): dump: 2026-02-22T23:28:04.568 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:28:04.568 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:28:04.568 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:04.568 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:04.568 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:28:04.568 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:28:04.569 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:28:04.569 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:28:04.569 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:28:04.569 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:28:04.569 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:28:04.569 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:28:04.569 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:28:04.569 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:28:04.569 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:28:04.569 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:04.569 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.550+0000 7f5611ffb640 1 -- 10.20.193.45:0/950299195 <== mon.0 v1:10.20.193.45:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f5614003220 con 0x7f56240a3630 2026-02-22T23:28:04.569 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.550+0000 7f5611ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-22T23:28:04.569 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.550+0000 7f5611ffb640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-22T23:28:04.569 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.550+0000 7f5611ffb640 10 monclient(hunting): dump: 2026-02-22T23:28:04.569 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:28:04.569 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:28:04.569 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:04.569 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:04.570 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:28:04.570 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:28:04.570 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:28:04.570 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:28:04.570 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:28:04.570 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:28:04.570 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:28:04.570 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:28:04.570 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:28:04.570 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:28:04.570 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:28:04.570 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:04.570 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.550+0000 7f5611ffb640 1 -- 10.20.193.45:0/950299195 <== mon.8 v1:10.20.193.45:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1535831987 0 0) 0x7f5624137f20 con 0x7f562413f310 2026-02-22T23:28:04.570 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.550+0000 7f5611ffb640 1 -- 10.20.193.45:0/950299195 >> v1:10.20.193.45:6792/0 conn(0x7f5624138e10 legacy=0x7f56241d5080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:04.570 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.550+0000 7f5611ffb640 1 -- 10.20.193.45:0/950299195 >> v1:10.20.193.45:6789/0 conn(0x7f56240a3630 legacy=0x7f56241d0040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:04.570 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.550+0000 7f5611ffb640 10 monclient: _finish_hunting 0 2026-02-22T23:28:04.570 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.550+0000 7f5611ffb640 1 monclient: found mon.e 2026-02-22T23:28:04.571 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.550+0000 7f5611ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T23:28:04.571 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.550+0000 7f5611ffb640 10 monclient: _send_mon_message to mon.e at v1:10.20.193.45:6793/0 2026-02-22T23:28:04.571 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.550+0000 7f5611ffb640 1 -- 10.20.193.45:0/950299195 --> v1:10.20.193.45:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5624137960 con 0x7f562413f310 2026-02-22T23:28:04.571 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.550+0000 7f5611ffb640 10 monclient: _finish_auth 0 2026-02-22T23:28:04.571 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.550+0000 7f5611ffb640 10 monclient: _check_auth_tickets 2026-02-22T23:28:04.571 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.550+0000 7f5611ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T23:28:04.571 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.550+0000 7f562b4da640 5 monclient: authenticate success, global_id 4652 2026-02-22T23:28:04.571 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.550+0000 7f562b4da640 10 monclient: _renew_subs 2026-02-22T23:28:04.571 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.550+0000 7f562b4da640 10 monclient: _send_mon_message to mon.e at v1:10.20.193.45:6793/0 2026-02-22T23:28:04.571 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.550+0000 7f562b4da640 1 -- 10.20.193.45:0/950299195 --> v1:10.20.193.45:6793/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f5624137c40 con 0x7f562413f310 2026-02-22T23:28:04.571 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.550+0000 7f562b4da640 10 monclient: _renew_subs 2026-02-22T23:28:04.571 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.550+0000 7f562b4da640 10 monclient: _send_mon_message to mon.e at v1:10.20.193.45:6793/0 2026-02-22T23:28:04.571 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.550+0000 7f562b4da640 1 -- 10.20.193.45:0/950299195 --> v1:10.20.193.45:6793/0 -- mon_subscribe({osdmap=0}) -- 0x7f5624134fc0 con 0x7f562413f310 2026-02-22T23:28:04.571 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.550+0000 7f5611ffb640 1 -- 10.20.193.45:0/950299195 <== mon.8 v1:10.20.193.45:6793/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5620004f10 con 0x7f562413f310 2026-02-22T23:28:04.571 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.550+0000 7f5611ffb640 10 monclient: handle_config config(0 keys) 2026-02-22T23:28:04.571 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.550+0000 7f5611ffb640 1 -- 10.20.193.45:0/950299195 <== mon.8 v1:10.20.193.45:6793/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f5620005400 con 0x7f562413f310 2026-02-22T23:28:04.571 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.550+0000 7f5611ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:28:04.571 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.550+0000 7f56137fe640 4 set_mon_vals no callback set 2026-02-22T23:28:04.572 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.550+0000 7f5611ffb640 10 monclient: got monmap 1 from mon.e (according to old e1) 2026-02-22T23:28:04.572 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.550+0000 7f5611ffb640 10 monclient: dump: 2026-02-22T23:28:04.572 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:28:04.572 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:28:04.572 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:04.572 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:04.572 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:28:04.572 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:28:04.572 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:28:04.572 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:28:04.572 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:28:04.572 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:28:04.572 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:28:04.572 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:28:04.572 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:28:04.572 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:28:04.572 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:28:04.572 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:04.573 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.551+0000 7f562b4da640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T23:28:04.573 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.551+0000 7f562b4da640 1 -- 10.20.193.45:0/950299195 --> v1:10.20.193.73:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f5624137760 con 0x7f56241d0750 2026-02-22T23:28:04.573 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.551+0000 7f5611ffb640 1 -- 10.20.193.45:0/950299195 <== mon.8 v1:10.20.193.45:6793/0 7 ==== mgrmap(e 5) ==== 50225+0+0 (unknown 2330357642 0 0) 0x7f56200119e0 con 0x7f562413f310 2026-02-22T23:28:04.573 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.551+0000 7f5611ffb640 1 -- 10.20.193.45:0/950299195 <== mon.8 v1:10.20.193.45:6793/0 8 ==== osd_map(25..25 src has 1..25) ==== 3502+0+0 (unknown 129690100 0 0) 0x7f562004e0e0 con 0x7f562413f310 2026-02-22T23:28:04.573 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.551+0000 7f5611ffb640 1 -- 10.20.193.45:0/950299195 <== mon.3 v1:10.20.193.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3972184712 0 0) 0x7f5624137760 con 0x7f56241d0750 2026-02-22T23:28:04.573 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.551+0000 7f5611ffb640 10 monclient(hunting): _negotiate 2026-02-22T23:28:04.573 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.551+0000 7f5611ffb640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:28:04.573 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.551+0000 7f5611ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:28:04.573 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.551+0000 7f5611ffb640 10 monclient(hunting): my global_id is 4611 2026-02-22T23:28:04.573 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.551+0000 7f5611ffb640 1 -- 10.20.193.45:0/950299195 --> v1:10.20.193.73:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5624137f20 con 0x7f56241d0750 2026-02-22T23:28:04.573 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.551+0000 7f5628a4e640 10 monclient: get_auth_request con 0x7f55f40402b0 auth_method 0 2026-02-22T23:28:04.573 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.551+0000 7f5611ffb640 1 -- 10.20.193.45:0/950299195 <== mon.3 v1:10.20.193.73:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2027313670 0 0) 0x7f5624137f20 con 0x7f56241d0750 2026-02-22T23:28:04.573 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.552+0000 7f5611ffb640 1 -- 10.20.193.45:0/950299195 --> v1:10.20.193.73:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5624137760 con 0x7f56241d0750 2026-02-22T23:28:04.573 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.552+0000 7f5611ffb640 1 -- 10.20.193.45:0/950299195 <== mon.3 v1:10.20.193.73:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f56140038f0 con 0x7f56241d0750 2026-02-22T23:28:04.573 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.552+0000 7f5611ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:28:04.573 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.552+0000 7f5611ffb640 10 monclient: got monmap 1 from mon.g (according to old e1) 2026-02-22T23:28:04.573 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.552+0000 7f5611ffb640 10 monclient: dump: 2026-02-22T23:28:04.574 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:28:04.574 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:28:04.574 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:04.574 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:04.574 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:28:04.574 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:28:04.574 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:28:04.574 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:28:04.574 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:28:04.574 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:28:04.574 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:28:04.574 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:28:04.574 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:28:04.574 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:28:04.574 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:28:04.574 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:04.574 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.552+0000 7f5611ffb640 1 -- 10.20.193.45:0/950299195 <== mon.3 v1:10.20.193.73:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1988655178 0 0) 0x7f5624137760 con 0x7f56241d0750 2026-02-22T23:28:04.574 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.552+0000 7f5611ffb640 1 -- 10.20.193.45:0/950299195 --> v1:10.20.193.73:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f562409de80 con 0x7f56241d0750 2026-02-22T23:28:04.575 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.552+0000 7f5611ffb640 1 -- 10.20.193.45:0/950299195 <== mon.3 v1:10.20.193.73:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (unknown 0 0 2024835662) 0x7f56140058c0 con 0x7f56241d0750 2026-02-22T23:28:04.575 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.552+0000 7f5611ffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T23:28:04.575 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.552+0000 7f5611ffb640 10 monclient: _finish_command 1 = system:0 2026-02-22T23:28:04.575 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.552+0000 7f5611ffb640 1 -- 10.20.193.45:0/950299195 >> v1:10.20.193.73:6790/0 conn(0x7f56241d0750 legacy=0x7f562413f6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:04.575 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.552+0000 7f5611ffb640 1 -- 10.20.193.45:0/950299195 >> v1:10.20.193.73:6790/0 conn(0x7f56241d0750 legacy=0x7f562413f6f0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T23:28:04.575 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.555+0000 7f562b4da640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-22T23:28:04.575 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.555+0000 7f562b4da640 1 -- 10.20.193.45:0/950299195 --> v1:10.20.193.73:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f56240a24a0 con 0x7f562413fe00 2026-02-22T23:28:04.575 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.555+0000 7f5611ffb640 1 -- 10.20.193.45:0/950299195 <== mon.3 v1:10.20.193.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 761557273 0 0) 0x7f56240a24a0 con 0x7f562413fe00 2026-02-22T23:28:04.575 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.555+0000 7f5611ffb640 10 monclient(hunting): _negotiate 2026-02-22T23:28:04.575 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.555+0000 7f5611ffb640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:28:04.575 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.555+0000 7f5611ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:28:04.575 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.555+0000 7f5611ffb640 10 monclient(hunting): my global_id is 4620 2026-02-22T23:28:04.575 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.555+0000 7f5611ffb640 1 -- 10.20.193.45:0/950299195 --> v1:10.20.193.73:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5624137760 con 0x7f562413fe00 2026-02-22T23:28:04.575 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.556+0000 7f5611ffb640 1 -- 10.20.193.45:0/950299195 <== mon.3 v1:10.20.193.73:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2012462435 0 0) 0x7f5624137760 con 0x7f562413fe00 2026-02-22T23:28:04.575 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.556+0000 7f5611ffb640 1 -- 10.20.193.45:0/950299195 --> v1:10.20.193.73:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f56240a24a0 con 0x7f562413fe00 2026-02-22T23:28:04.575 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.556+0000 7f5611ffb640 1 -- 10.20.193.45:0/950299195 <== mon.3 v1:10.20.193.73:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f5614004110 con 0x7f562413fe00 2026-02-22T23:28:04.575 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.556+0000 7f5611ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:28:04.576 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.556+0000 7f5611ffb640 10 monclient: got monmap 1 from mon.g (according to old e1) 2026-02-22T23:28:04.576 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.556+0000 7f5611ffb640 10 monclient: dump: 2026-02-22T23:28:04.576 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:28:04.576 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:28:04.576 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:04.576 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:04.576 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:28:04.576 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:28:04.576 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:28:04.576 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:28:04.576 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:28:04.576 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:28:04.576 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:28:04.576 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:28:04.576 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:28:04.576 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:28:04.576 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:28:04.576 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:04.577 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.556+0000 7f5611ffb640 1 -- 10.20.193.45:0/950299195 <== mon.3 v1:10.20.193.73:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 853995253 0 0) 0x7f56240a24a0 con 0x7f562413fe00 2026-02-22T23:28:04.577 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.556+0000 7f5611ffb640 1 -- 10.20.193.45:0/950299195 --> v1:10.20.193.73:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f562409ea60 con 0x7f562413fe00 2026-02-22T23:28:04.577 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.556+0000 7f5611ffb640 1 -- 10.20.193.45:0/950299195 <== mon.3 v1:10.20.193.73:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7695 (unknown 0 0 3214234022) 0x7f5614004370 con 0x7f562413fe00 2026-02-22T23:28:04.577 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.556+0000 7f5611ffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-22T23:28:04.577 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.556+0000 7f5611ffb640 10 monclient: _finish_command 2 = system:0 2026-02-22T23:28:04.577 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.556+0000 7f5611ffb640 1 -- 10.20.193.45:0/950299195 >> v1:10.20.193.73:6790/0 conn(0x7f562413fe00 legacy=0x7f56241def00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:04.577 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.556+0000 7f5611ffb640 1 -- 10.20.193.45:0/950299195 >> v1:10.20.193.73:6790/0 conn(0x7f562413fe00 legacy=0x7f56241def00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T23:28:04.577 INFO:teuthology.orchestra.run.trial045.stdout:{ 2026-02-22T23:28:04.577 INFO:teuthology.orchestra.run.trial045.stdout: "name": "g", 2026-02-22T23:28:04.577 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 3, 2026-02-22T23:28:04.577 INFO:teuthology.orchestra.run.trial045.stdout: "state": "peon", 2026-02-22T23:28:04.577 INFO:teuthology.orchestra.run.trial045.stdout: "election_epoch": 28, 2026-02-22T23:28:04.578 INFO:teuthology.orchestra.run.trial045.stdout: "uptime": 164675, 2026-02-22T23:28:04.578 INFO:teuthology.orchestra.run.trial045.stdout: "quorum": [ 2026-02-22T23:28:04.578 INFO:teuthology.orchestra.run.trial045.stdout: 0, 2026-02-22T23:28:04.578 INFO:teuthology.orchestra.run.trial045.stdout: 1, 2026-02-22T23:28:04.578 INFO:teuthology.orchestra.run.trial045.stdout: 2, 2026-02-22T23:28:04.578 INFO:teuthology.orchestra.run.trial045.stdout: 3, 2026-02-22T23:28:04.578 INFO:teuthology.orchestra.run.trial045.stdout: 4, 2026-02-22T23:28:04.578 INFO:teuthology.orchestra.run.trial045.stdout: 5, 2026-02-22T23:28:04.578 INFO:teuthology.orchestra.run.trial045.stdout: 6, 2026-02-22T23:28:04.578 INFO:teuthology.orchestra.run.trial045.stdout: 7, 2026-02-22T23:28:04.578 INFO:teuthology.orchestra.run.trial045.stdout: 8 2026-02-22T23:28:04.578 INFO:teuthology.orchestra.run.trial045.stdout: ], 2026-02-22T23:28:04.578 INFO:teuthology.orchestra.run.trial045.stdout: "quorum_age": 0, 2026-02-22T23:28:04.578 INFO:teuthology.orchestra.run.trial045.stdout: "features": { 2026-02-22T23:28:04.578 INFO:teuthology.orchestra.run.trial045.stdout: "required_con": "2450521708007866372", 2026-02-22T23:28:04.578 INFO:teuthology.orchestra.run.trial045.stdout: "required_mon": [ 2026-02-22T23:28:04.578 INFO:teuthology.orchestra.run.trial045.stdout: "kraken", 2026-02-22T23:28:04.578 INFO:teuthology.orchestra.run.trial045.stdout: "luminous", 2026-02-22T23:28:04.579 INFO:teuthology.orchestra.run.trial045.stdout: "mimic", 2026-02-22T23:28:04.579 INFO:teuthology.orchestra.run.trial045.stdout: "osdmap-prune", 2026-02-22T23:28:04.579 INFO:teuthology.orchestra.run.trial045.stdout: "nautilus", 2026-02-22T23:28:04.579 INFO:teuthology.orchestra.run.trial045.stdout: "octopus", 2026-02-22T23:28:04.579 INFO:teuthology.orchestra.run.trial045.stdout: "pacific", 2026-02-22T23:28:04.579 INFO:teuthology.orchestra.run.trial045.stdout: "elector-pinging", 2026-02-22T23:28:04.579 INFO:teuthology.orchestra.run.trial045.stdout: "quincy", 2026-02-22T23:28:04.579 INFO:teuthology.orchestra.run.trial045.stdout: "reef", 2026-02-22T23:28:04.579 INFO:teuthology.orchestra.run.trial045.stdout: "squid" 2026-02-22T23:28:04.579 INFO:teuthology.orchestra.run.trial045.stdout: ], 2026-02-22T23:28:04.579 INFO:teuthology.orchestra.run.trial045.stdout: "quorum_con": "4540701547738038271", 2026-02-22T23:28:04.579 INFO:teuthology.orchestra.run.trial045.stdout: "quorum_mon": [ 2026-02-22T23:28:04.579 INFO:teuthology.orchestra.run.trial045.stdout: "kraken", 2026-02-22T23:28:04.579 INFO:teuthology.orchestra.run.trial045.stdout: "luminous", 2026-02-22T23:28:04.579 INFO:teuthology.orchestra.run.trial045.stdout: "mimic", 2026-02-22T23:28:04.579 INFO:teuthology.orchestra.run.trial045.stdout: "osdmap-prune", 2026-02-22T23:28:04.579 INFO:teuthology.orchestra.run.trial045.stdout: "nautilus", 2026-02-22T23:28:04.579 INFO:teuthology.orchestra.run.trial045.stdout: "octopus", 2026-02-22T23:28:04.580 INFO:teuthology.orchestra.run.trial045.stdout: "pacific", 2026-02-22T23:28:04.580 INFO:teuthology.orchestra.run.trial045.stdout: "elector-pinging", 2026-02-22T23:28:04.580 INFO:teuthology.orchestra.run.trial045.stdout: "quincy", 2026-02-22T23:28:04.580 INFO:teuthology.orchestra.run.trial045.stdout: "reef", 2026-02-22T23:28:04.580 INFO:teuthology.orchestra.run.trial045.stdout: "squid" 2026-02-22T23:28:04.580 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:28:04.580 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:28:04.580 INFO:teuthology.orchestra.run.trial045.stdout: "outside_quorum": [], 2026-02-22T23:28:04.580 INFO:teuthology.orchestra.run.trial045.stdout: "extra_probe_peers": [], 2026-02-22T23:28:04.580 INFO:teuthology.orchestra.run.trial045.stdout: "sync_provider": [], 2026-02-22T23:28:04.580 INFO:teuthology.orchestra.run.trial045.stdout: "monmap": { 2026-02-22T23:28:04.580 INFO:teuthology.orchestra.run.trial045.stdout: "epoch": 1, 2026-02-22T23:28:04.580 INFO:teuthology.orchestra.run.trial045.stdout: "fsid": "4b60f18f-6660-4731-b731-dc85c4078413", 2026-02-22T23:28:04.580 INFO:teuthology.orchestra.run.trial045.stdout: "modified": "2026-02-22T23:24:52.393472Z", 2026-02-22T23:28:04.580 INFO:teuthology.orchestra.run.trial045.stdout: "created": "2026-02-22T23:24:52.393472Z", 2026-02-22T23:28:04.580 INFO:teuthology.orchestra.run.trial045.stdout: "min_mon_release": 19, 2026-02-22T23:28:04.580 INFO:teuthology.orchestra.run.trial045.stdout: "min_mon_release_name": "squid", 2026-02-22T23:28:04.581 INFO:teuthology.orchestra.run.trial045.stdout: "election_strategy": 3, 2026-02-22T23:28:04.581 INFO:teuthology.orchestra.run.trial045.stdout: "disallowed_leaders": "", 2026-02-22T23:28:04.581 INFO:teuthology.orchestra.run.trial045.stdout: "stretch_mode": false, 2026-02-22T23:28:04.581 INFO:teuthology.orchestra.run.trial045.stdout: "tiebreaker_mon": "", 2026-02-22T23:28:04.581 INFO:teuthology.orchestra.run.trial045.stdout: "removed_ranks": "", 2026-02-22T23:28:04.581 INFO:teuthology.orchestra.run.trial045.stdout: "features": { 2026-02-22T23:28:04.581 INFO:teuthology.orchestra.run.trial045.stdout: "persistent": [ 2026-02-22T23:28:04.581 INFO:teuthology.orchestra.run.trial045.stdout: "kraken", 2026-02-22T23:28:04.581 INFO:teuthology.orchestra.run.trial045.stdout: "luminous", 2026-02-22T23:28:04.581 INFO:teuthology.orchestra.run.trial045.stdout: "mimic", 2026-02-22T23:28:04.581 INFO:teuthology.orchestra.run.trial045.stdout: "osdmap-prune", 2026-02-22T23:28:04.581 INFO:teuthology.orchestra.run.trial045.stdout: "nautilus", 2026-02-22T23:28:04.581 INFO:teuthology.orchestra.run.trial045.stdout: "octopus", 2026-02-22T23:28:04.581 INFO:teuthology.orchestra.run.trial045.stdout: "pacific", 2026-02-22T23:28:04.581 INFO:teuthology.orchestra.run.trial045.stdout: "elector-pinging", 2026-02-22T23:28:04.581 INFO:teuthology.orchestra.run.trial045.stdout: "quincy", 2026-02-22T23:28:04.581 INFO:teuthology.orchestra.run.trial045.stdout: "reef", 2026-02-22T23:28:04.581 INFO:teuthology.orchestra.run.trial045.stdout: "squid" 2026-02-22T23:28:04.581 INFO:teuthology.orchestra.run.trial045.stdout: ], 2026-02-22T23:28:04.582 INFO:teuthology.orchestra.run.trial045.stdout: "optional": [] 2026-02-22T23:28:04.582 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:28:04.582 INFO:teuthology.orchestra.run.trial045.stdout: "mons": [ 2026-02-22T23:28:04.582 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:28:04.582 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 0, 2026-02-22T23:28:04.582 INFO:teuthology.orchestra.run.trial045.stdout: "name": "a", 2026-02-22T23:28:04.582 INFO:teuthology.orchestra.run.trial045.stdout: "public_addrs": { 2026-02-22T23:28:04.582 INFO:teuthology.orchestra.run.trial045.stdout: "addrvec": [ 2026-02-22T23:28:04.582 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:28:04.582 INFO:teuthology.orchestra.run.trial045.stdout: "type": "v1", 2026-02-22T23:28:04.582 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6789", 2026-02-22T23:28:04.582 INFO:teuthology.orchestra.run.trial045.stdout: "nonce": 0 2026-02-22T23:28:04.582 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:28:04.582 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:28:04.582 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:28:04.582 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6789/0", 2026-02-22T23:28:04.582 INFO:teuthology.orchestra.run.trial045.stdout: "public_addr": "10.20.193.45:6789/0", 2026-02-22T23:28:04.582 INFO:teuthology.orchestra.run.trial045.stdout: "priority": 0, 2026-02-22T23:28:04.583 INFO:teuthology.orchestra.run.trial045.stdout: "weight": 0, 2026-02-22T23:28:04.583 INFO:teuthology.orchestra.run.trial045.stdout: "crush_location": "{}" 2026-02-22T23:28:04.583 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:28:04.583 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:28:04.583 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 1, 2026-02-22T23:28:04.583 INFO:teuthology.orchestra.run.trial045.stdout: "name": "f", 2026-02-22T23:28:04.583 INFO:teuthology.orchestra.run.trial045.stdout: "public_addrs": { 2026-02-22T23:28:04.583 INFO:teuthology.orchestra.run.trial045.stdout: "addrvec": [ 2026-02-22T23:28:04.583 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:28:04.583 INFO:teuthology.orchestra.run.trial045.stdout: "type": "v1", 2026-02-22T23:28:04.583 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.73:6789", 2026-02-22T23:28:04.583 INFO:teuthology.orchestra.run.trial045.stdout: "nonce": 0 2026-02-22T23:28:04.583 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:28:04.583 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:28:04.583 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:28:04.583 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.73:6789/0", 2026-02-22T23:28:04.583 INFO:teuthology.orchestra.run.trial045.stdout: "public_addr": "10.20.193.73:6789/0", 2026-02-22T23:28:04.583 INFO:teuthology.orchestra.run.trial045.stdout: "priority": 0, 2026-02-22T23:28:04.583 INFO:teuthology.orchestra.run.trial045.stdout: "weight": 0, 2026-02-22T23:28:04.583 INFO:teuthology.orchestra.run.trial045.stdout: "crush_location": "{}" 2026-02-22T23:28:04.584 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:28:04.584 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:28:04.584 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 2, 2026-02-22T23:28:04.584 INFO:teuthology.orchestra.run.trial045.stdout: "name": "b", 2026-02-22T23:28:04.584 INFO:teuthology.orchestra.run.trial045.stdout: "public_addrs": { 2026-02-22T23:28:04.584 INFO:teuthology.orchestra.run.trial045.stdout: "addrvec": [ 2026-02-22T23:28:04.584 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:28:04.584 INFO:teuthology.orchestra.run.trial045.stdout: "type": "v1", 2026-02-22T23:28:04.584 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6790", 2026-02-22T23:28:04.584 INFO:teuthology.orchestra.run.trial045.stdout: "nonce": 0 2026-02-22T23:28:04.584 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:28:04.584 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:28:04.584 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:28:04.584 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6790/0", 2026-02-22T23:28:04.584 INFO:teuthology.orchestra.run.trial045.stdout: "public_addr": "10.20.193.45:6790/0", 2026-02-22T23:28:04.584 INFO:teuthology.orchestra.run.trial045.stdout: "priority": 0, 2026-02-22T23:28:04.584 INFO:teuthology.orchestra.run.trial045.stdout: "weight": 0, 2026-02-22T23:28:04.584 INFO:teuthology.orchestra.run.trial045.stdout: "crush_location": "{}" 2026-02-22T23:28:04.584 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:28:04.584 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:28:04.585 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 3, 2026-02-22T23:28:04.585 INFO:teuthology.orchestra.run.trial045.stdout: "name": "g", 2026-02-22T23:28:04.585 INFO:teuthology.orchestra.run.trial045.stdout: "public_addrs": { 2026-02-22T23:28:04.585 INFO:teuthology.orchestra.run.trial045.stdout: "addrvec": [ 2026-02-22T23:28:04.585 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:28:04.585 INFO:teuthology.orchestra.run.trial045.stdout: "type": "v1", 2026-02-22T23:28:04.585 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.73:6790", 2026-02-22T23:28:04.585 INFO:teuthology.orchestra.run.trial045.stdout: "nonce": 0 2026-02-22T23:28:04.585 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:28:04.585 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:28:04.585 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:28:04.585 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.73:6790/0", 2026-02-22T23:28:04.585 INFO:teuthology.orchestra.run.trial045.stdout: "public_addr": "10.20.193.73:6790/0", 2026-02-22T23:28:04.585 INFO:teuthology.orchestra.run.trial045.stdout: "priority": 0, 2026-02-22T23:28:04.585 INFO:teuthology.orchestra.run.trial045.stdout: "weight": 0, 2026-02-22T23:28:04.585 INFO:teuthology.orchestra.run.trial045.stdout: "crush_location": "{}" 2026-02-22T23:28:04.585 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:28:04.585 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:28:04.585 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 4, 2026-02-22T23:28:04.585 INFO:teuthology.orchestra.run.trial045.stdout: "name": "c", 2026-02-22T23:28:04.585 INFO:teuthology.orchestra.run.trial045.stdout: "public_addrs": { 2026-02-22T23:28:04.586 INFO:teuthology.orchestra.run.trial045.stdout: "addrvec": [ 2026-02-22T23:28:04.586 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:28:04.586 INFO:teuthology.orchestra.run.trial045.stdout: "type": "v1", 2026-02-22T23:28:04.586 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6791", 2026-02-22T23:28:04.586 INFO:teuthology.orchestra.run.trial045.stdout: "nonce": 0 2026-02-22T23:28:04.586 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:28:04.586 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:28:04.586 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:28:04.586 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6791/0", 2026-02-22T23:28:04.586 INFO:teuthology.orchestra.run.trial045.stdout: "public_addr": "10.20.193.45:6791/0", 2026-02-22T23:28:04.586 INFO:teuthology.orchestra.run.trial045.stdout: "priority": 0, 2026-02-22T23:28:04.586 INFO:teuthology.orchestra.run.trial045.stdout: "weight": 0, 2026-02-22T23:28:04.586 INFO:teuthology.orchestra.run.trial045.stdout: "crush_location": "{}" 2026-02-22T23:28:04.586 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:28:04.586 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:28:04.586 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 5, 2026-02-22T23:28:04.586 INFO:teuthology.orchestra.run.trial045.stdout: "name": "h", 2026-02-22T23:28:04.586 INFO:teuthology.orchestra.run.trial045.stdout: "public_addrs": { 2026-02-22T23:28:04.586 INFO:teuthology.orchestra.run.trial045.stdout: "addrvec": [ 2026-02-22T23:28:04.586 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:28:04.586 INFO:teuthology.orchestra.run.trial045.stdout: "type": "v1", 2026-02-22T23:28:04.586 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.73:6791", 2026-02-22T23:28:04.586 INFO:teuthology.orchestra.run.trial045.stdout: "nonce": 0 2026-02-22T23:28:04.587 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:28:04.587 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:28:04.587 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:28:04.587 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.73:6791/0", 2026-02-22T23:28:04.587 INFO:teuthology.orchestra.run.trial045.stdout: "public_addr": "10.20.193.73:6791/0", 2026-02-22T23:28:04.587 INFO:teuthology.orchestra.run.trial045.stdout: "priority": 0, 2026-02-22T23:28:04.587 INFO:teuthology.orchestra.run.trial045.stdout: "weight": 0, 2026-02-22T23:28:04.587 INFO:teuthology.orchestra.run.trial045.stdout: "crush_location": "{}" 2026-02-22T23:28:04.587 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:28:04.587 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:28:04.587 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 6, 2026-02-22T23:28:04.587 INFO:teuthology.orchestra.run.trial045.stdout: "name": "d", 2026-02-22T23:28:04.587 INFO:teuthology.orchestra.run.trial045.stdout: "public_addrs": { 2026-02-22T23:28:04.587 INFO:teuthology.orchestra.run.trial045.stdout: "addrvec": [ 2026-02-22T23:28:04.587 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:28:04.587 INFO:teuthology.orchestra.run.trial045.stdout: "type": "v1", 2026-02-22T23:28:04.587 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6792", 2026-02-22T23:28:04.587 INFO:teuthology.orchestra.run.trial045.stdout: "nonce": 0 2026-02-22T23:28:04.587 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:28:04.587 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:28:04.587 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:28:04.588 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6792/0", 2026-02-22T23:28:04.588 INFO:teuthology.orchestra.run.trial045.stdout: "public_addr": "10.20.193.45:6792/0", 2026-02-22T23:28:04.588 INFO:teuthology.orchestra.run.trial045.stdout: "priority": 0, 2026-02-22T23:28:04.588 INFO:teuthology.orchestra.run.trial045.stdout: "weight": 0, 2026-02-22T23:28:04.588 INFO:teuthology.orchestra.run.trial045.stdout: "crush_location": "{}" 2026-02-22T23:28:04.588 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:28:04.588 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:28:04.588 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 7, 2026-02-22T23:28:04.588 INFO:teuthology.orchestra.run.trial045.stdout: "name": "i", 2026-02-22T23:28:04.588 INFO:teuthology.orchestra.run.trial045.stdout: "public_addrs": { 2026-02-22T23:28:04.588 INFO:teuthology.orchestra.run.trial045.stdout: "addrvec": [ 2026-02-22T23:28:04.588 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:28:04.588 INFO:teuthology.orchestra.run.trial045.stdout: "type": "v1", 2026-02-22T23:28:04.588 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.73:6792", 2026-02-22T23:28:04.588 INFO:teuthology.orchestra.run.trial045.stdout: "nonce": 0 2026-02-22T23:28:04.588 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:28:04.588 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:28:04.588 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:28:04.588 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.73:6792/0", 2026-02-22T23:28:04.588 INFO:teuthology.orchestra.run.trial045.stdout: "public_addr": "10.20.193.73:6792/0", 2026-02-22T23:28:04.588 INFO:teuthology.orchestra.run.trial045.stdout: "priority": 0, 2026-02-22T23:28:04.588 INFO:teuthology.orchestra.run.trial045.stdout: "weight": 0, 2026-02-22T23:28:04.588 INFO:teuthology.orchestra.run.trial045.stdout: "crush_location": "{}" 2026-02-22T23:28:04.588 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:28:04.589 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:28:04.589 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 8, 2026-02-22T23:28:04.589 INFO:teuthology.orchestra.run.trial045.stdout: "name": "e", 2026-02-22T23:28:04.589 INFO:teuthology.orchestra.run.trial045.stdout: "public_addrs": { 2026-02-22T23:28:04.589 INFO:teuthology.orchestra.run.trial045.stdout: "addrvec": [ 2026-02-22T23:28:04.589 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:28:04.589 INFO:teuthology.orchestra.run.trial045.stdout: "type": "v1", 2026-02-22T23:28:04.589 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6793", 2026-02-22T23:28:04.589 INFO:teuthology.orchestra.run.trial045.stdout: "nonce": 0 2026-02-22T23:28:04.589 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:28:04.589 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:28:04.589 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:28:04.589 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6793/0", 2026-02-22T23:28:04.589 INFO:teuthology.orchestra.run.trial045.stdout: "public_addr": "10.20.193.45:6793/0", 2026-02-22T23:28:04.589 INFO:teuthology.orchestra.run.trial045.stdout: "priority": 0, 2026-02-22T23:28:04.589 INFO:teuthology.orchestra.run.trial045.stdout: "weight": 0, 2026-02-22T23:28:04.589 INFO:teuthology.orchestra.run.trial045.stdout: "crush_location": "{}" 2026-02-22T23:28:04.589 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:28:04.589 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:28:04.589 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:28:04.589 INFO:teuthology.orchestra.run.trial045.stdout: "feature_map": { 2026-02-22T23:28:04.589 INFO:teuthology.orchestra.run.trial045.stdout: "mon": [ 2026-02-22T23:28:04.589 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:28:04.590 INFO:teuthology.orchestra.run.trial045.stdout: "features": "0x3f03cffffffdffff", 2026-02-22T23:28:04.590 INFO:teuthology.orchestra.run.trial045.stdout: "release": "squid", 2026-02-22T23:28:04.590 INFO:teuthology.orchestra.run.trial045.stdout: "num": 1 2026-02-22T23:28:04.590 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:28:04.590 INFO:teuthology.orchestra.run.trial045.stdout: ], 2026-02-22T23:28:04.590 INFO:teuthology.orchestra.run.trial045.stdout: "osd": [ 2026-02-22T23:28:04.590 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:28:04.590 INFO:teuthology.orchestra.run.trial045.stdout: "features": "0x3f03cffffffdffff", 2026-02-22T23:28:04.590 INFO:teuthology.orchestra.run.trial045.stdout: "release": "squid", 2026-02-22T23:28:04.590 INFO:teuthology.orchestra.run.trial045.stdout: "num": 1 2026-02-22T23:28:04.590 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:28:04.590 INFO:teuthology.orchestra.run.trial045.stdout: ], 2026-02-22T23:28:04.590 INFO:teuthology.orchestra.run.trial045.stdout: "client": [ 2026-02-22T23:28:04.590 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:28:04.590 INFO:teuthology.orchestra.run.trial045.stdout: "features": "0x3f03cffffffdffff", 2026-02-22T23:28:04.590 INFO:teuthology.orchestra.run.trial045.stdout: "release": "squid", 2026-02-22T23:28:04.590 INFO:teuthology.orchestra.run.trial045.stdout: "num": 4 2026-02-22T23:28:04.590 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:28:04.590 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:28:04.590 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:28:04.590 INFO:teuthology.orchestra.run.trial045.stdout: "stretch_mode": false 2026-02-22T23:28:04.590 INFO:teuthology.orchestra.run.trial045.stdout:} 2026-02-22T23:28:04.591 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.556+0000 7f562b4da640 1 -- 10.20.193.45:0/950299195 >> v1:10.20.193.73:6800/2222410180 conn(0x7f55f40402b0 legacy=0x7f55f4042770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:04.591 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.556+0000 7f562b4da640 10 monclient: shutdown 2026-02-22T23:28:04.591 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.556+0000 7f562b4da640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T23:28:04.591 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.556+0000 7f562b4da640 1 -- 10.20.193.45:0/950299195 >> v1:10.20.193.45:6793/0 conn(0x7f562413f310 legacy=0x7f56241d87b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:04.591 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.556+0000 7f5629a50640 1 -- 10.20.193.45:0/950299195 reap_dead start 2026-02-22T23:28:04.591 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.556+0000 7f5629a50640 1 -- 10.20.193.45:0/950299195 reap_dead start 2026-02-22T23:28:04.591 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.556+0000 7f562b4da640 1 -- 10.20.193.45:0/950299195 shutdown_connections 2026-02-22T23:28:04.592 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.556+0000 7f562b4da640 1 -- 10.20.193.45:0/950299195 >> 10.20.193.45:0/950299195 conn(0x7f56240a7780 msgr2=0x7f56240a5590 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:28:04.592 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.556+0000 7f562b4da640 1 -- 10.20.193.45:0/950299195 shutdown_connections 2026-02-22T23:28:04.592 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.556+0000 7f562b4da640 1 -- 10.20.193.45:0/950299195 wait complete. 2026-02-22T23:28:04.592 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2026-02-22T23:28:04.592 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon h 2026-02-22T23:28:04.592 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.h mon_status 2026-02-22T23:28:04.660 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.659+0000 7f50b1e7c640 10 monclient: get_monmap_and_config 2026-02-22T23:28:04.660 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.659+0000 7f50b1e7c640 10 monclient: build_initial_monmap 2026-02-22T23:28:04.660 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.659+0000 7f50b1e7c640 10 monclient: monmap: 2026-02-22T23:28:04.660 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-22T23:28:04.660 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:28:04.661 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:28:04.660292+0000 2026-02-22T23:28:04.661 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:28:04.660292+0000 2026-02-22T23:28:04.661 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-22T23:28:04.661 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:28:04.661 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-22T23:28:04.661 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.noname-f 2026-02-22T23:28:04.661 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.noname-b 2026-02-22T23:28:04.661 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.noname-g 2026-02-22T23:28:04.661 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.noname-c 2026-02-22T23:28:04.661 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.noname-h 2026-02-22T23:28:04.661 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.noname-d 2026-02-22T23:28:04.661 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.noname-i 2026-02-22T23:28:04.661 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.noname-e 2026-02-22T23:28:04.661 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:04.667 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.659+0000 7f50b1e7c640 1 Processor -- start 2026-02-22T23:28:04.667 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.659+0000 7f50b1e7c640 1 -- start start 2026-02-22T23:28:04.667 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.659+0000 7f50b1e7c640 10 monclient: init 2026-02-22T23:28:04.667 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.659+0000 7f50b1e7c640 10 monclient: _reopen_session rank -1 2026-02-22T23:28:04.667 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.659+0000 7f50b1e7c640 10 monclient: _add_conns ranks=[0,7,1,8,6,3,4,5,2] 2026-02-22T23:28:04.667 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.659+0000 7f50b1e7c640 10 monclient(hunting): picked mon.noname-a con 0x7f50ac0a1a60 addr v1:10.20.193.45:6789/0 2026-02-22T23:28:04.667 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.659+0000 7f50b1e7c640 10 monclient(hunting): picked mon.noname-i con 0x7f50ac06f1e0 addr v1:10.20.193.73:6792/0 2026-02-22T23:28:04.668 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.659+0000 7f50b1e7c640 10 monclient(hunting): picked mon.noname-f con 0x7f50ac0a0980 addr v1:10.20.193.73:6789/0 2026-02-22T23:28:04.668 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.659+0000 7f50b1e7c640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f50ac09df00 con 0x7f50ac0a1a60 2026-02-22T23:28:04.668 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.659+0000 7f50b1e7c640 1 -- --> v1:10.20.193.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f50ac137660 con 0x7f50ac0a0980 2026-02-22T23:28:04.668 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.659+0000 7f50b1e7c640 1 -- --> v1:10.20.193.73:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f50ac0a4510 con 0x7f50ac06f1e0 2026-02-22T23:28:04.668 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.659+0000 7f50b1e7c640 10 monclient(hunting): _renew_subs 2026-02-22T23:28:04.668 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.659+0000 7f50b1e7c640 10 monclient(hunting): authenticate will time out at 816.276810s 2026-02-22T23:28:04.668 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.659+0000 7f50ab7fe640 1 --1- >> v1:10.20.193.45:6789/0 conn(0x7f50ac0a1a60 0x7f50ac136840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.45:6789/0 says I am v1:10.20.193.45:38398/0 (socket says 10.20.193.45:38398) 2026-02-22T23:28:04.668 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.659+0000 7f50ab7fe640 1 -- 10.20.193.45:0/1257511237 learned_addr learned my addr 10.20.193.45:0/1257511237 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-22T23:28:04.668 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.660+0000 7f50aa7fc640 1 -- 10.20.193.45:0/1257511237 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3807898395 0 0) 0x7f5098002920 con 0x7f50ac0a1a60 2026-02-22T23:28:04.668 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.660+0000 7f50aa7fc640 10 monclient(hunting): _negotiate 2026-02-22T23:28:04.668 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.660+0000 7f50aa7fc640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:28:04.668 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.660+0000 7f50aa7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:28:04.668 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.660+0000 7f50aa7fc640 10 monclient(hunting): my global_id is 4599 2026-02-22T23:28:04.668 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.660+0000 7f50aa7fc640 1 -- 10.20.193.45:0/1257511237 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5090003620 con 0x7f50ac0a1a60 2026-02-22T23:28:04.668 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.660+0000 7f50aa7fc640 1 -- 10.20.193.45:0/1257511237 <== mon.0 v1:10.20.193.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1109984114 0 0) 0x7f5090003620 con 0x7f50ac0a1a60 2026-02-22T23:28:04.668 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.660+0000 7f50aa7fc640 1 -- 10.20.193.45:0/1257511237 >> v1:10.20.193.73:6792/0 conn(0x7f50ac06f1e0 legacy=0x7f50ac136f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:04.668 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.660+0000 7f50aa7fc640 1 -- 10.20.193.45:0/1257511237 >> v1:10.20.193.73:6789/0 conn(0x7f50ac0a0980 legacy=0x7f50ac13ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:04.668 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.660+0000 7f50aa7fc640 10 monclient: _finish_hunting 0 2026-02-22T23:28:04.669 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.660+0000 7f50aa7fc640 1 monclient: found mon.noname-a 2026-02-22T23:28:04.669 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.660+0000 7f50aa7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T23:28:04.669 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.660+0000 7f50aa7fc640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.45:6789/0 2026-02-22T23:28:04.669 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.660+0000 7f50aa7fc640 1 -- 10.20.193.45:0/1257511237 --> v1:10.20.193.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50ac143400 con 0x7f50ac0a1a60 2026-02-22T23:28:04.669 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.660+0000 7f50aa7fc640 10 monclient: _finish_auth 0 2026-02-22T23:28:04.669 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.660+0000 7f50aa7fc640 10 monclient: _check_auth_tickets 2026-02-22T23:28:04.669 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.660+0000 7f50aa7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T23:28:04.669 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.660+0000 7f50aa7fc640 1 -- 10.20.193.45:0/1257511237 <== mon.0 v1:10.20.193.45:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f5098003210 con 0x7f50ac0a1a60 2026-02-22T23:28:04.669 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.660+0000 7f50b1e7c640 5 monclient: authenticate success, global_id 4599 2026-02-22T23:28:04.669 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.660+0000 7f50b1e7c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-22T23:28:04.669 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.660+0000 7f50aa7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:28:04.669 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.660+0000 7f50aa7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T23:28:04.669 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.660+0000 7f50aa7fc640 10 monclient: dump: 2026-02-22T23:28:04.669 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:28:04.669 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:28:04.669 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:04.669 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:04.669 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:28:04.669 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:28:04.670 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:28:04.670 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:28:04.670 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:28:04.670 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:28:04.670 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:28:04.670 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:28:04.670 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:28:04.670 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:28:04.670 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:28:04.670 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:04.670 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.660+0000 7f50b1e7c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-22T23:28:04.670 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.660+0000 7f50aa7fc640 1 -- 10.20.193.45:0/1257511237 <== mon.0 v1:10.20.193.45:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5098003430 con 0x7f50ac0a1a60 2026-02-22T23:28:04.670 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.660+0000 7f50aa7fc640 10 monclient: handle_config config(0 keys) 2026-02-22T23:28:04.670 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.660+0000 7f50b1e7c640 10 monclient: get_monmap_and_config success 2026-02-22T23:28:04.670 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.660+0000 7f50b1e7c640 4 set_mon_vals no callback set 2026-02-22T23:28:04.670 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.660+0000 7f50aa7fc640 1 -- 10.20.193.45:0/1257511237 <== mon.0 v1:10.20.193.45:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f5098004ce0 con 0x7f50ac0a1a60 2026-02-22T23:28:04.670 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.660+0000 7f50aa7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:28:04.670 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.660+0000 7f50aa7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T23:28:04.670 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.660+0000 7f50aa7fc640 10 monclient: dump: 2026-02-22T23:28:04.671 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:28:04.671 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:28:04.671 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:04.671 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:04.671 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:28:04.671 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:28:04.671 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:28:04.671 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:28:04.671 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:28:04.671 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:28:04.671 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:28:04.671 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:28:04.671 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:28:04.671 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:28:04.671 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:28:04.671 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:04.671 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.660+0000 7f50b1e7c640 10 monclient: shutdown 2026-02-22T23:28:04.671 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.660+0000 7f50b1e7c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T23:28:04.671 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.660+0000 7f50b1e7c640 1 -- 10.20.193.45:0/1257511237 >> v1:10.20.193.45:6789/0 conn(0x7f50ac0a1a60 legacy=0x7f50ac136840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:04.672 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.660+0000 7f50b1e7c640 1 -- 10.20.193.45:0/1257511237 shutdown_connections 2026-02-22T23:28:04.672 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.660+0000 7f50b1e7c640 1 -- 10.20.193.45:0/1257511237 >> 10.20.193.45:0/1257511237 conn(0x7f50ac0a7780 msgr2=0x7f50ac0a3b60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:28:04.672 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.660+0000 7f50b1e7c640 1 -- 10.20.193.45:0/1257511237 shutdown_connections 2026-02-22T23:28:04.672 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.660+0000 7f50b1e7c640 1 -- 10.20.193.45:0/1257511237 wait complete. 2026-02-22T23:28:04.672 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.660+0000 7f50b1e7c640 10 monclient: build_initial_monmap 2026-02-22T23:28:04.672 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.660+0000 7f50b1e7c640 10 monclient: monmap: 2026-02-22T23:28:04.672 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-22T23:28:04.672 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T23:28:04.672 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-22T23:28:04.672 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-22T23:28:04.672 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-22T23:28:04.672 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-22T23:28:04.672 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-22T23:28:04.672 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.noname-f 2026-02-22T23:28:04.672 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.noname-b 2026-02-22T23:28:04.672 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.noname-g 2026-02-22T23:28:04.672 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.noname-c 2026-02-22T23:28:04.672 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.noname-h 2026-02-22T23:28:04.672 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.noname-d 2026-02-22T23:28:04.673 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.noname-i 2026-02-22T23:28:04.673 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.noname-e 2026-02-22T23:28:04.673 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:04.673 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.661+0000 7f50b1e7c640 1 Processor -- start 2026-02-22T23:28:04.673 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.661+0000 7f50b1e7c640 1 -- start start 2026-02-22T23:28:04.673 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.661+0000 7f50b1e7c640 10 monclient: init 2026-02-22T23:28:04.673 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.661+0000 7f50b1e7c640 10 monclient: _reopen_session rank -1 2026-02-22T23:28:04.673 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.661+0000 7f50b1e7c640 10 monclient: _add_conns ranks=[4,8,0,5,6,3,7,1,2] 2026-02-22T23:28:04.673 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.661+0000 7f50b1e7c640 10 monclient(hunting): picked mon.noname-c con 0x7f50ac0a0980 addr v1:10.20.193.45:6791/0 2026-02-22T23:28:04.673 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.661+0000 7f50b1e7c640 10 monclient(hunting): picked mon.noname-e con 0x7f50ac0a1a60 addr v1:10.20.193.45:6793/0 2026-02-22T23:28:04.673 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.661+0000 7f50b1e7c640 10 monclient(hunting): picked mon.noname-a con 0x7f50ac1cc320 addr v1:10.20.193.45:6789/0 2026-02-22T23:28:04.673 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.661+0000 7f50b1e7c640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f50ac072340 con 0x7f50ac1cc320 2026-02-22T23:28:04.673 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.661+0000 7f50b1e7c640 1 -- --> v1:10.20.193.45:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f50ac137460 con 0x7f50ac0a0980 2026-02-22T23:28:04.673 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.661+0000 7f50b1e7c640 1 -- --> v1:10.20.193.45:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f50ac13fcf0 con 0x7f50ac0a1a60 2026-02-22T23:28:04.673 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.661+0000 7f50b1e7c640 10 monclient(hunting): _renew_subs 2026-02-22T23:28:04.673 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.661+0000 7f50b1e7c640 10 monclient(hunting): authenticate will time out at 816.278364s 2026-02-22T23:28:04.673 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.661+0000 7f50abfff640 1 --1- >> v1:10.20.193.45:6789/0 conn(0x7f50ac1cc320 0x7f50ac1d8310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.45:6789/0 says I am v1:10.20.193.45:38406/0 (socket says 10.20.193.45:38406) 2026-02-22T23:28:04.673 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.661+0000 7f50ab7fe640 1 --1- >> v1:10.20.193.45:6791/0 conn(0x7f50ac0a0980 0x7f50ac136d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.45:6791/0 says I am v1:10.20.193.45:57716/0 (socket says 10.20.193.45:57716) 2026-02-22T23:28:04.673 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.661+0000 7f50abfff640 1 -- 10.20.193.45:0/2331310930 learned_addr learned my addr 10.20.193.45:0/2331310930 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-22T23:28:04.674 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.661+0000 7f50aaffd640 1 --1- >> v1:10.20.193.45:6793/0 conn(0x7f50ac0a1a60 0x7f50ac1d4be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.45:6793/0 says I am v1:10.20.193.45:41036/0 (socket says 10.20.193.45:41036) 2026-02-22T23:28:04.674 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.661+0000 7f5087fff640 1 -- 10.20.193.45:0/2331310930 <== mon.8 v1:10.20.193.45:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2242082805 0 0) 0x7f50ac13fcf0 con 0x7f50ac0a1a60 2026-02-22T23:28:04.674 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.661+0000 7f5087fff640 10 monclient(hunting): _negotiate 2026-02-22T23:28:04.674 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.661+0000 7f5087fff640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:28:04.674 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.661+0000 7f5087fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:28:04.674 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.661+0000 7f5087fff640 10 monclient(hunting): my global_id is 4661 2026-02-22T23:28:04.674 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.661+0000 7f5087fff640 1 -- 10.20.193.45:0/2331310930 --> v1:10.20.193.45:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f507c003620 con 0x7f50ac0a1a60 2026-02-22T23:28:04.674 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.661+0000 7f5087fff640 1 -- 10.20.193.45:0/2331310930 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 119157355 0 0) 0x7f50ac072340 con 0x7f50ac1cc320 2026-02-22T23:28:04.674 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.661+0000 7f5087fff640 10 monclient(hunting): _negotiate 2026-02-22T23:28:04.674 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.661+0000 7f5087fff640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:28:04.674 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.661+0000 7f5087fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:28:04.674 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.661+0000 7f5087fff640 10 monclient(hunting): my global_id is 4608 2026-02-22T23:28:04.674 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.661+0000 7f5087fff640 1 -- 10.20.193.45:0/2331310930 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f50ac13fcf0 con 0x7f50ac1cc320 2026-02-22T23:28:04.674 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.661+0000 7f5087fff640 1 -- 10.20.193.45:0/2331310930 <== mon.4 v1:10.20.193.45:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2913219208 0 0) 0x7f50ac137460 con 0x7f50ac0a0980 2026-02-22T23:28:04.674 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.661+0000 7f5087fff640 10 monclient(hunting): _negotiate 2026-02-22T23:28:04.674 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.661+0000 7f5087fff640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:28:04.674 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.661+0000 7f5087fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:28:04.674 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.661+0000 7f5087fff640 10 monclient(hunting): my global_id is 114151 2026-02-22T23:28:04.674 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.661+0000 7f5087fff640 1 -- 10.20.193.45:0/2331310930 --> v1:10.20.193.45:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f50ac072340 con 0x7f50ac0a0980 2026-02-22T23:28:04.675 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.661+0000 7f5087fff640 1 -- 10.20.193.45:0/2331310930 <== mon.8 v1:10.20.193.45:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2020838911 0 0) 0x7f507c003620 con 0x7f50ac0a1a60 2026-02-22T23:28:04.675 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.661+0000 7f5087fff640 1 -- 10.20.193.45:0/2331310930 --> v1:10.20.193.45:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f50ac137460 con 0x7f50ac0a1a60 2026-02-22T23:28:04.675 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.661+0000 7f5087fff640 1 -- 10.20.193.45:0/2331310930 <== mon.8 v1:10.20.193.45:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f509c0032e0 con 0x7f50ac0a1a60 2026-02-22T23:28:04.675 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.661+0000 7f5087fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-22T23:28:04.675 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.661+0000 7f5087fff640 10 monclient(hunting): got monmap 1 from mon.noname-e (according to old e1) 2026-02-22T23:28:04.675 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.661+0000 7f5087fff640 10 monclient(hunting): dump: 2026-02-22T23:28:04.675 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:28:04.675 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:28:04.675 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:04.675 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:04.675 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:28:04.675 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:28:04.675 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:28:04.675 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:28:04.675 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:28:04.675 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:28:04.675 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:28:04.675 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:28:04.676 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:28:04.676 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:28:04.676 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:28:04.676 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:04.676 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.661+0000 7f5087fff640 10 monclient(hunting): _finish_auth 0 2026-02-22T23:28:04.676 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.661+0000 7f5087fff640 1 -- 10.20.193.45:0/2331310930 <== mon.0 v1:10.20.193.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1821776820 0 0) 0x7f50ac13fcf0 con 0x7f50ac1cc320 2026-02-22T23:28:04.676 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.661+0000 7f5087fff640 1 -- 10.20.193.45:0/2331310930 --> v1:10.20.193.45:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f507c003620 con 0x7f50ac1cc320 2026-02-22T23:28:04.676 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.661+0000 7f5087fff640 1 -- 10.20.193.45:0/2331310930 <== mon.4 v1:10.20.193.45:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4085241133 0 0) 0x7f50ac072340 con 0x7f50ac0a0980 2026-02-22T23:28:04.676 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.661+0000 7f5087fff640 1 -- 10.20.193.45:0/2331310930 --> v1:10.20.193.45:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f50ac13fcf0 con 0x7f50ac0a0980 2026-02-22T23:28:04.676 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.661+0000 7f5087fff640 1 -- 10.20.193.45:0/2331310930 <== mon.0 v1:10.20.193.45:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f50a00035a0 con 0x7f50ac1cc320 2026-02-22T23:28:04.676 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.661+0000 7f5087fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-22T23:28:04.676 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.661+0000 7f5087fff640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-22T23:28:04.676 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.661+0000 7f5087fff640 10 monclient(hunting): dump: 2026-02-22T23:28:04.676 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:28:04.676 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:28:04.676 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:04.676 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:04.676 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:28:04.676 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:28:04.677 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:28:04.677 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:28:04.677 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:28:04.677 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:28:04.677 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:28:04.677 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:28:04.677 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:28:04.677 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:28:04.677 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:28:04.677 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:04.677 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.661+0000 7f5087fff640 1 -- 10.20.193.45:0/2331310930 <== mon.4 v1:10.20.193.45:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f50980031d0 con 0x7f50ac0a0980 2026-02-22T23:28:04.677 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.661+0000 7f5087fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-22T23:28:04.677 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.661+0000 7f5087fff640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-22T23:28:04.677 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.661+0000 7f5087fff640 10 monclient(hunting): dump: 2026-02-22T23:28:04.677 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:28:04.677 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:28:04.677 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:04.677 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:04.677 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:28:04.678 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:28:04.678 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:28:04.678 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:28:04.678 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:28:04.678 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:28:04.678 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:28:04.678 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:28:04.678 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:28:04.678 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:28:04.678 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:28:04.678 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:04.678 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.661+0000 7f5087fff640 1 -- 10.20.193.45:0/2331310930 <== mon.8 v1:10.20.193.45:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4223727844 0 0) 0x7f50ac137460 con 0x7f50ac0a1a60 2026-02-22T23:28:04.678 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.661+0000 7f5087fff640 1 -- 10.20.193.45:0/2331310930 >> v1:10.20.193.45:6791/0 conn(0x7f50ac0a0980 legacy=0x7f50ac136d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:04.678 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.661+0000 7f5087fff640 1 -- 10.20.193.45:0/2331310930 >> v1:10.20.193.45:6789/0 conn(0x7f50ac1cc320 legacy=0x7f50ac1d8310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:04.678 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.661+0000 7f5087fff640 10 monclient: _finish_hunting 0 2026-02-22T23:28:04.678 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.661+0000 7f5087fff640 1 monclient: found mon.e 2026-02-22T23:28:04.678 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.661+0000 7f5087fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T23:28:04.678 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.661+0000 7f5087fff640 10 monclient: _send_mon_message to mon.e at v1:10.20.193.45:6793/0 2026-02-22T23:28:04.678 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.661+0000 7f5087fff640 1 -- 10.20.193.45:0/2331310930 --> v1:10.20.193.45:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50ac11e6b0 con 0x7f50ac0a1a60 2026-02-22T23:28:04.679 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.661+0000 7f5087fff640 10 monclient: _finish_auth 0 2026-02-22T23:28:04.679 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.661+0000 7f5087fff640 10 monclient: _check_auth_tickets 2026-02-22T23:28:04.679 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.661+0000 7f5087fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T23:28:04.679 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.661+0000 7f50b1e7c640 5 monclient: authenticate success, global_id 4661 2026-02-22T23:28:04.679 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.661+0000 7f50b1e7c640 10 monclient: _renew_subs 2026-02-22T23:28:04.679 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.661+0000 7f50b1e7c640 10 monclient: _send_mon_message to mon.e at v1:10.20.193.45:6793/0 2026-02-22T23:28:04.679 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.661+0000 7f50b1e7c640 1 -- 10.20.193.45:0/2331310930 --> v1:10.20.193.45:6793/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f50ac0a5f30 con 0x7f50ac0a1a60 2026-02-22T23:28:04.679 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.661+0000 7f50b1e7c640 10 monclient: _renew_subs 2026-02-22T23:28:04.679 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.661+0000 7f50b1e7c640 10 monclient: _send_mon_message to mon.e at v1:10.20.193.45:6793/0 2026-02-22T23:28:04.679 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.661+0000 7f50b1e7c640 1 -- 10.20.193.45:0/2331310930 --> v1:10.20.193.45:6793/0 -- mon_subscribe({osdmap=0}) -- 0x7f50ac1d9a30 con 0x7f50ac0a1a60 2026-02-22T23:28:04.679 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.661+0000 7f5087fff640 1 -- 10.20.193.45:0/2331310930 <== mon.8 v1:10.20.193.45:6793/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f509c0039c0 con 0x7f50ac0a1a60 2026-02-22T23:28:04.679 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.661+0000 7f5087fff640 10 monclient: handle_config config(0 keys) 2026-02-22T23:28:04.679 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.661+0000 7f5087fff640 1 -- 10.20.193.45:0/2331310930 <== mon.8 v1:10.20.193.45:6793/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f509c003f30 con 0x7f50ac0a1a60 2026-02-22T23:28:04.679 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.661+0000 7f5087fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:28:04.679 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.661+0000 7f5087fff640 10 monclient: got monmap 1 from mon.e (according to old e1) 2026-02-22T23:28:04.679 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.661+0000 7f50a9ffb640 4 set_mon_vals no callback set 2026-02-22T23:28:04.679 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.661+0000 7f5087fff640 10 monclient: dump: 2026-02-22T23:28:04.679 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:28:04.679 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:28:04.680 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:04.680 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:04.680 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:28:04.680 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:28:04.680 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:28:04.680 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:28:04.680 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:28:04.680 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:28:04.680 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:28:04.680 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:28:04.680 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:28:04.680 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:28:04.680 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:28:04.680 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:04.680 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.662+0000 7f50b1e7c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T23:28:04.680 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.662+0000 7f50b1e7c640 1 -- 10.20.193.45:0/2331310930 --> v1:10.20.193.73:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f50ac073fc0 con 0x7f50ac06f1e0 2026-02-22T23:28:04.680 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.662+0000 7f5087fff640 1 -- 10.20.193.45:0/2331310930 <== mon.8 v1:10.20.193.45:6793/0 7 ==== mgrmap(e 5) ==== 50225+0+0 (unknown 2330357642 0 0) 0x7f509c0040d0 con 0x7f50ac0a1a60 2026-02-22T23:28:04.680 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.662+0000 7f5087fff640 1 -- 10.20.193.45:0/2331310930 <== mon.8 v1:10.20.193.45:6793/0 8 ==== osd_map(25..25 src has 1..25) ==== 3502+0+0 (unknown 129690100 0 0) 0x7f509c04dc50 con 0x7f50ac0a1a60 2026-02-22T23:28:04.680 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.662+0000 7f50abfff640 10 monclient: get_auth_request con 0x7f507c0403f0 auth_method 0 2026-02-22T23:28:04.681 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.662+0000 7f5087fff640 1 -- 10.20.193.45:0/2331310930 <== mon.5 v1:10.20.193.73:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 766715774 0 0) 0x7f50ac13fcf0 con 0x7f50ac06f1e0 2026-02-22T23:28:04.681 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.662+0000 7f5087fff640 10 monclient(hunting): _negotiate 2026-02-22T23:28:04.681 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.662+0000 7f5087fff640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:28:04.681 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.662+0000 7f5087fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:28:04.681 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.662+0000 7f5087fff640 10 monclient(hunting): my global_id is 114134 2026-02-22T23:28:04.681 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.663+0000 7f5087fff640 1 -- 10.20.193.45:0/2331310930 --> v1:10.20.193.73:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f50ac137460 con 0x7f50ac06f1e0 2026-02-22T23:28:04.681 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.663+0000 7f5087fff640 1 -- 10.20.193.45:0/2331310930 <== mon.5 v1:10.20.193.73:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 353028394 0 0) 0x7f50ac137460 con 0x7f50ac06f1e0 2026-02-22T23:28:04.681 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.663+0000 7f5087fff640 1 -- 10.20.193.45:0/2331310930 --> v1:10.20.193.73:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f50ac13fcf0 con 0x7f50ac06f1e0 2026-02-22T23:28:04.681 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.663+0000 7f5087fff640 1 -- 10.20.193.45:0/2331310930 <== mon.5 v1:10.20.193.73:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f5098002be0 con 0x7f50ac06f1e0 2026-02-22T23:28:04.681 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.663+0000 7f5087fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:28:04.681 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.663+0000 7f5087fff640 10 monclient: got monmap 1 from mon.h (according to old e1) 2026-02-22T23:28:04.681 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.663+0000 7f5087fff640 10 monclient: dump: 2026-02-22T23:28:04.681 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:28:04.681 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:28:04.681 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:04.681 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:04.681 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:28:04.681 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:28:04.681 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:28:04.681 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:28:04.682 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:28:04.682 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:28:04.682 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:28:04.682 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:28:04.682 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:28:04.682 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:28:04.682 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:28:04.682 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:04.682 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.663+0000 7f5087fff640 1 -- 10.20.193.45:0/2331310930 <== mon.5 v1:10.20.193.73:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2308196214 0 0) 0x7f50ac13fcf0 con 0x7f50ac06f1e0 2026-02-22T23:28:04.682 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.663+0000 7f5087fff640 1 -- 10.20.193.45:0/2331310930 --> v1:10.20.193.73:6791/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f50ac074510 con 0x7f50ac06f1e0 2026-02-22T23:28:04.682 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.663+0000 7f5087fff640 1 -- 10.20.193.45:0/2331310930 <== mon.5 v1:10.20.193.73:6791/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (unknown 0 0 2024835662) 0x7f5098004f80 con 0x7f50ac06f1e0 2026-02-22T23:28:04.682 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.663+0000 7f5087fff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T23:28:04.682 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.663+0000 7f5087fff640 10 monclient: _finish_command 1 = system:0 2026-02-22T23:28:04.682 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.663+0000 7f5087fff640 1 -- 10.20.193.45:0/2331310930 >> v1:10.20.193.73:6791/0 conn(0x7f50ac06f1e0 legacy=0x7f50ac13c180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:04.682 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.663+0000 7f5087fff640 1 -- 10.20.193.45:0/2331310930 >> v1:10.20.193.73:6791/0 conn(0x7f50ac06f1e0 legacy=0x7f50ac13c180 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T23:28:04.683 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.666+0000 7f50b1e7c640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-22T23:28:04.684 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.666+0000 7f50b1e7c640 1 -- 10.20.193.45:0/2331310930 --> v1:10.20.193.73:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f50ac071cb0 con 0x7f50ac140620 2026-02-22T23:28:04.684 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.667+0000 7f5087fff640 1 -- 10.20.193.45:0/2331310930 <== mon.5 v1:10.20.193.73:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2652792380 0 0) 0x7f50ac071cb0 con 0x7f50ac140620 2026-02-22T23:28:04.684 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.667+0000 7f5087fff640 10 monclient(hunting): _negotiate 2026-02-22T23:28:04.684 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.667+0000 7f5087fff640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:28:04.684 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.667+0000 7f5087fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:28:04.684 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.667+0000 7f5087fff640 10 monclient(hunting): my global_id is 114143 2026-02-22T23:28:04.684 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.667+0000 7f5087fff640 1 -- 10.20.193.45:0/2331310930 --> v1:10.20.193.73:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f50ac13fcf0 con 0x7f50ac140620 2026-02-22T23:28:04.684 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.667+0000 7f5087fff640 1 -- 10.20.193.45:0/2331310930 <== mon.5 v1:10.20.193.73:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3710407987 0 0) 0x7f50ac13fcf0 con 0x7f50ac140620 2026-02-22T23:28:04.684 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.667+0000 7f5087fff640 1 -- 10.20.193.45:0/2331310930 --> v1:10.20.193.73:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f50ac071cb0 con 0x7f50ac140620 2026-02-22T23:28:04.684 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.667+0000 7f5087fff640 1 -- 10.20.193.45:0/2331310930 <== mon.5 v1:10.20.193.73:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f5098006810 con 0x7f50ac140620 2026-02-22T23:28:04.684 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.667+0000 7f5087fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:28:04.684 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.667+0000 7f5087fff640 10 monclient: got monmap 1 from mon.h (according to old e1) 2026-02-22T23:28:04.684 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.667+0000 7f5087fff640 10 monclient: dump: 2026-02-22T23:28:04.684 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:28:04.684 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:28:04.684 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:04.684 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:04.684 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:28:04.685 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:28:04.685 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:28:04.685 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:28:04.685 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:28:04.685 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:28:04.685 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:28:04.685 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:28:04.685 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:28:04.685 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:28:04.685 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:28:04.685 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:04.685 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.667+0000 7f5087fff640 1 -- 10.20.193.45:0/2331310930 <== mon.5 v1:10.20.193.73:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2384398366 0 0) 0x7f50ac071cb0 con 0x7f50ac140620 2026-02-22T23:28:04.685 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.667+0000 7f5087fff640 1 -- 10.20.193.45:0/2331310930 --> v1:10.20.193.73:6791/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f50ac06ce10 con 0x7f50ac140620 2026-02-22T23:28:04.685 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.668+0000 7f5087fff640 1 -- 10.20.193.45:0/2331310930 <== mon.5 v1:10.20.193.73:6791/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7527 (unknown 0 0 2206728070) 0x7f5098005440 con 0x7f50ac140620 2026-02-22T23:28:04.685 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.668+0000 7f5087fff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-22T23:28:04.685 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.668+0000 7f5087fff640 10 monclient: _finish_command 2 = system:0 2026-02-22T23:28:04.685 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.668+0000 7f5087fff640 1 -- 10.20.193.45:0/2331310930 >> v1:10.20.193.73:6791/0 conn(0x7f50ac140620 legacy=0x7f50ac13c890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:04.685 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.668+0000 7f5087fff640 1 -- 10.20.193.45:0/2331310930 >> v1:10.20.193.73:6791/0 conn(0x7f50ac140620 legacy=0x7f50ac13c890 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T23:28:04.686 INFO:teuthology.orchestra.run.trial045.stdout:{ 2026-02-22T23:28:04.686 INFO:teuthology.orchestra.run.trial045.stdout: "name": "h", 2026-02-22T23:28:04.686 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 5, 2026-02-22T23:28:04.686 INFO:teuthology.orchestra.run.trial045.stdout: "state": "peon", 2026-02-22T23:28:04.686 INFO:teuthology.orchestra.run.trial045.stdout: "election_epoch": 28, 2026-02-22T23:28:04.686 INFO:teuthology.orchestra.run.trial045.stdout: "uptime": 15989, 2026-02-22T23:28:04.686 INFO:teuthology.orchestra.run.trial045.stdout: "quorum": [ 2026-02-22T23:28:04.686 INFO:teuthology.orchestra.run.trial045.stdout: 0, 2026-02-22T23:28:04.686 INFO:teuthology.orchestra.run.trial045.stdout: 1, 2026-02-22T23:28:04.686 INFO:teuthology.orchestra.run.trial045.stdout: 2, 2026-02-22T23:28:04.686 INFO:teuthology.orchestra.run.trial045.stdout: 3, 2026-02-22T23:28:04.686 INFO:teuthology.orchestra.run.trial045.stdout: 4, 2026-02-22T23:28:04.686 INFO:teuthology.orchestra.run.trial045.stdout: 5, 2026-02-22T23:28:04.687 INFO:teuthology.orchestra.run.trial045.stdout: 6, 2026-02-22T23:28:04.687 INFO:teuthology.orchestra.run.trial045.stdout: 7, 2026-02-22T23:28:04.687 INFO:teuthology.orchestra.run.trial045.stdout: 8 2026-02-22T23:28:04.687 INFO:teuthology.orchestra.run.trial045.stdout: ], 2026-02-22T23:28:04.687 INFO:teuthology.orchestra.run.trial045.stdout: "quorum_age": 1, 2026-02-22T23:28:04.687 INFO:teuthology.orchestra.run.trial045.stdout: "features": { 2026-02-22T23:28:04.687 INFO:teuthology.orchestra.run.trial045.stdout: "required_con": "2450521708007866372", 2026-02-22T23:28:04.687 INFO:teuthology.orchestra.run.trial045.stdout: "required_mon": [ 2026-02-22T23:28:04.687 INFO:teuthology.orchestra.run.trial045.stdout: "kraken", 2026-02-22T23:28:04.687 INFO:teuthology.orchestra.run.trial045.stdout: "luminous", 2026-02-22T23:28:04.687 INFO:teuthology.orchestra.run.trial045.stdout: "mimic", 2026-02-22T23:28:04.687 INFO:teuthology.orchestra.run.trial045.stdout: "osdmap-prune", 2026-02-22T23:28:04.687 INFO:teuthology.orchestra.run.trial045.stdout: "nautilus", 2026-02-22T23:28:04.687 INFO:teuthology.orchestra.run.trial045.stdout: "octopus", 2026-02-22T23:28:04.687 INFO:teuthology.orchestra.run.trial045.stdout: "pacific", 2026-02-22T23:28:04.687 INFO:teuthology.orchestra.run.trial045.stdout: "elector-pinging", 2026-02-22T23:28:04.687 INFO:teuthology.orchestra.run.trial045.stdout: "quincy", 2026-02-22T23:28:04.687 INFO:teuthology.orchestra.run.trial045.stdout: "reef", 2026-02-22T23:28:04.688 INFO:teuthology.orchestra.run.trial045.stdout: "squid" 2026-02-22T23:28:04.688 INFO:teuthology.orchestra.run.trial045.stdout: ], 2026-02-22T23:28:04.688 INFO:teuthology.orchestra.run.trial045.stdout: "quorum_con": "4540701547738038271", 2026-02-22T23:28:04.688 INFO:teuthology.orchestra.run.trial045.stdout: "quorum_mon": [ 2026-02-22T23:28:04.688 INFO:teuthology.orchestra.run.trial045.stdout: "kraken", 2026-02-22T23:28:04.688 INFO:teuthology.orchestra.run.trial045.stdout: "luminous", 2026-02-22T23:28:04.688 INFO:teuthology.orchestra.run.trial045.stdout: "mimic", 2026-02-22T23:28:04.688 INFO:teuthology.orchestra.run.trial045.stdout: "osdmap-prune", 2026-02-22T23:28:04.688 INFO:teuthology.orchestra.run.trial045.stdout: "nautilus", 2026-02-22T23:28:04.688 INFO:teuthology.orchestra.run.trial045.stdout: "octopus", 2026-02-22T23:28:04.688 INFO:teuthology.orchestra.run.trial045.stdout: "pacific", 2026-02-22T23:28:04.688 INFO:teuthology.orchestra.run.trial045.stdout: "elector-pinging", 2026-02-22T23:28:04.688 INFO:teuthology.orchestra.run.trial045.stdout: "quincy", 2026-02-22T23:28:04.688 INFO:teuthology.orchestra.run.trial045.stdout: "reef", 2026-02-22T23:28:04.688 INFO:teuthology.orchestra.run.trial045.stdout: "squid" 2026-02-22T23:28:04.688 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:28:04.688 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:28:04.688 INFO:teuthology.orchestra.run.trial045.stdout: "outside_quorum": [], 2026-02-22T23:28:04.688 INFO:teuthology.orchestra.run.trial045.stdout: "extra_probe_peers": [], 2026-02-22T23:28:04.689 INFO:teuthology.orchestra.run.trial045.stdout: "sync_provider": [], 2026-02-22T23:28:04.689 INFO:teuthology.orchestra.run.trial045.stdout: "monmap": { 2026-02-22T23:28:04.689 INFO:teuthology.orchestra.run.trial045.stdout: "epoch": 1, 2026-02-22T23:28:04.689 INFO:teuthology.orchestra.run.trial045.stdout: "fsid": "4b60f18f-6660-4731-b731-dc85c4078413", 2026-02-22T23:28:04.689 INFO:teuthology.orchestra.run.trial045.stdout: "modified": "2026-02-22T23:24:52.393472Z", 2026-02-22T23:28:04.689 INFO:teuthology.orchestra.run.trial045.stdout: "created": "2026-02-22T23:24:52.393472Z", 2026-02-22T23:28:04.689 INFO:teuthology.orchestra.run.trial045.stdout: "min_mon_release": 19, 2026-02-22T23:28:04.689 INFO:teuthology.orchestra.run.trial045.stdout: "min_mon_release_name": "squid", 2026-02-22T23:28:04.689 INFO:teuthology.orchestra.run.trial045.stdout: "election_strategy": 3, 2026-02-22T23:28:04.689 INFO:teuthology.orchestra.run.trial045.stdout: "disallowed_leaders": "", 2026-02-22T23:28:04.689 INFO:teuthology.orchestra.run.trial045.stdout: "stretch_mode": false, 2026-02-22T23:28:04.689 INFO:teuthology.orchestra.run.trial045.stdout: "tiebreaker_mon": "", 2026-02-22T23:28:04.689 INFO:teuthology.orchestra.run.trial045.stdout: "removed_ranks": "", 2026-02-22T23:28:04.689 INFO:teuthology.orchestra.run.trial045.stdout: "features": { 2026-02-22T23:28:04.689 INFO:teuthology.orchestra.run.trial045.stdout: "persistent": [ 2026-02-22T23:28:04.689 INFO:teuthology.orchestra.run.trial045.stdout: "kraken", 2026-02-22T23:28:04.689 INFO:teuthology.orchestra.run.trial045.stdout: "luminous", 2026-02-22T23:28:04.689 INFO:teuthology.orchestra.run.trial045.stdout: "mimic", 2026-02-22T23:28:04.690 INFO:teuthology.orchestra.run.trial045.stdout: "osdmap-prune", 2026-02-22T23:28:04.690 INFO:teuthology.orchestra.run.trial045.stdout: "nautilus", 2026-02-22T23:28:04.690 INFO:teuthology.orchestra.run.trial045.stdout: "octopus", 2026-02-22T23:28:04.690 INFO:teuthology.orchestra.run.trial045.stdout: "pacific", 2026-02-22T23:28:04.690 INFO:teuthology.orchestra.run.trial045.stdout: "elector-pinging", 2026-02-22T23:28:04.690 INFO:teuthology.orchestra.run.trial045.stdout: "quincy", 2026-02-22T23:28:04.690 INFO:teuthology.orchestra.run.trial045.stdout: "reef", 2026-02-22T23:28:04.690 INFO:teuthology.orchestra.run.trial045.stdout: "squid" 2026-02-22T23:28:04.690 INFO:teuthology.orchestra.run.trial045.stdout: ], 2026-02-22T23:28:04.690 INFO:teuthology.orchestra.run.trial045.stdout: "optional": [] 2026-02-22T23:28:04.690 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:28:04.690 INFO:teuthology.orchestra.run.trial045.stdout: "mons": [ 2026-02-22T23:28:04.690 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:28:04.690 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 0, 2026-02-22T23:28:04.690 INFO:teuthology.orchestra.run.trial045.stdout: "name": "a", 2026-02-22T23:28:04.690 INFO:teuthology.orchestra.run.trial045.stdout: "public_addrs": { 2026-02-22T23:28:04.690 INFO:teuthology.orchestra.run.trial045.stdout: "addrvec": [ 2026-02-22T23:28:04.690 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:28:04.690 INFO:teuthology.orchestra.run.trial045.stdout: "type": "v1", 2026-02-22T23:28:04.690 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6789", 2026-02-22T23:28:04.691 INFO:teuthology.orchestra.run.trial045.stdout: "nonce": 0 2026-02-22T23:28:04.691 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:28:04.691 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:28:04.691 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:28:04.691 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6789/0", 2026-02-22T23:28:04.691 INFO:teuthology.orchestra.run.trial045.stdout: "public_addr": "10.20.193.45:6789/0", 2026-02-22T23:28:04.691 INFO:teuthology.orchestra.run.trial045.stdout: "priority": 0, 2026-02-22T23:28:04.691 INFO:teuthology.orchestra.run.trial045.stdout: "weight": 0, 2026-02-22T23:28:04.691 INFO:teuthology.orchestra.run.trial045.stdout: "crush_location": "{}" 2026-02-22T23:28:04.691 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:28:04.691 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:28:04.691 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 1, 2026-02-22T23:28:04.691 INFO:teuthology.orchestra.run.trial045.stdout: "name": "f", 2026-02-22T23:28:04.691 INFO:teuthology.orchestra.run.trial045.stdout: "public_addrs": { 2026-02-22T23:28:04.691 INFO:teuthology.orchestra.run.trial045.stdout: "addrvec": [ 2026-02-22T23:28:04.691 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:28:04.691 INFO:teuthology.orchestra.run.trial045.stdout: "type": "v1", 2026-02-22T23:28:04.691 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.73:6789", 2026-02-22T23:28:04.691 INFO:teuthology.orchestra.run.trial045.stdout: "nonce": 0 2026-02-22T23:28:04.691 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:28:04.692 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:28:04.692 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:28:04.692 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.73:6789/0", 2026-02-22T23:28:04.692 INFO:teuthology.orchestra.run.trial045.stdout: "public_addr": "10.20.193.73:6789/0", 2026-02-22T23:28:04.692 INFO:teuthology.orchestra.run.trial045.stdout: "priority": 0, 2026-02-22T23:28:04.692 INFO:teuthology.orchestra.run.trial045.stdout: "weight": 0, 2026-02-22T23:28:04.692 INFO:teuthology.orchestra.run.trial045.stdout: "crush_location": "{}" 2026-02-22T23:28:04.692 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:28:04.692 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:28:04.692 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 2, 2026-02-22T23:28:04.692 INFO:teuthology.orchestra.run.trial045.stdout: "name": "b", 2026-02-22T23:28:04.692 INFO:teuthology.orchestra.run.trial045.stdout: "public_addrs": { 2026-02-22T23:28:04.692 INFO:teuthology.orchestra.run.trial045.stdout: "addrvec": [ 2026-02-22T23:28:04.692 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:28:04.692 INFO:teuthology.orchestra.run.trial045.stdout: "type": "v1", 2026-02-22T23:28:04.692 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6790", 2026-02-22T23:28:04.692 INFO:teuthology.orchestra.run.trial045.stdout: "nonce": 0 2026-02-22T23:28:04.692 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:28:04.692 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:28:04.692 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:28:04.692 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6790/0", 2026-02-22T23:28:04.693 INFO:teuthology.orchestra.run.trial045.stdout: "public_addr": "10.20.193.45:6790/0", 2026-02-22T23:28:04.693 INFO:teuthology.orchestra.run.trial045.stdout: "priority": 0, 2026-02-22T23:28:04.693 INFO:teuthology.orchestra.run.trial045.stdout: "weight": 0, 2026-02-22T23:28:04.693 INFO:teuthology.orchestra.run.trial045.stdout: "crush_location": "{}" 2026-02-22T23:28:04.693 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:28:04.693 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:28:04.693 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 3, 2026-02-22T23:28:04.693 INFO:teuthology.orchestra.run.trial045.stdout: "name": "g", 2026-02-22T23:28:04.693 INFO:teuthology.orchestra.run.trial045.stdout: "public_addrs": { 2026-02-22T23:28:04.693 INFO:teuthology.orchestra.run.trial045.stdout: "addrvec": [ 2026-02-22T23:28:04.693 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:28:04.693 INFO:teuthology.orchestra.run.trial045.stdout: "type": "v1", 2026-02-22T23:28:04.693 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.73:6790", 2026-02-22T23:28:04.693 INFO:teuthology.orchestra.run.trial045.stdout: "nonce": 0 2026-02-22T23:28:04.693 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:28:04.693 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:28:04.693 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:28:04.693 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.73:6790/0", 2026-02-22T23:28:04.693 INFO:teuthology.orchestra.run.trial045.stdout: "public_addr": "10.20.193.73:6790/0", 2026-02-22T23:28:04.694 INFO:teuthology.orchestra.run.trial045.stdout: "priority": 0, 2026-02-22T23:28:04.694 INFO:teuthology.orchestra.run.trial045.stdout: "weight": 0, 2026-02-22T23:28:04.694 INFO:teuthology.orchestra.run.trial045.stdout: "crush_location": "{}" 2026-02-22T23:28:04.694 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:28:04.694 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:28:04.694 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 4, 2026-02-22T23:28:04.694 INFO:teuthology.orchestra.run.trial045.stdout: "name": "c", 2026-02-22T23:28:04.694 INFO:teuthology.orchestra.run.trial045.stdout: "public_addrs": { 2026-02-22T23:28:04.694 INFO:teuthology.orchestra.run.trial045.stdout: "addrvec": [ 2026-02-22T23:28:04.694 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:28:04.694 INFO:teuthology.orchestra.run.trial045.stdout: "type": "v1", 2026-02-22T23:28:04.694 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6791", 2026-02-22T23:28:04.694 INFO:teuthology.orchestra.run.trial045.stdout: "nonce": 0 2026-02-22T23:28:04.694 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:28:04.694 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:28:04.694 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:28:04.694 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6791/0", 2026-02-22T23:28:04.694 INFO:teuthology.orchestra.run.trial045.stdout: "public_addr": "10.20.193.45:6791/0", 2026-02-22T23:28:04.694 INFO:teuthology.orchestra.run.trial045.stdout: "priority": 0, 2026-02-22T23:28:04.694 INFO:teuthology.orchestra.run.trial045.stdout: "weight": 0, 2026-02-22T23:28:04.694 INFO:teuthology.orchestra.run.trial045.stdout: "crush_location": "{}" 2026-02-22T23:28:04.695 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:28:04.695 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:28:04.695 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 5, 2026-02-22T23:28:04.695 INFO:teuthology.orchestra.run.trial045.stdout: "name": "h", 2026-02-22T23:28:04.695 INFO:teuthology.orchestra.run.trial045.stdout: "public_addrs": { 2026-02-22T23:28:04.695 INFO:teuthology.orchestra.run.trial045.stdout: "addrvec": [ 2026-02-22T23:28:04.695 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:28:04.695 INFO:teuthology.orchestra.run.trial045.stdout: "type": "v1", 2026-02-22T23:28:04.695 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.73:6791", 2026-02-22T23:28:04.695 INFO:teuthology.orchestra.run.trial045.stdout: "nonce": 0 2026-02-22T23:28:04.695 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:28:04.695 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:28:04.695 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:28:04.695 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.73:6791/0", 2026-02-22T23:28:04.695 INFO:teuthology.orchestra.run.trial045.stdout: "public_addr": "10.20.193.73:6791/0", 2026-02-22T23:28:04.695 INFO:teuthology.orchestra.run.trial045.stdout: "priority": 0, 2026-02-22T23:28:04.695 INFO:teuthology.orchestra.run.trial045.stdout: "weight": 0, 2026-02-22T23:28:04.695 INFO:teuthology.orchestra.run.trial045.stdout: "crush_location": "{}" 2026-02-22T23:28:04.695 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:28:04.695 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:28:04.695 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 6, 2026-02-22T23:28:04.696 INFO:teuthology.orchestra.run.trial045.stdout: "name": "d", 2026-02-22T23:28:04.696 INFO:teuthology.orchestra.run.trial045.stdout: "public_addrs": { 2026-02-22T23:28:04.696 INFO:teuthology.orchestra.run.trial045.stdout: "addrvec": [ 2026-02-22T23:28:04.696 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:28:04.696 INFO:teuthology.orchestra.run.trial045.stdout: "type": "v1", 2026-02-22T23:28:04.696 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6792", 2026-02-22T23:28:04.696 INFO:teuthology.orchestra.run.trial045.stdout: "nonce": 0 2026-02-22T23:28:04.696 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:28:04.696 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:28:04.696 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:28:04.696 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6792/0", 2026-02-22T23:28:04.696 INFO:teuthology.orchestra.run.trial045.stdout: "public_addr": "10.20.193.45:6792/0", 2026-02-22T23:28:04.696 INFO:teuthology.orchestra.run.trial045.stdout: "priority": 0, 2026-02-22T23:28:04.696 INFO:teuthology.orchestra.run.trial045.stdout: "weight": 0, 2026-02-22T23:28:04.696 INFO:teuthology.orchestra.run.trial045.stdout: "crush_location": "{}" 2026-02-22T23:28:04.696 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:28:04.696 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:28:04.696 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 7, 2026-02-22T23:28:04.696 INFO:teuthology.orchestra.run.trial045.stdout: "name": "i", 2026-02-22T23:28:04.696 INFO:teuthology.orchestra.run.trial045.stdout: "public_addrs": { 2026-02-22T23:28:04.696 INFO:teuthology.orchestra.run.trial045.stdout: "addrvec": [ 2026-02-22T23:28:04.696 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:28:04.697 INFO:teuthology.orchestra.run.trial045.stdout: "type": "v1", 2026-02-22T23:28:04.697 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.73:6792", 2026-02-22T23:28:04.697 INFO:teuthology.orchestra.run.trial045.stdout: "nonce": 0 2026-02-22T23:28:04.697 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:28:04.697 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:28:04.697 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:28:04.697 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.73:6792/0", 2026-02-22T23:28:04.697 INFO:teuthology.orchestra.run.trial045.stdout: "public_addr": "10.20.193.73:6792/0", 2026-02-22T23:28:04.697 INFO:teuthology.orchestra.run.trial045.stdout: "priority": 0, 2026-02-22T23:28:04.697 INFO:teuthology.orchestra.run.trial045.stdout: "weight": 0, 2026-02-22T23:28:04.697 INFO:teuthology.orchestra.run.trial045.stdout: "crush_location": "{}" 2026-02-22T23:28:04.697 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:28:04.697 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:28:04.697 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 8, 2026-02-22T23:28:04.697 INFO:teuthology.orchestra.run.trial045.stdout: "name": "e", 2026-02-22T23:28:04.697 INFO:teuthology.orchestra.run.trial045.stdout: "public_addrs": { 2026-02-22T23:28:04.697 INFO:teuthology.orchestra.run.trial045.stdout: "addrvec": [ 2026-02-22T23:28:04.697 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:28:04.697 INFO:teuthology.orchestra.run.trial045.stdout: "type": "v1", 2026-02-22T23:28:04.697 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6793", 2026-02-22T23:28:04.697 INFO:teuthology.orchestra.run.trial045.stdout: "nonce": 0 2026-02-22T23:28:04.697 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:28:04.697 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:28:04.697 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:28:04.698 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6793/0", 2026-02-22T23:28:04.698 INFO:teuthology.orchestra.run.trial045.stdout: "public_addr": "10.20.193.45:6793/0", 2026-02-22T23:28:04.698 INFO:teuthology.orchestra.run.trial045.stdout: "priority": 0, 2026-02-22T23:28:04.698 INFO:teuthology.orchestra.run.trial045.stdout: "weight": 0, 2026-02-22T23:28:04.698 INFO:teuthology.orchestra.run.trial045.stdout: "crush_location": "{}" 2026-02-22T23:28:04.698 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:28:04.698 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:28:04.698 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:28:04.698 INFO:teuthology.orchestra.run.trial045.stdout: "feature_map": { 2026-02-22T23:28:04.698 INFO:teuthology.orchestra.run.trial045.stdout: "mon": [ 2026-02-22T23:28:04.698 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:28:04.698 INFO:teuthology.orchestra.run.trial045.stdout: "features": "0x3f03cffffffdffff", 2026-02-22T23:28:04.698 INFO:teuthology.orchestra.run.trial045.stdout: "release": "squid", 2026-02-22T23:28:04.698 INFO:teuthology.orchestra.run.trial045.stdout: "num": 1 2026-02-22T23:28:04.698 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:28:04.698 INFO:teuthology.orchestra.run.trial045.stdout: ], 2026-02-22T23:28:04.698 INFO:teuthology.orchestra.run.trial045.stdout: "client": [ 2026-02-22T23:28:04.698 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:28:04.698 INFO:teuthology.orchestra.run.trial045.stdout: "features": "0x3f03cffffffdffff", 2026-02-22T23:28:04.698 INFO:teuthology.orchestra.run.trial045.stdout: "release": "squid", 2026-02-22T23:28:04.698 INFO:teuthology.orchestra.run.trial045.stdout: "num": 1 2026-02-22T23:28:04.698 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:28:04.698 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:28:04.699 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:28:04.699 INFO:teuthology.orchestra.run.trial045.stdout: "stretch_mode": false 2026-02-22T23:28:04.699 INFO:teuthology.orchestra.run.trial045.stdout:} 2026-02-22T23:28:04.699 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.668+0000 7f50b1e7c640 1 -- 10.20.193.45:0/2331310930 >> v1:10.20.193.73:6800/2222410180 conn(0x7f507c0403f0 legacy=0x7f507c0428b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:04.699 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.668+0000 7f50b1e7c640 10 monclient: shutdown 2026-02-22T23:28:04.700 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.668+0000 7f50b1e7c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T23:28:04.700 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.668+0000 7f50b1e7c640 1 -- 10.20.193.45:0/2331310930 >> v1:10.20.193.45:6793/0 conn(0x7f50ac0a1a60 legacy=0x7f50ac1d4be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:04.700 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.668+0000 7f50abfff640 1 -- 10.20.193.45:0/2331310930 reap_dead start 2026-02-22T23:28:04.700 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.668+0000 7f50abfff640 1 -- 10.20.193.45:0/2331310930 reap_dead start 2026-02-22T23:28:04.700 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.668+0000 7f50b1e7c640 1 -- 10.20.193.45:0/2331310930 shutdown_connections 2026-02-22T23:28:04.700 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.668+0000 7f50b1e7c640 1 -- 10.20.193.45:0/2331310930 >> 10.20.193.45:0/2331310930 conn(0x7f50ac0a7780 msgr2=0x7f50ac09e5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:28:04.700 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.668+0000 7f50b1e7c640 1 -- 10.20.193.45:0/2331310930 shutdown_connections 2026-02-22T23:28:04.700 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.668+0000 7f50b1e7c640 1 -- 10.20.193.45:0/2331310930 wait complete. 2026-02-22T23:28:04.700 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2026-02-22T23:28:04.700 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon i 2026-02-22T23:28:04.700 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.i mon_status 2026-02-22T23:28:04.768 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.766+0000 7f0a84022640 10 monclient: get_monmap_and_config 2026-02-22T23:28:04.769 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.766+0000 7f0a84022640 10 monclient: build_initial_monmap 2026-02-22T23:28:04.769 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.766+0000 7f0a84022640 10 monclient: monmap: 2026-02-22T23:28:04.769 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-22T23:28:04.769 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:28:04.769 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:28:04.768133+0000 2026-02-22T23:28:04.769 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:28:04.768133+0000 2026-02-22T23:28:04.769 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-22T23:28:04.769 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:28:04.769 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-22T23:28:04.769 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.noname-f 2026-02-22T23:28:04.769 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.noname-b 2026-02-22T23:28:04.770 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.noname-g 2026-02-22T23:28:04.770 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.noname-c 2026-02-22T23:28:04.770 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.noname-h 2026-02-22T23:28:04.770 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.noname-d 2026-02-22T23:28:04.770 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.noname-i 2026-02-22T23:28:04.770 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.noname-e 2026-02-22T23:28:04.770 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:04.770 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.767+0000 7f0a84022640 1 Processor -- start 2026-02-22T23:28:04.770 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.767+0000 7f0a84022640 1 -- start start 2026-02-22T23:28:04.770 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.767+0000 7f0a84022640 10 monclient: init 2026-02-22T23:28:04.777 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.767+0000 7f0a84022640 10 monclient: _reopen_session rank -1 2026-02-22T23:28:04.777 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.767+0000 7f0a84022640 10 monclient: _add_conns ranks=[0,5,4,7,8,3,1,6,2] 2026-02-22T23:28:04.777 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.767+0000 7f0a84022640 10 monclient(hunting): picked mon.noname-a con 0x7f0a7c0a1a60 addr v1:10.20.193.45:6789/0 2026-02-22T23:28:04.777 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.767+0000 7f0a84022640 10 monclient(hunting): picked mon.noname-h con 0x7f0a7c06f1e0 addr v1:10.20.193.73:6791/0 2026-02-22T23:28:04.777 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.767+0000 7f0a84022640 10 monclient(hunting): picked mon.noname-c con 0x7f0a7c0a0980 addr v1:10.20.193.45:6791/0 2026-02-22T23:28:04.777 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.767+0000 7f0a84022640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0a7c09df00 con 0x7f0a7c0a1a60 2026-02-22T23:28:04.777 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.767+0000 7f0a84022640 1 -- --> v1:10.20.193.45:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0a7c137660 con 0x7f0a7c0a0980 2026-02-22T23:28:04.778 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.767+0000 7f0a84022640 1 -- --> v1:10.20.193.73:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0a7c0a4510 con 0x7f0a7c06f1e0 2026-02-22T23:28:04.778 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.767+0000 7f0a84022640 10 monclient(hunting): _renew_subs 2026-02-22T23:28:04.778 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.767+0000 7f0a84022640 10 monclient(hunting): authenticate will time out at 816.384703s 2026-02-22T23:28:04.778 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.767+0000 7f0a81d97640 1 --1- >> v1:10.20.193.45:6789/0 conn(0x7f0a7c0a1a60 0x7f0a7c136840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.45:6789/0 says I am v1:10.20.193.45:38428/0 (socket says 10.20.193.45:38428) 2026-02-22T23:28:04.778 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.767+0000 7f0a81d97640 1 -- 10.20.193.45:0/2142966989 learned_addr learned my addr 10.20.193.45:0/2142966989 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-22T23:28:04.778 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.767+0000 7f0a80d95640 1 -- 10.20.193.45:0/2142966989 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3089654378 0 0) 0x7f0a6c002920 con 0x7f0a7c0a1a60 2026-02-22T23:28:04.778 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.767+0000 7f0a80d95640 10 monclient(hunting): _negotiate 2026-02-22T23:28:04.778 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.767+0000 7f0a80d95640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:28:04.778 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.767+0000 7f0a80d95640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:28:04.778 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.767+0000 7f0a80d95640 10 monclient(hunting): my global_id is 4617 2026-02-22T23:28:04.778 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.767+0000 7f0a80d95640 1 -- 10.20.193.45:0/2142966989 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0a64003620 con 0x7f0a7c0a1a60 2026-02-22T23:28:04.778 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.767+0000 7f0a80d95640 1 -- 10.20.193.45:0/2142966989 <== mon.4 v1:10.20.193.45:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 354804008 0 0) 0x7f0a7c137660 con 0x7f0a7c0a0980 2026-02-22T23:28:04.778 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.767+0000 7f0a80d95640 10 monclient(hunting): _negotiate 2026-02-22T23:28:04.778 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.767+0000 7f0a80d95640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:28:04.778 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.767+0000 7f0a80d95640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:28:04.778 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.767+0000 7f0a80d95640 10 monclient(hunting): my global_id is 114160 2026-02-22T23:28:04.778 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.767+0000 7f0a80d95640 1 -- 10.20.193.45:0/2142966989 --> v1:10.20.193.45:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0a6c002920 con 0x7f0a7c0a0980 2026-02-22T23:28:04.778 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.768+0000 7f0a80d95640 1 -- 10.20.193.45:0/2142966989 <== mon.0 v1:10.20.193.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3850685778 0 0) 0x7f0a64003620 con 0x7f0a7c0a1a60 2026-02-22T23:28:04.779 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.768+0000 7f0a80d95640 1 -- 10.20.193.45:0/2142966989 >> v1:10.20.193.73:6791/0 conn(0x7f0a7c06f1e0 legacy=0x7f0a7c136f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:04.779 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.768+0000 7f0a80d95640 1 -- 10.20.193.45:0/2142966989 >> v1:10.20.193.45:6791/0 conn(0x7f0a7c0a0980 legacy=0x7f0a7c13ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:04.779 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.768+0000 7f0a80d95640 10 monclient: _finish_hunting 0 2026-02-22T23:28:04.779 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.768+0000 7f0a80d95640 1 monclient: found mon.noname-a 2026-02-22T23:28:04.779 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.768+0000 7f0a80d95640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T23:28:04.779 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.768+0000 7f0a80d95640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.45:6789/0 2026-02-22T23:28:04.779 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.768+0000 7f0a80d95640 1 -- 10.20.193.45:0/2142966989 --> v1:10.20.193.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a7c143400 con 0x7f0a7c0a1a60 2026-02-22T23:28:04.779 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.768+0000 7f0a80d95640 10 monclient: _finish_auth 0 2026-02-22T23:28:04.779 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.768+0000 7f0a80d95640 10 monclient: _check_auth_tickets 2026-02-22T23:28:04.779 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.768+0000 7f0a80d95640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T23:28:04.779 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.768+0000 7f0a80d95640 1 -- 10.20.193.45:0/2142966989 <== mon.0 v1:10.20.193.45:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f0a6c003210 con 0x7f0a7c0a1a60 2026-02-22T23:28:04.779 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.768+0000 7f0a84022640 5 monclient: authenticate success, global_id 4617 2026-02-22T23:28:04.779 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.768+0000 7f0a84022640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-22T23:28:04.779 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.768+0000 7f0a80d95640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:28:04.779 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.768+0000 7f0a80d95640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T23:28:04.779 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.768+0000 7f0a80d95640 10 monclient: dump: 2026-02-22T23:28:04.779 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:28:04.779 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:28:04.780 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:04.780 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:04.780 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:28:04.780 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:28:04.780 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:28:04.780 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:28:04.780 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:28:04.780 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:28:04.780 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:28:04.780 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:28:04.780 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:28:04.780 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:28:04.780 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:28:04.780 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:04.780 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.768+0000 7f0a84022640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-22T23:28:04.780 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.768+0000 7f0a80d95640 1 -- 10.20.193.45:0/2142966989 <== mon.0 v1:10.20.193.45:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0a6c003430 con 0x7f0a7c0a1a60 2026-02-22T23:28:04.780 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.768+0000 7f0a80d95640 10 monclient: handle_config config(0 keys) 2026-02-22T23:28:04.780 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.768+0000 7f0a80d95640 1 -- 10.20.193.45:0/2142966989 <== mon.0 v1:10.20.193.45:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f0a6c004ce0 con 0x7f0a7c0a1a60 2026-02-22T23:28:04.780 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.768+0000 7f0a84022640 10 monclient: get_monmap_and_config success 2026-02-22T23:28:04.781 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.768+0000 7f0a84022640 4 set_mon_vals no callback set 2026-02-22T23:28:04.781 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.768+0000 7f0a80d95640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:28:04.781 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.768+0000 7f0a80d95640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T23:28:04.781 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.768+0000 7f0a80d95640 10 monclient: dump: 2026-02-22T23:28:04.781 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:28:04.781 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:28:04.781 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:04.781 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:04.781 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:28:04.781 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:28:04.781 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:28:04.781 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:28:04.781 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:28:04.781 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:28:04.781 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:28:04.781 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:28:04.781 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:28:04.781 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:28:04.781 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:28:04.781 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:04.782 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.768+0000 7f0a84022640 10 monclient: shutdown 2026-02-22T23:28:04.782 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.768+0000 7f0a84022640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T23:28:04.782 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.768+0000 7f0a84022640 1 -- 10.20.193.45:0/2142966989 >> v1:10.20.193.45:6789/0 conn(0x7f0a7c0a1a60 legacy=0x7f0a7c136840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:04.782 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.768+0000 7f0a84022640 1 -- 10.20.193.45:0/2142966989 shutdown_connections 2026-02-22T23:28:04.782 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.768+0000 7f0a84022640 1 -- 10.20.193.45:0/2142966989 >> 10.20.193.45:0/2142966989 conn(0x7f0a7c0a7780 msgr2=0x7f0a7c0a3b60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:28:04.782 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.768+0000 7f0a84022640 1 -- 10.20.193.45:0/2142966989 shutdown_connections 2026-02-22T23:28:04.782 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.768+0000 7f0a84022640 1 -- 10.20.193.45:0/2142966989 wait complete. 2026-02-22T23:28:04.782 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.768+0000 7f0a84022640 10 monclient: build_initial_monmap 2026-02-22T23:28:04.782 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.768+0000 7f0a84022640 10 monclient: monmap: 2026-02-22T23:28:04.782 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-22T23:28:04.782 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T23:28:04.782 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-22T23:28:04.782 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-22T23:28:04.782 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-22T23:28:04.782 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-22T23:28:04.782 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-22T23:28:04.782 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.noname-f 2026-02-22T23:28:04.782 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.noname-b 2026-02-22T23:28:04.783 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.noname-g 2026-02-22T23:28:04.783 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.noname-c 2026-02-22T23:28:04.783 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.noname-h 2026-02-22T23:28:04.783 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.noname-d 2026-02-22T23:28:04.783 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.noname-i 2026-02-22T23:28:04.783 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.noname-e 2026-02-22T23:28:04.783 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:04.783 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.769+0000 7f0a84022640 1 Processor -- start 2026-02-22T23:28:04.783 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.769+0000 7f0a84022640 1 -- start start 2026-02-22T23:28:04.783 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.769+0000 7f0a84022640 10 monclient: init 2026-02-22T23:28:04.783 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.769+0000 7f0a84022640 10 monclient: _reopen_session rank -1 2026-02-22T23:28:04.783 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.769+0000 7f0a84022640 10 monclient: _add_conns ranks=[0,2,5,4,1,8,7,6,3] 2026-02-22T23:28:04.783 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.769+0000 7f0a84022640 10 monclient(hunting): picked mon.noname-a con 0x7f0a7c0a0980 addr v1:10.20.193.45:6789/0 2026-02-22T23:28:04.783 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.769+0000 7f0a84022640 10 monclient(hunting): picked mon.noname-b con 0x7f0a7c0a1a60 addr v1:10.20.193.45:6790/0 2026-02-22T23:28:04.783 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.769+0000 7f0a84022640 10 monclient(hunting): picked mon.noname-h con 0x7f0a7c1d57e0 addr v1:10.20.193.73:6791/0 2026-02-22T23:28:04.783 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.769+0000 7f0a84022640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0a7c072640 con 0x7f0a7c0a0980 2026-02-22T23:28:04.783 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.769+0000 7f0a84022640 1 -- --> v1:10.20.193.45:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0a7c13ff80 con 0x7f0a7c0a1a60 2026-02-22T23:28:04.783 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.769+0000 7f0a84022640 1 -- --> v1:10.20.193.73:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0a7c142d00 con 0x7f0a7c1d57e0 2026-02-22T23:28:04.784 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.769+0000 7f0a84022640 10 monclient(hunting): _renew_subs 2026-02-22T23:28:04.784 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.769+0000 7f0a84022640 10 monclient(hunting): authenticate will time out at 816.386558s 2026-02-22T23:28:04.784 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.769+0000 7f0a81d97640 1 --1- >> v1:10.20.193.45:6789/0 conn(0x7f0a7c0a0980 0x7f0a7c1cf450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.45:6789/0 says I am v1:10.20.193.45:38438/0 (socket says 10.20.193.45:38438) 2026-02-22T23:28:04.784 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.769+0000 7f0a81d97640 1 -- 10.20.193.45:0/2638195689 learned_addr learned my addr 10.20.193.45:0/2638195689 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-22T23:28:04.784 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.769+0000 7f0a6a7fc640 1 -- 10.20.193.45:0/2638195689 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 198589609 0 0) 0x7f0a7c072640 con 0x7f0a7c0a0980 2026-02-22T23:28:04.784 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.769+0000 7f0a6a7fc640 10 monclient(hunting): _negotiate 2026-02-22T23:28:04.784 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.769+0000 7f0a6a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:28:04.784 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.769+0000 7f0a6a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:28:04.784 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.769+0000 7f0a6a7fc640 10 monclient(hunting): my global_id is 4626 2026-02-22T23:28:04.784 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.769+0000 7f0a6a7fc640 1 -- 10.20.193.45:0/2638195689 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0a4c003620 con 0x7f0a7c0a0980 2026-02-22T23:28:04.784 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.769+0000 7f0a6a7fc640 1 -- 10.20.193.45:0/2638195689 <== mon.2 v1:10.20.193.45:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2068972614 0 0) 0x7f0a7c13ff80 con 0x7f0a7c0a1a60 2026-02-22T23:28:04.784 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.769+0000 7f0a6a7fc640 10 monclient(hunting): _negotiate 2026-02-22T23:28:04.784 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.769+0000 7f0a6a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:28:04.784 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.769+0000 7f0a6a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:28:04.784 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.769+0000 7f0a6a7fc640 10 monclient(hunting): my global_id is 4718 2026-02-22T23:28:04.784 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.769+0000 7f0a6a7fc640 1 -- 10.20.193.45:0/2638195689 --> v1:10.20.193.45:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0a7c072640 con 0x7f0a7c0a1a60 2026-02-22T23:28:04.784 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.769+0000 7f0a6a7fc640 1 -- 10.20.193.45:0/2638195689 <== mon.0 v1:10.20.193.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2810606013 0 0) 0x7f0a4c003620 con 0x7f0a7c0a0980 2026-02-22T23:28:04.784 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.769+0000 7f0a6a7fc640 1 -- 10.20.193.45:0/2638195689 --> v1:10.20.193.45:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0a7c13ff80 con 0x7f0a7c0a0980 2026-02-22T23:28:04.784 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.769+0000 7f0a6a7fc640 1 -- 10.20.193.45:0/2638195689 <== mon.2 v1:10.20.193.45:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2140541620 0 0) 0x7f0a7c072640 con 0x7f0a7c0a1a60 2026-02-22T23:28:04.785 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.769+0000 7f0a6a7fc640 1 -- 10.20.193.45:0/2638195689 --> v1:10.20.193.45:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0a4c003620 con 0x7f0a7c0a1a60 2026-02-22T23:28:04.785 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.769+0000 7f0a6a7fc640 1 -- 10.20.193.45:0/2638195689 <== mon.0 v1:10.20.193.45:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f0a6c004c20 con 0x7f0a7c0a0980 2026-02-22T23:28:04.785 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.769+0000 7f0a6a7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-22T23:28:04.785 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.769+0000 7f0a6a7fc640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T23:28:04.785 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.769+0000 7f0a6a7fc640 10 monclient(hunting): dump: 2026-02-22T23:28:04.785 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:28:04.785 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:28:04.785 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:04.785 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:04.785 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:28:04.785 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:28:04.785 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:28:04.785 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:28:04.785 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:28:04.785 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:28:04.785 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:28:04.785 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:28:04.785 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:28:04.785 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:28:04.785 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:28:04.786 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:04.786 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.769+0000 7f0a6a7fc640 10 monclient(hunting): _finish_auth 0 2026-02-22T23:28:04.786 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.769+0000 7f0a6a7fc640 1 -- 10.20.193.45:0/2638195689 <== mon.2 v1:10.20.193.45:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f0a700032a0 con 0x7f0a7c0a1a60 2026-02-22T23:28:04.786 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.769+0000 7f0a6a7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-22T23:28:04.786 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.769+0000 7f0a6a7fc640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-22T23:28:04.786 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.769+0000 7f0a6a7fc640 10 monclient(hunting): dump: 2026-02-22T23:28:04.786 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:28:04.786 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:28:04.786 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:04.786 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:04.786 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:28:04.786 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:28:04.786 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:28:04.786 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:28:04.786 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:28:04.786 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:28:04.786 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:28:04.786 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:28:04.786 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:28:04.787 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:28:04.787 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:28:04.787 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:04.787 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.769+0000 7f0a6a7fc640 1 -- 10.20.193.45:0/2638195689 <== mon.0 v1:10.20.193.45:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1887085333 0 0) 0x7f0a7c13ff80 con 0x7f0a7c0a0980 2026-02-22T23:28:04.787 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.769+0000 7f0a6a7fc640 1 -- 10.20.193.45:0/2638195689 >> v1:10.20.193.73:6791/0 conn(0x7f0a7c1d57e0 legacy=0x7f0a7c1d7bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:04.787 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.769+0000 7f0a6a7fc640 1 -- 10.20.193.45:0/2638195689 >> v1:10.20.193.45:6790/0 conn(0x7f0a7c0a1a60 legacy=0x7f0a7c136f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:04.787 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.769+0000 7f0a6a7fc640 10 monclient: _finish_hunting 0 2026-02-22T23:28:04.787 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.769+0000 7f0a6a7fc640 1 monclient: found mon.a 2026-02-22T23:28:04.787 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.769+0000 7f0a6a7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T23:28:04.787 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.769+0000 7f0a6a7fc640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-22T23:28:04.787 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.769+0000 7f0a6a7fc640 1 -- 10.20.193.45:0/2638195689 --> v1:10.20.193.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a7c11e8b0 con 0x7f0a7c0a0980 2026-02-22T23:28:04.787 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.770+0000 7f0a6a7fc640 10 monclient: _finish_auth 0 2026-02-22T23:28:04.787 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.770+0000 7f0a6a7fc640 10 monclient: _check_auth_tickets 2026-02-22T23:28:04.787 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.770+0000 7f0a6a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T23:28:04.787 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.770+0000 7f0a84022640 5 monclient: authenticate success, global_id 4626 2026-02-22T23:28:04.787 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.770+0000 7f0a84022640 10 monclient: _renew_subs 2026-02-22T23:28:04.787 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.770+0000 7f0a84022640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-22T23:28:04.787 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.770+0000 7f0a84022640 1 -- 10.20.193.45:0/2638195689 --> v1:10.20.193.45:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f0a7c137660 con 0x7f0a7c0a0980 2026-02-22T23:28:04.787 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.770+0000 7f0a6a7fc640 1 -- 10.20.193.45:0/2638195689 <== mon.0 v1:10.20.193.45:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0a6c005070 con 0x7f0a7c0a0980 2026-02-22T23:28:04.788 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.770+0000 7f0a6a7fc640 10 monclient: handle_config config(0 keys) 2026-02-22T23:28:04.788 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.770+0000 7f0a6a7fc640 1 -- 10.20.193.45:0/2638195689 <== mon.0 v1:10.20.193.45:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f0a6c005560 con 0x7f0a7c0a0980 2026-02-22T23:28:04.788 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.770+0000 7f0a84022640 10 monclient: _renew_subs 2026-02-22T23:28:04.788 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.770+0000 7f0a84022640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-22T23:28:04.788 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.770+0000 7f0a6bfff640 4 set_mon_vals no callback set 2026-02-22T23:28:04.788 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.770+0000 7f0a84022640 1 -- 10.20.193.45:0/2638195689 --> v1:10.20.193.45:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f0a7c1d92f0 con 0x7f0a7c0a0980 2026-02-22T23:28:04.788 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.770+0000 7f0a6a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:28:04.788 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.770+0000 7f0a6a7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T23:28:04.788 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.770+0000 7f0a6a7fc640 10 monclient: dump: 2026-02-22T23:28:04.788 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:28:04.788 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:28:04.788 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:04.788 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:04.788 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:28:04.788 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:28:04.788 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:28:04.788 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:28:04.788 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:28:04.788 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:28:04.789 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:28:04.789 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:28:04.789 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:28:04.789 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:28:04.789 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:28:04.789 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:04.789 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.770+0000 7f0a84022640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T23:28:04.789 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.770+0000 7f0a84022640 1 -- 10.20.193.45:0/2638195689 --> v1:10.20.193.73:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f0a7c11e250 con 0x7f0a7c06f1e0 2026-02-22T23:28:04.789 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.770+0000 7f0a6a7fc640 1 -- 10.20.193.45:0/2638195689 <== mon.0 v1:10.20.193.45:6789/0 7 ==== mgrmap(e 5) ==== 50225+0+0 (unknown 2330357642 0 0) 0x7f0a6c011b40 con 0x7f0a7c0a0980 2026-02-22T23:28:04.789 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.770+0000 7f0a6a7fc640 1 -- 10.20.193.45:0/2638195689 <== mon.0 v1:10.20.193.45:6789/0 8 ==== osd_map(25..25 src has 1..25) ==== 3502+0+0 (unknown 129690100 0 0) 0x7f0a6c04dd10 con 0x7f0a7c0a0980 2026-02-22T23:28:04.789 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.770+0000 7f0a6a7fc640 1 -- 10.20.193.45:0/2638195689 <== mon.7 v1:10.20.193.73:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1747432336 0 0) 0x7f0a7c11e250 con 0x7f0a7c06f1e0 2026-02-22T23:28:04.789 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.770+0000 7f0a6a7fc640 10 monclient(hunting): _negotiate 2026-02-22T23:28:04.789 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.770+0000 7f0a6a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:28:04.789 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.771+0000 7f0a6a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:28:04.789 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.771+0000 7f0a6a7fc640 10 monclient(hunting): my global_id is 4543 2026-02-22T23:28:04.789 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.771+0000 7f0a6a7fc640 1 -- 10.20.193.45:0/2638195689 --> v1:10.20.193.73:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0a7c13ff80 con 0x7f0a7c06f1e0 2026-02-22T23:28:04.789 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.771+0000 7f0a6a7fc640 1 -- 10.20.193.45:0/2638195689 <== mon.7 v1:10.20.193.73:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 260024112 0 0) 0x7f0a7c13ff80 con 0x7f0a7c06f1e0 2026-02-22T23:28:04.789 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.771+0000 7f0a6a7fc640 1 -- 10.20.193.45:0/2638195689 --> v1:10.20.193.73:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0a7c11e250 con 0x7f0a7c06f1e0 2026-02-22T23:28:04.789 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.771+0000 7f0a6a7fc640 1 -- 10.20.193.45:0/2638195689 <== mon.7 v1:10.20.193.73:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f0a70003d00 con 0x7f0a7c06f1e0 2026-02-22T23:28:04.790 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.771+0000 7f0a6a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:28:04.790 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.771+0000 7f0a6a7fc640 10 monclient: got monmap 1 from mon.i (according to old e1) 2026-02-22T23:28:04.790 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.771+0000 7f0a6a7fc640 10 monclient: dump: 2026-02-22T23:28:04.790 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:28:04.790 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:28:04.790 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:04.790 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:04.790 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:28:04.790 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:28:04.790 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:28:04.790 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:28:04.790 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:28:04.790 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:28:04.790 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:28:04.790 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:28:04.790 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:28:04.790 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:28:04.790 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:28:04.790 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:04.790 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.771+0000 7f0a82598640 10 monclient: get_auth_request con 0x7f0a4c03fd40 auth_method 0 2026-02-22T23:28:04.791 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.771+0000 7f0a6a7fc640 1 -- 10.20.193.45:0/2638195689 <== mon.7 v1:10.20.193.73:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 4261523497 0 0) 0x7f0a7c11e250 con 0x7f0a7c06f1e0 2026-02-22T23:28:04.791 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.771+0000 7f0a6a7fc640 1 -- 10.20.193.45:0/2638195689 --> v1:10.20.193.73:6792/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0a7c137a50 con 0x7f0a7c06f1e0 2026-02-22T23:28:04.791 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.771+0000 7f0a6a7fc640 1 -- 10.20.193.45:0/2638195689 <== mon.7 v1:10.20.193.73:6792/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (unknown 0 0 2024835662) 0x7f0a700040a0 con 0x7f0a7c06f1e0 2026-02-22T23:28:04.791 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.771+0000 7f0a6a7fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T23:28:04.791 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.771+0000 7f0a6a7fc640 10 monclient: _finish_command 1 = system:0 2026-02-22T23:28:04.791 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.771+0000 7f0a6a7fc640 1 -- 10.20.193.45:0/2638195689 >> v1:10.20.193.73:6792/0 conn(0x7f0a7c06f1e0 legacy=0x7f0a7c13c180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:04.791 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.771+0000 7f0a6a7fc640 1 -- 10.20.193.45:0/2638195689 >> v1:10.20.193.73:6792/0 conn(0x7f0a7c06f1e0 legacy=0x7f0a7c13c180 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T23:28:04.791 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.774+0000 7f0a84022640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-22T23:28:04.791 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.774+0000 7f0a84022640 1 -- 10.20.193.45:0/2638195689 --> v1:10.20.193.73:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f0a7c06ce10 con 0x7f0a7c140620 2026-02-22T23:28:04.791 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.775+0000 7f0a6a7fc640 1 -- 10.20.193.45:0/2638195689 <== mon.7 v1:10.20.193.73:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1382962996 0 0) 0x7f0a7c06ce10 con 0x7f0a7c140620 2026-02-22T23:28:04.791 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.775+0000 7f0a6a7fc640 10 monclient(hunting): _negotiate 2026-02-22T23:28:04.791 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.775+0000 7f0a6a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:28:04.791 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.775+0000 7f0a6a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:28:04.791 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.775+0000 7f0a6a7fc640 10 monclient(hunting): my global_id is 4552 2026-02-22T23:28:04.791 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.775+0000 7f0a6a7fc640 1 -- 10.20.193.45:0/2638195689 --> v1:10.20.193.73:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0a7c11e250 con 0x7f0a7c140620 2026-02-22T23:28:04.791 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.775+0000 7f0a6a7fc640 1 -- 10.20.193.45:0/2638195689 <== mon.7 v1:10.20.193.73:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2296531720 0 0) 0x7f0a7c11e250 con 0x7f0a7c140620 2026-02-22T23:28:04.791 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.775+0000 7f0a6a7fc640 1 -- 10.20.193.45:0/2638195689 --> v1:10.20.193.73:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0a7c06ce10 con 0x7f0a7c140620 2026-02-22T23:28:04.791 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.775+0000 7f0a6a7fc640 1 -- 10.20.193.45:0/2638195689 <== mon.7 v1:10.20.193.73:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f0a700047c0 con 0x7f0a7c140620 2026-02-22T23:28:04.792 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.775+0000 7f0a6a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:28:04.792 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.775+0000 7f0a6a7fc640 10 monclient: got monmap 1 from mon.i (according to old e1) 2026-02-22T23:28:04.792 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.775+0000 7f0a6a7fc640 10 monclient: dump: 2026-02-22T23:28:04.792 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:28:04.792 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:28:04.792 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:04.792 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:04.792 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:28:04.792 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:28:04.792 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:28:04.792 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:28:04.792 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:28:04.792 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:28:04.792 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:28:04.792 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:28:04.792 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:28:04.792 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:28:04.792 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:28:04.792 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:04.792 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.776+0000 7f0a6a7fc640 1 -- 10.20.193.45:0/2638195689 <== mon.7 v1:10.20.193.73:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1784153856 0 0) 0x7f0a7c06ce10 con 0x7f0a7c140620 2026-02-22T23:28:04.793 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.776+0000 7f0a6a7fc640 1 -- 10.20.193.45:0/2638195689 --> v1:10.20.193.73:6792/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f0a7c13cfa0 con 0x7f0a7c140620 2026-02-22T23:28:04.793 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.776+0000 7f0a6a7fc640 1 -- 10.20.193.45:0/2638195689 <== mon.7 v1:10.20.193.73:6792/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7695 (unknown 0 0 191863278) 0x7f0a70006a60 con 0x7f0a7c140620 2026-02-22T23:28:04.793 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.776+0000 7f0a6a7fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-22T23:28:04.793 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.776+0000 7f0a6a7fc640 10 monclient: _finish_command 2 = system:0 2026-02-22T23:28:04.793 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.776+0000 7f0a6a7fc640 1 -- 10.20.193.45:0/2638195689 >> v1:10.20.193.73:6792/0 conn(0x7f0a7c140620 legacy=0x7f0a7c13c890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:04.793 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.776+0000 7f0a6a7fc640 1 -- 10.20.193.45:0/2638195689 >> v1:10.20.193.73:6792/0 conn(0x7f0a7c140620 legacy=0x7f0a7c13c890 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T23:28:04.793 INFO:teuthology.orchestra.run.trial045.stdout:{ 2026-02-22T23:28:04.793 INFO:teuthology.orchestra.run.trial045.stdout: "name": "i", 2026-02-22T23:28:04.793 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 7, 2026-02-22T23:28:04.793 INFO:teuthology.orchestra.run.trial045.stdout: "state": "peon", 2026-02-22T23:28:04.793 INFO:teuthology.orchestra.run.trial045.stdout: "election_epoch": 28, 2026-02-22T23:28:04.793 INFO:teuthology.orchestra.run.trial045.stdout: "uptime": 164890, 2026-02-22T23:28:04.794 INFO:teuthology.orchestra.run.trial045.stdout: "quorum": [ 2026-02-22T23:28:04.794 INFO:teuthology.orchestra.run.trial045.stdout: 0, 2026-02-22T23:28:04.794 INFO:teuthology.orchestra.run.trial045.stdout: 1, 2026-02-22T23:28:04.794 INFO:teuthology.orchestra.run.trial045.stdout: 2, 2026-02-22T23:28:04.794 INFO:teuthology.orchestra.run.trial045.stdout: 3, 2026-02-22T23:28:04.794 INFO:teuthology.orchestra.run.trial045.stdout: 4, 2026-02-22T23:28:04.794 INFO:teuthology.orchestra.run.trial045.stdout: 5, 2026-02-22T23:28:04.794 INFO:teuthology.orchestra.run.trial045.stdout: 6, 2026-02-22T23:28:04.794 INFO:teuthology.orchestra.run.trial045.stdout: 7, 2026-02-22T23:28:04.794 INFO:teuthology.orchestra.run.trial045.stdout: 8 2026-02-22T23:28:04.794 INFO:teuthology.orchestra.run.trial045.stdout: ], 2026-02-22T23:28:04.794 INFO:teuthology.orchestra.run.trial045.stdout: "quorum_age": 1, 2026-02-22T23:28:04.794 INFO:teuthology.orchestra.run.trial045.stdout: "features": { 2026-02-22T23:28:04.794 INFO:teuthology.orchestra.run.trial045.stdout: "required_con": "2450521708007866372", 2026-02-22T23:28:04.794 INFO:teuthology.orchestra.run.trial045.stdout: "required_mon": [ 2026-02-22T23:28:04.794 INFO:teuthology.orchestra.run.trial045.stdout: "kraken", 2026-02-22T23:28:04.794 INFO:teuthology.orchestra.run.trial045.stdout: "luminous", 2026-02-22T23:28:04.795 INFO:teuthology.orchestra.run.trial045.stdout: "mimic", 2026-02-22T23:28:04.795 INFO:teuthology.orchestra.run.trial045.stdout: "osdmap-prune", 2026-02-22T23:28:04.795 INFO:teuthology.orchestra.run.trial045.stdout: "nautilus", 2026-02-22T23:28:04.795 INFO:teuthology.orchestra.run.trial045.stdout: "octopus", 2026-02-22T23:28:04.795 INFO:teuthology.orchestra.run.trial045.stdout: "pacific", 2026-02-22T23:28:04.795 INFO:teuthology.orchestra.run.trial045.stdout: "elector-pinging", 2026-02-22T23:28:04.795 INFO:teuthology.orchestra.run.trial045.stdout: "quincy", 2026-02-22T23:28:04.795 INFO:teuthology.orchestra.run.trial045.stdout: "reef", 2026-02-22T23:28:04.795 INFO:teuthology.orchestra.run.trial045.stdout: "squid" 2026-02-22T23:28:04.795 INFO:teuthology.orchestra.run.trial045.stdout: ], 2026-02-22T23:28:04.795 INFO:teuthology.orchestra.run.trial045.stdout: "quorum_con": "4540701547738038271", 2026-02-22T23:28:04.795 INFO:teuthology.orchestra.run.trial045.stdout: "quorum_mon": [ 2026-02-22T23:28:04.795 INFO:teuthology.orchestra.run.trial045.stdout: "kraken", 2026-02-22T23:28:04.795 INFO:teuthology.orchestra.run.trial045.stdout: "luminous", 2026-02-22T23:28:04.795 INFO:teuthology.orchestra.run.trial045.stdout: "mimic", 2026-02-22T23:28:04.795 INFO:teuthology.orchestra.run.trial045.stdout: "osdmap-prune", 2026-02-22T23:28:04.795 INFO:teuthology.orchestra.run.trial045.stdout: "nautilus", 2026-02-22T23:28:04.795 INFO:teuthology.orchestra.run.trial045.stdout: "octopus", 2026-02-22T23:28:04.795 INFO:teuthology.orchestra.run.trial045.stdout: "pacific", 2026-02-22T23:28:04.796 INFO:teuthology.orchestra.run.trial045.stdout: "elector-pinging", 2026-02-22T23:28:04.796 INFO:teuthology.orchestra.run.trial045.stdout: "quincy", 2026-02-22T23:28:04.796 INFO:teuthology.orchestra.run.trial045.stdout: "reef", 2026-02-22T23:28:04.796 INFO:teuthology.orchestra.run.trial045.stdout: "squid" 2026-02-22T23:28:04.796 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:28:04.796 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:28:04.796 INFO:teuthology.orchestra.run.trial045.stdout: "outside_quorum": [], 2026-02-22T23:28:04.796 INFO:teuthology.orchestra.run.trial045.stdout: "extra_probe_peers": [], 2026-02-22T23:28:04.796 INFO:teuthology.orchestra.run.trial045.stdout: "sync_provider": [], 2026-02-22T23:28:04.796 INFO:teuthology.orchestra.run.trial045.stdout: "monmap": { 2026-02-22T23:28:04.796 INFO:teuthology.orchestra.run.trial045.stdout: "epoch": 1, 2026-02-22T23:28:04.796 INFO:teuthology.orchestra.run.trial045.stdout: "fsid": "4b60f18f-6660-4731-b731-dc85c4078413", 2026-02-22T23:28:04.796 INFO:teuthology.orchestra.run.trial045.stdout: "modified": "2026-02-22T23:24:52.393472Z", 2026-02-22T23:28:04.796 INFO:teuthology.orchestra.run.trial045.stdout: "created": "2026-02-22T23:24:52.393472Z", 2026-02-22T23:28:04.796 INFO:teuthology.orchestra.run.trial045.stdout: "min_mon_release": 19, 2026-02-22T23:28:04.796 INFO:teuthology.orchestra.run.trial045.stdout: "min_mon_release_name": "squid", 2026-02-22T23:28:04.796 INFO:teuthology.orchestra.run.trial045.stdout: "election_strategy": 3, 2026-02-22T23:28:04.796 INFO:teuthology.orchestra.run.trial045.stdout: "disallowed_leaders": "", 2026-02-22T23:28:04.797 INFO:teuthology.orchestra.run.trial045.stdout: "stretch_mode": false, 2026-02-22T23:28:04.797 INFO:teuthology.orchestra.run.trial045.stdout: "tiebreaker_mon": "", 2026-02-22T23:28:04.797 INFO:teuthology.orchestra.run.trial045.stdout: "removed_ranks": "", 2026-02-22T23:28:04.797 INFO:teuthology.orchestra.run.trial045.stdout: "features": { 2026-02-22T23:28:04.797 INFO:teuthology.orchestra.run.trial045.stdout: "persistent": [ 2026-02-22T23:28:04.797 INFO:teuthology.orchestra.run.trial045.stdout: "kraken", 2026-02-22T23:28:04.797 INFO:teuthology.orchestra.run.trial045.stdout: "luminous", 2026-02-22T23:28:04.797 INFO:teuthology.orchestra.run.trial045.stdout: "mimic", 2026-02-22T23:28:04.797 INFO:teuthology.orchestra.run.trial045.stdout: "osdmap-prune", 2026-02-22T23:28:04.797 INFO:teuthology.orchestra.run.trial045.stdout: "nautilus", 2026-02-22T23:28:04.797 INFO:teuthology.orchestra.run.trial045.stdout: "octopus", 2026-02-22T23:28:04.797 INFO:teuthology.orchestra.run.trial045.stdout: "pacific", 2026-02-22T23:28:04.797 INFO:teuthology.orchestra.run.trial045.stdout: "elector-pinging", 2026-02-22T23:28:04.797 INFO:teuthology.orchestra.run.trial045.stdout: "quincy", 2026-02-22T23:28:04.797 INFO:teuthology.orchestra.run.trial045.stdout: "reef", 2026-02-22T23:28:04.797 INFO:teuthology.orchestra.run.trial045.stdout: "squid" 2026-02-22T23:28:04.797 INFO:teuthology.orchestra.run.trial045.stdout: ], 2026-02-22T23:28:04.797 INFO:teuthology.orchestra.run.trial045.stdout: "optional": [] 2026-02-22T23:28:04.797 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:28:04.798 INFO:teuthology.orchestra.run.trial045.stdout: "mons": [ 2026-02-22T23:28:04.798 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:28:04.798 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 0, 2026-02-22T23:28:04.798 INFO:teuthology.orchestra.run.trial045.stdout: "name": "a", 2026-02-22T23:28:04.798 INFO:teuthology.orchestra.run.trial045.stdout: "public_addrs": { 2026-02-22T23:28:04.798 INFO:teuthology.orchestra.run.trial045.stdout: "addrvec": [ 2026-02-22T23:28:04.798 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:28:04.798 INFO:teuthology.orchestra.run.trial045.stdout: "type": "v1", 2026-02-22T23:28:04.798 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6789", 2026-02-22T23:28:04.798 INFO:teuthology.orchestra.run.trial045.stdout: "nonce": 0 2026-02-22T23:28:04.798 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:28:04.798 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:28:04.798 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:28:04.798 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6789/0", 2026-02-22T23:28:04.798 INFO:teuthology.orchestra.run.trial045.stdout: "public_addr": "10.20.193.45:6789/0", 2026-02-22T23:28:04.798 INFO:teuthology.orchestra.run.trial045.stdout: "priority": 0, 2026-02-22T23:28:04.798 INFO:teuthology.orchestra.run.trial045.stdout: "weight": 0, 2026-02-22T23:28:04.798 INFO:teuthology.orchestra.run.trial045.stdout: "crush_location": "{}" 2026-02-22T23:28:04.799 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:28:04.799 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:28:04.799 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 1, 2026-02-22T23:28:04.799 INFO:teuthology.orchestra.run.trial045.stdout: "name": "f", 2026-02-22T23:28:04.799 INFO:teuthology.orchestra.run.trial045.stdout: "public_addrs": { 2026-02-22T23:28:04.799 INFO:teuthology.orchestra.run.trial045.stdout: "addrvec": [ 2026-02-22T23:28:04.799 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:28:04.799 INFO:teuthology.orchestra.run.trial045.stdout: "type": "v1", 2026-02-22T23:28:04.799 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.73:6789", 2026-02-22T23:28:04.799 INFO:teuthology.orchestra.run.trial045.stdout: "nonce": 0 2026-02-22T23:28:04.799 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:28:04.799 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:28:04.799 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:28:04.799 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.73:6789/0", 2026-02-22T23:28:04.799 INFO:teuthology.orchestra.run.trial045.stdout: "public_addr": "10.20.193.73:6789/0", 2026-02-22T23:28:04.799 INFO:teuthology.orchestra.run.trial045.stdout: "priority": 0, 2026-02-22T23:28:04.799 INFO:teuthology.orchestra.run.trial045.stdout: "weight": 0, 2026-02-22T23:28:04.799 INFO:teuthology.orchestra.run.trial045.stdout: "crush_location": "{}" 2026-02-22T23:28:04.799 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:28:04.799 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:28:04.799 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 2, 2026-02-22T23:28:04.800 INFO:teuthology.orchestra.run.trial045.stdout: "name": "b", 2026-02-22T23:28:04.800 INFO:teuthology.orchestra.run.trial045.stdout: "public_addrs": { 2026-02-22T23:28:04.800 INFO:teuthology.orchestra.run.trial045.stdout: "addrvec": [ 2026-02-22T23:28:04.800 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:28:04.800 INFO:teuthology.orchestra.run.trial045.stdout: "type": "v1", 2026-02-22T23:28:04.800 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6790", 2026-02-22T23:28:04.800 INFO:teuthology.orchestra.run.trial045.stdout: "nonce": 0 2026-02-22T23:28:04.800 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:28:04.800 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:28:04.800 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:28:04.800 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6790/0", 2026-02-22T23:28:04.800 INFO:teuthology.orchestra.run.trial045.stdout: "public_addr": "10.20.193.45:6790/0", 2026-02-22T23:28:04.800 INFO:teuthology.orchestra.run.trial045.stdout: "priority": 0, 2026-02-22T23:28:04.800 INFO:teuthology.orchestra.run.trial045.stdout: "weight": 0, 2026-02-22T23:28:04.800 INFO:teuthology.orchestra.run.trial045.stdout: "crush_location": "{}" 2026-02-22T23:28:04.800 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:28:04.800 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:28:04.800 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 3, 2026-02-22T23:28:04.800 INFO:teuthology.orchestra.run.trial045.stdout: "name": "g", 2026-02-22T23:28:04.800 INFO:teuthology.orchestra.run.trial045.stdout: "public_addrs": { 2026-02-22T23:28:04.801 INFO:teuthology.orchestra.run.trial045.stdout: "addrvec": [ 2026-02-22T23:28:04.801 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:28:04.801 INFO:teuthology.orchestra.run.trial045.stdout: "type": "v1", 2026-02-22T23:28:04.801 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.73:6790", 2026-02-22T23:28:04.801 INFO:teuthology.orchestra.run.trial045.stdout: "nonce": 0 2026-02-22T23:28:04.801 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:28:04.801 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:28:04.801 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:28:04.801 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.73:6790/0", 2026-02-22T23:28:04.801 INFO:teuthology.orchestra.run.trial045.stdout: "public_addr": "10.20.193.73:6790/0", 2026-02-22T23:28:04.801 INFO:teuthology.orchestra.run.trial045.stdout: "priority": 0, 2026-02-22T23:28:04.801 INFO:teuthology.orchestra.run.trial045.stdout: "weight": 0, 2026-02-22T23:28:04.801 INFO:teuthology.orchestra.run.trial045.stdout: "crush_location": "{}" 2026-02-22T23:28:04.801 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:28:04.801 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:28:04.801 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 4, 2026-02-22T23:28:04.801 INFO:teuthology.orchestra.run.trial045.stdout: "name": "c", 2026-02-22T23:28:04.801 INFO:teuthology.orchestra.run.trial045.stdout: "public_addrs": { 2026-02-22T23:28:04.801 INFO:teuthology.orchestra.run.trial045.stdout: "addrvec": [ 2026-02-22T23:28:04.801 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:28:04.802 INFO:teuthology.orchestra.run.trial045.stdout: "type": "v1", 2026-02-22T23:28:04.802 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6791", 2026-02-22T23:28:04.802 INFO:teuthology.orchestra.run.trial045.stdout: "nonce": 0 2026-02-22T23:28:04.802 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:28:04.802 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:28:04.802 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:28:04.802 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6791/0", 2026-02-22T23:28:04.802 INFO:teuthology.orchestra.run.trial045.stdout: "public_addr": "10.20.193.45:6791/0", 2026-02-22T23:28:04.802 INFO:teuthology.orchestra.run.trial045.stdout: "priority": 0, 2026-02-22T23:28:04.802 INFO:teuthology.orchestra.run.trial045.stdout: "weight": 0, 2026-02-22T23:28:04.802 INFO:teuthology.orchestra.run.trial045.stdout: "crush_location": "{}" 2026-02-22T23:28:04.802 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:28:04.802 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:28:04.802 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 5, 2026-02-22T23:28:04.802 INFO:teuthology.orchestra.run.trial045.stdout: "name": "h", 2026-02-22T23:28:04.802 INFO:teuthology.orchestra.run.trial045.stdout: "public_addrs": { 2026-02-22T23:28:04.802 INFO:teuthology.orchestra.run.trial045.stdout: "addrvec": [ 2026-02-22T23:28:04.802 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:28:04.802 INFO:teuthology.orchestra.run.trial045.stdout: "type": "v1", 2026-02-22T23:28:04.802 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.73:6791", 2026-02-22T23:28:04.802 INFO:teuthology.orchestra.run.trial045.stdout: "nonce": 0 2026-02-22T23:28:04.803 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:28:04.803 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:28:04.803 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:28:04.803 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.73:6791/0", 2026-02-22T23:28:04.803 INFO:teuthology.orchestra.run.trial045.stdout: "public_addr": "10.20.193.73:6791/0", 2026-02-22T23:28:04.803 INFO:teuthology.orchestra.run.trial045.stdout: "priority": 0, 2026-02-22T23:28:04.803 INFO:teuthology.orchestra.run.trial045.stdout: "weight": 0, 2026-02-22T23:28:04.803 INFO:teuthology.orchestra.run.trial045.stdout: "crush_location": "{}" 2026-02-22T23:28:04.803 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:28:04.803 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:28:04.803 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 6, 2026-02-22T23:28:04.803 INFO:teuthology.orchestra.run.trial045.stdout: "name": "d", 2026-02-22T23:28:04.803 INFO:teuthology.orchestra.run.trial045.stdout: "public_addrs": { 2026-02-22T23:28:04.803 INFO:teuthology.orchestra.run.trial045.stdout: "addrvec": [ 2026-02-22T23:28:04.803 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:28:04.803 INFO:teuthology.orchestra.run.trial045.stdout: "type": "v1", 2026-02-22T23:28:04.803 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6792", 2026-02-22T23:28:04.803 INFO:teuthology.orchestra.run.trial045.stdout: "nonce": 0 2026-02-22T23:28:04.803 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:28:04.803 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:28:04.803 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:28:04.803 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6792/0", 2026-02-22T23:28:04.803 INFO:teuthology.orchestra.run.trial045.stdout: "public_addr": "10.20.193.45:6792/0", 2026-02-22T23:28:04.804 INFO:teuthology.orchestra.run.trial045.stdout: "priority": 0, 2026-02-22T23:28:04.804 INFO:teuthology.orchestra.run.trial045.stdout: "weight": 0, 2026-02-22T23:28:04.804 INFO:teuthology.orchestra.run.trial045.stdout: "crush_location": "{}" 2026-02-22T23:28:04.804 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:28:04.804 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:28:04.804 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 7, 2026-02-22T23:28:04.804 INFO:teuthology.orchestra.run.trial045.stdout: "name": "i", 2026-02-22T23:28:04.804 INFO:teuthology.orchestra.run.trial045.stdout: "public_addrs": { 2026-02-22T23:28:04.804 INFO:teuthology.orchestra.run.trial045.stdout: "addrvec": [ 2026-02-22T23:28:04.804 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:28:04.804 INFO:teuthology.orchestra.run.trial045.stdout: "type": "v1", 2026-02-22T23:28:04.804 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.73:6792", 2026-02-22T23:28:04.804 INFO:teuthology.orchestra.run.trial045.stdout: "nonce": 0 2026-02-22T23:28:04.804 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:28:04.804 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:28:04.804 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:28:04.804 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.73:6792/0", 2026-02-22T23:28:04.804 INFO:teuthology.orchestra.run.trial045.stdout: "public_addr": "10.20.193.73:6792/0", 2026-02-22T23:28:04.804 INFO:teuthology.orchestra.run.trial045.stdout: "priority": 0, 2026-02-22T23:28:04.804 INFO:teuthology.orchestra.run.trial045.stdout: "weight": 0, 2026-02-22T23:28:04.804 INFO:teuthology.orchestra.run.trial045.stdout: "crush_location": "{}" 2026-02-22T23:28:04.804 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:28:04.805 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:28:04.805 INFO:teuthology.orchestra.run.trial045.stdout: "rank": 8, 2026-02-22T23:28:04.805 INFO:teuthology.orchestra.run.trial045.stdout: "name": "e", 2026-02-22T23:28:04.805 INFO:teuthology.orchestra.run.trial045.stdout: "public_addrs": { 2026-02-22T23:28:04.805 INFO:teuthology.orchestra.run.trial045.stdout: "addrvec": [ 2026-02-22T23:28:04.805 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:28:04.805 INFO:teuthology.orchestra.run.trial045.stdout: "type": "v1", 2026-02-22T23:28:04.805 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6793", 2026-02-22T23:28:04.805 INFO:teuthology.orchestra.run.trial045.stdout: "nonce": 0 2026-02-22T23:28:04.805 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:28:04.805 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:28:04.805 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:28:04.805 INFO:teuthology.orchestra.run.trial045.stdout: "addr": "10.20.193.45:6793/0", 2026-02-22T23:28:04.805 INFO:teuthology.orchestra.run.trial045.stdout: "public_addr": "10.20.193.45:6793/0", 2026-02-22T23:28:04.805 INFO:teuthology.orchestra.run.trial045.stdout: "priority": 0, 2026-02-22T23:28:04.805 INFO:teuthology.orchestra.run.trial045.stdout: "weight": 0, 2026-02-22T23:28:04.805 INFO:teuthology.orchestra.run.trial045.stdout: "crush_location": "{}" 2026-02-22T23:28:04.805 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:28:04.805 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:28:04.805 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:28:04.805 INFO:teuthology.orchestra.run.trial045.stdout: "feature_map": { 2026-02-22T23:28:04.805 INFO:teuthology.orchestra.run.trial045.stdout: "mon": [ 2026-02-22T23:28:04.806 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:28:04.806 INFO:teuthology.orchestra.run.trial045.stdout: "features": "0x3f03cffffffdffff", 2026-02-22T23:28:04.806 INFO:teuthology.orchestra.run.trial045.stdout: "release": "squid", 2026-02-22T23:28:04.806 INFO:teuthology.orchestra.run.trial045.stdout: "num": 1 2026-02-22T23:28:04.806 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:28:04.806 INFO:teuthology.orchestra.run.trial045.stdout: ], 2026-02-22T23:28:04.806 INFO:teuthology.orchestra.run.trial045.stdout: "client": [ 2026-02-22T23:28:04.806 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:28:04.806 INFO:teuthology.orchestra.run.trial045.stdout: "features": "0x3f03cffffffdffff", 2026-02-22T23:28:04.806 INFO:teuthology.orchestra.run.trial045.stdout: "release": "squid", 2026-02-22T23:28:04.806 INFO:teuthology.orchestra.run.trial045.stdout: "num": 2 2026-02-22T23:28:04.806 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:28:04.806 INFO:teuthology.orchestra.run.trial045.stdout: ], 2026-02-22T23:28:04.806 INFO:teuthology.orchestra.run.trial045.stdout: "mgr": [ 2026-02-22T23:28:04.806 INFO:teuthology.orchestra.run.trial045.stdout: { 2026-02-22T23:28:04.806 INFO:teuthology.orchestra.run.trial045.stdout: "features": "0x3f03cffffffdffff", 2026-02-22T23:28:04.806 INFO:teuthology.orchestra.run.trial045.stdout: "release": "squid", 2026-02-22T23:28:04.806 INFO:teuthology.orchestra.run.trial045.stdout: "num": 1 2026-02-22T23:28:04.806 INFO:teuthology.orchestra.run.trial045.stdout: } 2026-02-22T23:28:04.806 INFO:teuthology.orchestra.run.trial045.stdout: ] 2026-02-22T23:28:04.806 INFO:teuthology.orchestra.run.trial045.stdout: }, 2026-02-22T23:28:04.806 INFO:teuthology.orchestra.run.trial045.stdout: "stretch_mode": false 2026-02-22T23:28:04.806 INFO:teuthology.orchestra.run.trial045.stdout:} 2026-02-22T23:28:04.807 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.776+0000 7f0a84022640 1 -- 10.20.193.45:0/2638195689 >> v1:10.20.193.73:6800/2222410180 conn(0x7f0a4c03fd40 legacy=0x7f0a4c042200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:04.807 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.776+0000 7f0a84022640 10 monclient: shutdown 2026-02-22T23:28:04.807 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.776+0000 7f0a84022640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T23:28:04.808 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.776+0000 7f0a84022640 1 -- 10.20.193.45:0/2638195689 >> v1:10.20.193.45:6789/0 conn(0x7f0a7c0a0980 legacy=0x7f0a7c1cf450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:04.808 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.776+0000 7f0a82598640 1 -- 10.20.193.45:0/2638195689 reap_dead start 2026-02-22T23:28:04.808 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.776+0000 7f0a82598640 1 -- 10.20.193.45:0/2638195689 reap_dead start 2026-02-22T23:28:04.808 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.776+0000 7f0a84022640 1 -- 10.20.193.45:0/2638195689 shutdown_connections 2026-02-22T23:28:04.808 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.776+0000 7f0a84022640 1 -- 10.20.193.45:0/2638195689 >> 10.20.193.45:0/2638195689 conn(0x7f0a7c0a7780 msgr2=0x7f0a7c0a4f60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:28:04.808 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.776+0000 7f0a84022640 1 -- 10.20.193.45:0/2638195689 shutdown_connections 2026-02-22T23:28:04.808 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.776+0000 7f0a84022640 1 -- 10.20.193.45:0/2638195689 wait complete. 2026-02-22T23:28:04.808 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2026-02-22T23:28:04.808 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2026-02-22T23:28:04.808 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2026-02-22T23:28:04.875 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.874+0000 7fc0bf52c640 10 monclient: get_monmap_and_config 2026-02-22T23:28:04.875 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.874+0000 7fc0bf52c640 10 monclient: build_initial_monmap 2026-02-22T23:28:04.876 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.874+0000 7fc0bf52c640 10 monclient: monmap: 2026-02-22T23:28:04.876 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-22T23:28:04.876 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:28:04.876 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:28:04.875647+0000 2026-02-22T23:28:04.876 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:28:04.875647+0000 2026-02-22T23:28:04.876 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-22T23:28:04.876 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:28:04.876 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-22T23:28:04.876 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.noname-f 2026-02-22T23:28:04.876 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.noname-b 2026-02-22T23:28:04.876 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.noname-g 2026-02-22T23:28:04.876 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.noname-c 2026-02-22T23:28:04.876 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.noname-h 2026-02-22T23:28:04.876 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.noname-d 2026-02-22T23:28:04.876 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.noname-i 2026-02-22T23:28:04.876 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.noname-e 2026-02-22T23:28:04.876 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:04.881 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.874+0000 7fc0bf52c640 1 Processor -- start 2026-02-22T23:28:04.882 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.874+0000 7fc0bf52c640 1 -- start start 2026-02-22T23:28:04.882 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.874+0000 7fc0bf52c640 10 monclient: init 2026-02-22T23:28:04.882 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.875+0000 7fc0bf52c640 10 monclient: _reopen_session rank -1 2026-02-22T23:28:04.882 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.875+0000 7fc0bf52c640 10 monclient: _add_conns ranks=[3,5,4,0,7,2,6,1,8] 2026-02-22T23:28:04.882 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.875+0000 7fc0bf52c640 10 monclient(hunting): picked mon.noname-g con 0x7fc0b80a41a0 addr v1:10.20.193.73:6790/0 2026-02-22T23:28:04.882 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.875+0000 7fc0bf52c640 10 monclient(hunting): picked mon.noname-h con 0x7fc0b80a4c90 addr v1:10.20.193.73:6791/0 2026-02-22T23:28:04.882 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.875+0000 7fc0bf52c640 10 monclient(hunting): picked mon.noname-c con 0x7fc0b80a50a0 addr v1:10.20.193.45:6791/0 2026-02-22T23:28:04.882 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.875+0000 7fc0bf52c640 1 -- --> v1:10.20.193.73:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc0b806e1b0 con 0x7fc0b80a41a0 2026-02-22T23:28:04.882 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.875+0000 7fc0bf52c640 1 -- --> v1:10.20.193.45:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc0b806e490 con 0x7fc0b80a50a0 2026-02-22T23:28:04.882 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.875+0000 7fc0bf52c640 1 -- --> v1:10.20.193.73:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc0b80a5530 con 0x7fc0b80a4c90 2026-02-22T23:28:04.882 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.875+0000 7fc0bf52c640 10 monclient(hunting): _renew_subs 2026-02-22T23:28:04.882 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.875+0000 7fc0bf52c640 10 monclient(hunting): authenticate will time out at 816.492231s 2026-02-22T23:28:04.882 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.875+0000 7fc0bdaa2640 1 --1- >> v1:10.20.193.45:6791/0 conn(0x7fc0b80a50a0 0x7fc0b8141710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.45:6791/0 says I am v1:10.20.193.45:57734/0 (socket says 10.20.193.45:57734) 2026-02-22T23:28:04.882 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.875+0000 7fc0bdaa2640 1 -- 10.20.193.45:0/2041703821 learned_addr learned my addr 10.20.193.45:0/2041703821 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-22T23:28:04.882 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.875+0000 7fc0a7fff640 1 -- 10.20.193.45:0/2041703821 <== mon.4 v1:10.20.193.45:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 454996582 0 0) 0x7fc0b806e490 con 0x7fc0b80a50a0 2026-02-22T23:28:04.882 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.875+0000 7fc0a7fff640 10 monclient(hunting): _negotiate 2026-02-22T23:28:04.882 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.875+0000 7fc0a7fff640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:28:04.882 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.875+0000 7fc0a7fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:28:04.883 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.875+0000 7fc0a7fff640 10 monclient(hunting): my global_id is 114169 2026-02-22T23:28:04.883 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.875+0000 7fc0a7fff640 1 -- 10.20.193.45:0/2041703821 --> v1:10.20.193.45:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc0a0003620 con 0x7fc0b80a50a0 2026-02-22T23:28:04.883 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.875+0000 7fc0a7fff640 1 -- 10.20.193.45:0/2041703821 <== mon.5 v1:10.20.193.73:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1034872307 0 0) 0x7fc0b80a5530 con 0x7fc0b80a4c90 2026-02-22T23:28:04.883 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.875+0000 7fc0a7fff640 10 monclient(hunting): _negotiate 2026-02-22T23:28:04.883 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.875+0000 7fc0a7fff640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:28:04.883 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.875+0000 7fc0a7fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:28:04.883 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.875+0000 7fc0a7fff640 10 monclient(hunting): my global_id is 114170 2026-02-22T23:28:04.883 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.875+0000 7fc0a7fff640 1 -- 10.20.193.45:0/2041703821 --> v1:10.20.193.73:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc0b806e490 con 0x7fc0b80a4c90 2026-02-22T23:28:04.883 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.875+0000 7fc0a7fff640 1 -- 10.20.193.45:0/2041703821 <== mon.3 v1:10.20.193.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3849836418 0 0) 0x7fc0b806e1b0 con 0x7fc0b80a41a0 2026-02-22T23:28:04.883 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.875+0000 7fc0a7fff640 10 monclient(hunting): _negotiate 2026-02-22T23:28:04.883 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.875+0000 7fc0a7fff640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:28:04.883 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.875+0000 7fc0a7fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:28:04.883 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.875+0000 7fc0a7fff640 10 monclient(hunting): my global_id is 4629 2026-02-22T23:28:04.883 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.875+0000 7fc0a7fff640 1 -- 10.20.193.45:0/2041703821 --> v1:10.20.193.73:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc0b80a5530 con 0x7fc0b80a41a0 2026-02-22T23:28:04.883 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.875+0000 7fc0a7fff640 1 -- 10.20.193.45:0/2041703821 <== mon.4 v1:10.20.193.45:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3965523974 0 0) 0x7fc0a0003620 con 0x7fc0b80a50a0 2026-02-22T23:28:04.883 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.875+0000 7fc0a7fff640 1 -- 10.20.193.45:0/2041703821 >> v1:10.20.193.73:6791/0 conn(0x7fc0b80a4c90 legacy=0x7fc0b813dfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:04.883 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.875+0000 7fc0a7fff640 1 -- 10.20.193.45:0/2041703821 >> v1:10.20.193.73:6790/0 conn(0x7fc0b80a41a0 legacy=0x7fc0b80a4580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:04.883 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.875+0000 7fc0a7fff640 10 monclient: _finish_hunting 0 2026-02-22T23:28:04.884 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.875+0000 7fc0a7fff640 1 monclient: found mon.noname-c 2026-02-22T23:28:04.884 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.875+0000 7fc0a7fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T23:28:04.884 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.875+0000 7fc0a7fff640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.45:6791/0 2026-02-22T23:28:04.884 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.875+0000 7fc0a7fff640 1 -- 10.20.193.45:0/2041703821 --> v1:10.20.193.45:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0b806ced0 con 0x7fc0b80a50a0 2026-02-22T23:28:04.884 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.875+0000 7fc0a7fff640 10 monclient: _finish_auth 0 2026-02-22T23:28:04.884 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.875+0000 7fc0a7fff640 10 monclient: _check_auth_tickets 2026-02-22T23:28:04.884 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.875+0000 7fc0a7fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T23:28:04.884 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.875+0000 7fc0a7fff640 1 -- 10.20.193.45:0/2041703821 <== mon.4 v1:10.20.193.45:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7fc0b40033c0 con 0x7fc0b80a50a0 2026-02-22T23:28:04.884 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.875+0000 7fc0bf52c640 5 monclient: authenticate success, global_id 114169 2026-02-22T23:28:04.884 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.875+0000 7fc0bf52c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-22T23:28:04.884 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.875+0000 7fc0a7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:28:04.884 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.875+0000 7fc0a7fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-22T23:28:04.884 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.875+0000 7fc0a7fff640 10 monclient: dump: 2026-02-22T23:28:04.884 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:28:04.884 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:28:04.884 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:04.884 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:04.884 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:28:04.885 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:28:04.885 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:28:04.885 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:28:04.885 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:28:04.885 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:28:04.885 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:28:04.885 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:28:04.885 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:28:04.885 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:28:04.885 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:28:04.885 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:04.885 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.875+0000 7fc0bf52c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-22T23:28:04.885 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.875+0000 7fc0a7fff640 1 -- 10.20.193.45:0/2041703821 <== mon.4 v1:10.20.193.45:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc0b40035e0 con 0x7fc0b80a50a0 2026-02-22T23:28:04.885 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.875+0000 7fc0a7fff640 10 monclient: handle_config config(0 keys) 2026-02-22T23:28:04.885 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.875+0000 7fc0a7fff640 1 -- 10.20.193.45:0/2041703821 <== mon.4 v1:10.20.193.45:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7fc0b4005060 con 0x7fc0b80a50a0 2026-02-22T23:28:04.885 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.875+0000 7fc0bf52c640 10 monclient: get_monmap_and_config success 2026-02-22T23:28:04.885 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.875+0000 7fc0bf52c640 4 set_mon_vals no callback set 2026-02-22T23:28:04.885 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.875+0000 7fc0a7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:28:04.885 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.875+0000 7fc0a7fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T23:28:04.885 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.875+0000 7fc0a7fff640 10 monclient: dump: 2026-02-22T23:28:04.886 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:28:04.886 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:28:04.886 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:04.886 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:04.886 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:28:04.886 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:28:04.886 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:28:04.886 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:28:04.886 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:28:04.886 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:28:04.886 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:28:04.886 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:28:04.886 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:28:04.886 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:28:04.886 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:28:04.886 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:04.886 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.875+0000 7fc0bf52c640 10 monclient: shutdown 2026-02-22T23:28:04.886 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.875+0000 7fc0bf52c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T23:28:04.886 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.875+0000 7fc0bf52c640 1 -- 10.20.193.45:0/2041703821 >> v1:10.20.193.45:6791/0 conn(0x7fc0b80a50a0 legacy=0x7fc0b8141710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:04.887 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.876+0000 7fc0bf52c640 1 -- 10.20.193.45:0/2041703821 shutdown_connections 2026-02-22T23:28:04.887 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.876+0000 7fc0bf52c640 1 -- 10.20.193.45:0/2041703821 >> 10.20.193.45:0/2041703821 conn(0x7fc0b80a9720 msgr2=0x7fc0b80a9b30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:28:04.887 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.876+0000 7fc0bf52c640 1 -- 10.20.193.45:0/2041703821 shutdown_connections 2026-02-22T23:28:04.887 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.876+0000 7fc0bf52c640 1 -- 10.20.193.45:0/2041703821 wait complete. 2026-02-22T23:28:04.887 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.876+0000 7fc0bf52c640 10 monclient: build_initial_monmap 2026-02-22T23:28:04.887 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.876+0000 7fc0bf52c640 10 monclient: monmap: 2026-02-22T23:28:04.887 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-22T23:28:04.887 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T23:28:04.887 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-22T23:28:04.887 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-22T23:28:04.887 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-22T23:28:04.887 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-22T23:28:04.887 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-22T23:28:04.887 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.noname-f 2026-02-22T23:28:04.887 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.noname-b 2026-02-22T23:28:04.887 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.noname-g 2026-02-22T23:28:04.887 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.noname-c 2026-02-22T23:28:04.887 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.noname-h 2026-02-22T23:28:04.887 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.noname-d 2026-02-22T23:28:04.888 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.noname-i 2026-02-22T23:28:04.888 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.noname-e 2026-02-22T23:28:04.888 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:04.888 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.876+0000 7fc0bf52c640 1 Processor -- start 2026-02-22T23:28:04.888 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.876+0000 7fc0bf52c640 1 -- start start 2026-02-22T23:28:04.888 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.876+0000 7fc0bf52c640 10 monclient: init 2026-02-22T23:28:04.888 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.876+0000 7fc0bf52c640 10 monclient: _reopen_session rank -1 2026-02-22T23:28:04.888 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.876+0000 7fc0bf52c640 10 monclient: _add_conns ranks=[2,6,7,8,3,0,5,1,4] 2026-02-22T23:28:04.888 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.876+0000 7fc0bf52c640 10 monclient(hunting): picked mon.noname-b con 0x7fc0b80a41a0 addr v1:10.20.193.45:6790/0 2026-02-22T23:28:04.888 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.876+0000 7fc0bf52c640 10 monclient(hunting): picked mon.noname-d con 0x7fc0b80a4c90 addr v1:10.20.193.45:6792/0 2026-02-22T23:28:04.888 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.876+0000 7fc0bf52c640 10 monclient(hunting): picked mon.noname-i con 0x7fc0b80a50a0 addr v1:10.20.193.73:6792/0 2026-02-22T23:28:04.888 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.876+0000 7fc0bf52c640 1 -- --> v1:10.20.193.45:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc0b81400d0 con 0x7fc0b80a41a0 2026-02-22T23:28:04.888 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.876+0000 7fc0bf52c640 1 -- --> v1:10.20.193.45:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc0b813e570 con 0x7fc0b80a4c90 2026-02-22T23:28:04.888 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.876+0000 7fc0bf52c640 1 -- --> v1:10.20.193.73:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc0b80a67c0 con 0x7fc0b80a50a0 2026-02-22T23:28:04.888 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.876+0000 7fc0bf52c640 10 monclient(hunting): _renew_subs 2026-02-22T23:28:04.888 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.876+0000 7fc0bf52c640 10 monclient(hunting): authenticate will time out at 816.493957s 2026-02-22T23:28:04.888 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.877+0000 7fc0bd2a1640 1 --1- >> v1:10.20.193.45:6790/0 conn(0x7fc0b80a41a0 0x7fc0b813d750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.45:6790/0 says I am v1:10.20.193.45:60172/0 (socket says 10.20.193.45:60172) 2026-02-22T23:28:04.888 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.877+0000 7fc0bd2a1640 1 -- 10.20.193.45:0/3684027174 learned_addr learned my addr 10.20.193.45:0/3684027174 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-22T23:28:04.889 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.877+0000 7fc0a5ffb640 1 -- 10.20.193.45:0/3684027174 <== mon.6 v1:10.20.193.45:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3121354744 0 0) 0x7fc0b813e570 con 0x7fc0b80a4c90 2026-02-22T23:28:04.889 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.877+0000 7fc0a5ffb640 10 monclient(hunting): _negotiate 2026-02-22T23:28:04.889 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.877+0000 7fc0a5ffb640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:28:04.889 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.877+0000 7fc0a5ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:28:04.889 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.877+0000 7fc0a5ffb640 10 monclient(hunting): my global_id is 114171 2026-02-22T23:28:04.889 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.877+0000 7fc0a5ffb640 1 -- 10.20.193.45:0/3684027174 --> v1:10.20.193.45:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc088003620 con 0x7fc0b80a4c90 2026-02-22T23:28:04.889 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.877+0000 7fc0a5ffb640 1 -- 10.20.193.45:0/3684027174 <== mon.2 v1:10.20.193.45:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2109733838 0 0) 0x7fc0b81400d0 con 0x7fc0b80a41a0 2026-02-22T23:28:04.889 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.877+0000 7fc0a5ffb640 10 monclient(hunting): _negotiate 2026-02-22T23:28:04.889 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.877+0000 7fc0a5ffb640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:28:04.889 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.877+0000 7fc0a5ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:28:04.889 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.877+0000 7fc0a5ffb640 10 monclient(hunting): my global_id is 4727 2026-02-22T23:28:04.889 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.877+0000 7fc0a5ffb640 1 -- 10.20.193.45:0/3684027174 --> v1:10.20.193.45:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc0b813e570 con 0x7fc0b80a41a0 2026-02-22T23:28:04.889 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.877+0000 7fc0a5ffb640 1 -- 10.20.193.45:0/3684027174 <== mon.6 v1:10.20.193.45:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3700304241 0 0) 0x7fc088003620 con 0x7fc0b80a4c90 2026-02-22T23:28:04.889 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.877+0000 7fc0a5ffb640 1 -- 10.20.193.45:0/3684027174 --> v1:10.20.193.45:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc0b81400d0 con 0x7fc0b80a4c90 2026-02-22T23:28:04.889 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.877+0000 7fc0a5ffb640 1 -- 10.20.193.45:0/3684027174 <== mon.6 v1:10.20.193.45:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7fc0ac003320 con 0x7fc0b80a4c90 2026-02-22T23:28:04.889 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.877+0000 7fc0a5ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-22T23:28:04.889 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.877+0000 7fc0a5ffb640 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2026-02-22T23:28:04.889 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.877+0000 7fc0a5ffb640 10 monclient(hunting): dump: 2026-02-22T23:28:04.889 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:28:04.890 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:28:04.890 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:04.890 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:04.890 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:28:04.890 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:28:04.890 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:28:04.890 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:28:04.890 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:28:04.890 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:28:04.890 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:28:04.890 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:28:04.890 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:28:04.890 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:28:04.890 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:28:04.890 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:04.890 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.877+0000 7fc0a5ffb640 10 monclient(hunting): _finish_auth 0 2026-02-22T23:28:04.890 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.877+0000 7fc0a5ffb640 1 -- 10.20.193.45:0/3684027174 <== mon.2 v1:10.20.193.45:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 805537668 0 0) 0x7fc0b813e570 con 0x7fc0b80a41a0 2026-02-22T23:28:04.890 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.877+0000 7fc0a5ffb640 1 -- 10.20.193.45:0/3684027174 --> v1:10.20.193.45:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc088003620 con 0x7fc0b80a41a0 2026-02-22T23:28:04.890 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.877+0000 7fc0a5ffb640 1 -- 10.20.193.45:0/3684027174 <== mon.2 v1:10.20.193.45:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7fc0a8003270 con 0x7fc0b80a41a0 2026-02-22T23:28:04.890 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.877+0000 7fc0a5ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-22T23:28:04.891 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.877+0000 7fc0a5ffb640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-22T23:28:04.891 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.877+0000 7fc0a5ffb640 10 monclient(hunting): dump: 2026-02-22T23:28:04.891 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:28:04.891 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:28:04.891 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:04.891 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:04.891 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:28:04.891 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:28:04.891 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:28:04.891 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:28:04.891 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:28:04.891 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:28:04.891 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:28:04.891 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:28:04.891 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:28:04.891 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:28:04.891 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:28:04.891 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:04.891 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.877+0000 7fc0a5ffb640 1 -- 10.20.193.45:0/3684027174 <== mon.6 v1:10.20.193.45:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4234281487 0 0) 0x7fc0b81400d0 con 0x7fc0b80a4c90 2026-02-22T23:28:04.892 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.877+0000 7fc0a5ffb640 1 -- 10.20.193.45:0/3684027174 >> v1:10.20.193.73:6792/0 conn(0x7fc0b80a50a0 legacy=0x7fc0b81d7ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:04.892 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.877+0000 7fc0a5ffb640 1 -- 10.20.193.45:0/3684027174 >> v1:10.20.193.45:6790/0 conn(0x7fc0b80a41a0 legacy=0x7fc0b813d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:04.892 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.877+0000 7fc0a5ffb640 10 monclient: _finish_hunting 0 2026-02-22T23:28:04.892 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.877+0000 7fc0a5ffb640 1 monclient: found mon.d 2026-02-22T23:28:04.892 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.877+0000 7fc0a5ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T23:28:04.892 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.877+0000 7fc0a5ffb640 10 monclient: _send_mon_message to mon.d at v1:10.20.193.45:6792/0 2026-02-22T23:28:04.892 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.877+0000 7fc0a5ffb640 1 -- 10.20.193.45:0/3684027174 --> v1:10.20.193.45:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0b813fdf0 con 0x7fc0b80a4c90 2026-02-22T23:28:04.892 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.877+0000 7fc0a5ffb640 10 monclient: _finish_auth 0 2026-02-22T23:28:04.892 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.877+0000 7fc0a5ffb640 10 monclient: _check_auth_tickets 2026-02-22T23:28:04.892 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.877+0000 7fc0a5ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T23:28:04.892 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.877+0000 7fc0bf52c640 5 monclient: authenticate success, global_id 114171 2026-02-22T23:28:04.892 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.877+0000 7fc0bf52c640 10 monclient: _renew_subs 2026-02-22T23:28:04.892 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.877+0000 7fc0bf52c640 10 monclient: _send_mon_message to mon.d at v1:10.20.193.45:6792/0 2026-02-22T23:28:04.892 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.877+0000 7fc0bf52c640 1 -- 10.20.193.45:0/3684027174 --> v1:10.20.193.45:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fc0b813ef60 con 0x7fc0b80a4c90 2026-02-22T23:28:04.892 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.877+0000 7fc0a5ffb640 1 -- 10.20.193.45:0/3684027174 <== mon.6 v1:10.20.193.45:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc0ac0039c0 con 0x7fc0b80a4c90 2026-02-22T23:28:04.892 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.877+0000 7fc0a5ffb640 10 monclient: handle_config config(0 keys) 2026-02-22T23:28:04.892 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.877+0000 7fc0a5ffb640 1 -- 10.20.193.45:0/3684027174 <== mon.6 v1:10.20.193.45:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7fc0ac003eb0 con 0x7fc0b80a4c90 2026-02-22T23:28:04.892 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.877+0000 7fc0bf52c640 10 monclient: _renew_subs 2026-02-22T23:28:04.892 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.877+0000 7fc0bf52c640 10 monclient: _send_mon_message to mon.d at v1:10.20.193.45:6792/0 2026-02-22T23:28:04.893 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.877+0000 7fc0bf52c640 1 -- 10.20.193.45:0/3684027174 --> v1:10.20.193.45:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7fc0b80730b0 con 0x7fc0b80a4c90 2026-02-22T23:28:04.893 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.877+0000 7fc0a77fe640 4 set_mon_vals no callback set 2026-02-22T23:28:04.893 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.877+0000 7fc0a5ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:28:04.893 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.877+0000 7fc0a5ffb640 10 monclient: got monmap 1 from mon.d (according to old e1) 2026-02-22T23:28:04.893 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.877+0000 7fc0a5ffb640 10 monclient: dump: 2026-02-22T23:28:04.893 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:28:04.893 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:28:04.893 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:04.893 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:04.893 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:28:04.893 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:28:04.893 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:28:04.893 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:28:04.893 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:28:04.893 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:28:04.893 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:28:04.893 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:28:04.893 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:28:04.893 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:28:04.893 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:28:04.894 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:04.894 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.877+0000 7fc0bf52c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T23:28:04.894 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.877+0000 7fc0bf52c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T23:28:04.894 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.877+0000 7fc0bf52c640 10 monclient: _send_mon_message to mon.d at v1:10.20.193.45:6792/0 2026-02-22T23:28:04.894 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.877+0000 7fc0bf52c640 1 -- 10.20.193.45:0/3684027174 --> v1:10.20.193.45:6792/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc0b8073fd0 con 0x7fc0b80a4c90 2026-02-22T23:28:04.894 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.877+0000 7fc0a5ffb640 1 -- 10.20.193.45:0/3684027174 <== mon.6 v1:10.20.193.45:6792/0 7 ==== mgrmap(e 5) ==== 50225+0+0 (unknown 2330357642 0 0) 0x7fc0ac010490 con 0x7fc0b80a4c90 2026-02-22T23:28:04.894 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.878+0000 7fc0a5ffb640 1 -- 10.20.193.45:0/3684027174 <== mon.6 v1:10.20.193.45:6792/0 8 ==== osd_map(25..25 src has 1..25) ==== 3502+0+0 (unknown 129690100 0 0) 0x7fc0ac04cb00 con 0x7fc0b80a4c90 2026-02-22T23:28:04.894 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.878+0000 7fc0bd2a1640 10 monclient: get_auth_request con 0x7fc08803fe10 auth_method 0 2026-02-22T23:28:04.894 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.881+0000 7fc0a5ffb640 1 -- 10.20.193.45:0/3684027174 <== mon.6 v1:10.20.193.45:6792/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (unknown 1092875540 0 2568732696) 0x7fc0ac016640 con 0x7fc0b80a4c90 2026-02-22T23:28:04.894 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.881+0000 7fc0a5ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T23:28:04.894 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.881+0000 7fc0a5ffb640 10 monclient: _finish_command 1 = system:0 2026-02-22T23:28:04.999 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.997+0000 7fc0bf52c640 10 start_mon_command cmd=[{"prefix": "mon scrub"}] 2026-02-22T23:28:04.999 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.997+0000 7fc0bf52c640 10 monclient: _send_command 2 [{"prefix": "mon scrub"}] 2026-02-22T23:28:04.999 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.997+0000 7fc0bf52c640 10 monclient: _send_mon_message to mon.d at v1:10.20.193.45:6792/0 2026-02-22T23:28:04.999 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.997+0000 7fc0bf52c640 1 -- 10.20.193.45:0/3684027174 --> v1:10.20.193.45:6792/0 -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7fc0b806ea50 con 0x7fc0b80a4c90 2026-02-22T23:28:04.999 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.998+0000 7fc0a5ffb640 1 -- 10.20.193.45:0/3684027174 <== mon.6 v1:10.20.193.45:6792/0 10 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (unknown 246732539 0 0) 0x7fc0ac01a290 con 0x7fc0b80a4c90 2026-02-22T23:28:05.000 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.998+0000 7fc0a5ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "mon scrub"}] 2026-02-22T23:28:05.000 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.998+0000 7fc0a5ffb640 10 monclient: _finish_command 2 = system:0 2026-02-22T23:28:05.003 INFO:tasks.ceph.mon.e.trial045.stderr:2026-02-22T23:28:04.998+0000 7f0d047b0640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T23:28:05.004 INFO:tasks.ceph.mon.e.trial045.stderr:2026-02-22T23:28:04.998+0000 7f0d047b0640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {auth=16,config=2,health=12,kv=9,logm=61} crc {auth=3082488916,config=3140514009,health=2157093694,kv=2415979059,logm=751787059}) 2026-02-22T23:28:05.004 INFO:tasks.ceph.mon.e.trial045.stderr:2026-02-22T23:28:04.998+0000 7f0d047b0640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=17,config=2,health=11,kv=10,logm=60} crc {auth=2043835576,config=3140514009,health=1886805112,kv=2200975322,logm=78953991}) 2026-02-22T23:28:05.004 INFO:tasks.ceph.mon.e.trial045.stderr:2026-02-22T23:28:04.998+0000 7f0d047b0640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T23:28:05.004 INFO:tasks.ceph.mon.e.trial045.stderr:2026-02-22T23:28:04.998+0000 7f0d047b0640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {auth=16,config=2,health=12,kv=9,logm=61} crc {auth=3082488916,config=3140514009,health=2157093694,kv=2415979059,logm=751787059}) 2026-02-22T23:28:05.004 INFO:tasks.ceph.mon.e.trial045.stderr:2026-02-22T23:28:04.998+0000 7f0d047b0640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {auth=18,config=2,health=12,kv=9,logm=59} crc {auth=384318060,config=3140514009,health=2157093694,kv=277182096,logm=2481758423}) 2026-02-22T23:28:05.004 INFO:tasks.ceph.mon.e.trial045.stderr:2026-02-22T23:28:04.998+0000 7f0d047b0640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T23:28:05.004 INFO:tasks.ceph.mon.e.trial045.stderr:2026-02-22T23:28:04.998+0000 7f0d047b0640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {auth=16,config=2,health=12,kv=9,logm=61} crc {auth=3082488916,config=3140514009,health=2157093694,kv=2415979059,logm=751787059}) 2026-02-22T23:28:05.004 INFO:tasks.ceph.mon.e.trial045.stderr:2026-02-22T23:28:04.998+0000 7f0d047b0640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {auth=17,config=2,health=12,kv=8,logm=61} crc {auth=1155034314,config=3140514009,health=2157093694,kv=219917977,logm=3431694395}) 2026-02-22T23:28:05.004 INFO:tasks.ceph.mon.e.trial045.stderr:2026-02-22T23:28:04.998+0000 7f0d047b0640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T23:28:05.004 INFO:tasks.ceph.mon.e.trial045.stderr:2026-02-22T23:28:04.998+0000 7f0d047b0640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {auth=16,config=2,health=12,kv=9,logm=61} crc {auth=3082488916,config=3140514009,health=2157093694,kv=2415979059,logm=751787059}) 2026-02-22T23:28:05.005 INFO:tasks.ceph.mon.e.trial045.stderr:2026-02-22T23:28:04.998+0000 7f0d047b0640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {auth=17,config=2,health=12,kv=10,logm=59} crc {auth=2043835576,config=3140514009,health=2157093694,kv=2200975322,logm=3470759168}) 2026-02-22T23:28:05.005 INFO:tasks.ceph.mon.e.trial045.stderr:2026-02-22T23:28:04.998+0000 7f0d047b0640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T23:28:05.005 INFO:tasks.ceph.mon.e.trial045.stderr:2026-02-22T23:28:04.998+0000 7f0d047b0640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {auth=16,config=2,health=12,kv=9,logm=61} crc {auth=3082488916,config=3140514009,health=2157093694,kv=2415979059,logm=751787059}) 2026-02-22T23:28:05.005 INFO:tasks.ceph.mon.e.trial045.stderr:2026-02-22T23:28:04.998+0000 7f0d047b0640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {auth=17,config=2,health=11,kv=10,logm=60} crc {auth=1648988642,config=3140514009,health=2785302430,kv=2200975322,logm=1663831523}) 2026-02-22T23:28:05.005 INFO:tasks.ceph.mon.e.trial045.stderr:2026-02-22T23:28:04.998+0000 7f0d047b0640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T23:28:05.005 INFO:tasks.ceph.mon.e.trial045.stderr:2026-02-22T23:28:04.998+0000 7f0d047b0640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {auth=16,config=2,health=12,kv=9,logm=61} crc {auth=3082488916,config=3140514009,health=2157093694,kv=2415979059,logm=751787059}) 2026-02-22T23:28:05.005 INFO:tasks.ceph.mon.e.trial045.stderr:2026-02-22T23:28:04.998+0000 7f0d047b0640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {auth=18,config=1,health=12,kv=10,logm=59} crc {auth=384318060,config=1228700967,health=2157093694,kv=2200975322,logm=1727925313}) 2026-02-22T23:28:05.005 INFO:tasks.ceph.mon.e.trial045.stderr:2026-02-22T23:28:04.998+0000 7f0d047b0640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T23:28:05.005 INFO:tasks.ceph.mon.e.trial045.stderr:2026-02-22T23:28:04.998+0000 7f0d047b0640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {auth=16,config=2,health=12,kv=9,logm=61} crc {auth=3082488916,config=3140514009,health=2157093694,kv=2415979059,logm=751787059}) 2026-02-22T23:28:05.005 INFO:tasks.ceph.mon.e.trial045.stderr:2026-02-22T23:28:04.998+0000 7f0d047b0640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {auth=18,config=2,health=12,kv=9,logm=59} crc {auth=2690698819,config=3140514009,health=2157093694,kv=3563974125,logm=471905327}) 2026-02-22T23:28:05.005 INFO:tasks.ceph.mon.e.trial045.stderr:2026-02-22T23:28:04.998+0000 7f0d047b0640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T23:28:05.005 INFO:tasks.ceph.mon.e.trial045.stderr:2026-02-22T23:28:04.998+0000 7f0d047b0640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {auth=16,config=2,health=12,kv=9,logm=61} crc {auth=3082488916,config=3140514009,health=2157093694,kv=2415979059,logm=751787059}) 2026-02-22T23:28:05.005 INFO:tasks.ceph.mon.e.trial045.stderr:2026-02-22T23:28:04.998+0000 7f0d047b0640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {auth=16,config=2,health=12,kv=10,logm=60} crc {auth=2931364059,config=3140514009,health=2157093694,kv=2200975322,logm=3766139368}) 2026-02-22T23:28:05.006 INFO:tasks.ceph.mon.e.trial045.stderr:2026-02-22T23:28:04.999+0000 7f0d047b0640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T23:28:05.006 INFO:tasks.ceph.mon.e.trial045.stderr:2026-02-22T23:28:04.999+0000 7f0d047b0640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2908575898}) 2026-02-22T23:28:05.006 INFO:tasks.ceph.mon.e.trial045.stderr:2026-02-22T23:28:04.999+0000 7f0d047b0640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1032789803}) 2026-02-22T23:28:05.006 INFO:tasks.ceph.mon.e.trial045.stderr:2026-02-22T23:28:04.999+0000 7f0d047b0640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T23:28:05.006 INFO:tasks.ceph.mon.e.trial045.stderr:2026-02-22T23:28:04.999+0000 7f0d047b0640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2908575898}) 2026-02-22T23:28:05.006 INFO:tasks.ceph.mon.e.trial045.stderr:2026-02-22T23:28:04.999+0000 7f0d047b0640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=469197380}) 2026-02-22T23:28:05.006 INFO:tasks.ceph.mon.e.trial045.stderr:2026-02-22T23:28:04.999+0000 7f0d047b0640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T23:28:05.006 INFO:tasks.ceph.mon.e.trial045.stderr:2026-02-22T23:28:04.999+0000 7f0d047b0640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2908575898}) 2026-02-22T23:28:05.006 INFO:tasks.ceph.mon.e.trial045.stderr:2026-02-22T23:28:04.999+0000 7f0d047b0640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1630923313}) 2026-02-22T23:28:05.006 INFO:tasks.ceph.mon.e.trial045.stderr:2026-02-22T23:28:04.999+0000 7f0d047b0640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T23:28:05.006 INFO:tasks.ceph.mon.e.trial045.stderr:2026-02-22T23:28:04.999+0000 7f0d047b0640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2908575898}) 2026-02-22T23:28:05.006 INFO:tasks.ceph.mon.e.trial045.stderr:2026-02-22T23:28:04.999+0000 7f0d047b0640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2209953713}) 2026-02-22T23:28:05.006 INFO:tasks.ceph.mon.e.trial045.stderr:2026-02-22T23:28:04.999+0000 7f0d047b0640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T23:28:05.007 INFO:tasks.ceph.mon.e.trial045.stderr:2026-02-22T23:28:04.999+0000 7f0d047b0640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2908575898}) 2026-02-22T23:28:05.007 INFO:tasks.ceph.mon.e.trial045.stderr:2026-02-22T23:28:04.999+0000 7f0d047b0640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3269659854}) 2026-02-22T23:28:05.007 INFO:tasks.ceph.mon.e.trial045.stderr:2026-02-22T23:28:04.999+0000 7f0d047b0640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T23:28:05.007 INFO:tasks.ceph.mon.e.trial045.stderr:2026-02-22T23:28:04.999+0000 7f0d047b0640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2908575898}) 2026-02-22T23:28:05.007 INFO:tasks.ceph.mon.e.trial045.stderr:2026-02-22T23:28:04.999+0000 7f0d047b0640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3855230996}) 2026-02-22T23:28:05.007 INFO:tasks.ceph.mon.e.trial045.stderr:2026-02-22T23:28:04.999+0000 7f0d047b0640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T23:28:05.007 INFO:tasks.ceph.mon.e.trial045.stderr:2026-02-22T23:28:04.999+0000 7f0d047b0640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2908575898}) 2026-02-22T23:28:05.007 INFO:tasks.ceph.mon.e.trial045.stderr:2026-02-22T23:28:04.999+0000 7f0d047b0640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1600062291}) 2026-02-22T23:28:05.007 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.999+0000 7fc0bf52c640 1 -- 10.20.193.45:0/3684027174 >> v1:10.20.193.73:6800/2222410180 conn(0x7fc08803fe10 legacy=0x7fc0880422d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:05.008 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.999+0000 7fc0bf52c640 10 monclient: shutdown 2026-02-22T23:28:05.008 INFO:tasks.ceph.mon.e.trial045.stderr:2026-02-22T23:28:04.999+0000 7f0d047b0640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T23:28:05.008 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.999+0000 7fc0bf52c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T23:28:05.008 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.999+0000 7fc0bf52c640 1 -- 10.20.193.45:0/3684027174 >> v1:10.20.193.45:6792/0 conn(0x7fc0b80a4c90 legacy=0x7fc0b813de60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:05.009 INFO:tasks.ceph.mon.e.trial045.stderr:2026-02-22T23:28:04.999+0000 7f0d047b0640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2908575898}) 2026-02-22T23:28:05.009 INFO:tasks.ceph.mon.e.trial045.stderr:2026-02-22T23:28:04.999+0000 7f0d047b0640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1069050398}) 2026-02-22T23:28:05.009 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.999+0000 7fc0bf52c640 1 -- 10.20.193.45:0/3684027174 shutdown_connections 2026-02-22T23:28:05.010 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.999+0000 7fc0bf52c640 1 -- 10.20.193.45:0/3684027174 >> 10.20.193.45:0/3684027174 conn(0x7fc0b80a9720 msgr2=0x7fc0b80a8090 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:28:05.010 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.999+0000 7fc0bf52c640 1 -- 10.20.193.45:0/3684027174 shutdown_connections 2026-02-22T23:28:05.010 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:04.999+0000 7fc0bf52c640 1 -- 10.20.193.45:0/3684027174 wait complete. 2026-02-22T23:28:05.021 INFO:tasks.ceph.mon.e.trial045.stderr:2026-02-22T23:28:04.999+0000 7f0d047b0640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T23:28:05.021 INFO:tasks.ceph.mon.e.trial045.stderr:2026-02-22T23:28:04.999+0000 7f0d047b0640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1006901675}) 2026-02-22T23:28:05.021 INFO:tasks.ceph.mon.e.trial045.stderr:2026-02-22T23:28:04.999+0000 7f0d047b0640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3214809088}) 2026-02-22T23:28:05.021 INFO:tasks.ceph.mon.e.trial045.stderr:2026-02-22T23:28:04.999+0000 7f0d047b0640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T23:28:05.021 INFO:tasks.ceph.mon.e.trial045.stderr:2026-02-22T23:28:04.999+0000 7f0d047b0640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1006901675}) 2026-02-22T23:28:05.021 INFO:tasks.ceph.mon.e.trial045.stderr:2026-02-22T23:28:04.999+0000 7f0d047b0640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4000916687}) 2026-02-22T23:28:05.021 INFO:tasks.ceph.mon.e.trial045.stderr:2026-02-22T23:28:04.999+0000 7f0d047b0640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T23:28:05.021 INFO:tasks.ceph.mon.e.trial045.stderr:2026-02-22T23:28:04.999+0000 7f0d047b0640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1006901675}) 2026-02-22T23:28:05.022 INFO:tasks.ceph.mon.e.trial045.stderr:2026-02-22T23:28:04.999+0000 7f0d047b0640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1133764975}) 2026-02-22T23:28:05.022 INFO:tasks.ceph.mon.e.trial045.stderr:2026-02-22T23:28:04.999+0000 7f0d047b0640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T23:28:05.022 INFO:tasks.ceph.mon.e.trial045.stderr:2026-02-22T23:28:04.999+0000 7f0d047b0640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1006901675}) 2026-02-22T23:28:05.022 INFO:tasks.ceph.mon.e.trial045.stderr:2026-02-22T23:28:04.999+0000 7f0d047b0640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1526238235}) 2026-02-22T23:28:05.022 INFO:tasks.ceph.mon.e.trial045.stderr:2026-02-22T23:28:04.999+0000 7f0d047b0640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T23:28:05.022 INFO:tasks.ceph.mon.e.trial045.stderr:2026-02-22T23:28:04.999+0000 7f0d047b0640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1006901675}) 2026-02-22T23:28:05.022 INFO:tasks.ceph.mon.e.trial045.stderr:2026-02-22T23:28:04.999+0000 7f0d047b0640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=487033000}) 2026-02-22T23:28:05.022 INFO:tasks.ceph.mon.e.trial045.stderr:2026-02-22T23:28:04.999+0000 7f0d047b0640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T23:28:05.022 INFO:tasks.ceph.mon.e.trial045.stderr:2026-02-22T23:28:04.999+0000 7f0d047b0640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1006901675}) 2026-02-22T23:28:05.022 INFO:tasks.ceph.mon.e.trial045.stderr:2026-02-22T23:28:04.999+0000 7f0d047b0640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=126884748}) 2026-02-22T23:28:05.022 INFO:tasks.ceph.mon.e.trial045.stderr:2026-02-22T23:28:04.999+0000 7f0d047b0640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T23:28:05.022 INFO:tasks.ceph.mon.e.trial045.stderr:2026-02-22T23:28:04.999+0000 7f0d047b0640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1006901675}) 2026-02-22T23:28:05.023 INFO:tasks.ceph.mon.e.trial045.stderr:2026-02-22T23:28:04.999+0000 7f0d047b0640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1180413267}) 2026-02-22T23:28:05.023 INFO:tasks.ceph.mon.e.trial045.stderr:2026-02-22T23:28:04.999+0000 7f0d047b0640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T23:28:05.023 INFO:tasks.ceph.mon.e.trial045.stderr:2026-02-22T23:28:04.999+0000 7f0d047b0640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1006901675}) 2026-02-22T23:28:05.023 INFO:tasks.ceph.mon.e.trial045.stderr:2026-02-22T23:28:04.999+0000 7f0d047b0640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1746597042}) 2026-02-22T23:28:05.023 INFO:tasks.ceph.mon.e.trial045.stderr:2026-02-22T23:28:05.000+0000 7f0d047b0640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T23:28:05.023 INFO:tasks.ceph.mon.e.trial045.stderr:2026-02-22T23:28:05.000+0000 7f0d047b0640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2128964216}) 2026-02-22T23:28:05.023 INFO:tasks.ceph.mon.e.trial045.stderr:2026-02-22T23:28:05.000+0000 7f0d047b0640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2346505149}) 2026-02-22T23:28:05.023 INFO:tasks.ceph.mon.e.trial045.stderr:2026-02-22T23:28:05.000+0000 7f0d047b0640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T23:28:05.023 INFO:tasks.ceph.mon.e.trial045.stderr:2026-02-22T23:28:05.000+0000 7f0d047b0640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2128964216}) 2026-02-22T23:28:05.023 INFO:tasks.ceph.mon.e.trial045.stderr:2026-02-22T23:28:05.000+0000 7f0d047b0640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2214125321}) 2026-02-22T23:28:05.023 INFO:tasks.ceph.mon.e.trial045.stderr:2026-02-22T23:28:05.000+0000 7f0d047b0640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T23:28:05.023 INFO:tasks.ceph.mon.e.trial045.stderr:2026-02-22T23:28:05.000+0000 7f0d047b0640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2128964216}) 2026-02-22T23:28:05.024 INFO:tasks.ceph.mon.e.trial045.stderr:2026-02-22T23:28:05.000+0000 7f0d047b0640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2646769360}) 2026-02-22T23:28:05.024 INFO:tasks.ceph.mon.e.trial045.stderr:2026-02-22T23:28:05.000+0000 7f0d047b0640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T23:28:05.024 INFO:tasks.ceph.mon.e.trial045.stderr:2026-02-22T23:28:05.000+0000 7f0d047b0640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2128964216}) 2026-02-22T23:28:05.024 INFO:tasks.ceph.mon.e.trial045.stderr:2026-02-22T23:28:05.000+0000 7f0d047b0640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2762265501}) 2026-02-22T23:28:05.024 INFO:tasks.ceph.mon.e.trial045.stderr:2026-02-22T23:28:05.000+0000 7f0d047b0640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T23:28:05.024 INFO:tasks.ceph.mon.e.trial045.stderr:2026-02-22T23:28:05.000+0000 7f0d047b0640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2128964216}) 2026-02-22T23:28:05.024 INFO:tasks.ceph.mon.e.trial045.stderr:2026-02-22T23:28:05.000+0000 7f0d047b0640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3175573597}) 2026-02-22T23:28:05.024 INFO:tasks.ceph.mon.e.trial045.stderr:2026-02-22T23:28:05.000+0000 7f0d047b0640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T23:28:05.024 INFO:tasks.ceph.mon.e.trial045.stderr:2026-02-22T23:28:05.000+0000 7f0d047b0640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2128964216}) 2026-02-22T23:28:05.024 INFO:tasks.ceph.mon.e.trial045.stderr:2026-02-22T23:28:05.000+0000 7f0d047b0640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1750100360}) 2026-02-22T23:28:05.024 INFO:tasks.ceph.mon.e.trial045.stderr:2026-02-22T23:28:05.000+0000 7f0d047b0640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T23:28:05.025 INFO:tasks.ceph.mon.e.trial045.stderr:2026-02-22T23:28:05.000+0000 7f0d047b0640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2128964216}) 2026-02-22T23:28:05.025 INFO:tasks.ceph.mon.e.trial045.stderr:2026-02-22T23:28:05.000+0000 7f0d047b0640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3899828760}) 2026-02-22T23:28:05.025 INFO:tasks.ceph.mon.e.trial045.stderr:2026-02-22T23:28:05.000+0000 7f0d047b0640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T23:28:05.025 INFO:tasks.ceph.mon.e.trial045.stderr:2026-02-22T23:28:05.000+0000 7f0d047b0640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2128964216}) 2026-02-22T23:28:05.025 INFO:tasks.ceph.mon.e.trial045.stderr:2026-02-22T23:28:05.000+0000 7f0d047b0640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1137519209}) 2026-02-22T23:28:05.025 INFO:tasks.ceph.mon.e.trial045.stderr:2026-02-22T23:28:05.001+0000 7f0d047b0640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T23:28:05.025 INFO:tasks.ceph.mon.e.trial045.stderr:2026-02-22T23:28:05.001+0000 7f0d047b0640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1416246530}) 2026-02-22T23:28:05.025 INFO:tasks.ceph.mon.e.trial045.stderr:2026-02-22T23:28:05.001+0000 7f0d047b0640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2519980847}) 2026-02-22T23:28:05.025 INFO:tasks.ceph.mon.e.trial045.stderr:2026-02-22T23:28:05.001+0000 7f0d047b0640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T23:28:05.025 INFO:tasks.ceph.mon.e.trial045.stderr:2026-02-22T23:28:05.001+0000 7f0d047b0640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1416246530}) 2026-02-22T23:28:05.025 INFO:tasks.ceph.mon.e.trial045.stderr:2026-02-22T23:28:05.001+0000 7f0d047b0640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2752330323}) 2026-02-22T23:28:05.025 INFO:tasks.ceph.mon.e.trial045.stderr:2026-02-22T23:28:05.001+0000 7f0d047b0640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T23:28:05.025 INFO:tasks.ceph.mon.e.trial045.stderr:2026-02-22T23:28:05.001+0000 7f0d047b0640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1416246530}) 2026-02-22T23:28:05.026 INFO:tasks.ceph.mon.e.trial045.stderr:2026-02-22T23:28:05.001+0000 7f0d047b0640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=428323596}) 2026-02-22T23:28:05.026 INFO:tasks.ceph.mon.e.trial045.stderr:2026-02-22T23:28:05.001+0000 7f0d047b0640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T23:28:05.026 INFO:tasks.ceph.mon.e.trial045.stderr:2026-02-22T23:28:05.001+0000 7f0d047b0640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1416246530}) 2026-02-22T23:28:05.026 INFO:tasks.ceph.mon.e.trial045.stderr:2026-02-22T23:28:05.001+0000 7f0d047b0640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3065390581}) 2026-02-22T23:28:05.026 INFO:tasks.ceph.mon.e.trial045.stderr:2026-02-22T23:28:05.001+0000 7f0d047b0640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T23:28:05.026 INFO:tasks.ceph.mon.e.trial045.stderr:2026-02-22T23:28:05.001+0000 7f0d047b0640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1416246530}) 2026-02-22T23:28:05.026 INFO:tasks.ceph.mon.e.trial045.stderr:2026-02-22T23:28:05.001+0000 7f0d047b0640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3512796836}) 2026-02-22T23:28:05.026 INFO:tasks.ceph.mon.e.trial045.stderr:2026-02-22T23:28:05.001+0000 7f0d047b0640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T23:28:05.026 INFO:tasks.ceph.mon.e.trial045.stderr:2026-02-22T23:28:05.001+0000 7f0d047b0640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1416246530}) 2026-02-22T23:28:05.026 INFO:tasks.ceph.mon.e.trial045.stderr:2026-02-22T23:28:05.001+0000 7f0d047b0640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1956117463}) 2026-02-22T23:28:05.026 INFO:tasks.ceph.mon.e.trial045.stderr:2026-02-22T23:28:05.001+0000 7f0d047b0640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T23:28:05.026 INFO:tasks.ceph.mon.e.trial045.stderr:2026-02-22T23:28:05.001+0000 7f0d047b0640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1416246530}) 2026-02-22T23:28:05.027 INFO:tasks.ceph.mon.e.trial045.stderr:2026-02-22T23:28:05.001+0000 7f0d047b0640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=193348311}) 2026-02-22T23:28:05.027 INFO:tasks.ceph.mon.e.trial045.stderr:2026-02-22T23:28:05.001+0000 7f0d047b0640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T23:28:05.027 INFO:tasks.ceph.mon.e.trial045.stderr:2026-02-22T23:28:05.001+0000 7f0d047b0640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1416246530}) 2026-02-22T23:28:05.027 INFO:tasks.ceph.mon.e.trial045.stderr:2026-02-22T23:28:05.001+0000 7f0d047b0640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3632212900}) 2026-02-22T23:28:05.027 INFO:tasks.ceph.mon.e.trial045.stderr:2026-02-22T23:28:05.001+0000 7f0d047b0640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T23:28:05.027 INFO:tasks.ceph.mon.e.trial045.stderr:2026-02-22T23:28:05.001+0000 7f0d047b0640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3617060603}) 2026-02-22T23:28:05.027 INFO:tasks.ceph.mon.e.trial045.stderr:2026-02-22T23:28:05.001+0000 7f0d047b0640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3666916581}) 2026-02-22T23:28:05.027 INFO:tasks.ceph.mon.e.trial045.stderr:2026-02-22T23:28:05.001+0000 7f0d047b0640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T23:28:05.027 INFO:tasks.ceph.mon.e.trial045.stderr:2026-02-22T23:28:05.001+0000 7f0d047b0640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3617060603}) 2026-02-22T23:28:05.027 INFO:tasks.ceph.mon.e.trial045.stderr:2026-02-22T23:28:05.001+0000 7f0d047b0640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2424895735}) 2026-02-22T23:28:05.027 INFO:tasks.ceph.mon.e.trial045.stderr:2026-02-22T23:28:05.001+0000 7f0d047b0640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T23:28:05.027 INFO:tasks.ceph.mon.e.trial045.stderr:2026-02-22T23:28:05.001+0000 7f0d047b0640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3617060603}) 2026-02-22T23:28:05.027 INFO:tasks.ceph.mon.e.trial045.stderr:2026-02-22T23:28:05.001+0000 7f0d047b0640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1465068623}) 2026-02-22T23:28:05.027 INFO:tasks.ceph.mon.e.trial045.stderr:2026-02-22T23:28:05.001+0000 7f0d047b0640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T23:28:05.028 INFO:tasks.ceph.mon.e.trial045.stderr:2026-02-22T23:28:05.001+0000 7f0d047b0640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3617060603}) 2026-02-22T23:28:05.028 INFO:tasks.ceph.mon.e.trial045.stderr:2026-02-22T23:28:05.001+0000 7f0d047b0640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3737308392}) 2026-02-22T23:28:05.028 INFO:tasks.ceph.mon.e.trial045.stderr:2026-02-22T23:28:05.001+0000 7f0d047b0640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T23:28:05.028 INFO:tasks.ceph.mon.e.trial045.stderr:2026-02-22T23:28:05.001+0000 7f0d047b0640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3617060603}) 2026-02-22T23:28:05.028 INFO:tasks.ceph.mon.e.trial045.stderr:2026-02-22T23:28:05.001+0000 7f0d047b0640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3103427514}) 2026-02-22T23:28:05.028 INFO:tasks.ceph.mon.e.trial045.stderr:2026-02-22T23:28:05.001+0000 7f0d047b0640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T23:28:05.028 INFO:tasks.ceph.mon.e.trial045.stderr:2026-02-22T23:28:05.001+0000 7f0d047b0640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3617060603}) 2026-02-22T23:28:05.028 INFO:tasks.ceph.mon.e.trial045.stderr:2026-02-22T23:28:05.001+0000 7f0d047b0640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3792510168}) 2026-02-22T23:28:05.028 INFO:tasks.ceph.mon.e.trial045.stderr:2026-02-22T23:28:05.001+0000 7f0d047b0640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T23:28:05.028 INFO:tasks.ceph.mon.e.trial045.stderr:2026-02-22T23:28:05.001+0000 7f0d047b0640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3617060603}) 2026-02-22T23:28:05.028 INFO:tasks.ceph.mon.e.trial045.stderr:2026-02-22T23:28:05.001+0000 7f0d047b0640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=495940339}) 2026-02-22T23:28:05.028 INFO:tasks.ceph.mon.e.trial045.stderr:2026-02-22T23:28:05.001+0000 7f0d047b0640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T23:28:05.028 INFO:tasks.ceph.mon.e.trial045.stderr:2026-02-22T23:28:05.001+0000 7f0d047b0640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3617060603}) 2026-02-22T23:28:05.029 INFO:tasks.ceph.mon.e.trial045.stderr:2026-02-22T23:28:05.001+0000 7f0d047b0640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3328824320}) 2026-02-22T23:28:05.029 INFO:tasks.ceph.mon.e.trial045.stderr:2026-02-22T23:28:05.002+0000 7f0d047b0640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T23:28:05.029 INFO:tasks.ceph.mon.e.trial045.stderr:2026-02-22T23:28:05.002+0000 7f0d047b0640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3396908073}) 2026-02-22T23:28:05.029 INFO:tasks.ceph.mon.e.trial045.stderr:2026-02-22T23:28:05.002+0000 7f0d047b0640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=746271963}) 2026-02-22T23:28:05.029 INFO:tasks.ceph.mon.e.trial045.stderr:2026-02-22T23:28:05.002+0000 7f0d047b0640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T23:28:05.029 INFO:tasks.ceph.mon.e.trial045.stderr:2026-02-22T23:28:05.002+0000 7f0d047b0640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3396908073}) 2026-02-22T23:28:05.029 INFO:tasks.ceph.mon.e.trial045.stderr:2026-02-22T23:28:05.002+0000 7f0d047b0640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1204415982}) 2026-02-22T23:28:05.029 INFO:tasks.ceph.mon.e.trial045.stderr:2026-02-22T23:28:05.002+0000 7f0d047b0640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T23:28:05.029 INFO:tasks.ceph.mon.e.trial045.stderr:2026-02-22T23:28:05.002+0000 7f0d047b0640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3396908073}) 2026-02-22T23:28:05.029 INFO:tasks.ceph.mon.e.trial045.stderr:2026-02-22T23:28:05.002+0000 7f0d047b0640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1297071867}) 2026-02-22T23:28:05.029 INFO:tasks.ceph.mon.e.trial045.stderr:2026-02-22T23:28:05.002+0000 7f0d047b0640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T23:28:05.029 INFO:tasks.ceph.mon.e.trial045.stderr:2026-02-22T23:28:05.002+0000 7f0d047b0640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3396908073}) 2026-02-22T23:28:05.029 INFO:tasks.ceph.mon.e.trial045.stderr:2026-02-22T23:28:05.002+0000 7f0d047b0640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3722385028}) 2026-02-22T23:28:05.030 INFO:tasks.ceph.mon.e.trial045.stderr:2026-02-22T23:28:05.002+0000 7f0d047b0640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T23:28:05.030 INFO:tasks.ceph.mon.e.trial045.stderr:2026-02-22T23:28:05.002+0000 7f0d047b0640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3396908073}) 2026-02-22T23:28:05.030 INFO:tasks.ceph.mon.e.trial045.stderr:2026-02-22T23:28:05.002+0000 7f0d047b0640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1526993719}) 2026-02-22T23:28:05.030 INFO:tasks.ceph.mon.e.trial045.stderr:2026-02-22T23:28:05.002+0000 7f0d047b0640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T23:28:05.030 INFO:tasks.ceph.mon.e.trial045.stderr:2026-02-22T23:28:05.002+0000 7f0d047b0640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3396908073}) 2026-02-22T23:28:05.030 INFO:tasks.ceph.mon.e.trial045.stderr:2026-02-22T23:28:05.002+0000 7f0d047b0640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1170580973}) 2026-02-22T23:28:05.030 INFO:tasks.ceph.mon.e.trial045.stderr:2026-02-22T23:28:05.002+0000 7f0d047b0640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T23:28:05.030 INFO:tasks.ceph.mon.e.trial045.stderr:2026-02-22T23:28:05.002+0000 7f0d047b0640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3396908073}) 2026-02-22T23:28:05.030 INFO:tasks.ceph.mon.e.trial045.stderr:2026-02-22T23:28:05.002+0000 7f0d047b0640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3814252271}) 2026-02-22T23:28:05.030 INFO:tasks.ceph.mon.e.trial045.stderr:2026-02-22T23:28:05.002+0000 7f0d047b0640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T23:28:05.030 INFO:tasks.ceph.mon.e.trial045.stderr:2026-02-22T23:28:05.002+0000 7f0d047b0640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3396908073}) 2026-02-22T23:28:05.030 INFO:tasks.ceph.mon.e.trial045.stderr:2026-02-22T23:28:05.002+0000 7f0d047b0640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=90325979}) 2026-02-22T23:28:05.030 INFO:tasks.ceph.mon.e.trial045.stderr:2026-02-22T23:28:05.003+0000 7f0d047b0640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T23:28:05.031 INFO:tasks.ceph.mon.e.trial045.stderr:2026-02-22T23:28:05.003+0000 7f0d047b0640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=8,mdsmap=2,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=11,mon_config_key=6,monmap=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=51} crc {logm=479829213,mdsmap=3819642919,mgr=1157176685,mgr_command_descs=1238205435,mgr_metadata=832914645,mgrstat=2692499279,mon_config_key=527349381,monmap=1476910738,osd_metadata=2960800,osd_pg_creating=3251506115,osd_snap=4133920409,osdmap=3408709396}) 2026-02-22T23:28:05.031 INFO:tasks.ceph.mon.e.trial045.stderr:2026-02-22T23:28:05.003+0000 7f0d047b0640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=9,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=11,mon_config_key=7,monmap=2,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=49} crc {logm=4155079542,mdsmap=1141921480,mgr=1709481728,mgr_command_descs=1238205435,mgr_metadata=832914645,mgrstat=2692499279,mon_config_key=2968337929,monmap=3140514009,osd_metadata=2960800,osd_pg_creating=3251506115,osd_snap=4133920409,osdmap=3963113279}) 2026-02-22T23:28:05.031 INFO:tasks.ceph.mon.e.trial045.stderr:2026-02-22T23:28:05.003+0000 7f0d047b0640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T23:28:05.031 INFO:tasks.ceph.mon.e.trial045.stderr:2026-02-22T23:28:05.003+0000 7f0d047b0640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=8,mdsmap=2,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=11,mon_config_key=6,monmap=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=51} crc {logm=479829213,mdsmap=3819642919,mgr=1157176685,mgr_command_descs=1238205435,mgr_metadata=832914645,mgrstat=2692499279,mon_config_key=527349381,monmap=1476910738,osd_metadata=2960800,osd_pg_creating=3251506115,osd_snap=4133920409,osdmap=3408709396}) 2026-02-22T23:28:05.031 INFO:tasks.ceph.mon.e.trial045.stderr:2026-02-22T23:28:05.003+0000 7f0d047b0640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=9,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=11,mon_config_key=6,monmap=2,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=50} crc {logm=4155079542,mdsmap=1141921480,mgr=1165502731,mgr_command_descs=1238205435,mgr_metadata=832914645,mgrstat=2692499279,mon_config_key=3668594138,monmap=3140514009,osd_metadata=2960800,osd_pg_creating=3251506115,osd_snap=4133920409,osdmap=241616978}) 2026-02-22T23:28:05.031 INFO:tasks.ceph.mon.e.trial045.stderr:2026-02-22T23:28:05.003+0000 7f0d047b0640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T23:28:05.031 INFO:tasks.ceph.mon.e.trial045.stderr:2026-02-22T23:28:05.003+0000 7f0d047b0640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=8,mdsmap=2,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=11,mon_config_key=6,monmap=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=51} crc {logm=479829213,mdsmap=3819642919,mgr=1157176685,mgr_command_descs=1238205435,mgr_metadata=832914645,mgrstat=2692499279,mon_config_key=527349381,monmap=1476910738,osd_metadata=2960800,osd_pg_creating=3251506115,osd_snap=4133920409,osdmap=3408709396}) 2026-02-22T23:28:05.031 INFO:tasks.ceph.mon.e.trial045.stderr:2026-02-22T23:28:05.003+0000 7f0d047b0640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=9,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=10,mon_config_key=6,monmap=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=48} crc {logm=4155079542,mdsmap=1141921480,mgr=1165502731,mgr_command_descs=1238205435,mgr_metadata=832914645,mgrstat=2222212080,mon_config_key=527349381,monmap=1476910738,osd_metadata=2960800,osd_pg_creating=3251506115,osd_snap=4133920409,osdmap=2780422045}) 2026-02-22T23:28:05.031 INFO:tasks.ceph.mon.e.trial045.stderr:2026-02-22T23:28:05.003+0000 7f0d047b0640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T23:28:05.031 INFO:tasks.ceph.mon.e.trial045.stderr:2026-02-22T23:28:05.003+0000 7f0d047b0640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=8,mdsmap=2,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=11,mon_config_key=6,monmap=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=51} crc {logm=479829213,mdsmap=3819642919,mgr=1157176685,mgr_command_descs=1238205435,mgr_metadata=832914645,mgrstat=2692499279,mon_config_key=527349381,monmap=1476910738,osd_metadata=2960800,osd_pg_creating=3251506115,osd_snap=4133920409,osdmap=3408709396}) 2026-02-22T23:28:05.031 INFO:tasks.ceph.mon.e.trial045.stderr:2026-02-22T23:28:05.003+0000 7f0d047b0640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=9,mdsmap=2,mgr=7,mgr_command_descs=1,mgrstat=10,mon_config_key=7,monmap=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=52} crc {logm=4155079542,mdsmap=3140514009,mgr=613453916,mgr_command_descs=1238205435,mgrstat=1778396074,mon_config_key=2968337929,monmap=1476910738,osd_metadata=2960800,osd_pg_creating=3251506115,osd_snap=4133920409,osdmap=3798620757}) 2026-02-22T23:28:05.031 INFO:tasks.ceph.mon.e.trial045.stderr:2026-02-22T23:28:05.003+0000 7f0d047b0640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T23:28:05.031 INFO:tasks.ceph.mon.e.trial045.stderr:2026-02-22T23:28:05.003+0000 7f0d047b0640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=8,mdsmap=2,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=11,mon_config_key=6,monmap=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=51} crc {logm=479829213,mdsmap=3819642919,mgr=1157176685,mgr_command_descs=1238205435,mgr_metadata=832914645,mgrstat=2692499279,mon_config_key=527349381,monmap=1476910738,osd_metadata=2960800,osd_pg_creating=3251506115,osd_snap=4133920409,osdmap=3408709396}) 2026-02-22T23:28:05.032 INFO:tasks.ceph.mon.e.trial045.stderr:2026-02-22T23:28:05.003+0000 7f0d047b0640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=8,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=11,mon_config_key=6,monmap=2,osd_metadata=5,osd_pg_creating=1,osd_snap=2,osdmap=48} crc {logm=479829213,mdsmap=1141921480,mgr=1165502731,mgr_command_descs=1238205435,mgr_metadata=832914645,mgrstat=2692499279,mon_config_key=3720701295,monmap=3140514009,osd_metadata=1788250845,osd_pg_creating=3251506115,osd_snap=4133920409,osdmap=1708882787}) 2026-02-22T23:28:05.032 INFO:tasks.ceph.mon.e.trial045.stderr:2026-02-22T23:28:05.003+0000 7f0d047b0640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T23:28:05.032 INFO:tasks.ceph.mon.e.trial045.stderr:2026-02-22T23:28:05.003+0000 7f0d047b0640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=8,mdsmap=2,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=11,mon_config_key=6,monmap=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=51} crc {logm=479829213,mdsmap=3819642919,mgr=1157176685,mgr_command_descs=1238205435,mgr_metadata=832914645,mgrstat=2692499279,mon_config_key=527349381,monmap=1476910738,osd_metadata=2960800,osd_pg_creating=3251506115,osd_snap=4133920409,osdmap=3408709396}) 2026-02-22T23:28:05.032 INFO:tasks.ceph.mon.e.trial045.stderr:2026-02-22T23:28:05.003+0000 7f0d047b0640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=9,mdsmap=3,mgr=8,mgr_command_descs=1,mgrstat=10,mon_config_key=7,monmap=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=50} crc {logm=4155079542,mdsmap=1141921480,mgr=1165502731,mgr_command_descs=1238205435,mgrstat=1276242533,mon_config_key=2968337929,monmap=1476910738,osd_metadata=2960800,osd_pg_creating=3251506115,osd_snap=4133920409,osdmap=1741912142}) 2026-02-22T23:28:05.032 INFO:tasks.ceph.mon.e.trial045.stderr:2026-02-22T23:28:05.003+0000 7f0d047b0640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T23:28:05.032 INFO:tasks.ceph.mon.e.trial045.stderr:2026-02-22T23:28:05.003+0000 7f0d047b0640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=8,mdsmap=2,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=11,mon_config_key=6,monmap=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=51} crc {logm=479829213,mdsmap=3819642919,mgr=1157176685,mgr_command_descs=1238205435,mgr_metadata=832914645,mgrstat=2692499279,mon_config_key=527349381,monmap=1476910738,osd_metadata=2960800,osd_pg_creating=3251506115,osd_snap=4133920409,osdmap=3408709396}) 2026-02-22T23:28:05.032 INFO:tasks.ceph.mon.e.trial045.stderr:2026-02-22T23:28:05.003+0000 7f0d047b0640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=8,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=10,mon_config_key=6,monmap=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=49} crc {logm=1118130001,mdsmap=1141921480,mgr=1165502731,mgr_command_descs=1238205435,mgr_metadata=832914645,mgrstat=119943602,mon_config_key=527349382,monmap=1476910738,osd_metadata=2960800,osd_pg_creating=3251506115,osd_snap=4133920409,osdmap=1020879541}) 2026-02-22T23:28:05.032 INFO:tasks.ceph.mon.e.trial045.stderr:2026-02-22T23:28:05.003+0000 7f0d047b0640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T23:28:05.032 INFO:tasks.ceph.mon.e.trial045.stderr:2026-02-22T23:28:05.003+0000 7f0d047b0640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=8,mdsmap=2,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=11,mon_config_key=6,monmap=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=51} crc {logm=479829213,mdsmap=3819642919,mgr=1157176685,mgr_command_descs=1238205435,mgr_metadata=832914645,mgrstat=2692499279,mon_config_key=527349381,monmap=1476910738,osd_metadata=2960800,osd_pg_creating=3251506115,osd_snap=4133920409,osdmap=3408709396}) 2026-02-22T23:28:05.032 INFO:tasks.ceph.mon.e.trial045.stderr:2026-02-22T23:28:05.003+0000 7f0d047b0640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=9,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=10,mon_config_key=7,monmap=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=49} crc {logm=4155079542,mdsmap=1141921480,mgr=1165502731,mgr_command_descs=1238205435,mgr_metadata=832914645,mgrstat=119943602,mon_config_key=2968337929,monmap=1476910738,osd_metadata=2960800,osd_pg_creating=3251506115,osd_snap=4133920409,osdmap=3919010798}) 2026-02-22T23:28:05.033 INFO:tasks.mon_thrash.mon_thrasher:waiting for 1.0 secs before continuing thrashing 2026-02-22T23:28:06.034 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 9 2026-02-22T23:28:06.035 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-22T23:28:06.103 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.101+0000 7f85273fe640 10 monclient: get_monmap_and_config 2026-02-22T23:28:06.104 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.101+0000 7f85273fe640 10 monclient: build_initial_monmap 2026-02-22T23:28:06.104 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.101+0000 7f85273fe640 10 monclient: monmap: 2026-02-22T23:28:06.104 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-22T23:28:06.104 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:28:06.104 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:28:06.103155+0000 2026-02-22T23:28:06.104 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:28:06.103155+0000 2026-02-22T23:28:06.104 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-22T23:28:06.104 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:28:06.104 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-22T23:28:06.104 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.noname-f 2026-02-22T23:28:06.104 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.noname-b 2026-02-22T23:28:06.104 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.noname-g 2026-02-22T23:28:06.104 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.noname-c 2026-02-22T23:28:06.105 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.noname-h 2026-02-22T23:28:06.105 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.noname-d 2026-02-22T23:28:06.105 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.noname-i 2026-02-22T23:28:06.105 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.noname-e 2026-02-22T23:28:06.105 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:06.105 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.102+0000 7f85273fe640 1 Processor -- start 2026-02-22T23:28:06.105 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.102+0000 7f85273fe640 1 -- start start 2026-02-22T23:28:06.105 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.102+0000 7f85273fe640 10 monclient: init 2026-02-22T23:28:06.112 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.102+0000 7f85273fe640 10 monclient: _reopen_session rank -1 2026-02-22T23:28:06.112 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.102+0000 7f85273fe640 10 monclient: _add_conns ranks=[1,0,5,3,8,4,7,6,2] 2026-02-22T23:28:06.112 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.102+0000 7f85273fe640 10 monclient(hunting): picked mon.noname-f con 0x7f85200a5e00 addr v1:10.20.193.73:6789/0 2026-02-22T23:28:06.112 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.102+0000 7f85273fe640 10 monclient(hunting): picked mon.noname-a con 0x7f85200a68f0 addr v1:10.20.193.45:6789/0 2026-02-22T23:28:06.112 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.102+0000 7f85273fe640 10 monclient(hunting): picked mon.noname-h con 0x7f85200a6d00 addr v1:10.20.193.73:6791/0 2026-02-22T23:28:06.112 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.102+0000 7f85273fe640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f85200a2d00 con 0x7f85200a68f0 2026-02-22T23:28:06.113 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.102+0000 7f85273fe640 1 -- --> v1:10.20.193.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f85200a2fe0 con 0x7f85200a5e00 2026-02-22T23:28:06.113 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.102+0000 7f85273fe640 1 -- --> v1:10.20.193.73:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f85200a32c0 con 0x7f85200a6d00 2026-02-22T23:28:06.113 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.102+0000 7f85273fe640 10 monclient(hunting): _renew_subs 2026-02-22T23:28:06.113 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.102+0000 7f85273fe640 10 monclient(hunting): authenticate will time out at 817.719762s 2026-02-22T23:28:06.113 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.102+0000 7f8524972640 1 --1- >> v1:10.20.193.45:6789/0 conn(0x7f85200a68f0 0x7f852013e080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.45:6789/0 says I am v1:10.20.193.45:38452/0 (socket says 10.20.193.45:38452) 2026-02-22T23:28:06.113 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.102+0000 7f8524972640 1 -- 10.20.193.45:0/2326308595 learned_addr learned my addr 10.20.193.45:0/2326308595 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-22T23:28:06.113 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.102+0000 7f850ffff640 1 -- 10.20.193.45:0/2326308595 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3234455211 0 0) 0x7f85200a2d00 con 0x7f85200a68f0 2026-02-22T23:28:06.113 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.102+0000 7f850ffff640 10 monclient(hunting): _negotiate 2026-02-22T23:28:06.113 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.102+0000 7f850ffff640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:28:06.113 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.102+0000 7f850ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:28:06.113 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.102+0000 7f850ffff640 10 monclient(hunting): my global_id is 4635 2026-02-22T23:28:06.113 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.103+0000 7f850ffff640 1 -- 10.20.193.45:0/2326308595 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8508003620 con 0x7f85200a68f0 2026-02-22T23:28:06.114 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.103+0000 7f850ffff640 1 -- 10.20.193.45:0/2326308595 <== mon.0 v1:10.20.193.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4271416006 0 0) 0x7f8508003620 con 0x7f85200a68f0 2026-02-22T23:28:06.114 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.103+0000 7f850ffff640 1 -- 10.20.193.45:0/2326308595 >> v1:10.20.193.73:6791/0 conn(0x7f85200a6d00 legacy=0x7f85201417b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T23:28:06.114 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.103+0000 7f850ffff640 1 -- 10.20.193.45:0/2326308595 >> v1:10.20.193.73:6789/0 conn(0x7f85200a5e00 legacy=0x7f85200a61e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:06.114 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.103+0000 7f850ffff640 10 monclient: _finish_hunting 0 2026-02-22T23:28:06.114 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.103+0000 7f850ffff640 1 monclient: found mon.noname-a 2026-02-22T23:28:06.114 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.103+0000 7f850ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T23:28:06.114 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.103+0000 7f850ffff640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.45:6789/0 2026-02-22T23:28:06.114 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.103+0000 7f850ffff640 1 -- 10.20.193.45:0/2326308595 --> v1:10.20.193.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85200a35a0 con 0x7f85200a68f0 2026-02-22T23:28:06.114 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.103+0000 7f850ffff640 10 monclient: _finish_auth 0 2026-02-22T23:28:06.114 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.103+0000 7f850ffff640 10 monclient: _check_auth_tickets 2026-02-22T23:28:06.114 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.103+0000 7f850ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T23:28:06.115 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.103+0000 7f850ffff640 1 -- 10.20.193.45:0/2326308595 <== mon.0 v1:10.20.193.45:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f8514003040 con 0x7f85200a68f0 2026-02-22T23:28:06.115 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.103+0000 7f850ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:28:06.115 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.103+0000 7f850ffff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T23:28:06.115 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.103+0000 7f850ffff640 10 monclient: dump: 2026-02-22T23:28:06.115 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:28:06.115 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:28:06.115 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:06.115 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:06.115 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:28:06.115 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:28:06.115 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:28:06.116 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:28:06.116 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:28:06.116 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:28:06.116 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:28:06.116 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:28:06.116 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:28:06.116 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:28:06.116 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:28:06.116 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:06.116 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.103+0000 7f85273fe640 5 monclient: authenticate success, global_id 4635 2026-02-22T23:28:06.116 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.103+0000 7f85273fe640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-22T23:28:06.116 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.103+0000 7f850ffff640 1 -- 10.20.193.45:0/2326308595 <== mon.0 v1:10.20.193.45:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f85140032a0 con 0x7f85200a68f0 2026-02-22T23:28:06.117 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.103+0000 7f850ffff640 10 monclient: handle_config config(0 keys) 2026-02-22T23:28:06.117 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.103+0000 7f850ffff640 1 -- 10.20.193.45:0/2326308595 <== mon.0 v1:10.20.193.45:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f8514003550 con 0x7f85200a68f0 2026-02-22T23:28:06.117 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.103+0000 7f850ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:28:06.117 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.103+0000 7f850ffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T23:28:06.117 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.103+0000 7f850ffff640 10 monclient: dump: 2026-02-22T23:28:06.117 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:28:06.117 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:28:06.117 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:06.117 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:06.117 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:28:06.117 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:28:06.117 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:28:06.117 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:28:06.118 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:28:06.118 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:28:06.118 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:28:06.118 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:28:06.118 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:28:06.118 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:28:06.118 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:28:06.118 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:06.118 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.103+0000 7f85273fe640 10 monclient: get_monmap_and_config success 2026-02-22T23:28:06.118 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.103+0000 7f85273fe640 4 set_mon_vals no callback set 2026-02-22T23:28:06.118 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.103+0000 7f85273fe640 10 monclient: shutdown 2026-02-22T23:28:06.118 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.103+0000 7f85273fe640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T23:28:06.119 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.103+0000 7f85273fe640 1 -- 10.20.193.45:0/2326308595 >> v1:10.20.193.45:6789/0 conn(0x7f85200a68f0 legacy=0x7f852013e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:06.119 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.103+0000 7f85273fe640 1 -- 10.20.193.45:0/2326308595 shutdown_connections 2026-02-22T23:28:06.119 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.103+0000 7f85273fe640 1 -- 10.20.193.45:0/2326308595 >> 10.20.193.45:0/2326308595 conn(0x7f85200abb50 msgr2=0x7f85200a7f00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:28:06.119 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.103+0000 7f85273fe640 1 -- 10.20.193.45:0/2326308595 shutdown_connections 2026-02-22T23:28:06.119 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.103+0000 7f85273fe640 1 -- 10.20.193.45:0/2326308595 wait complete. 2026-02-22T23:28:06.119 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.103+0000 7f85273fe640 10 monclient: build_initial_monmap 2026-02-22T23:28:06.119 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.103+0000 7f85273fe640 10 monclient: monmap: 2026-02-22T23:28:06.119 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-22T23:28:06.119 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T23:28:06.119 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-22T23:28:06.119 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-22T23:28:06.119 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-22T23:28:06.119 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-22T23:28:06.120 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-22T23:28:06.120 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.noname-f 2026-02-22T23:28:06.120 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.noname-b 2026-02-22T23:28:06.120 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.noname-g 2026-02-22T23:28:06.120 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.noname-c 2026-02-22T23:28:06.120 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.noname-h 2026-02-22T23:28:06.120 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.noname-d 2026-02-22T23:28:06.120 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.noname-i 2026-02-22T23:28:06.120 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.noname-e 2026-02-22T23:28:06.120 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:06.120 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.104+0000 7f85273fe640 1 Processor -- start 2026-02-22T23:28:06.120 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.104+0000 7f85273fe640 1 -- start start 2026-02-22T23:28:06.120 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.104+0000 7f85273fe640 10 monclient: init 2026-02-22T23:28:06.121 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.104+0000 7f85273fe640 10 monclient: _reopen_session rank -1 2026-02-22T23:28:06.121 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.104+0000 7f85273fe640 10 monclient: _add_conns ranks=[1,6,3,8,5,2,0,7,4] 2026-02-22T23:28:06.121 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.104+0000 7f85273fe640 10 monclient(hunting): picked mon.noname-f con 0x7f85200a5e00 addr v1:10.20.193.73:6789/0 2026-02-22T23:28:06.121 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.104+0000 7f85273fe640 10 monclient(hunting): picked mon.noname-d con 0x7f85200a68f0 addr v1:10.20.193.45:6792/0 2026-02-22T23:28:06.121 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.104+0000 7f85273fe640 10 monclient(hunting): picked mon.noname-g con 0x7f85200a6d00 addr v1:10.20.193.73:6790/0 2026-02-22T23:28:06.121 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.104+0000 7f85273fe640 1 -- --> v1:10.20.193.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f85201293f0 con 0x7f85200a5e00 2026-02-22T23:28:06.121 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.104+0000 7f85273fe640 1 -- --> v1:10.20.193.73:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f85200aa110 con 0x7f85200a6d00 2026-02-22T23:28:06.121 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.104+0000 7f85273fe640 1 -- --> v1:10.20.193.45:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f85200a9be0 con 0x7f85200a68f0 2026-02-22T23:28:06.121 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.104+0000 7f85273fe640 10 monclient(hunting): _renew_subs 2026-02-22T23:28:06.121 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.104+0000 7f85273fe640 10 monclient(hunting): authenticate will time out at 817.721460s 2026-02-22T23:28:06.121 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.104+0000 7f8524972640 1 --1- >> v1:10.20.193.45:6792/0 conn(0x7f85200a68f0 0x7f8520125de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.45:6792/0 says I am v1:10.20.193.45:36806/0 (socket says 10.20.193.45:36806) 2026-02-22T23:28:06.122 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.104+0000 7f8524972640 1 -- 10.20.193.45:0/249044186 learned_addr learned my addr 10.20.193.45:0/249044186 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-22T23:28:06.122 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.104+0000 7f850dffb640 1 -- 10.20.193.45:0/249044186 <== mon.6 v1:10.20.193.45:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3889785146 0 0) 0x7f85200a9be0 con 0x7f85200a68f0 2026-02-22T23:28:06.122 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.104+0000 7f850dffb640 10 monclient(hunting): _negotiate 2026-02-22T23:28:06.122 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.104+0000 7f850dffb640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:28:06.122 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.104+0000 7f850dffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:28:06.122 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.104+0000 7f850dffb640 10 monclient(hunting): my global_id is 114180 2026-02-22T23:28:06.122 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.104+0000 7f850dffb640 1 -- 10.20.193.45:0/249044186 --> v1:10.20.193.45:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f84f0003620 con 0x7f85200a68f0 2026-02-22T23:28:06.122 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.104+0000 7f850dffb640 1 -- 10.20.193.45:0/249044186 <== mon.6 v1:10.20.193.45:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 467115955 0 0) 0x7f84f0003620 con 0x7f85200a68f0 2026-02-22T23:28:06.122 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.104+0000 7f850dffb640 1 -- 10.20.193.45:0/249044186 --> v1:10.20.193.45:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f85200a9be0 con 0x7f85200a68f0 2026-02-22T23:28:06.122 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.104+0000 7f850dffb640 1 -- 10.20.193.45:0/249044186 <== mon.6 v1:10.20.193.45:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f8514003000 con 0x7f85200a68f0 2026-02-22T23:28:06.122 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.104+0000 7f850dffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-22T23:28:06.122 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.104+0000 7f850dffb640 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2026-02-22T23:28:06.122 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.104+0000 7f850dffb640 10 monclient(hunting): dump: 2026-02-22T23:28:06.123 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:28:06.123 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:28:06.123 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:06.123 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:06.123 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:28:06.123 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:28:06.123 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:28:06.123 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:28:06.123 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:28:06.123 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:28:06.123 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:28:06.123 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:28:06.124 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:28:06.124 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:28:06.124 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:28:06.124 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:06.124 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.104+0000 7f850dffb640 10 monclient(hunting): _finish_auth 0 2026-02-22T23:28:06.124 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.104+0000 7f850dffb640 1 -- 10.20.193.45:0/249044186 <== mon.6 v1:10.20.193.45:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2870731872 0 0) 0x7f85200a9be0 con 0x7f85200a68f0 2026-02-22T23:28:06.124 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.104+0000 7f850dffb640 1 -- 10.20.193.45:0/249044186 >> v1:10.20.193.73:6790/0 conn(0x7f85200a6d00 legacy=0x7f85201d7d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:06.124 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.104+0000 7f850dffb640 1 -- 10.20.193.45:0/249044186 >> v1:10.20.193.73:6789/0 conn(0x7f85200a5e00 legacy=0x7f85201256d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:06.124 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.104+0000 7f850dffb640 10 monclient: _finish_hunting 0 2026-02-22T23:28:06.124 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.104+0000 7f850dffb640 1 monclient: found mon.d 2026-02-22T23:28:06.124 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.104+0000 7f850dffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T23:28:06.124 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.104+0000 7f850dffb640 10 monclient: _send_mon_message to mon.d at v1:10.20.193.45:6792/0 2026-02-22T23:28:06.124 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.104+0000 7f850dffb640 1 -- 10.20.193.45:0/249044186 --> v1:10.20.193.45:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85200a1be0 con 0x7f85200a68f0 2026-02-22T23:28:06.125 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.104+0000 7f850dffb640 10 monclient: _finish_auth 0 2026-02-22T23:28:06.125 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.104+0000 7f850dffb640 10 monclient: _check_auth_tickets 2026-02-22T23:28:06.125 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.104+0000 7f850dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T23:28:06.125 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.104+0000 7f85273fe640 5 monclient: authenticate success, global_id 114180 2026-02-22T23:28:06.125 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.104+0000 7f85273fe640 10 monclient: _renew_subs 2026-02-22T23:28:06.125 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.104+0000 7f85273fe640 10 monclient: _send_mon_message to mon.d at v1:10.20.193.45:6792/0 2026-02-22T23:28:06.125 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.104+0000 7f85273fe640 1 -- 10.20.193.45:0/249044186 --> v1:10.20.193.45:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f85201279b0 con 0x7f85200a68f0 2026-02-22T23:28:06.125 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.104+0000 7f85273fe640 10 monclient: _renew_subs 2026-02-22T23:28:06.125 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.104+0000 7f85273fe640 10 monclient: _send_mon_message to mon.d at v1:10.20.193.45:6792/0 2026-02-22T23:28:06.125 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.104+0000 7f85273fe640 1 -- 10.20.193.45:0/249044186 --> v1:10.20.193.45:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7f8520129110 con 0x7f85200a68f0 2026-02-22T23:28:06.126 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.104+0000 7f850dffb640 1 -- 10.20.193.45:0/249044186 <== mon.6 v1:10.20.193.45:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f85140032a0 con 0x7f85200a68f0 2026-02-22T23:28:06.126 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.104+0000 7f850dffb640 10 monclient: handle_config config(0 keys) 2026-02-22T23:28:06.126 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.104+0000 7f850dffb640 1 -- 10.20.193.45:0/249044186 <== mon.6 v1:10.20.193.45:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f85140034d0 con 0x7f85200a68f0 2026-02-22T23:28:06.126 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.104+0000 7f850dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:28:06.126 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.104+0000 7f850f7fe640 4 set_mon_vals no callback set 2026-02-22T23:28:06.126 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.104+0000 7f850dffb640 10 monclient: got monmap 1 from mon.d (according to old e1) 2026-02-22T23:28:06.126 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.104+0000 7f850dffb640 10 monclient: dump: 2026-02-22T23:28:06.126 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:28:06.126 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:28:06.126 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:06.126 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:06.126 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:28:06.126 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:28:06.127 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:28:06.127 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:28:06.127 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:28:06.127 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:28:06.127 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:28:06.127 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:28:06.127 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:28:06.127 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:28:06.127 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:28:06.127 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:06.127 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.105+0000 7f85273fe640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T23:28:06.127 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.105+0000 7f85273fe640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T23:28:06.127 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.105+0000 7f85273fe640 10 monclient: _send_mon_message to mon.d at v1:10.20.193.45:6792/0 2026-02-22T23:28:06.128 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.105+0000 7f85273fe640 1 -- 10.20.193.45:0/249044186 --> v1:10.20.193.45:6792/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8520069720 con 0x7f85200a68f0 2026-02-22T23:28:06.128 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.105+0000 7f850dffb640 1 -- 10.20.193.45:0/249044186 <== mon.6 v1:10.20.193.45:6792/0 7 ==== mgrmap(e 5) ==== 50225+0+0 (unknown 2330357642 0 0) 0x7f8514011870 con 0x7f85200a68f0 2026-02-22T23:28:06.128 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.105+0000 7f850dffb640 1 -- 10.20.193.45:0/249044186 <== mon.6 v1:10.20.193.45:6792/0 8 ==== osd_map(25..25 src has 1..25) ==== 3502+0+0 (unknown 129690100 0 0) 0x7f851404dcc0 con 0x7f85200a68f0 2026-02-22T23:28:06.128 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.105+0000 7f8525173640 10 monclient: get_auth_request con 0x7f84f003f6d0 auth_method 0 2026-02-22T23:28:06.128 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.108+0000 7f850dffb640 1 -- 10.20.193.45:0/249044186 <== mon.6 v1:10.20.193.45:6792/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (unknown 1092875540 0 2568732696) 0x7f8514017920 con 0x7f85200a68f0 2026-02-22T23:28:06.128 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.108+0000 7f850dffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T23:28:06.128 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.108+0000 7f850dffb640 10 monclient: _finish_command 1 = system:0 2026-02-22T23:28:06.224 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.222+0000 7f85273fe640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-22T23:28:06.224 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.222+0000 7f85273fe640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-22T23:28:06.224 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.222+0000 7f85273fe640 10 monclient: _send_mon_message to mon.d at v1:10.20.193.45:6792/0 2026-02-22T23:28:06.224 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.222+0000 7f85273fe640 1 -- 10.20.193.45:0/249044186 --> v1:10.20.193.45:6792/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f852006ce10 con 0x7f85200a68f0 2026-02-22T23:28:06.224 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.222+0000 7f850dffb640 1 -- 10.20.193.45:0/249044186 <== mon.6 v1:10.20.193.45:6792/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+2713 (unknown 254746657 0 3624651796) 0x7f8514017220 con 0x7f85200a68f0 2026-02-22T23:28:06.224 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.222+0000 7f850dffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-22T23:28:06.224 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.222+0000 7f850dffb640 10 monclient: _finish_command 2 = system:0 2026-02-22T23:28:06.224 INFO:teuthology.orchestra.run.trial045.stdout:{"election_epoch":28,"quorum":[0,1,2,3,4,5,6,7,8],"quorum_names":["a","f","b","g","c","h","d","i","e"],"quorum_leader_name":"e","quorum_age":2,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"4b60f18f-6660-4731-b731-dc85c4078413","modified":"2026-02-22T23:24:52.393472Z","created":"2026-02-22T23:24:52.393472Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":3,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.45:6789","nonce":0}]},"addr":"10.20.193.45:6789/0","public_addr":"10.20.193.45:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.73:6789","nonce":0}]},"addr":"10.20.193.73:6789/0","public_addr":"10.20.193.73:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.45:6790","nonce":0}]},"addr":"10.20.193.45:6790/0","public_addr":"10.20.193.45:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.73:6790","nonce":0}]},"addr":"10.20.193.73:6790/0","public_addr":"10.20.193.73:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.45:6791","nonce":0}]},"addr":"10.20.193.45:6791/0","public_addr":"10.20.193.45:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.73:6791","nonce":0}]},"addr":"10.20.193.73:6791/0","public_addr":"10.20.193.73:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.45:6792","nonce":0}]},"addr":"10.20.193.45:6792/0","public_addr":"10.20.193.45:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.73:6792","nonce":0}]},"addr":"10.20.193.73:6792/0","public_addr":"10.20.193.73:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.45:6793","nonce":0}]},"addr":"10.20.193.45:6793/0","public_addr":"10.20.193.45:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-22T23:28:06.225 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.223+0000 7f85273fe640 1 -- 10.20.193.45:0/249044186 >> v1:10.20.193.73:6800/2222410180 conn(0x7f84f003f6d0 legacy=0x7f84f0041b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:06.225 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.223+0000 7f85273fe640 10 monclient: shutdown 2026-02-22T23:28:06.225 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.223+0000 7f85273fe640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T23:28:06.225 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.223+0000 7f85273fe640 1 -- 10.20.193.45:0/249044186 >> v1:10.20.193.45:6792/0 conn(0x7f85200a68f0 legacy=0x7f8520125de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:06.225 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.223+0000 7f85273fe640 1 -- 10.20.193.45:0/249044186 shutdown_connections 2026-02-22T23:28:06.225 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.223+0000 7f85273fe640 1 -- 10.20.193.45:0/249044186 >> 10.20.193.45:0/249044186 conn(0x7f85200abb50 msgr2=0x7f8520142380 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:28:06.225 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.223+0000 7f85273fe640 1 -- 10.20.193.45:0/249044186 shutdown_connections 2026-02-22T23:28:06.225 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.223+0000 7f85273fe640 1 -- 10.20.193.45:0/249044186 wait complete. 2026-02-22T23:28:06.232 INFO:tasks.mon_thrash.ceph_manager:quorum is size 9 2026-02-22T23:28:06.232 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2026-02-22T23:28:06.243 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2026-02-22T23:28:06.243 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-22T23:28:06.312 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.310+0000 7fa8e7fff640 10 monclient: get_monmap_and_config 2026-02-22T23:28:06.312 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.310+0000 7fa8e7fff640 10 monclient: build_initial_monmap 2026-02-22T23:28:06.312 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.310+0000 7fa8e7fff640 10 monclient: monmap: 2026-02-22T23:28:06.312 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-22T23:28:06.312 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:28:06.313 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:28:06.311698+0000 2026-02-22T23:28:06.313 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:28:06.311698+0000 2026-02-22T23:28:06.313 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-22T23:28:06.313 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:28:06.313 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-22T23:28:06.313 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.noname-f 2026-02-22T23:28:06.313 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.noname-b 2026-02-22T23:28:06.313 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.noname-g 2026-02-22T23:28:06.313 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.noname-c 2026-02-22T23:28:06.313 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.noname-h 2026-02-22T23:28:06.313 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.noname-d 2026-02-22T23:28:06.313 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.noname-i 2026-02-22T23:28:06.313 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.noname-e 2026-02-22T23:28:06.313 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:06.314 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.310+0000 7fa8e7fff640 1 Processor -- start 2026-02-22T23:28:06.314 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.310+0000 7fa8e7fff640 1 -- start start 2026-02-22T23:28:06.314 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.310+0000 7fa8e7fff640 10 monclient: init 2026-02-22T23:28:06.321 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.311+0000 7fa8e7fff640 10 monclient: _reopen_session rank -1 2026-02-22T23:28:06.322 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.311+0000 7fa8e7fff640 10 monclient: _add_conns ranks=[8,1,4,2,3,0,6,5,7] 2026-02-22T23:28:06.322 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.311+0000 7fa8e7fff640 10 monclient(hunting): picked mon.noname-e con 0x7fa8e80a4a90 addr v1:10.20.193.45:6793/0 2026-02-22T23:28:06.322 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.311+0000 7fa8e7fff640 10 monclient(hunting): picked mon.noname-f con 0x7fa8e806d4e0 addr v1:10.20.193.73:6789/0 2026-02-22T23:28:06.322 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.311+0000 7fa8e7fff640 10 monclient(hunting): picked mon.noname-c con 0x7fa8e80a5580 addr v1:10.20.193.45:6791/0 2026-02-22T23:28:06.322 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.311+0000 7fa8e7fff640 1 -- --> v1:10.20.193.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa8e80a02c0 con 0x7fa8e806d4e0 2026-02-22T23:28:06.322 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.311+0000 7fa8e7fff640 1 -- --> v1:10.20.193.45:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa8e8074840 con 0x7fa8e80a5580 2026-02-22T23:28:06.322 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.311+0000 7fa8e7fff640 1 -- --> v1:10.20.193.45:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa8e806e510 con 0x7fa8e80a4a90 2026-02-22T23:28:06.322 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.311+0000 7fa8e7fff640 10 monclient(hunting): _renew_subs 2026-02-22T23:28:06.322 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.311+0000 7fa8e7fff640 10 monclient(hunting): authenticate will time out at 817.928364s 2026-02-22T23:28:06.322 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.311+0000 7fa8e6ffd640 1 --1- >> v1:10.20.193.45:6793/0 conn(0x7fa8e80a4a90 0x7fa8e80a4e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.45:6793/0 says I am v1:10.20.193.45:41046/0 (socket says 10.20.193.45:41046) 2026-02-22T23:28:06.322 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.311+0000 7fa8e6ffd640 1 -- 10.20.193.45:0/65120243 learned_addr learned my addr 10.20.193.45:0/65120243 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-22T23:28:06.322 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.311+0000 7fa8e5ffb640 1 -- 10.20.193.45:0/65120243 <== mon.4 v1:10.20.193.45:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1115150294 0 0) 0x7fa8e8074840 con 0x7fa8e80a5580 2026-02-22T23:28:06.322 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.311+0000 7fa8e5ffb640 10 monclient(hunting): _negotiate 2026-02-22T23:28:06.323 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.311+0000 7fa8e5ffb640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:28:06.323 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.311+0000 7fa8e5ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:28:06.323 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.311+0000 7fa8e5ffb640 10 monclient(hunting): my global_id is 114178 2026-02-22T23:28:06.323 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.311+0000 7fa8e5ffb640 1 -- 10.20.193.45:0/65120243 --> v1:10.20.193.45:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa8d4003620 con 0x7fa8e80a5580 2026-02-22T23:28:06.323 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.311+0000 7fa8e5ffb640 1 -- 10.20.193.45:0/65120243 <== mon.8 v1:10.20.193.45:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1699870550 0 0) 0x7fa8e806e510 con 0x7fa8e80a4a90 2026-02-22T23:28:06.323 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.311+0000 7fa8e5ffb640 10 monclient(hunting): _negotiate 2026-02-22T23:28:06.323 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.311+0000 7fa8e5ffb640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:28:06.323 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.311+0000 7fa8e5ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:28:06.323 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.311+0000 7fa8e5ffb640 10 monclient(hunting): my global_id is 4670 2026-02-22T23:28:06.323 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.311+0000 7fa8e5ffb640 1 -- 10.20.193.45:0/65120243 --> v1:10.20.193.45:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa8e8074840 con 0x7fa8e80a4a90 2026-02-22T23:28:06.323 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.311+0000 7fa8e5ffb640 1 -- 10.20.193.45:0/65120243 <== mon.8 v1:10.20.193.45:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3714544474 0 0) 0x7fa8e8074840 con 0x7fa8e80a4a90 2026-02-22T23:28:06.323 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.311+0000 7fa8e5ffb640 1 -- 10.20.193.45:0/65120243 >> v1:10.20.193.45:6791/0 conn(0x7fa8e80a5580 legacy=0x7fa8e81416a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:06.323 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.311+0000 7fa8e5ffb640 1 -- 10.20.193.45:0/65120243 >> v1:10.20.193.73:6789/0 conn(0x7fa8e806d4e0 legacy=0x7fa8e813df70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:06.324 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.311+0000 7fa8e5ffb640 10 monclient: _finish_hunting 0 2026-02-22T23:28:06.324 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.311+0000 7fa8e5ffb640 1 monclient: found mon.noname-e 2026-02-22T23:28:06.324 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.311+0000 7fa8e5ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T23:28:06.324 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.311+0000 7fa8e5ffb640 10 monclient: _send_mon_message to mon.noname-e at v1:10.20.193.45:6793/0 2026-02-22T23:28:06.324 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.311+0000 7fa8e5ffb640 1 -- 10.20.193.45:0/65120243 --> v1:10.20.193.45:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8e806d220 con 0x7fa8e80a4a90 2026-02-22T23:28:06.324 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.311+0000 7fa8e5ffb640 10 monclient: _finish_auth 0 2026-02-22T23:28:06.324 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.311+0000 7fa8e5ffb640 10 monclient: _check_auth_tickets 2026-02-22T23:28:06.324 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.311+0000 7fa8e5ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T23:28:06.324 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.311+0000 7fa8e5ffb640 1 -- 10.20.193.45:0/65120243 <== mon.8 v1:10.20.193.45:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7fa8dc002fa0 con 0x7fa8e80a4a90 2026-02-22T23:28:06.324 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.311+0000 7fa8e5ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:28:06.324 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.311+0000 7fa8e5ffb640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2026-02-22T23:28:06.324 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.311+0000 7fa8e5ffb640 10 monclient: dump: 2026-02-22T23:28:06.324 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:28:06.324 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:28:06.325 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:06.325 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:06.325 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:28:06.325 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:28:06.325 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:28:06.325 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:28:06.325 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:28:06.325 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:28:06.325 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:28:06.325 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:28:06.325 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:28:06.325 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:28:06.325 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:28:06.325 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:06.326 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.311+0000 7fa8e7fff640 5 monclient: authenticate success, global_id 4670 2026-02-22T23:28:06.326 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.311+0000 7fa8e7fff640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-22T23:28:06.326 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.311+0000 7fa8e5ffb640 1 -- 10.20.193.45:0/65120243 <== mon.8 v1:10.20.193.45:6793/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa8dc003140 con 0x7fa8e80a4a90 2026-02-22T23:28:06.326 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.311+0000 7fa8e5ffb640 10 monclient: handle_config config(0 keys) 2026-02-22T23:28:06.326 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.311+0000 7fa8e5ffb640 1 -- 10.20.193.45:0/65120243 <== mon.8 v1:10.20.193.45:6793/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7fa8dc004ce0 con 0x7fa8e80a4a90 2026-02-22T23:28:06.326 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.311+0000 7fa8e7fff640 10 monclient: get_monmap_and_config success 2026-02-22T23:28:06.326 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.311+0000 7fa8e5ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:28:06.326 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.311+0000 7fa8e7fff640 4 set_mon_vals no callback set 2026-02-22T23:28:06.326 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.311+0000 7fa8e5ffb640 10 monclient: got monmap 1 from mon.e (according to old e1) 2026-02-22T23:28:06.326 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.311+0000 7fa8e5ffb640 10 monclient: dump: 2026-02-22T23:28:06.326 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:28:06.327 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:28:06.327 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:06.327 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:06.327 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:28:06.327 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:28:06.327 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:28:06.327 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:28:06.327 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:28:06.327 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:28:06.327 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:28:06.327 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:28:06.327 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:28:06.327 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:28:06.327 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:28:06.327 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:06.328 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.312+0000 7fa8e7fff640 10 monclient: shutdown 2026-02-22T23:28:06.328 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.312+0000 7fa8e7fff640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T23:28:06.328 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.312+0000 7fa8e7fff640 1 -- 10.20.193.45:0/65120243 >> v1:10.20.193.45:6793/0 conn(0x7fa8e80a4a90 legacy=0x7fa8e80a4e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:06.328 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.312+0000 7fa8e7fff640 1 -- 10.20.193.45:0/65120243 shutdown_connections 2026-02-22T23:28:06.328 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.312+0000 7fa8e7fff640 1 -- 10.20.193.45:0/65120243 >> 10.20.193.45:0/65120243 conn(0x7fa8e80a96e0 msgr2=0x7fa8e80a5b80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:28:06.328 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.312+0000 7fa8e7fff640 1 -- 10.20.193.45:0/65120243 shutdown_connections 2026-02-22T23:28:06.328 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.312+0000 7fa8e7fff640 1 -- 10.20.193.45:0/65120243 wait complete. 2026-02-22T23:28:06.328 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.312+0000 7fa8e7fff640 10 monclient: build_initial_monmap 2026-02-22T23:28:06.328 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.312+0000 7fa8e7fff640 10 monclient: monmap: 2026-02-22T23:28:06.328 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-22T23:28:06.328 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T23:28:06.328 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-22T23:28:06.328 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-22T23:28:06.328 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-22T23:28:06.329 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-22T23:28:06.329 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-22T23:28:06.329 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.noname-f 2026-02-22T23:28:06.329 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.noname-b 2026-02-22T23:28:06.329 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.noname-g 2026-02-22T23:28:06.329 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.noname-c 2026-02-22T23:28:06.329 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.noname-h 2026-02-22T23:28:06.329 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.noname-d 2026-02-22T23:28:06.329 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.noname-i 2026-02-22T23:28:06.329 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.noname-e 2026-02-22T23:28:06.329 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:06.329 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.312+0000 7fa8e7fff640 1 Processor -- start 2026-02-22T23:28:06.329 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.312+0000 7fa8e7fff640 1 -- start start 2026-02-22T23:28:06.330 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.312+0000 7fa8e7fff640 10 monclient: init 2026-02-22T23:28:06.330 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.313+0000 7fa8e7fff640 10 monclient: _reopen_session rank -1 2026-02-22T23:28:06.330 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.313+0000 7fa8e7fff640 10 monclient: _add_conns ranks=[4,8,1,7,2,6,3,0,5] 2026-02-22T23:28:06.330 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.313+0000 7fa8e7fff640 10 monclient(hunting): picked mon.noname-c con 0x7fa8e806d4e0 addr v1:10.20.193.45:6791/0 2026-02-22T23:28:06.330 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.313+0000 7fa8e7fff640 10 monclient(hunting): picked mon.noname-e con 0x7fa8e80a4a90 addr v1:10.20.193.45:6793/0 2026-02-22T23:28:06.330 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.313+0000 7fa8e7fff640 10 monclient(hunting): picked mon.noname-f con 0x7fa8e80a5580 addr v1:10.20.193.73:6789/0 2026-02-22T23:28:06.330 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.313+0000 7fa8e7fff640 1 -- --> v1:10.20.193.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa8e80a2780 con 0x7fa8e80a5580 2026-02-22T23:28:06.330 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.313+0000 7fa8e7fff640 1 -- --> v1:10.20.193.45:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa8e80a4260 con 0x7fa8e806d4e0 2026-02-22T23:28:06.330 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.313+0000 7fa8e7fff640 1 -- --> v1:10.20.193.45:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa8e8141ef0 con 0x7fa8e80a4a90 2026-02-22T23:28:06.330 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.313+0000 7fa8e7fff640 10 monclient(hunting): _renew_subs 2026-02-22T23:28:06.330 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.313+0000 7fa8e7fff640 10 monclient(hunting): authenticate will time out at 817.930171s 2026-02-22T23:28:06.330 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.313+0000 7fa8e6ffd640 1 --1- >> v1:10.20.193.45:6791/0 conn(0x7fa8e806d4e0 0x7fa8e81417e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.45:6791/0 says I am v1:10.20.193.45:57746/0 (socket says 10.20.193.45:57746) 2026-02-22T23:28:06.330 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.313+0000 7fa8e6ffd640 1 -- 10.20.193.45:0/4089231078 learned_addr learned my addr 10.20.193.45:0/4089231078 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-22T23:28:06.330 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.313+0000 7fa8bffff640 1 -- 10.20.193.45:0/4089231078 <== mon.8 v1:10.20.193.45:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2107189193 0 0) 0x7fa8e80a02c0 con 0x7fa8e80a4a90 2026-02-22T23:28:06.331 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.313+0000 7fa8bffff640 10 monclient(hunting): _negotiate 2026-02-22T23:28:06.331 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.313+0000 7fa8bffff640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:28:06.331 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.313+0000 7fa8bffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:28:06.331 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.313+0000 7fa8bffff640 10 monclient(hunting): my global_id is 4679 2026-02-22T23:28:06.331 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.313+0000 7fa8bffff640 1 -- 10.20.193.45:0/4089231078 --> v1:10.20.193.45:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa8b8003620 con 0x7fa8e80a4a90 2026-02-22T23:28:06.331 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.313+0000 7fa8bffff640 1 -- 10.20.193.45:0/4089231078 <== mon.4 v1:10.20.193.45:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2251316401 0 0) 0x7fa8e806d220 con 0x7fa8e806d4e0 2026-02-22T23:28:06.331 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.313+0000 7fa8bffff640 10 monclient(hunting): _negotiate 2026-02-22T23:28:06.331 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.313+0000 7fa8bffff640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:28:06.331 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.313+0000 7fa8bffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:28:06.331 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.313+0000 7fa8bffff640 10 monclient(hunting): my global_id is 114187 2026-02-22T23:28:06.331 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.313+0000 7fa8bffff640 1 -- 10.20.193.45:0/4089231078 --> v1:10.20.193.45:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa8e80a02c0 con 0x7fa8e806d4e0 2026-02-22T23:28:06.331 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.313+0000 7fa8bffff640 1 -- 10.20.193.45:0/4089231078 <== mon.8 v1:10.20.193.45:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 840234724 0 0) 0x7fa8b8003620 con 0x7fa8e80a4a90 2026-02-22T23:28:06.331 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.313+0000 7fa8bffff640 1 -- 10.20.193.45:0/4089231078 --> v1:10.20.193.45:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa8e806d220 con 0x7fa8e80a4a90 2026-02-22T23:28:06.331 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.313+0000 7fa8bffff640 1 -- 10.20.193.45:0/4089231078 <== mon.4 v1:10.20.193.45:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 52177613 0 0) 0x7fa8e80a02c0 con 0x7fa8e806d4e0 2026-02-22T23:28:06.332 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.313+0000 7fa8bffff640 1 -- 10.20.193.45:0/4089231078 --> v1:10.20.193.45:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa8b8003620 con 0x7fa8e806d4e0 2026-02-22T23:28:06.332 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.313+0000 7fa8bffff640 1 -- 10.20.193.45:0/4089231078 <== mon.4 v1:10.20.193.45:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7fa8dc0048e0 con 0x7fa8e806d4e0 2026-02-22T23:28:06.332 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.313+0000 7fa8bffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-22T23:28:06.332 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.313+0000 7fa8bffff640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-22T23:28:06.332 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.313+0000 7fa8bffff640 10 monclient(hunting): dump: 2026-02-22T23:28:06.332 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:28:06.332 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:28:06.332 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:06.332 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:06.332 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:28:06.332 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:28:06.332 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:28:06.332 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:28:06.332 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:28:06.333 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:28:06.333 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:28:06.333 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:28:06.333 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:28:06.333 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:28:06.333 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:28:06.333 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:06.333 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.313+0000 7fa8bffff640 10 monclient(hunting): _finish_auth 0 2026-02-22T23:28:06.333 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.313+0000 7fa8bffff640 1 -- 10.20.193.45:0/4089231078 <== mon.8 v1:10.20.193.45:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7fa8d00043b0 con 0x7fa8e80a4a90 2026-02-22T23:28:06.333 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.313+0000 7fa8bffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-22T23:28:06.333 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.313+0000 7fa8bffff640 10 monclient(hunting): got monmap 1 from mon.e (according to old e1) 2026-02-22T23:28:06.333 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.313+0000 7fa8bffff640 10 monclient(hunting): dump: 2026-02-22T23:28:06.333 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:28:06.333 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:28:06.334 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:06.334 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:06.334 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:28:06.334 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:28:06.334 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:28:06.334 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:28:06.334 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:28:06.334 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:28:06.334 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:28:06.334 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:28:06.334 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:28:06.334 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:28:06.334 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:28:06.334 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:06.334 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.313+0000 7fa8bffff640 1 -- 10.20.193.45:0/4089231078 <== mon.4 v1:10.20.193.45:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 446853679 0 0) 0x7fa8b8003620 con 0x7fa8e806d4e0 2026-02-22T23:28:06.335 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.313+0000 7fa8bffff640 1 -- 10.20.193.45:0/4089231078 >> v1:10.20.193.45:6793/0 conn(0x7fa8e80a4a90 legacy=0x7fa8e81d47a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:06.335 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.313+0000 7fa8bffff640 1 -- 10.20.193.45:0/4089231078 >> v1:10.20.193.73:6789/0 conn(0x7fa8e80a5580 legacy=0x7fa8e81d7ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:06.335 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.313+0000 7fa8bffff640 10 monclient: _finish_hunting 0 2026-02-22T23:28:06.335 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.313+0000 7fa8bffff640 1 monclient: found mon.c 2026-02-22T23:28:06.335 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.313+0000 7fa8bffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T23:28:06.335 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.313+0000 7fa8bffff640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.45:6791/0 2026-02-22T23:28:06.335 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.313+0000 7fa8bffff640 1 -- 10.20.193.45:0/4089231078 --> v1:10.20.193.45:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8e8128b80 con 0x7fa8e806d4e0 2026-02-22T23:28:06.335 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.313+0000 7fa8bffff640 10 monclient: _finish_auth 0 2026-02-22T23:28:06.335 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.313+0000 7fa8bffff640 10 monclient: _check_auth_tickets 2026-02-22T23:28:06.335 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.313+0000 7fa8bffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T23:28:06.335 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.313+0000 7fa8e7fff640 5 monclient: authenticate success, global_id 114187 2026-02-22T23:28:06.335 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.313+0000 7fa8e7fff640 10 monclient: _renew_subs 2026-02-22T23:28:06.335 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.313+0000 7fa8e7fff640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.45:6791/0 2026-02-22T23:28:06.336 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.313+0000 7fa8e7fff640 1 -- 10.20.193.45:0/4089231078 --> v1:10.20.193.45:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fa8e8128e60 con 0x7fa8e806d4e0 2026-02-22T23:28:06.336 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.313+0000 7fa8e7fff640 10 monclient: _renew_subs 2026-02-22T23:28:06.336 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.313+0000 7fa8e7fff640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.45:6791/0 2026-02-22T23:28:06.336 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.313+0000 7fa8e7fff640 1 -- 10.20.193.45:0/4089231078 --> v1:10.20.193.45:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7fa8e8127cf0 con 0x7fa8e806d4e0 2026-02-22T23:28:06.336 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.313+0000 7fa8bffff640 1 -- 10.20.193.45:0/4089231078 <== mon.4 v1:10.20.193.45:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa8dc0030e0 con 0x7fa8e806d4e0 2026-02-22T23:28:06.336 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.313+0000 7fa8bffff640 10 monclient: handle_config config(0 keys) 2026-02-22T23:28:06.336 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.313+0000 7fa8bffff640 1 -- 10.20.193.45:0/4089231078 <== mon.4 v1:10.20.193.45:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7fa8dc0052e0 con 0x7fa8e806d4e0 2026-02-22T23:28:06.336 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.313+0000 7fa8bffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:28:06.336 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.313+0000 7fa8bffff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T23:28:06.336 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.313+0000 7fa8e57fa640 4 set_mon_vals no callback set 2026-02-22T23:28:06.336 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.313+0000 7fa8bffff640 10 monclient: dump: 2026-02-22T23:28:06.336 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:28:06.336 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:28:06.336 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:06.337 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:06.337 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:28:06.337 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:28:06.337 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:28:06.337 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:28:06.337 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:28:06.337 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:28:06.337 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:28:06.337 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:28:06.337 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:28:06.337 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:28:06.337 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:28:06.337 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:06.337 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.314+0000 7fa8e7fff640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T23:28:06.337 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.314+0000 7fa8e7fff640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T23:28:06.338 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.314+0000 7fa8e7fff640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.45:6791/0 2026-02-22T23:28:06.338 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.314+0000 7fa8e7fff640 1 -- 10.20.193.45:0/4089231078 --> v1:10.20.193.45:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa8e81d0320 con 0x7fa8e806d4e0 2026-02-22T23:28:06.338 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.314+0000 7fa8bffff640 1 -- 10.20.193.45:0/4089231078 <== mon.4 v1:10.20.193.45:6791/0 7 ==== mgrmap(e 5) ==== 50225+0+0 (unknown 2330357642 0 0) 0x7fa8dc0118c0 con 0x7fa8e806d4e0 2026-02-22T23:28:06.338 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.314+0000 7fa8bffff640 1 -- 10.20.193.45:0/4089231078 <== mon.4 v1:10.20.193.45:6791/0 8 ==== osd_map(25..25 src has 1..25) ==== 3502+0+0 (unknown 129690100 0 0) 0x7fa8dc04dbe0 con 0x7fa8e806d4e0 2026-02-22T23:28:06.338 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.314+0000 7fa8e67fc640 10 monclient: get_auth_request con 0x7fa8b803fca0 auth_method 0 2026-02-22T23:28:06.338 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.317+0000 7fa8bffff640 1 -- 10.20.193.45:0/4089231078 <== mon.4 v1:10.20.193.45:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (unknown 1092875540 0 2568732696) 0x7fa8e80a4260 con 0x7fa8e806d4e0 2026-02-22T23:28:06.338 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.317+0000 7fa8bffff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T23:28:06.338 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.317+0000 7fa8bffff640 10 monclient: _finish_command 1 = system:0 2026-02-22T23:28:06.399 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.397+0000 7fa8e7fff640 1 -- 10.20.193.45:0/4089231078 --> v1:10.20.193.73:6800/2222410180 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa8e81279b0 con 0x7fa8b803fca0 2026-02-22T23:28:06.400 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.398+0000 7fa8bffff640 1 -- 10.20.193.45:0/4089231078 <== mgr.4111 v1:10.20.193.73:6800/2222410180 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+33968 (unknown 2965378022 0 1572888847) 0x7fa8e81279b0 con 0x7fa8b803fca0 2026-02-22T23:28:06.400 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-22T23:28:06.401 INFO:teuthology.orchestra.run.trial045.stderr:dumped all 2026-02-22T23:28:06.402 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.399+0000 7fa8e7fff640 1 -- 10.20.193.45:0/4089231078 >> v1:10.20.193.73:6800/2222410180 conn(0x7fa8b803fca0 legacy=0x7fa8b8042160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:06.402 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.399+0000 7fa8e7fff640 10 monclient: shutdown 2026-02-22T23:28:06.402 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.399+0000 7fa8e7fff640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T23:28:06.402 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.399+0000 7fa8e7fff640 1 -- 10.20.193.45:0/4089231078 >> v1:10.20.193.45:6791/0 conn(0x7fa8e806d4e0 legacy=0x7fa8e81417e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:06.402 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.399+0000 7fa8e7fff640 1 -- 10.20.193.45:0/4089231078 shutdown_connections 2026-02-22T23:28:06.402 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.399+0000 7fa8e7fff640 1 -- 10.20.193.45:0/4089231078 >> 10.20.193.45:0/4089231078 conn(0x7fa8e80a96e0 msgr2=0x7fa8e809ef50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:28:06.402 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.399+0000 7fa8e7fff640 1 -- 10.20.193.45:0/4089231078 shutdown_connections 2026-02-22T23:28:06.402 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.399+0000 7fa8e7fff640 1 -- 10.20.193.45:0/4089231078 wait complete. 2026-02-22T23:28:06.408 INFO:teuthology.orchestra.run.trial045.stdout:{"pg_ready":true,"pg_map":{"version":96,"stamp":"2026-02-22T23:28:05.208833+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":147,"num_write_kb":2674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":115,"ondisk_log_size":115,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":163224,"kb_used_data":1424,"kb_used_omap":9,"kb_used_meta":161654,"kb_avail":566067816,"statfs":{"total":579820584960,"available":579653443584,"internally_reserved":0,"allocated":1458176,"data_stored":1521850,"data_compressed":22320,"data_compressed_allocated":81920,"data_compressed_original":1024000,"omap_allocated":9561,"internal_metadata":165534375},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001150"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":31,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-22T23:26:19.181052+0000","last_change":"2026-02-22T23:25:44.735205+0000","last_active":"2026-02-22T23:26:19.181052+0000","last_peered":"2026-02-22T23:26:19.181052+0000","last_clean":"2026-02-22T23:26:19.181052+0000","last_became_active":"2026-02-22T23:25:42.732237+0000","last_became_peered":"2026-02-22T23:25:42.732237+0000","last_unstale":"2026-02-22T23:26:19.181052+0000","last_undegraded":"2026-02-22T23:26:19.181052+0000","last_fullsized":"2026-02-22T23:26:19.181052+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:25:41.723660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:25:41.723660+0000","last_clean_scrub_stamp":"2026-02-22T23:25:41.723660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:02:39.156862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000197314,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":32,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-22T23:26:18.881919+0000","last_change":"2026-02-22T23:25:44.734485+0000","last_active":"2026-02-22T23:26:18.881919+0000","last_peered":"2026-02-22T23:26:18.881919+0000","last_clean":"2026-02-22T23:26:18.881919+0000","last_became_active":"2026-02-22T23:25:42.731608+0000","last_became_peered":"2026-02-22T23:25:42.731608+0000","last_unstale":"2026-02-22T23:26:18.881919+0000","last_undegraded":"2026-02-22T23:26:18.881919+0000","last_fullsized":"2026-02-22T23:26:18.881919+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:25:41.723660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:25:41.723660+0000","last_clean_scrub_stamp":"2026-02-22T23:25:41.723660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:38:27.110138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044396600000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":31,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-22T23:26:19.180763+0000","last_change":"2026-02-22T23:25:44.735342+0000","last_active":"2026-02-22T23:26:19.180763+0000","last_peered":"2026-02-22T23:26:19.180763+0000","last_clean":"2026-02-22T23:26:19.180763+0000","last_became_active":"2026-02-22T23:25:42.732947+0000","last_became_peered":"2026-02-22T23:25:42.732947+0000","last_unstale":"2026-02-22T23:26:19.180763+0000","last_undegraded":"2026-02-22T23:26:19.180763+0000","last_fullsized":"2026-02-22T23:26:19.180763+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:25:41.723660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:25:41.723660+0000","last_clean_scrub_stamp":"2026-02-22T23:25:41.723660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T02:33:36.757781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00031882900000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":31,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-22T23:26:18.882218+0000","last_change":"2026-02-22T23:25:44.771461+0000","last_active":"2026-02-22T23:26:18.882218+0000","last_peered":"2026-02-22T23:26:18.882218+0000","last_clean":"2026-02-22T23:26:18.882218+0000","last_became_active":"2026-02-22T23:25:42.729582+0000","last_became_peered":"2026-02-22T23:25:42.729582+0000","last_unstale":"2026-02-22T23:26:18.882218+0000","last_undegraded":"2026-02-22T23:26:18.882218+0000","last_fullsized":"2026-02-22T23:26:18.882218+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:25:41.723660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:25:41.723660+0000","last_clean_scrub_stamp":"2026-02-22T23:25:41.723660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T06:30:33.437324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00022341099999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"19'2","reported_seq":33,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-22T23:26:19.179750+0000","last_change":"2026-02-22T23:25:44.735543+0000","last_active":"2026-02-22T23:26:19.179750+0000","last_peered":"2026-02-22T23:26:19.179750+0000","last_clean":"2026-02-22T23:26:19.179750+0000","last_became_active":"2026-02-22T23:25:42.733018+0000","last_became_peered":"2026-02-22T23:25:42.733018+0000","last_unstale":"2026-02-22T23:26:19.179750+0000","last_undegraded":"2026-02-22T23:26:19.179750+0000","last_fullsized":"2026-02-22T23:26:19.179750+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:25:41.723660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:25:41.723660+0000","last_clean_scrub_stamp":"2026-02-22T23:25:41.723660+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T04:28:19.249844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044642500000000002,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":32,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-22T23:26:19.178926+0000","last_change":"2026-02-22T23:25:44.734019+0000","last_active":"2026-02-22T23:26:19.178926+0000","last_peered":"2026-02-22T23:26:19.178926+0000","last_clean":"2026-02-22T23:26:19.178926+0000","last_became_active":"2026-02-22T23:25:42.729332+0000","last_became_peered":"2026-02-22T23:25:42.729332+0000","last_unstale":"2026-02-22T23:26:19.178926+0000","last_undegraded":"2026-02-22T23:26:19.178926+0000","last_fullsized":"2026-02-22T23:26:19.178926+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:25:41.723660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:25:41.723660+0000","last_clean_scrub_stamp":"2026-02-22T23:25:41.723660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T05:15:12.260477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00028113600000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":31,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-22T23:26:19.180610+0000","last_change":"2026-02-22T23:25:44.735208+0000","last_active":"2026-02-22T23:26:19.180610+0000","last_peered":"2026-02-22T23:26:19.180610+0000","last_clean":"2026-02-22T23:26:19.180610+0000","last_became_active":"2026-02-22T23:25:42.732106+0000","last_became_peered":"2026-02-22T23:25:42.732106+0000","last_unstale":"2026-02-22T23:26:19.180610+0000","last_undegraded":"2026-02-22T23:26:19.180610+0000","last_fullsized":"2026-02-22T23:26:19.180610+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:25:41.723660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:25:41.723660+0000","last_clean_scrub_stamp":"2026-02-22T23:25:41.723660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:35:08.328395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000186295,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"17'1","reported_seq":32,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-22T23:26:19.179503+0000","last_change":"2026-02-22T23:25:44.735244+0000","last_active":"2026-02-22T23:26:19.179503+0000","last_peered":"2026-02-22T23:26:19.179503+0000","last_clean":"2026-02-22T23:26:19.179503+0000","last_became_active":"2026-02-22T23:25:42.732702+0000","last_became_peered":"2026-02-22T23:25:42.732702+0000","last_unstale":"2026-02-22T23:26:19.179503+0000","last_undegraded":"2026-02-22T23:26:19.179503+0000","last_fullsized":"2026-02-22T23:26:19.179503+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:25:41.723660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:25:41.723660+0000","last_clean_scrub_stamp":"2026-02-22T23:25:41.723660+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T01:00:00.519442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00023975299999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"14'112","reported_seq":168,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-22T23:26:19.180475+0000","last_change":"2026-02-22T23:25:36.890023+0000","last_active":"2026-02-22T23:26:19.180475+0000","last_peered":"2026-02-22T23:26:19.180475+0000","last_clean":"2026-02-22T23:26:19.180475+0000","last_became_active":"2026-02-22T23:25:36.889147+0000","last_became_peered":"2026-02-22T23:25:36.889147+0000","last_unstale":"2026-02-22T23:26:19.180475+0000","last_undegraded":"2026-02-22T23:26:19.180475+0000","last_fullsized":"2026-02-22T23:26:19.180475+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:25:35.704171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:25:35.704171+0000","last_clean_scrub_stamp":"2026-02-22T23:25:35.704171+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T02:46:45.050923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":1057856,"data_compressed":22320,"data_compressed_allocated":81920,"data_compressed_original":1024000,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":12,"seq":51539607584,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":282624,"data_stored":606254,"data_compressed":11160,"data_compressed_allocated":40960,"data_compressed_original":512000,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":12,"seq":51539607583,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27192,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344648,"statfs":{"total":96636764160,"available":96608919552,"internally_reserved":0,"allocated":225280,"data_stored":77345,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":12,"seq":51539607583,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27184,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344656,"statfs":{"total":96636764160,"available":96608927744,"internally_reserved":0,"allocated":221184,"data_stored":77326,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":12,"seq":51539607583,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":282624,"data_stored":606254,"data_compressed":11160,"data_compressed_allocated":40960,"data_compressed_original":512000,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":12,"seq":51539607583,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27188,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344652,"statfs":{"total":96636764160,"available":96608923648,"internally_reserved":0,"allocated":225280,"data_stored":77345,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":11,"seq":47244640288,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27176,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344664,"statfs":{"total":96636764160,"available":96608935936,"internally_reserved":0,"allocated":221184,"data_stored":77326,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27589065},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":528928,"data_compressed":11160,"data_compressed_allocated":40960,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":528928,"data_compressed":11160,"data_compressed_allocated":40960,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-22T23:28:06.410 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-22T23:28:06.478 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.476+0000 7fd0f3676640 10 monclient: get_monmap_and_config 2026-02-22T23:28:06.478 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.476+0000 7fd0f3676640 10 monclient: build_initial_monmap 2026-02-22T23:28:06.478 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.476+0000 7fd0f3676640 10 monclient: monmap: 2026-02-22T23:28:06.478 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-22T23:28:06.478 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:28:06.478 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:28:06.478153+0000 2026-02-22T23:28:06.478 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:28:06.478153+0000 2026-02-22T23:28:06.478 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-22T23:28:06.478 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:28:06.478 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-22T23:28:06.478 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.noname-f 2026-02-22T23:28:06.478 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.noname-b 2026-02-22T23:28:06.478 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.noname-g 2026-02-22T23:28:06.479 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.noname-c 2026-02-22T23:28:06.479 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.noname-h 2026-02-22T23:28:06.479 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.noname-d 2026-02-22T23:28:06.479 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.noname-i 2026-02-22T23:28:06.479 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.noname-e 2026-02-22T23:28:06.479 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:06.482 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.477+0000 7fd0f3676640 1 Processor -- start 2026-02-22T23:28:06.482 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.477+0000 7fd0f3676640 1 -- start start 2026-02-22T23:28:06.482 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.477+0000 7fd0f3676640 10 monclient: init 2026-02-22T23:28:06.482 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.477+0000 7fd0f3676640 10 monclient: _reopen_session rank -1 2026-02-22T23:28:06.482 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.477+0000 7fd0f3676640 10 monclient: _add_conns ranks=[6,8,4,5,1,0,7,2,3] 2026-02-22T23:28:06.482 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.477+0000 7fd0f3676640 10 monclient(hunting): picked mon.noname-d con 0x7fd0ec139240 addr v1:10.20.193.45:6792/0 2026-02-22T23:28:06.482 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.477+0000 7fd0f3676640 10 monclient(hunting): picked mon.noname-e con 0x7fd0ec0a51e0 addr v1:10.20.193.45:6793/0 2026-02-22T23:28:06.482 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.477+0000 7fd0f3676640 10 monclient(hunting): picked mon.noname-c con 0x7fd0ec13f8a0 addr v1:10.20.193.45:6791/0 2026-02-22T23:28:06.482 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.477+0000 7fd0f3676640 1 -- --> v1:10.20.193.45:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd0ec06cde0 con 0x7fd0ec13f8a0 2026-02-22T23:28:06.482 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.477+0000 7fd0f3676640 1 -- --> v1:10.20.193.45:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd0ec0a55c0 con 0x7fd0ec139240 2026-02-22T23:28:06.482 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.477+0000 7fd0f3676640 1 -- --> v1:10.20.193.45:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd0ec06e850 con 0x7fd0ec0a51e0 2026-02-22T23:28:06.482 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.477+0000 7fd0f3676640 10 monclient(hunting): _renew_subs 2026-02-22T23:28:06.482 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.477+0000 7fd0f3676640 10 monclient(hunting): authenticate will time out at 818.094748s 2026-02-22T23:28:06.482 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.477+0000 7fd0f1bec640 1 --1- >> v1:10.20.193.45:6791/0 conn(0x7fd0ec13f8a0 0x7fd0ec141c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.45:6791/0 says I am v1:10.20.193.45:57750/0 (socket says 10.20.193.45:57750) 2026-02-22T23:28:06.482 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.477+0000 7fd0f1bec640 1 -- 10.20.193.45:0/4010139520 learned_addr learned my addr 10.20.193.45:0/4010139520 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-22T23:28:06.482 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.478+0000 7fd0dbfff640 1 -- 10.20.193.45:0/4010139520 <== mon.4 v1:10.20.193.45:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2409753599 0 0) 0x7fd0ec06cde0 con 0x7fd0ec13f8a0 2026-02-22T23:28:06.482 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.478+0000 7fd0dbfff640 10 monclient(hunting): _negotiate 2026-02-22T23:28:06.482 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.478+0000 7fd0dbfff640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:28:06.482 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.478+0000 7fd0dbfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:28:06.482 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.478+0000 7fd0dbfff640 10 monclient(hunting): my global_id is 114196 2026-02-22T23:28:06.483 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.478+0000 7fd0dbfff640 1 -- 10.20.193.45:0/4010139520 --> v1:10.20.193.45:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd0d4003620 con 0x7fd0ec13f8a0 2026-02-22T23:28:06.483 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.478+0000 7fd0dbfff640 1 -- 10.20.193.45:0/4010139520 <== mon.6 v1:10.20.193.45:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3929795104 0 0) 0x7fd0ec0a55c0 con 0x7fd0ec139240 2026-02-22T23:28:06.483 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.478+0000 7fd0dbfff640 10 monclient(hunting): _negotiate 2026-02-22T23:28:06.483 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.478+0000 7fd0dbfff640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:28:06.483 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.478+0000 7fd0dbfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:28:06.483 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.478+0000 7fd0dbfff640 10 monclient(hunting): my global_id is 114189 2026-02-22T23:28:06.483 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.478+0000 7fd0dbfff640 1 -- 10.20.193.45:0/4010139520 --> v1:10.20.193.45:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd0ec06cde0 con 0x7fd0ec139240 2026-02-22T23:28:06.483 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.478+0000 7fd0dbfff640 1 -- 10.20.193.45:0/4010139520 <== mon.8 v1:10.20.193.45:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1569157096 0 0) 0x7fd0ec06e850 con 0x7fd0ec0a51e0 2026-02-22T23:28:06.483 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.478+0000 7fd0dbfff640 10 monclient(hunting): _negotiate 2026-02-22T23:28:06.483 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.478+0000 7fd0dbfff640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:28:06.483 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.478+0000 7fd0dbfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:28:06.483 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.478+0000 7fd0dbfff640 10 monclient(hunting): my global_id is 4688 2026-02-22T23:28:06.483 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.478+0000 7fd0dbfff640 1 -- 10.20.193.45:0/4010139520 --> v1:10.20.193.45:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd0ec0a55c0 con 0x7fd0ec0a51e0 2026-02-22T23:28:06.483 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.478+0000 7fd0dbfff640 1 -- 10.20.193.45:0/4010139520 <== mon.6 v1:10.20.193.45:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1976080892 0 0) 0x7fd0ec06cde0 con 0x7fd0ec139240 2026-02-22T23:28:06.483 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.478+0000 7fd0dbfff640 1 -- 10.20.193.45:0/4010139520 >> v1:10.20.193.45:6793/0 conn(0x7fd0ec0a51e0 legacy=0x7fd0ec13e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:06.483 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.478+0000 7fd0dbfff640 1 -- 10.20.193.45:0/4010139520 >> v1:10.20.193.45:6791/0 conn(0x7fd0ec13f8a0 legacy=0x7fd0ec141c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:06.483 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.478+0000 7fd0dbfff640 10 monclient: _finish_hunting 0 2026-02-22T23:28:06.483 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.478+0000 7fd0dbfff640 1 monclient: found mon.noname-d 2026-02-22T23:28:06.483 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.478+0000 7fd0dbfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T23:28:06.483 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.478+0000 7fd0dbfff640 10 monclient: _send_mon_message to mon.noname-d at v1:10.20.193.45:6792/0 2026-02-22T23:28:06.483 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.478+0000 7fd0dbfff640 1 -- 10.20.193.45:0/4010139520 --> v1:10.20.193.45:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0ec06cba0 con 0x7fd0ec139240 2026-02-22T23:28:06.483 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.478+0000 7fd0dbfff640 10 monclient: _finish_auth 0 2026-02-22T23:28:06.483 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.478+0000 7fd0dbfff640 10 monclient: _check_auth_tickets 2026-02-22T23:28:06.483 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.478+0000 7fd0dbfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T23:28:06.483 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.478+0000 7fd0dbfff640 1 -- 10.20.193.45:0/4010139520 <== mon.6 v1:10.20.193.45:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7fd0dc003020 con 0x7fd0ec139240 2026-02-22T23:28:06.483 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.478+0000 7fd0f3676640 5 monclient: authenticate success, global_id 114189 2026-02-22T23:28:06.483 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.478+0000 7fd0f3676640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-22T23:28:06.483 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.478+0000 7fd0dbfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:28:06.484 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.478+0000 7fd0dbfff640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2026-02-22T23:28:06.484 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.478+0000 7fd0dbfff640 10 monclient: dump: 2026-02-22T23:28:06.484 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:28:06.484 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:28:06.484 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:06.484 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:06.484 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:28:06.484 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:28:06.484 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:28:06.484 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:28:06.484 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:28:06.484 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:28:06.484 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:28:06.484 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:28:06.484 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:28:06.484 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:28:06.484 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:28:06.484 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:06.484 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.478+0000 7fd0f3676640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-22T23:28:06.484 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.478+0000 7fd0dbfff640 1 -- 10.20.193.45:0/4010139520 <== mon.6 v1:10.20.193.45:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd0dc003240 con 0x7fd0ec139240 2026-02-22T23:28:06.484 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.478+0000 7fd0dbfff640 10 monclient: handle_config config(0 keys) 2026-02-22T23:28:06.484 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.478+0000 7fd0dbfff640 1 -- 10.20.193.45:0/4010139520 <== mon.6 v1:10.20.193.45:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7fd0dc003a50 con 0x7fd0ec139240 2026-02-22T23:28:06.484 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.478+0000 7fd0f3676640 10 monclient: get_monmap_and_config success 2026-02-22T23:28:06.484 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.478+0000 7fd0f3676640 4 set_mon_vals no callback set 2026-02-22T23:28:06.484 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.478+0000 7fd0dbfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:28:06.484 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.478+0000 7fd0dbfff640 10 monclient: got monmap 1 from mon.d (according to old e1) 2026-02-22T23:28:06.484 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.478+0000 7fd0dbfff640 10 monclient: dump: 2026-02-22T23:28:06.485 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:28:06.485 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:28:06.485 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:06.485 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:06.485 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:28:06.485 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:28:06.485 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:28:06.485 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:28:06.485 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:28:06.485 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:28:06.485 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:28:06.485 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:28:06.485 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:28:06.485 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:28:06.485 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:28:06.485 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:06.485 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.478+0000 7fd0f3676640 10 monclient: shutdown 2026-02-22T23:28:06.485 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.478+0000 7fd0f3676640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T23:28:06.485 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.478+0000 7fd0f3676640 1 -- 10.20.193.45:0/4010139520 >> v1:10.20.193.45:6792/0 conn(0x7fd0ec139240 legacy=0x7fd0ec139620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:06.485 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.478+0000 7fd0f3676640 1 -- 10.20.193.45:0/4010139520 shutdown_connections 2026-02-22T23:28:06.485 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.478+0000 7fd0f3676640 1 -- 10.20.193.45:0/4010139520 >> 10.20.193.45:0/4010139520 conn(0x7fd0ec0a96b0 msgr2=0x7fd0ec0a9ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:28:06.485 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.478+0000 7fd0f3676640 1 -- 10.20.193.45:0/4010139520 shutdown_connections 2026-02-22T23:28:06.485 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.478+0000 7fd0f3676640 1 -- 10.20.193.45:0/4010139520 wait complete. 2026-02-22T23:28:06.485 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.478+0000 7fd0f3676640 10 monclient: build_initial_monmap 2026-02-22T23:28:06.485 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.478+0000 7fd0f3676640 10 monclient: monmap: 2026-02-22T23:28:06.485 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-22T23:28:06.485 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T23:28:06.485 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-22T23:28:06.486 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-22T23:28:06.486 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-22T23:28:06.486 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-22T23:28:06.486 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-22T23:28:06.486 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.noname-f 2026-02-22T23:28:06.486 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.noname-b 2026-02-22T23:28:06.486 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.noname-g 2026-02-22T23:28:06.486 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.noname-c 2026-02-22T23:28:06.486 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.noname-h 2026-02-22T23:28:06.486 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.noname-d 2026-02-22T23:28:06.486 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.noname-i 2026-02-22T23:28:06.486 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.noname-e 2026-02-22T23:28:06.486 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:06.486 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.479+0000 7fd0f3676640 1 Processor -- start 2026-02-22T23:28:06.486 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.479+0000 7fd0f3676640 1 -- start start 2026-02-22T23:28:06.486 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.479+0000 7fd0f3676640 10 monclient: init 2026-02-22T23:28:06.486 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.479+0000 7fd0f3676640 10 monclient: _reopen_session rank -1 2026-02-22T23:28:06.486 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.479+0000 7fd0f3676640 10 monclient: _add_conns ranks=[8,1,4,0,5,7,3,2,6] 2026-02-22T23:28:06.486 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.479+0000 7fd0f3676640 10 monclient(hunting): picked mon.noname-e con 0x7fd0ec0a51e0 addr v1:10.20.193.45:6793/0 2026-02-22T23:28:06.486 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.479+0000 7fd0f3676640 10 monclient(hunting): picked mon.noname-f con 0x7fd0ec139240 addr v1:10.20.193.73:6789/0 2026-02-22T23:28:06.486 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.479+0000 7fd0f3676640 10 monclient(hunting): picked mon.noname-c con 0x7fd0ec13f8a0 addr v1:10.20.193.45:6791/0 2026-02-22T23:28:06.486 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.479+0000 7fd0f3676640 1 -- --> v1:10.20.193.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd0ec072e70 con 0x7fd0ec139240 2026-02-22T23:28:06.486 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.479+0000 7fd0f3676640 1 -- --> v1:10.20.193.45:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd0ec0a1dc0 con 0x7fd0ec13f8a0 2026-02-22T23:28:06.486 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.479+0000 7fd0f3676640 1 -- --> v1:10.20.193.45:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd0ec0a6600 con 0x7fd0ec0a51e0 2026-02-22T23:28:06.486 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.479+0000 7fd0f3676640 10 monclient(hunting): _renew_subs 2026-02-22T23:28:06.486 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.479+0000 7fd0f3676640 10 monclient(hunting): authenticate will time out at 818.096367s 2026-02-22T23:28:06.486 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.479+0000 7fd0f13eb640 1 --1- >> v1:10.20.193.45:6793/0 conn(0x7fd0ec0a51e0 0x7fd0ec072050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.45:6793/0 says I am v1:10.20.193.45:41084/0 (socket says 10.20.193.45:41084) 2026-02-22T23:28:06.486 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.479+0000 7fd0f13eb640 1 -- 10.20.193.45:0/73475307 learned_addr learned my addr 10.20.193.45:0/73475307 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-22T23:28:06.487 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.479+0000 7fd0d9ffb640 1 -- 10.20.193.45:0/73475307 <== mon.4 v1:10.20.193.45:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1403177508 0 0) 0x7fd0ec0a1dc0 con 0x7fd0ec13f8a0 2026-02-22T23:28:06.487 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.479+0000 7fd0d9ffb640 10 monclient(hunting): _negotiate 2026-02-22T23:28:06.487 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.479+0000 7fd0d9ffb640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:28:06.487 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.479+0000 7fd0d9ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:28:06.487 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.479+0000 7fd0d9ffb640 10 monclient(hunting): my global_id is 114205 2026-02-22T23:28:06.487 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.479+0000 7fd0d9ffb640 1 -- 10.20.193.45:0/73475307 --> v1:10.20.193.45:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd0bc003620 con 0x7fd0ec13f8a0 2026-02-22T23:28:06.487 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.479+0000 7fd0d9ffb640 1 -- 10.20.193.45:0/73475307 <== mon.8 v1:10.20.193.45:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 152191211 0 0) 0x7fd0ec0a6600 con 0x7fd0ec0a51e0 2026-02-22T23:28:06.487 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.479+0000 7fd0d9ffb640 10 monclient(hunting): _negotiate 2026-02-22T23:28:06.487 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.479+0000 7fd0d9ffb640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:28:06.487 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.479+0000 7fd0d9ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:28:06.487 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.479+0000 7fd0d9ffb640 10 monclient(hunting): my global_id is 4697 2026-02-22T23:28:06.487 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.479+0000 7fd0d9ffb640 1 -- 10.20.193.45:0/73475307 --> v1:10.20.193.45:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd0ec0a1dc0 con 0x7fd0ec0a51e0 2026-02-22T23:28:06.487 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.479+0000 7fd0d9ffb640 1 -- 10.20.193.45:0/73475307 <== mon.4 v1:10.20.193.45:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3626055304 0 0) 0x7fd0bc003620 con 0x7fd0ec13f8a0 2026-02-22T23:28:06.487 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.479+0000 7fd0d9ffb640 1 -- 10.20.193.45:0/73475307 --> v1:10.20.193.45:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd0ec0a6600 con 0x7fd0ec13f8a0 2026-02-22T23:28:06.487 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.479+0000 7fd0d9ffb640 1 -- 10.20.193.45:0/73475307 <== mon.4 v1:10.20.193.45:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7fd0e8003030 con 0x7fd0ec13f8a0 2026-02-22T23:28:06.487 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.479+0000 7fd0d9ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-22T23:28:06.487 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.479+0000 7fd0d9ffb640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-22T23:28:06.487 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.479+0000 7fd0d9ffb640 10 monclient(hunting): dump: 2026-02-22T23:28:06.487 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:28:06.487 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:28:06.487 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:06.487 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:06.487 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:28:06.487 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:28:06.487 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:28:06.487 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:28:06.487 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:28:06.487 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:28:06.487 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:28:06.488 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:28:06.488 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:28:06.488 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:28:06.488 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:28:06.488 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:06.488 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.479+0000 7fd0d9ffb640 10 monclient(hunting): _finish_auth 0 2026-02-22T23:28:06.488 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.479+0000 7fd0d9ffb640 1 -- 10.20.193.45:0/73475307 <== mon.8 v1:10.20.193.45:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 463261808 0 0) 0x7fd0ec0a1dc0 con 0x7fd0ec0a51e0 2026-02-22T23:28:06.488 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.479+0000 7fd0d9ffb640 1 -- 10.20.193.45:0/73475307 --> v1:10.20.193.45:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd0bc003620 con 0x7fd0ec0a51e0 2026-02-22T23:28:06.488 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.479+0000 7fd0d9ffb640 1 -- 10.20.193.45:0/73475307 <== mon.8 v1:10.20.193.45:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7fd0dc003730 con 0x7fd0ec0a51e0 2026-02-22T23:28:06.488 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.479+0000 7fd0d9ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-22T23:28:06.488 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.479+0000 7fd0d9ffb640 10 monclient(hunting): got monmap 1 from mon.e (according to old e1) 2026-02-22T23:28:06.488 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.479+0000 7fd0d9ffb640 10 monclient(hunting): dump: 2026-02-22T23:28:06.488 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:28:06.488 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:28:06.488 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:06.488 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:06.488 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:28:06.488 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:28:06.488 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:28:06.488 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:28:06.488 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:28:06.488 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:28:06.488 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:28:06.488 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:28:06.488 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:28:06.488 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:28:06.488 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:28:06.488 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:06.489 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.479+0000 7fd0d9ffb640 1 -- 10.20.193.45:0/73475307 <== mon.4 v1:10.20.193.45:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2314766615 0 0) 0x7fd0ec0a6600 con 0x7fd0ec13f8a0 2026-02-22T23:28:06.489 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.479+0000 7fd0d9ffb640 1 -- 10.20.193.45:0/73475307 >> v1:10.20.193.45:6793/0 conn(0x7fd0ec0a51e0 legacy=0x7fd0ec072050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:06.489 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.479+0000 7fd0d9ffb640 1 -- 10.20.193.45:0/73475307 >> v1:10.20.193.73:6789/0 conn(0x7fd0ec139240 legacy=0x7fd0ec072760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:06.489 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.479+0000 7fd0d9ffb640 10 monclient: _finish_hunting 0 2026-02-22T23:28:06.489 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.479+0000 7fd0d9ffb640 1 monclient: found mon.c 2026-02-22T23:28:06.489 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.479+0000 7fd0d9ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T23:28:06.489 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.479+0000 7fd0d9ffb640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.45:6791/0 2026-02-22T23:28:06.489 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.479+0000 7fd0d9ffb640 1 -- 10.20.193.45:0/73475307 --> v1:10.20.193.45:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0ec09e3a0 con 0x7fd0ec13f8a0 2026-02-22T23:28:06.489 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.479+0000 7fd0d9ffb640 10 monclient: _finish_auth 0 2026-02-22T23:28:06.489 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.479+0000 7fd0d9ffb640 10 monclient: _check_auth_tickets 2026-02-22T23:28:06.489 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.479+0000 7fd0d9ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T23:28:06.489 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.479+0000 7fd0f3676640 5 monclient: authenticate success, global_id 114205 2026-02-22T23:28:06.489 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.479+0000 7fd0f3676640 10 monclient: _renew_subs 2026-02-22T23:28:06.489 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.479+0000 7fd0f3676640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.45:6791/0 2026-02-22T23:28:06.489 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.479+0000 7fd0f3676640 1 -- 10.20.193.45:0/73475307 --> v1:10.20.193.45:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fd0ec09e680 con 0x7fd0ec13f8a0 2026-02-22T23:28:06.489 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.479+0000 7fd0f3676640 10 monclient: _renew_subs 2026-02-22T23:28:06.489 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.479+0000 7fd0f3676640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.45:6791/0 2026-02-22T23:28:06.489 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.479+0000 7fd0f3676640 1 -- 10.20.193.45:0/73475307 --> v1:10.20.193.45:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7fd0ec0734b0 con 0x7fd0ec13f8a0 2026-02-22T23:28:06.489 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.479+0000 7fd0d9ffb640 1 -- 10.20.193.45:0/73475307 <== mon.4 v1:10.20.193.45:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd0e8003390 con 0x7fd0ec13f8a0 2026-02-22T23:28:06.489 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.479+0000 7fd0d9ffb640 10 monclient: handle_config config(0 keys) 2026-02-22T23:28:06.489 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.479+0000 7fd0d9ffb640 1 -- 10.20.193.45:0/73475307 <== mon.4 v1:10.20.193.45:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7fd0e8005250 con 0x7fd0ec13f8a0 2026-02-22T23:28:06.489 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.479+0000 7fd0d9ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:28:06.489 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.479+0000 7fd0d9ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T23:28:06.489 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.479+0000 7fd0db7fe640 4 set_mon_vals no callback set 2026-02-22T23:28:06.489 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.479+0000 7fd0d9ffb640 10 monclient: dump: 2026-02-22T23:28:06.489 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:28:06.489 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:28:06.489 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:06.489 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:06.490 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:28:06.490 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:28:06.490 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:28:06.490 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:28:06.490 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:28:06.490 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:28:06.490 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:28:06.490 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:28:06.490 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:28:06.490 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:28:06.490 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:28:06.490 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:06.490 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.480+0000 7fd0f3676640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T23:28:06.490 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.480+0000 7fd0f3676640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T23:28:06.490 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.480+0000 7fd0f3676640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.45:6791/0 2026-02-22T23:28:06.490 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.480+0000 7fd0f3676640 1 -- 10.20.193.45:0/73475307 --> v1:10.20.193.45:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd0ec06ea50 con 0x7fd0ec13f8a0 2026-02-22T23:28:06.490 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.480+0000 7fd0d9ffb640 1 -- 10.20.193.45:0/73475307 <== mon.4 v1:10.20.193.45:6791/0 7 ==== mgrmap(e 5) ==== 50225+0+0 (unknown 2330357642 0 0) 0x7fd0e80118b0 con 0x7fd0ec13f8a0 2026-02-22T23:28:06.490 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.480+0000 7fd0d9ffb640 1 -- 10.20.193.45:0/73475307 <== mon.4 v1:10.20.193.45:6791/0 8 ==== osd_map(25..25 src has 1..25) ==== 3502+0+0 (unknown 129690100 0 0) 0x7fd0e804df50 con 0x7fd0ec13f8a0 2026-02-22T23:28:06.490 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.480+0000 7fd0f13eb640 10 monclient: get_auth_request con 0x7fd0bc03fde0 auth_method 0 2026-02-22T23:28:06.490 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.483+0000 7fd0d9ffb640 1 -- 10.20.193.45:0/73475307 <== mon.4 v1:10.20.193.45:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (unknown 1092875540 0 2568732696) 0x7fd0e801b6e0 con 0x7fd0ec13f8a0 2026-02-22T23:28:06.490 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.483+0000 7fd0d9ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T23:28:06.490 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.483+0000 7fd0d9ffb640 10 monclient: _finish_command 1 = system:0 2026-02-22T23:28:06.564 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.563+0000 7fd0f3676640 1 -- 10.20.193.45:0/73475307 --> v1:10.20.193.73:6800/2222410180 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd0ec139d00 con 0x7fd0bc03fde0 2026-02-22T23:28:06.565 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.563+0000 7fd0d9ffb640 1 -- 10.20.193.45:0/73475307 <== mgr.4111 v1:10.20.193.73:6800/2222410180 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+33968 (unknown 2965378022 0 1572888847) 0x7fd0ec139d00 con 0x7fd0bc03fde0 2026-02-22T23:28:06.565 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-22T23:28:06.565 INFO:teuthology.orchestra.run.trial045.stderr:dumped all 2026-02-22T23:28:06.566 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.564+0000 7fd0f3676640 1 -- 10.20.193.45:0/73475307 >> v1:10.20.193.73:6800/2222410180 conn(0x7fd0bc03fde0 legacy=0x7fd0bc0422a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:06.566 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.564+0000 7fd0f3676640 10 monclient: shutdown 2026-02-22T23:28:06.566 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.564+0000 7fd0f3676640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T23:28:06.566 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.564+0000 7fd0f3676640 1 -- 10.20.193.45:0/73475307 >> v1:10.20.193.45:6791/0 conn(0x7fd0ec13f8a0 legacy=0x7fd0ec1d79b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:06.566 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.564+0000 7fd0f3676640 1 -- 10.20.193.45:0/73475307 shutdown_connections 2026-02-22T23:28:06.566 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.564+0000 7fd0f3676640 1 -- 10.20.193.45:0/73475307 >> 10.20.193.45:0/73475307 conn(0x7fd0ec0a96b0 msgr2=0x7fd0ec135070 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:28:06.566 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.564+0000 7fd0f3676640 1 -- 10.20.193.45:0/73475307 shutdown_connections 2026-02-22T23:28:06.566 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.564+0000 7fd0f3676640 1 -- 10.20.193.45:0/73475307 wait complete. 2026-02-22T23:28:06.573 INFO:teuthology.orchestra.run.trial045.stdout:{"pg_ready":true,"pg_map":{"version":96,"stamp":"2026-02-22T23:28:05.208833+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":147,"num_write_kb":2674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":115,"ondisk_log_size":115,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":163224,"kb_used_data":1424,"kb_used_omap":9,"kb_used_meta":161654,"kb_avail":566067816,"statfs":{"total":579820584960,"available":579653443584,"internally_reserved":0,"allocated":1458176,"data_stored":1521850,"data_compressed":22320,"data_compressed_allocated":81920,"data_compressed_original":1024000,"omap_allocated":9561,"internal_metadata":165534375},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001150"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":31,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-22T23:26:19.181052+0000","last_change":"2026-02-22T23:25:44.735205+0000","last_active":"2026-02-22T23:26:19.181052+0000","last_peered":"2026-02-22T23:26:19.181052+0000","last_clean":"2026-02-22T23:26:19.181052+0000","last_became_active":"2026-02-22T23:25:42.732237+0000","last_became_peered":"2026-02-22T23:25:42.732237+0000","last_unstale":"2026-02-22T23:26:19.181052+0000","last_undegraded":"2026-02-22T23:26:19.181052+0000","last_fullsized":"2026-02-22T23:26:19.181052+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:25:41.723660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:25:41.723660+0000","last_clean_scrub_stamp":"2026-02-22T23:25:41.723660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:02:39.156862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000197314,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":32,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-22T23:26:18.881919+0000","last_change":"2026-02-22T23:25:44.734485+0000","last_active":"2026-02-22T23:26:18.881919+0000","last_peered":"2026-02-22T23:26:18.881919+0000","last_clean":"2026-02-22T23:26:18.881919+0000","last_became_active":"2026-02-22T23:25:42.731608+0000","last_became_peered":"2026-02-22T23:25:42.731608+0000","last_unstale":"2026-02-22T23:26:18.881919+0000","last_undegraded":"2026-02-22T23:26:18.881919+0000","last_fullsized":"2026-02-22T23:26:18.881919+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:25:41.723660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:25:41.723660+0000","last_clean_scrub_stamp":"2026-02-22T23:25:41.723660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:38:27.110138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044396600000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":31,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-22T23:26:19.180763+0000","last_change":"2026-02-22T23:25:44.735342+0000","last_active":"2026-02-22T23:26:19.180763+0000","last_peered":"2026-02-22T23:26:19.180763+0000","last_clean":"2026-02-22T23:26:19.180763+0000","last_became_active":"2026-02-22T23:25:42.732947+0000","last_became_peered":"2026-02-22T23:25:42.732947+0000","last_unstale":"2026-02-22T23:26:19.180763+0000","last_undegraded":"2026-02-22T23:26:19.180763+0000","last_fullsized":"2026-02-22T23:26:19.180763+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:25:41.723660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:25:41.723660+0000","last_clean_scrub_stamp":"2026-02-22T23:25:41.723660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T02:33:36.757781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00031882900000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":31,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-22T23:26:18.882218+0000","last_change":"2026-02-22T23:25:44.771461+0000","last_active":"2026-02-22T23:26:18.882218+0000","last_peered":"2026-02-22T23:26:18.882218+0000","last_clean":"2026-02-22T23:26:18.882218+0000","last_became_active":"2026-02-22T23:25:42.729582+0000","last_became_peered":"2026-02-22T23:25:42.729582+0000","last_unstale":"2026-02-22T23:26:18.882218+0000","last_undegraded":"2026-02-22T23:26:18.882218+0000","last_fullsized":"2026-02-22T23:26:18.882218+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:25:41.723660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:25:41.723660+0000","last_clean_scrub_stamp":"2026-02-22T23:25:41.723660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T06:30:33.437324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00022341099999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"19'2","reported_seq":33,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-22T23:26:19.179750+0000","last_change":"2026-02-22T23:25:44.735543+0000","last_active":"2026-02-22T23:26:19.179750+0000","last_peered":"2026-02-22T23:26:19.179750+0000","last_clean":"2026-02-22T23:26:19.179750+0000","last_became_active":"2026-02-22T23:25:42.733018+0000","last_became_peered":"2026-02-22T23:25:42.733018+0000","last_unstale":"2026-02-22T23:26:19.179750+0000","last_undegraded":"2026-02-22T23:26:19.179750+0000","last_fullsized":"2026-02-22T23:26:19.179750+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:25:41.723660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:25:41.723660+0000","last_clean_scrub_stamp":"2026-02-22T23:25:41.723660+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T04:28:19.249844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044642500000000002,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":32,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-22T23:26:19.178926+0000","last_change":"2026-02-22T23:25:44.734019+0000","last_active":"2026-02-22T23:26:19.178926+0000","last_peered":"2026-02-22T23:26:19.178926+0000","last_clean":"2026-02-22T23:26:19.178926+0000","last_became_active":"2026-02-22T23:25:42.729332+0000","last_became_peered":"2026-02-22T23:25:42.729332+0000","last_unstale":"2026-02-22T23:26:19.178926+0000","last_undegraded":"2026-02-22T23:26:19.178926+0000","last_fullsized":"2026-02-22T23:26:19.178926+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:25:41.723660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:25:41.723660+0000","last_clean_scrub_stamp":"2026-02-22T23:25:41.723660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T05:15:12.260477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00028113600000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":31,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-22T23:26:19.180610+0000","last_change":"2026-02-22T23:25:44.735208+0000","last_active":"2026-02-22T23:26:19.180610+0000","last_peered":"2026-02-22T23:26:19.180610+0000","last_clean":"2026-02-22T23:26:19.180610+0000","last_became_active":"2026-02-22T23:25:42.732106+0000","last_became_peered":"2026-02-22T23:25:42.732106+0000","last_unstale":"2026-02-22T23:26:19.180610+0000","last_undegraded":"2026-02-22T23:26:19.180610+0000","last_fullsized":"2026-02-22T23:26:19.180610+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:25:41.723660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:25:41.723660+0000","last_clean_scrub_stamp":"2026-02-22T23:25:41.723660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:35:08.328395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000186295,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"17'1","reported_seq":32,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-22T23:26:19.179503+0000","last_change":"2026-02-22T23:25:44.735244+0000","last_active":"2026-02-22T23:26:19.179503+0000","last_peered":"2026-02-22T23:26:19.179503+0000","last_clean":"2026-02-22T23:26:19.179503+0000","last_became_active":"2026-02-22T23:25:42.732702+0000","last_became_peered":"2026-02-22T23:25:42.732702+0000","last_unstale":"2026-02-22T23:26:19.179503+0000","last_undegraded":"2026-02-22T23:26:19.179503+0000","last_fullsized":"2026-02-22T23:26:19.179503+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:25:41.723660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:25:41.723660+0000","last_clean_scrub_stamp":"2026-02-22T23:25:41.723660+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T01:00:00.519442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00023975299999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"14'112","reported_seq":168,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-22T23:26:19.180475+0000","last_change":"2026-02-22T23:25:36.890023+0000","last_active":"2026-02-22T23:26:19.180475+0000","last_peered":"2026-02-22T23:26:19.180475+0000","last_clean":"2026-02-22T23:26:19.180475+0000","last_became_active":"2026-02-22T23:25:36.889147+0000","last_became_peered":"2026-02-22T23:25:36.889147+0000","last_unstale":"2026-02-22T23:26:19.180475+0000","last_undegraded":"2026-02-22T23:26:19.180475+0000","last_fullsized":"2026-02-22T23:26:19.180475+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:25:35.704171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:25:35.704171+0000","last_clean_scrub_stamp":"2026-02-22T23:25:35.704171+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T02:46:45.050923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":1057856,"data_compressed":22320,"data_compressed_allocated":81920,"data_compressed_original":1024000,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":12,"seq":51539607584,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":282624,"data_stored":606254,"data_compressed":11160,"data_compressed_allocated":40960,"data_compressed_original":512000,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":12,"seq":51539607583,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27192,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344648,"statfs":{"total":96636764160,"available":96608919552,"internally_reserved":0,"allocated":225280,"data_stored":77345,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":12,"seq":51539607583,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27184,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344656,"statfs":{"total":96636764160,"available":96608927744,"internally_reserved":0,"allocated":221184,"data_stored":77326,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":12,"seq":51539607583,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":282624,"data_stored":606254,"data_compressed":11160,"data_compressed_allocated":40960,"data_compressed_original":512000,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":12,"seq":51539607583,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27188,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344652,"statfs":{"total":96636764160,"available":96608923648,"internally_reserved":0,"allocated":225280,"data_stored":77345,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":11,"seq":47244640288,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27176,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344664,"statfs":{"total":96636764160,"available":96608935936,"internally_reserved":0,"allocated":221184,"data_stored":77326,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27589065},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":528928,"data_compressed":11160,"data_compressed_allocated":40960,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":528928,"data_compressed":11160,"data_compressed_allocated":40960,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-22T23:28:06.574 INFO:tasks.ceph.ceph_manager.ceph:clean! 2026-02-22T23:28:06.574 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-22T23:28:06.648 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.640+0000 7f39201ce640 10 monclient: get_monmap_and_config 2026-02-22T23:28:06.649 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.640+0000 7f39201ce640 10 monclient: build_initial_monmap 2026-02-22T23:28:06.649 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.640+0000 7f39201ce640 10 monclient: monmap: 2026-02-22T23:28:06.649 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-22T23:28:06.649 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:28:06.649 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:28:06.641271+0000 2026-02-22T23:28:06.649 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:28:06.641271+0000 2026-02-22T23:28:06.649 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-22T23:28:06.649 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:28:06.649 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-22T23:28:06.649 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.noname-f 2026-02-22T23:28:06.649 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.noname-b 2026-02-22T23:28:06.650 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.noname-g 2026-02-22T23:28:06.650 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.noname-c 2026-02-22T23:28:06.650 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.noname-h 2026-02-22T23:28:06.650 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.noname-d 2026-02-22T23:28:06.650 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.noname-i 2026-02-22T23:28:06.650 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.noname-e 2026-02-22T23:28:06.650 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:06.650 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.640+0000 7f39201ce640 1 Processor -- start 2026-02-22T23:28:06.650 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.640+0000 7f39201ce640 1 -- start start 2026-02-22T23:28:06.650 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.640+0000 7f39201ce640 10 monclient: init 2026-02-22T23:28:06.650 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.640+0000 7f39201ce640 10 monclient: _reopen_session rank -1 2026-02-22T23:28:06.650 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.640+0000 7f39201ce640 10 monclient: _add_conns ranks=[2,4,8,0,1,3,5,7,6] 2026-02-22T23:28:06.651 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.640+0000 7f39201ce640 10 monclient(hunting): picked mon.noname-b con 0x7f39180a1a60 addr v1:10.20.193.45:6790/0 2026-02-22T23:28:06.651 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.640+0000 7f39201ce640 10 monclient(hunting): picked mon.noname-c con 0x7f391806f1e0 addr v1:10.20.193.45:6791/0 2026-02-22T23:28:06.651 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.640+0000 7f39201ce640 10 monclient(hunting): picked mon.noname-e con 0x7f39180a0980 addr v1:10.20.193.45:6793/0 2026-02-22T23:28:06.651 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.640+0000 7f39201ce640 1 -- --> v1:10.20.193.45:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f391809df00 con 0x7f39180a1a60 2026-02-22T23:28:06.651 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.640+0000 7f39201ce640 1 -- --> v1:10.20.193.45:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3918137660 con 0x7f391806f1e0 2026-02-22T23:28:06.651 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.640+0000 7f39201ce640 1 -- --> v1:10.20.193.45:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f39180a4510 con 0x7f39180a0980 2026-02-22T23:28:06.651 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.640+0000 7f39201ce640 10 monclient(hunting): _renew_subs 2026-02-22T23:28:06.651 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.640+0000 7f39201ce640 10 monclient(hunting): authenticate will time out at 818.257847s 2026-02-22T23:28:06.651 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.640+0000 7f391df43640 1 --1- >> v1:10.20.193.45:6790/0 conn(0x7f39180a1a60 0x7f3918136840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.45:6790/0 says I am v1:10.20.193.45:60182/0 (socket says 10.20.193.45:60182) 2026-02-22T23:28:06.651 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.640+0000 7f391df43640 1 -- 10.20.193.45:0/832850523 learned_addr learned my addr 10.20.193.45:0/832850523 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-22T23:28:06.651 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.641+0000 7f391cf41640 1 -- 10.20.193.45:0/832850523 <== mon.2 v1:10.20.193.45:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 964640843 0 0) 0x7f3908002920 con 0x7f39180a1a60 2026-02-22T23:28:06.651 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.641+0000 7f391cf41640 10 monclient(hunting): _negotiate 2026-02-22T23:28:06.652 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.641+0000 7f391cf41640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:28:06.652 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.641+0000 7f391cf41640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:28:06.652 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.641+0000 7f391cf41640 10 monclient(hunting): my global_id is 4736 2026-02-22T23:28:06.652 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.641+0000 7f391cf41640 1 -- 10.20.193.45:0/832850523 --> v1:10.20.193.45:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3900003620 con 0x7f39180a1a60 2026-02-22T23:28:06.652 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.641+0000 7f391cf41640 1 -- 10.20.193.45:0/832850523 <== mon.4 v1:10.20.193.45:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4097621421 0 0) 0x7f3918137660 con 0x7f391806f1e0 2026-02-22T23:28:06.652 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.641+0000 7f391cf41640 10 monclient(hunting): _negotiate 2026-02-22T23:28:06.652 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.641+0000 7f391cf41640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:28:06.652 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.641+0000 7f391cf41640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:28:06.652 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.641+0000 7f391cf41640 10 monclient(hunting): my global_id is 114214 2026-02-22T23:28:06.652 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.641+0000 7f391cf41640 1 -- 10.20.193.45:0/832850523 --> v1:10.20.193.45:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3908002920 con 0x7f391806f1e0 2026-02-22T23:28:06.652 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.641+0000 7f391cf41640 1 -- 10.20.193.45:0/832850523 <== mon.8 v1:10.20.193.45:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2019250489 0 0) 0x7f39180a4510 con 0x7f39180a0980 2026-02-22T23:28:06.652 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.641+0000 7f391cf41640 10 monclient(hunting): _negotiate 2026-02-22T23:28:06.652 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.641+0000 7f391cf41640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:28:06.653 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.641+0000 7f391cf41640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:28:06.653 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.641+0000 7f391cf41640 10 monclient(hunting): my global_id is 4706 2026-02-22T23:28:06.653 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.641+0000 7f391cf41640 1 -- 10.20.193.45:0/832850523 --> v1:10.20.193.45:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3918137660 con 0x7f39180a0980 2026-02-22T23:28:06.653 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.641+0000 7f391cf41640 1 -- 10.20.193.45:0/832850523 <== mon.2 v1:10.20.193.45:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3979268099 0 0) 0x7f3900003620 con 0x7f39180a1a60 2026-02-22T23:28:06.653 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.641+0000 7f391cf41640 1 -- 10.20.193.45:0/832850523 >> v1:10.20.193.45:6793/0 conn(0x7f39180a0980 legacy=0x7f391813ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:06.653 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.641+0000 7f391cf41640 1 -- 10.20.193.45:0/832850523 >> v1:10.20.193.45:6791/0 conn(0x7f391806f1e0 legacy=0x7f3918136f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:06.653 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.641+0000 7f391cf41640 10 monclient: _finish_hunting 0 2026-02-22T23:28:06.653 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.641+0000 7f391cf41640 1 monclient: found mon.noname-b 2026-02-22T23:28:06.653 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.641+0000 7f391cf41640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T23:28:06.653 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.641+0000 7f391cf41640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.45:6790/0 2026-02-22T23:28:06.653 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.641+0000 7f391cf41640 1 -- 10.20.193.45:0/832850523 --> v1:10.20.193.45:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3918143400 con 0x7f39180a1a60 2026-02-22T23:28:06.653 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.641+0000 7f391cf41640 10 monclient: _finish_auth 0 2026-02-22T23:28:06.654 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.641+0000 7f391cf41640 10 monclient: _check_auth_tickets 2026-02-22T23:28:06.654 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.641+0000 7f391cf41640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T23:28:06.654 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.641+0000 7f391cf41640 1 -- 10.20.193.45:0/832850523 <== mon.2 v1:10.20.193.45:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f3908003210 con 0x7f39180a1a60 2026-02-22T23:28:06.654 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.641+0000 7f39201ce640 5 monclient: authenticate success, global_id 4736 2026-02-22T23:28:06.654 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.641+0000 7f39201ce640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-22T23:28:06.654 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.641+0000 7f391cf41640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:28:06.654 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.641+0000 7f391cf41640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-22T23:28:06.654 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.641+0000 7f391cf41640 10 monclient: dump: 2026-02-22T23:28:06.654 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:28:06.654 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:28:06.654 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:06.654 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:06.655 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:28:06.655 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:28:06.655 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:28:06.655 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:28:06.655 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:28:06.655 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:28:06.655 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:28:06.655 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:28:06.655 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:28:06.655 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:28:06.655 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:28:06.655 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:06.655 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.641+0000 7f39201ce640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-22T23:28:06.656 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.641+0000 7f391cf41640 1 -- 10.20.193.45:0/832850523 <== mon.2 v1:10.20.193.45:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f39080033b0 con 0x7f39180a1a60 2026-02-22T23:28:06.656 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.641+0000 7f391cf41640 10 monclient: handle_config config(0 keys) 2026-02-22T23:28:06.656 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.641+0000 7f391cf41640 1 -- 10.20.193.45:0/832850523 <== mon.2 v1:10.20.193.45:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f3908004ce0 con 0x7f39180a1a60 2026-02-22T23:28:06.656 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.641+0000 7f391cf41640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:28:06.656 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.641+0000 7f391cf41640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-22T23:28:06.656 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.641+0000 7f391cf41640 10 monclient: dump: 2026-02-22T23:28:06.656 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:28:06.656 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:28:06.656 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:06.656 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:06.656 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:28:06.656 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:28:06.657 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:28:06.657 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:28:06.657 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:28:06.657 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:28:06.657 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:28:06.657 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:28:06.657 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:28:06.657 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:28:06.657 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:28:06.657 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:06.657 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.641+0000 7f39201ce640 10 monclient: get_monmap_and_config success 2026-02-22T23:28:06.657 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.641+0000 7f39201ce640 4 set_mon_vals no callback set 2026-02-22T23:28:06.658 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.641+0000 7f39201ce640 10 monclient: shutdown 2026-02-22T23:28:06.658 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.641+0000 7f39201ce640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T23:28:06.658 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.641+0000 7f39201ce640 1 -- 10.20.193.45:0/832850523 >> v1:10.20.193.45:6790/0 conn(0x7f39180a1a60 legacy=0x7f3918136840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:06.658 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.641+0000 7f39201ce640 1 -- 10.20.193.45:0/832850523 shutdown_connections 2026-02-22T23:28:06.658 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.641+0000 7f39201ce640 1 -- 10.20.193.45:0/832850523 >> 10.20.193.45:0/832850523 conn(0x7f39180a7780 msgr2=0x7f39180a3b60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:28:06.658 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.641+0000 7f39201ce640 1 -- 10.20.193.45:0/832850523 shutdown_connections 2026-02-22T23:28:06.658 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.641+0000 7f39201ce640 1 -- 10.20.193.45:0/832850523 wait complete. 2026-02-22T23:28:06.658 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.641+0000 7f39201ce640 10 monclient: build_initial_monmap 2026-02-22T23:28:06.658 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.641+0000 7f39201ce640 10 monclient: monmap: 2026-02-22T23:28:06.658 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-22T23:28:06.658 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T23:28:06.658 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-22T23:28:06.659 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-22T23:28:06.659 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-22T23:28:06.659 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-22T23:28:06.659 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-22T23:28:06.659 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.noname-f 2026-02-22T23:28:06.659 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.noname-b 2026-02-22T23:28:06.659 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.noname-g 2026-02-22T23:28:06.659 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.noname-c 2026-02-22T23:28:06.659 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.noname-h 2026-02-22T23:28:06.659 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.noname-d 2026-02-22T23:28:06.659 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.noname-i 2026-02-22T23:28:06.659 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.noname-e 2026-02-22T23:28:06.659 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:06.660 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.642+0000 7f39201ce640 1 Processor -- start 2026-02-22T23:28:06.660 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.642+0000 7f39201ce640 1 -- start start 2026-02-22T23:28:06.660 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.642+0000 7f39201ce640 10 monclient: init 2026-02-22T23:28:06.660 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.642+0000 7f39201ce640 10 monclient: _reopen_session rank -1 2026-02-22T23:28:06.660 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.642+0000 7f39201ce640 10 monclient: _add_conns ranks=[7,6,1,0,2,5,4,8,3] 2026-02-22T23:28:06.660 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.642+0000 7f39201ce640 10 monclient(hunting): picked mon.noname-i con 0x7f39180a0980 addr v1:10.20.193.73:6792/0 2026-02-22T23:28:06.660 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.642+0000 7f39201ce640 10 monclient(hunting): picked mon.noname-d con 0x7f39180a1a60 addr v1:10.20.193.45:6792/0 2026-02-22T23:28:06.660 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.642+0000 7f39201ce640 10 monclient(hunting): picked mon.noname-f con 0x7f39181cf450 addr v1:10.20.193.73:6789/0 2026-02-22T23:28:06.660 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.642+0000 7f39201ce640 1 -- --> v1:10.20.193.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3918136f50 con 0x7f39181cf450 2026-02-22T23:28:06.660 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.642+0000 7f39201ce640 1 -- --> v1:10.20.193.45:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f391811e1a0 con 0x7f39180a1a60 2026-02-22T23:28:06.660 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.642+0000 7f39201ce640 1 -- --> v1:10.20.193.73:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3918143180 con 0x7f39180a0980 2026-02-22T23:28:06.660 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.642+0000 7f39201ce640 10 monclient(hunting): _renew_subs 2026-02-22T23:28:06.660 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.642+0000 7f39201ce640 10 monclient(hunting): authenticate will time out at 818.259391s 2026-02-22T23:28:06.661 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.642+0000 7f391d742640 1 --1- >> v1:10.20.193.45:6792/0 conn(0x7f39180a1a60 0x7f39181d4770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.45:6792/0 says I am v1:10.20.193.45:36828/0 (socket says 10.20.193.45:36828) 2026-02-22T23:28:06.661 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.642+0000 7f391d742640 1 -- 10.20.193.45:0/3183600872 learned_addr learned my addr 10.20.193.45:0/3183600872 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-22T23:28:06.661 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.642+0000 7f39067fc640 1 -- 10.20.193.45:0/3183600872 <== mon.6 v1:10.20.193.45:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 350212226 0 0) 0x7f391811e1a0 con 0x7f39180a1a60 2026-02-22T23:28:06.661 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.642+0000 7f39067fc640 10 monclient(hunting): _negotiate 2026-02-22T23:28:06.661 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.642+0000 7f39067fc640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:28:06.661 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.642+0000 7f39067fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:28:06.661 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.642+0000 7f39067fc640 10 monclient(hunting): my global_id is 114198 2026-02-22T23:28:06.661 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.642+0000 7f39067fc640 1 -- 10.20.193.45:0/3183600872 --> v1:10.20.193.45:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f38e8003620 con 0x7f39180a1a60 2026-02-22T23:28:06.661 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.642+0000 7f39067fc640 1 -- 10.20.193.45:0/3183600872 <== mon.6 v1:10.20.193.45:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 73032350 0 0) 0x7f38e8003620 con 0x7f39180a1a60 2026-02-22T23:28:06.661 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.642+0000 7f39067fc640 1 -- 10.20.193.45:0/3183600872 --> v1:10.20.193.45:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f391811e1a0 con 0x7f39180a1a60 2026-02-22T23:28:06.661 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.642+0000 7f39067fc640 1 -- 10.20.193.45:0/3183600872 <== mon.6 v1:10.20.193.45:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f390c0035e0 con 0x7f39180a1a60 2026-02-22T23:28:06.661 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.642+0000 7f39067fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-22T23:28:06.662 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.642+0000 7f39067fc640 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2026-02-22T23:28:06.662 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.642+0000 7f39067fc640 10 monclient(hunting): dump: 2026-02-22T23:28:06.662 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:28:06.662 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:28:06.662 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:06.662 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:06.662 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:28:06.662 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:28:06.662 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:28:06.662 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:28:06.662 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:28:06.662 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:28:06.662 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:28:06.663 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:28:06.663 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:28:06.663 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:28:06.663 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:28:06.663 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:06.663 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.642+0000 7f39067fc640 10 monclient(hunting): _finish_auth 0 2026-02-22T23:28:06.663 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.642+0000 7f39067fc640 1 -- 10.20.193.45:0/3183600872 <== mon.6 v1:10.20.193.45:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2189259169 0 0) 0x7f391811e1a0 con 0x7f39180a1a60 2026-02-22T23:28:06.663 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.642+0000 7f39067fc640 1 -- 10.20.193.45:0/3183600872 >> v1:10.20.193.73:6792/0 conn(0x7f39180a0980 legacy=0x7f3918136840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:06.663 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.642+0000 7f39067fc640 1 -- 10.20.193.45:0/3183600872 >> v1:10.20.193.73:6789/0 conn(0x7f39181cf450 legacy=0x7f39181d7ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:06.663 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.642+0000 7f39067fc640 10 monclient: _finish_hunting 0 2026-02-22T23:28:06.663 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.642+0000 7f39067fc640 1 monclient: found mon.d 2026-02-22T23:28:06.663 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.642+0000 7f39067fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T23:28:06.664 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.642+0000 7f39067fc640 10 monclient: _send_mon_message to mon.d at v1:10.20.193.45:6792/0 2026-02-22T23:28:06.664 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.642+0000 7f39067fc640 1 -- 10.20.193.45:0/3183600872 --> v1:10.20.193.45:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3918142d70 con 0x7f39180a1a60 2026-02-22T23:28:06.664 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.642+0000 7f39067fc640 10 monclient: _finish_auth 0 2026-02-22T23:28:06.664 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.642+0000 7f39067fc640 10 monclient: _check_auth_tickets 2026-02-22T23:28:06.664 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.642+0000 7f39067fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T23:28:06.664 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.642+0000 7f39201ce640 5 monclient: authenticate success, global_id 114198 2026-02-22T23:28:06.664 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.642+0000 7f39201ce640 10 monclient: _renew_subs 2026-02-22T23:28:06.664 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.642+0000 7f39201ce640 10 monclient: _send_mon_message to mon.d at v1:10.20.193.45:6792/0 2026-02-22T23:28:06.664 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.642+0000 7f39201ce640 1 -- 10.20.193.45:0/3183600872 --> v1:10.20.193.45:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f391811dbe0 con 0x7f39180a1a60 2026-02-22T23:28:06.664 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.642+0000 7f39201ce640 10 monclient: _renew_subs 2026-02-22T23:28:06.664 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.642+0000 7f39201ce640 10 monclient: _send_mon_message to mon.d at v1:10.20.193.45:6792/0 2026-02-22T23:28:06.664 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.642+0000 7f39201ce640 1 -- 10.20.193.45:0/3183600872 --> v1:10.20.193.45:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7f39181d02e0 con 0x7f39180a1a60 2026-02-22T23:28:06.665 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.642+0000 7f39067fc640 1 -- 10.20.193.45:0/3183600872 <== mon.6 v1:10.20.193.45:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f390c003b30 con 0x7f39180a1a60 2026-02-22T23:28:06.665 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.642+0000 7f39067fc640 10 monclient: handle_config config(0 keys) 2026-02-22T23:28:06.665 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.642+0000 7f39067fc640 1 -- 10.20.193.45:0/3183600872 <== mon.6 v1:10.20.193.45:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f390c005430 con 0x7f39180a1a60 2026-02-22T23:28:06.665 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.642+0000 7f39067fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:28:06.665 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.642+0000 7f39067fc640 10 monclient: got monmap 1 from mon.d (according to old e1) 2026-02-22T23:28:06.665 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.642+0000 7f39067fc640 10 monclient: dump: 2026-02-22T23:28:06.665 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:28:06.665 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:28:06.665 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:06.665 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:06.665 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:28:06.665 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:28:06.665 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:28:06.666 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:28:06.666 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:28:06.666 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:28:06.666 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:28:06.666 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:28:06.666 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:28:06.666 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:28:06.666 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:28:06.666 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:06.666 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.642+0000 7f3907fff640 4 set_mon_vals no callback set 2026-02-22T23:28:06.666 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.643+0000 7f39201ce640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T23:28:06.666 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.643+0000 7f39201ce640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T23:28:06.666 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.643+0000 7f39201ce640 10 monclient: _send_mon_message to mon.d at v1:10.20.193.45:6792/0 2026-02-22T23:28:06.667 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.643+0000 7f39201ce640 1 -- 10.20.193.45:0/3183600872 --> v1:10.20.193.45:6792/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39180008d0 con 0x7f39180a1a60 2026-02-22T23:28:06.667 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.643+0000 7f39067fc640 1 -- 10.20.193.45:0/3183600872 <== mon.6 v1:10.20.193.45:6792/0 7 ==== mgrmap(e 5) ==== 50225+0+0 (unknown 2330357642 0 0) 0x7f390c011a10 con 0x7f39180a1a60 2026-02-22T23:28:06.667 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.643+0000 7f39067fc640 1 -- 10.20.193.45:0/3183600872 <== mon.6 v1:10.20.193.45:6792/0 8 ==== osd_map(25..25 src has 1..25) ==== 3502+0+0 (unknown 129690100 0 0) 0x7f390c04dd40 con 0x7f39180a1a60 2026-02-22T23:28:06.667 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.643+0000 7f391df43640 10 monclient: get_auth_request con 0x7f38e803f820 auth_method 0 2026-02-22T23:28:06.667 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.645+0000 7f39067fc640 1 -- 10.20.193.45:0/3183600872 <== mon.6 v1:10.20.193.45:6792/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (unknown 1092875540 0 2568732696) 0x7f390c017940 con 0x7f39180a1a60 2026-02-22T23:28:06.667 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.645+0000 7f39067fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T23:28:06.667 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.645+0000 7f39067fc640 10 monclient: _finish_command 1 = system:0 2026-02-22T23:28:06.731 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.729+0000 7f39201ce640 1 -- 10.20.193.45:0/3183600872 --> v1:10.20.193.73:6800/2222410180 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f391813f230 con 0x7f38e803f820 2026-02-22T23:28:06.732 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.730+0000 7f39067fc640 1 -- 10.20.193.45:0/3183600872 <== mgr.4111 v1:10.20.193.73:6800/2222410180 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+33968 (unknown 2965378022 0 1572888847) 0x7f391813f230 con 0x7f38e803f820 2026-02-22T23:28:06.732 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-22T23:28:06.733 INFO:teuthology.orchestra.run.trial045.stderr:dumped all 2026-02-22T23:28:06.733 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.731+0000 7f39201ce640 1 -- 10.20.193.45:0/3183600872 >> v1:10.20.193.73:6800/2222410180 conn(0x7f38e803f820 legacy=0x7f38e8041ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:06.734 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.731+0000 7f39201ce640 10 monclient: shutdown 2026-02-22T23:28:06.734 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.731+0000 7f39201ce640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T23:28:06.734 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.731+0000 7f39201ce640 1 -- 10.20.193.45:0/3183600872 >> v1:10.20.193.45:6792/0 conn(0x7f39180a1a60 legacy=0x7f39181d4770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:06.734 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.731+0000 7f39201ce640 1 -- 10.20.193.45:0/3183600872 shutdown_connections 2026-02-22T23:28:06.734 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.731+0000 7f39201ce640 1 -- 10.20.193.45:0/3183600872 >> 10.20.193.45:0/3183600872 conn(0x7f39180a7780 msgr2=0x7f391809e850 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:28:06.734 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.731+0000 7f39201ce640 1 -- 10.20.193.45:0/3183600872 shutdown_connections 2026-02-22T23:28:06.734 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.731+0000 7f39201ce640 1 -- 10.20.193.45:0/3183600872 wait complete. 2026-02-22T23:28:06.739 INFO:teuthology.orchestra.run.trial045.stdout:{"pg_ready":true,"pg_map":{"version":96,"stamp":"2026-02-22T23:28:05.208833+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":147,"num_write_kb":2674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":115,"ondisk_log_size":115,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":163224,"kb_used_data":1424,"kb_used_omap":9,"kb_used_meta":161654,"kb_avail":566067816,"statfs":{"total":579820584960,"available":579653443584,"internally_reserved":0,"allocated":1458176,"data_stored":1521850,"data_compressed":22320,"data_compressed_allocated":81920,"data_compressed_original":1024000,"omap_allocated":9561,"internal_metadata":165534375},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001150"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":31,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-22T23:26:19.181052+0000","last_change":"2026-02-22T23:25:44.735205+0000","last_active":"2026-02-22T23:26:19.181052+0000","last_peered":"2026-02-22T23:26:19.181052+0000","last_clean":"2026-02-22T23:26:19.181052+0000","last_became_active":"2026-02-22T23:25:42.732237+0000","last_became_peered":"2026-02-22T23:25:42.732237+0000","last_unstale":"2026-02-22T23:26:19.181052+0000","last_undegraded":"2026-02-22T23:26:19.181052+0000","last_fullsized":"2026-02-22T23:26:19.181052+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:25:41.723660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:25:41.723660+0000","last_clean_scrub_stamp":"2026-02-22T23:25:41.723660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:02:39.156862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000197314,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":32,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-22T23:26:18.881919+0000","last_change":"2026-02-22T23:25:44.734485+0000","last_active":"2026-02-22T23:26:18.881919+0000","last_peered":"2026-02-22T23:26:18.881919+0000","last_clean":"2026-02-22T23:26:18.881919+0000","last_became_active":"2026-02-22T23:25:42.731608+0000","last_became_peered":"2026-02-22T23:25:42.731608+0000","last_unstale":"2026-02-22T23:26:18.881919+0000","last_undegraded":"2026-02-22T23:26:18.881919+0000","last_fullsized":"2026-02-22T23:26:18.881919+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:25:41.723660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:25:41.723660+0000","last_clean_scrub_stamp":"2026-02-22T23:25:41.723660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:38:27.110138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044396600000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":31,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-22T23:26:19.180763+0000","last_change":"2026-02-22T23:25:44.735342+0000","last_active":"2026-02-22T23:26:19.180763+0000","last_peered":"2026-02-22T23:26:19.180763+0000","last_clean":"2026-02-22T23:26:19.180763+0000","last_became_active":"2026-02-22T23:25:42.732947+0000","last_became_peered":"2026-02-22T23:25:42.732947+0000","last_unstale":"2026-02-22T23:26:19.180763+0000","last_undegraded":"2026-02-22T23:26:19.180763+0000","last_fullsized":"2026-02-22T23:26:19.180763+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:25:41.723660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:25:41.723660+0000","last_clean_scrub_stamp":"2026-02-22T23:25:41.723660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T02:33:36.757781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00031882900000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":31,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-22T23:26:18.882218+0000","last_change":"2026-02-22T23:25:44.771461+0000","last_active":"2026-02-22T23:26:18.882218+0000","last_peered":"2026-02-22T23:26:18.882218+0000","last_clean":"2026-02-22T23:26:18.882218+0000","last_became_active":"2026-02-22T23:25:42.729582+0000","last_became_peered":"2026-02-22T23:25:42.729582+0000","last_unstale":"2026-02-22T23:26:18.882218+0000","last_undegraded":"2026-02-22T23:26:18.882218+0000","last_fullsized":"2026-02-22T23:26:18.882218+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:25:41.723660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:25:41.723660+0000","last_clean_scrub_stamp":"2026-02-22T23:25:41.723660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T06:30:33.437324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00022341099999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"19'2","reported_seq":33,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-22T23:26:19.179750+0000","last_change":"2026-02-22T23:25:44.735543+0000","last_active":"2026-02-22T23:26:19.179750+0000","last_peered":"2026-02-22T23:26:19.179750+0000","last_clean":"2026-02-22T23:26:19.179750+0000","last_became_active":"2026-02-22T23:25:42.733018+0000","last_became_peered":"2026-02-22T23:25:42.733018+0000","last_unstale":"2026-02-22T23:26:19.179750+0000","last_undegraded":"2026-02-22T23:26:19.179750+0000","last_fullsized":"2026-02-22T23:26:19.179750+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:25:41.723660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:25:41.723660+0000","last_clean_scrub_stamp":"2026-02-22T23:25:41.723660+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T04:28:19.249844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044642500000000002,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":32,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-22T23:26:19.178926+0000","last_change":"2026-02-22T23:25:44.734019+0000","last_active":"2026-02-22T23:26:19.178926+0000","last_peered":"2026-02-22T23:26:19.178926+0000","last_clean":"2026-02-22T23:26:19.178926+0000","last_became_active":"2026-02-22T23:25:42.729332+0000","last_became_peered":"2026-02-22T23:25:42.729332+0000","last_unstale":"2026-02-22T23:26:19.178926+0000","last_undegraded":"2026-02-22T23:26:19.178926+0000","last_fullsized":"2026-02-22T23:26:19.178926+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:25:41.723660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:25:41.723660+0000","last_clean_scrub_stamp":"2026-02-22T23:25:41.723660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T05:15:12.260477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00028113600000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":31,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-22T23:26:19.180610+0000","last_change":"2026-02-22T23:25:44.735208+0000","last_active":"2026-02-22T23:26:19.180610+0000","last_peered":"2026-02-22T23:26:19.180610+0000","last_clean":"2026-02-22T23:26:19.180610+0000","last_became_active":"2026-02-22T23:25:42.732106+0000","last_became_peered":"2026-02-22T23:25:42.732106+0000","last_unstale":"2026-02-22T23:26:19.180610+0000","last_undegraded":"2026-02-22T23:26:19.180610+0000","last_fullsized":"2026-02-22T23:26:19.180610+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:25:41.723660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:25:41.723660+0000","last_clean_scrub_stamp":"2026-02-22T23:25:41.723660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:35:08.328395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000186295,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"17'1","reported_seq":32,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-22T23:26:19.179503+0000","last_change":"2026-02-22T23:25:44.735244+0000","last_active":"2026-02-22T23:26:19.179503+0000","last_peered":"2026-02-22T23:26:19.179503+0000","last_clean":"2026-02-22T23:26:19.179503+0000","last_became_active":"2026-02-22T23:25:42.732702+0000","last_became_peered":"2026-02-22T23:25:42.732702+0000","last_unstale":"2026-02-22T23:26:19.179503+0000","last_undegraded":"2026-02-22T23:26:19.179503+0000","last_fullsized":"2026-02-22T23:26:19.179503+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:25:41.723660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:25:41.723660+0000","last_clean_scrub_stamp":"2026-02-22T23:25:41.723660+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T01:00:00.519442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00023975299999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"14'112","reported_seq":168,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-22T23:26:19.180475+0000","last_change":"2026-02-22T23:25:36.890023+0000","last_active":"2026-02-22T23:26:19.180475+0000","last_peered":"2026-02-22T23:26:19.180475+0000","last_clean":"2026-02-22T23:26:19.180475+0000","last_became_active":"2026-02-22T23:25:36.889147+0000","last_became_peered":"2026-02-22T23:25:36.889147+0000","last_unstale":"2026-02-22T23:26:19.180475+0000","last_undegraded":"2026-02-22T23:26:19.180475+0000","last_fullsized":"2026-02-22T23:26:19.180475+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:25:35.704171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:25:35.704171+0000","last_clean_scrub_stamp":"2026-02-22T23:25:35.704171+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T02:46:45.050923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":1057856,"data_compressed":22320,"data_compressed_allocated":81920,"data_compressed_original":1024000,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":12,"seq":51539607584,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":282624,"data_stored":606254,"data_compressed":11160,"data_compressed_allocated":40960,"data_compressed_original":512000,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":12,"seq":51539607583,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27192,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344648,"statfs":{"total":96636764160,"available":96608919552,"internally_reserved":0,"allocated":225280,"data_stored":77345,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":12,"seq":51539607583,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27184,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344656,"statfs":{"total":96636764160,"available":96608927744,"internally_reserved":0,"allocated":221184,"data_stored":77326,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":12,"seq":51539607583,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":282624,"data_stored":606254,"data_compressed":11160,"data_compressed_allocated":40960,"data_compressed_original":512000,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":12,"seq":51539607583,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27188,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344652,"statfs":{"total":96636764160,"available":96608923648,"internally_reserved":0,"allocated":225280,"data_stored":77345,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":11,"seq":47244640288,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27176,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344664,"statfs":{"total":96636764160,"available":96608935936,"internally_reserved":0,"allocated":221184,"data_stored":77326,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27589065},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":528928,"data_compressed":11160,"data_compressed_allocated":40960,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":528928,"data_compressed":11160,"data_compressed_allocated":40960,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-22T23:28:06.741 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-22T23:28:06.810 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.808+0000 7f23a008f640 10 monclient: get_monmap_and_config 2026-02-22T23:28:06.810 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.808+0000 7f23a008f640 10 monclient: build_initial_monmap 2026-02-22T23:28:06.810 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.808+0000 7f23a008f640 10 monclient: monmap: 2026-02-22T23:28:06.810 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-22T23:28:06.810 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:28:06.810 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:28:06.809598+0000 2026-02-22T23:28:06.811 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:28:06.809598+0000 2026-02-22T23:28:06.811 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-22T23:28:06.811 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:28:06.811 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-22T23:28:06.811 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.noname-f 2026-02-22T23:28:06.811 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.noname-b 2026-02-22T23:28:06.811 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.noname-g 2026-02-22T23:28:06.811 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.noname-c 2026-02-22T23:28:06.811 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.noname-h 2026-02-22T23:28:06.811 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.noname-d 2026-02-22T23:28:06.811 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.noname-i 2026-02-22T23:28:06.811 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.noname-e 2026-02-22T23:28:06.812 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:06.812 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.808+0000 7f23a008f640 1 Processor -- start 2026-02-22T23:28:06.812 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.808+0000 7f23a008f640 1 -- start start 2026-02-22T23:28:06.812 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.808+0000 7f23a008f640 10 monclient: init 2026-02-22T23:28:06.819 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.809+0000 7f23a008f640 10 monclient: _reopen_session rank -1 2026-02-22T23:28:06.819 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.809+0000 7f23a008f640 10 monclient: _add_conns ranks=[6,3,2,5,8,0,7,4,1] 2026-02-22T23:28:06.819 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.809+0000 7f23a008f640 10 monclient(hunting): picked mon.noname-d con 0x7f239809e5d0 addr v1:10.20.193.45:6792/0 2026-02-22T23:28:06.819 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.809+0000 7f23a008f640 10 monclient(hunting): picked mon.noname-g con 0x7f239809f700 addr v1:10.20.193.73:6790/0 2026-02-22T23:28:06.819 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.809+0000 7f23a008f640 10 monclient(hunting): picked mon.noname-b con 0x7f239809f0c0 addr v1:10.20.193.45:6790/0 2026-02-22T23:28:06.820 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.809+0000 7f23a008f640 1 -- --> v1:10.20.193.45:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23980a0560 con 0x7f239809f0c0 2026-02-22T23:28:06.820 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.809+0000 7f23a008f640 1 -- --> v1:10.20.193.73:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f239809fcc0 con 0x7f239809f700 2026-02-22T23:28:06.820 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.809+0000 7f23a008f640 1 -- --> v1:10.20.193.45:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23980a2e90 con 0x7f239809e5d0 2026-02-22T23:28:06.820 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.809+0000 7f23a008f640 10 monclient(hunting): _renew_subs 2026-02-22T23:28:06.820 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.809+0000 7f23a008f640 10 monclient(hunting): authenticate will time out at 818.426190s 2026-02-22T23:28:06.820 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.809+0000 7f239de04640 1 --1- >> v1:10.20.193.45:6792/0 conn(0x7f239809e5d0 0x7f239809e9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.45:6792/0 says I am v1:10.20.193.45:36832/0 (socket says 10.20.193.45:36832) 2026-02-22T23:28:06.820 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.809+0000 7f239de04640 1 -- 10.20.193.45:0/691212112 learned_addr learned my addr 10.20.193.45:0/691212112 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-22T23:28:06.820 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.809+0000 7f239ce02640 1 -- 10.20.193.45:0/691212112 <== mon.6 v1:10.20.193.45:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3908940017 0 0) 0x7f23980a2e90 con 0x7f239809e5d0 2026-02-22T23:28:06.820 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.809+0000 7f239ce02640 10 monclient(hunting): _negotiate 2026-02-22T23:28:06.820 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.809+0000 7f239ce02640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:28:06.821 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.809+0000 7f239ce02640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:28:06.821 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.809+0000 7f239ce02640 10 monclient(hunting): my global_id is 114207 2026-02-22T23:28:06.821 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.809+0000 7f239ce02640 1 -- 10.20.193.45:0/691212112 --> v1:10.20.193.45:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2380003620 con 0x7f239809e5d0 2026-02-22T23:28:06.821 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.809+0000 7f239ce02640 1 -- 10.20.193.45:0/691212112 <== mon.2 v1:10.20.193.45:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1374585552 0 0) 0x7f23980a0560 con 0x7f239809f0c0 2026-02-22T23:28:06.821 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.809+0000 7f239ce02640 10 monclient(hunting): _negotiate 2026-02-22T23:28:06.821 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.809+0000 7f239ce02640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:28:06.821 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.809+0000 7f239ce02640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:28:06.821 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.809+0000 7f239ce02640 10 monclient(hunting): my global_id is 4745 2026-02-22T23:28:06.821 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.809+0000 7f239ce02640 1 -- 10.20.193.45:0/691212112 --> v1:10.20.193.45:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f23980a2e90 con 0x7f239809f0c0 2026-02-22T23:28:06.821 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.809+0000 7f239ce02640 1 -- 10.20.193.45:0/691212112 <== mon.6 v1:10.20.193.45:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2154807690 0 0) 0x7f2380003620 con 0x7f239809e5d0 2026-02-22T23:28:06.821 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.809+0000 7f239ce02640 1 -- 10.20.193.45:0/691212112 >> v1:10.20.193.73:6790/0 conn(0x7f239809f700 legacy=0x7f239813ac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:06.822 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.809+0000 7f239ce02640 1 -- 10.20.193.45:0/691212112 >> v1:10.20.193.45:6790/0 conn(0x7f239809f0c0 legacy=0x7f239813e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:06.822 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.809+0000 7f239ce02640 10 monclient: _finish_hunting 0 2026-02-22T23:28:06.822 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.809+0000 7f239ce02640 1 monclient: found mon.noname-d 2026-02-22T23:28:06.822 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.809+0000 7f239ce02640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T23:28:06.822 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.809+0000 7f239ce02640 10 monclient: _send_mon_message to mon.noname-d at v1:10.20.193.45:6792/0 2026-02-22T23:28:06.822 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.809+0000 7f239ce02640 1 -- 10.20.193.45:0/691212112 --> v1:10.20.193.45:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23980a3130 con 0x7f239809e5d0 2026-02-22T23:28:06.822 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.809+0000 7f239ce02640 10 monclient: _finish_auth 0 2026-02-22T23:28:06.822 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.809+0000 7f239ce02640 10 monclient: _check_auth_tickets 2026-02-22T23:28:06.822 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.809+0000 7f239ce02640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T23:28:06.822 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.809+0000 7f239ce02640 1 -- 10.20.193.45:0/691212112 <== mon.6 v1:10.20.193.45:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f2388003040 con 0x7f239809e5d0 2026-02-22T23:28:06.822 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.809+0000 7f23a008f640 5 monclient: authenticate success, global_id 114207 2026-02-22T23:28:06.822 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.809+0000 7f23a008f640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-22T23:28:06.822 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.809+0000 7f239ce02640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:28:06.823 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.809+0000 7f239ce02640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2026-02-22T23:28:06.823 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.809+0000 7f239ce02640 10 monclient: dump: 2026-02-22T23:28:06.823 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:28:06.823 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:28:06.823 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:06.823 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:06.823 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:28:06.823 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:28:06.823 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:28:06.823 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:28:06.823 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:28:06.823 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:28:06.824 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:28:06.824 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:28:06.824 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:28:06.824 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:28:06.824 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:28:06.824 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:06.824 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.809+0000 7f23a008f640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-22T23:28:06.824 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.809+0000 7f239ce02640 1 -- 10.20.193.45:0/691212112 <== mon.6 v1:10.20.193.45:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f23880031e0 con 0x7f239809e5d0 2026-02-22T23:28:06.824 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.809+0000 7f239ce02640 10 monclient: handle_config config(0 keys) 2026-02-22T23:28:06.824 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.809+0000 7f239ce02640 1 -- 10.20.193.45:0/691212112 <== mon.6 v1:10.20.193.45:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f2388004ce0 con 0x7f239809e5d0 2026-02-22T23:28:06.824 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.809+0000 7f23a008f640 10 monclient: get_monmap_and_config success 2026-02-22T23:28:06.825 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.809+0000 7f23a008f640 4 set_mon_vals no callback set 2026-02-22T23:28:06.825 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.809+0000 7f239ce02640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:28:06.825 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.809+0000 7f239ce02640 10 monclient: got monmap 1 from mon.d (according to old e1) 2026-02-22T23:28:06.825 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.809+0000 7f239ce02640 10 monclient: dump: 2026-02-22T23:28:06.825 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:28:06.825 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:28:06.825 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:06.825 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:06.825 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:28:06.825 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:28:06.825 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:28:06.825 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:28:06.826 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:28:06.826 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:28:06.826 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:28:06.826 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:28:06.826 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:28:06.826 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:28:06.826 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:28:06.826 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:06.826 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.809+0000 7f23a008f640 10 monclient: shutdown 2026-02-22T23:28:06.826 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.809+0000 7f23a008f640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T23:28:06.826 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.809+0000 7f23a008f640 1 -- 10.20.193.45:0/691212112 >> v1:10.20.193.45:6792/0 conn(0x7f239809e5d0 legacy=0x7f239809e9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:06.826 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.810+0000 7f23a008f640 1 -- 10.20.193.45:0/691212112 shutdown_connections 2026-02-22T23:28:06.826 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.810+0000 7f23a008f640 1 -- 10.20.193.45:0/691212112 >> 10.20.193.45:0/691212112 conn(0x7f23980a7780 msgr2=0x7f23980a3b60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:28:06.827 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.810+0000 7f23a008f640 1 -- 10.20.193.45:0/691212112 shutdown_connections 2026-02-22T23:28:06.827 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.810+0000 7f23a008f640 1 -- 10.20.193.45:0/691212112 wait complete. 2026-02-22T23:28:06.827 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.810+0000 7f23a008f640 10 monclient: build_initial_monmap 2026-02-22T23:28:06.827 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.810+0000 7f23a008f640 10 monclient: monmap: 2026-02-22T23:28:06.827 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-22T23:28:06.827 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T23:28:06.827 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-22T23:28:06.827 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-22T23:28:06.827 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-22T23:28:06.827 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-22T23:28:06.827 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-22T23:28:06.828 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.noname-f 2026-02-22T23:28:06.828 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.noname-b 2026-02-22T23:28:06.828 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.noname-g 2026-02-22T23:28:06.828 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.noname-c 2026-02-22T23:28:06.828 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.noname-h 2026-02-22T23:28:06.828 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.noname-d 2026-02-22T23:28:06.828 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.noname-i 2026-02-22T23:28:06.828 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.noname-e 2026-02-22T23:28:06.828 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:06.828 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.810+0000 7f23a008f640 1 Processor -- start 2026-02-22T23:28:06.828 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.810+0000 7f23a008f640 1 -- start start 2026-02-22T23:28:06.828 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.810+0000 7f23a008f640 10 monclient: init 2026-02-22T23:28:06.828 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.810+0000 7f23a008f640 10 monclient: _reopen_session rank -1 2026-02-22T23:28:06.829 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.810+0000 7f23a008f640 10 monclient: _add_conns ranks=[5,7,8,3,6,4,2,0,1] 2026-02-22T23:28:06.829 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.810+0000 7f23a008f640 10 monclient(hunting): picked mon.noname-h con 0x7f239809e5d0 addr v1:10.20.193.73:6791/0 2026-02-22T23:28:06.829 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.810+0000 7f23a008f640 10 monclient(hunting): picked mon.noname-i con 0x7f239809f0c0 addr v1:10.20.193.73:6792/0 2026-02-22T23:28:06.829 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.810+0000 7f23a008f640 10 monclient(hunting): picked mon.noname-e con 0x7f23981361c0 addr v1:10.20.193.45:6793/0 2026-02-22T23:28:06.829 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.810+0000 7f23a008f640 1 -- --> v1:10.20.193.73:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2398073ae0 con 0x7f239809e5d0 2026-02-22T23:28:06.829 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.810+0000 7f23a008f640 1 -- --> v1:10.20.193.73:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23980a2430 con 0x7f239809f0c0 2026-02-22T23:28:06.829 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.810+0000 7f23a008f640 1 -- --> v1:10.20.193.45:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2398121180 con 0x7f23981361c0 2026-02-22T23:28:06.829 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.810+0000 7f23a008f640 10 monclient(hunting): _renew_subs 2026-02-22T23:28:06.829 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.810+0000 7f23a008f640 10 monclient(hunting): authenticate will time out at 818.427970s 2026-02-22T23:28:06.829 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.811+0000 7f239e605640 1 --1- >> v1:10.20.193.45:6793/0 conn(0x7f23981361c0 0x7f23981d37c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.45:6793/0 says I am v1:10.20.193.45:41096/0 (socket says 10.20.193.45:41096) 2026-02-22T23:28:06.829 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.811+0000 7f239e605640 1 -- 10.20.193.45:0/3801046510 learned_addr learned my addr 10.20.193.45:0/3801046510 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-22T23:28:06.829 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.811+0000 7f23867fc640 1 -- 10.20.193.45:0/3801046510 <== mon.8 v1:10.20.193.45:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 257721893 0 0) 0x7f2398121180 con 0x7f23981361c0 2026-02-22T23:28:06.830 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.811+0000 7f23867fc640 10 monclient(hunting): _negotiate 2026-02-22T23:28:06.830 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.811+0000 7f23867fc640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:28:06.830 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.811+0000 7f23867fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:28:06.830 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.811+0000 7f23867fc640 10 monclient(hunting): my global_id is 4715 2026-02-22T23:28:06.830 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.811+0000 7f23867fc640 1 -- 10.20.193.45:0/3801046510 --> v1:10.20.193.45:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2368003620 con 0x7f23981361c0 2026-02-22T23:28:06.830 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.811+0000 7f23867fc640 1 -- 10.20.193.45:0/3801046510 <== mon.7 v1:10.20.193.73:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2377271518 0 0) 0x7f23980a2430 con 0x7f239809f0c0 2026-02-22T23:28:06.830 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.811+0000 7f23867fc640 10 monclient(hunting): _negotiate 2026-02-22T23:28:06.830 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.811+0000 7f23867fc640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:28:06.830 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.811+0000 7f23867fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:28:06.830 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.811+0000 7f23867fc640 10 monclient(hunting): my global_id is 4561 2026-02-22T23:28:06.830 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.811+0000 7f23867fc640 1 -- 10.20.193.45:0/3801046510 --> v1:10.20.193.73:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2398121180 con 0x7f239809f0c0 2026-02-22T23:28:06.830 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.811+0000 7f23867fc640 1 -- 10.20.193.45:0/3801046510 <== mon.8 v1:10.20.193.45:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4015466719 0 0) 0x7f2368003620 con 0x7f23981361c0 2026-02-22T23:28:06.831 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.811+0000 7f23867fc640 1 -- 10.20.193.45:0/3801046510 --> v1:10.20.193.45:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f23980a2430 con 0x7f23981361c0 2026-02-22T23:28:06.831 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.811+0000 7f23867fc640 1 -- 10.20.193.45:0/3801046510 <== mon.8 v1:10.20.193.45:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f2394003960 con 0x7f23981361c0 2026-02-22T23:28:06.831 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.811+0000 7f23867fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-22T23:28:06.831 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.811+0000 7f23867fc640 10 monclient(hunting): got monmap 1 from mon.noname-e (according to old e1) 2026-02-22T23:28:06.831 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.811+0000 7f23867fc640 10 monclient(hunting): dump: 2026-02-22T23:28:06.831 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:28:06.831 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:28:06.831 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:06.831 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:06.831 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:28:06.831 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:28:06.831 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:28:06.832 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:28:06.832 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:28:06.832 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:28:06.832 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:28:06.832 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:28:06.832 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:28:06.832 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:28:06.832 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:28:06.832 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:06.832 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.811+0000 7f23867fc640 10 monclient(hunting): _finish_auth 0 2026-02-22T23:28:06.832 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.811+0000 7f23867fc640 1 -- 10.20.193.45:0/3801046510 <== mon.8 v1:10.20.193.45:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3788387725 0 0) 0x7f23980a2430 con 0x7f23981361c0 2026-02-22T23:28:06.832 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.811+0000 7f23867fc640 1 -- 10.20.193.45:0/3801046510 >> v1:10.20.193.73:6792/0 conn(0x7f239809f0c0 legacy=0x7f23981d0090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:06.832 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.811+0000 7f23867fc640 1 -- 10.20.193.45:0/3801046510 >> v1:10.20.193.73:6791/0 conn(0x7f239809e5d0 legacy=0x7f2398135ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:06.833 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.811+0000 7f23867fc640 10 monclient: _finish_hunting 0 2026-02-22T23:28:06.833 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.811+0000 7f23867fc640 1 monclient: found mon.e 2026-02-22T23:28:06.833 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.811+0000 7f23867fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T23:28:06.833 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.811+0000 7f23867fc640 10 monclient: _send_mon_message to mon.e at v1:10.20.193.45:6793/0 2026-02-22T23:28:06.833 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.811+0000 7f23867fc640 1 -- 10.20.193.45:0/3801046510 --> v1:10.20.193.45:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2398123470 con 0x7f23981361c0 2026-02-22T23:28:06.833 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.811+0000 7f23867fc640 10 monclient: _finish_auth 0 2026-02-22T23:28:06.833 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.811+0000 7f23867fc640 10 monclient: _check_auth_tickets 2026-02-22T23:28:06.833 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.811+0000 7f23867fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T23:28:06.833 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.811+0000 7f23a008f640 5 monclient: authenticate success, global_id 4715 2026-02-22T23:28:06.833 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.811+0000 7f23a008f640 10 monclient: _renew_subs 2026-02-22T23:28:06.833 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.811+0000 7f23a008f640 10 monclient: _send_mon_message to mon.e at v1:10.20.193.45:6793/0 2026-02-22T23:28:06.833 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.811+0000 7f23a008f640 1 -- 10.20.193.45:0/3801046510 --> v1:10.20.193.45:6793/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f2398123190 con 0x7f23981361c0 2026-02-22T23:28:06.834 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.811+0000 7f23a008f640 10 monclient: _renew_subs 2026-02-22T23:28:06.834 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.811+0000 7f23867fc640 1 -- 10.20.193.45:0/3801046510 <== mon.8 v1:10.20.193.45:6793/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2394003360 con 0x7f23981361c0 2026-02-22T23:28:06.834 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.811+0000 7f23a008f640 10 monclient: _send_mon_message to mon.e at v1:10.20.193.45:6793/0 2026-02-22T23:28:06.834 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.811+0000 7f23a008f640 1 -- 10.20.193.45:0/3801046510 --> v1:10.20.193.45:6793/0 -- mon_subscribe({osdmap=0}) -- 0x7f23981cad70 con 0x7f23981361c0 2026-02-22T23:28:06.834 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.811+0000 7f23867fc640 10 monclient: handle_config config(0 keys) 2026-02-22T23:28:06.834 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.811+0000 7f23867fc640 1 -- 10.20.193.45:0/3801046510 <== mon.8 v1:10.20.193.45:6793/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f2394004170 con 0x7f23981361c0 2026-02-22T23:28:06.834 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.811+0000 7f23867fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:28:06.834 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.811+0000 7f2387fff640 4 set_mon_vals no callback set 2026-02-22T23:28:06.834 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.811+0000 7f23867fc640 10 monclient: got monmap 1 from mon.e (according to old e1) 2026-02-22T23:28:06.834 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.811+0000 7f23867fc640 10 monclient: dump: 2026-02-22T23:28:06.834 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:28:06.834 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:28:06.835 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:06.835 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:06.835 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:28:06.835 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:28:06.835 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:28:06.835 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:28:06.835 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:28:06.835 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:28:06.835 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:28:06.835 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:28:06.836 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:28:06.836 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:28:06.836 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:28:06.836 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:06.836 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.811+0000 7f23a008f640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T23:28:06.836 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.811+0000 7f23a008f640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T23:28:06.836 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.811+0000 7f23a008f640 10 monclient: _send_mon_message to mon.e at v1:10.20.193.45:6793/0 2026-02-22T23:28:06.836 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.811+0000 7f23a008f640 1 -- 10.20.193.45:0/3801046510 --> v1:10.20.193.45:6793/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23980008d0 con 0x7f23981361c0 2026-02-22T23:28:06.836 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.812+0000 7f23867fc640 1 -- 10.20.193.45:0/3801046510 <== mon.8 v1:10.20.193.45:6793/0 7 ==== mgrmap(e 5) ==== 50225+0+0 (unknown 2330357642 0 0) 0x7f2394004310 con 0x7f23981361c0 2026-02-22T23:28:06.836 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.812+0000 7f23867fc640 1 -- 10.20.193.45:0/3801046510 <== mon.8 v1:10.20.193.45:6793/0 8 ==== osd_map(25..25 src has 1..25) ==== 3502+0+0 (unknown 129690100 0 0) 0x7f239404dfe0 con 0x7f23981361c0 2026-02-22T23:28:06.836 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.812+0000 7f239de04640 10 monclient: get_auth_request con 0x7f236803f830 auth_method 0 2026-02-22T23:28:06.836 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.814+0000 7f23867fc640 1 -- 10.20.193.45:0/3801046510 <== mon.8 v1:10.20.193.45:6793/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (unknown 1092875540 0 2568732696) 0x7f2394017ae0 con 0x7f23981361c0 2026-02-22T23:28:06.837 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.814+0000 7f23867fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T23:28:06.837 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.814+0000 7f23867fc640 10 monclient: _finish_command 1 = system:0 2026-02-22T23:28:06.899 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.897+0000 7f23a008f640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2026-02-22T23:28:06.899 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.897+0000 7f23a008f640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-22T23:28:06.899 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.897+0000 7f23a008f640 10 monclient: _send_mon_message to mon.e at v1:10.20.193.45:6793/0 2026-02-22T23:28:06.899 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.897+0000 7f23a008f640 1 -- 10.20.193.45:0/3801046510 --> v1:10.20.193.45:6793/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f23981cb100 con 0x7f23981361c0 2026-02-22T23:28:06.899 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.897+0000 7f23867fc640 1 -- 10.20.193.45:0/3801046510 <== mon.8 v1:10.20.193.45:6793/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+10845 (unknown 780366164 0 2264752221) 0x7f23940173e0 con 0x7f23981361c0 2026-02-22T23:28:06.900 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.897+0000 7f23867fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-22T23:28:06.900 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.897+0000 7f23867fc640 10 monclient: _finish_command 2 = system:0 2026-02-22T23:28:06.900 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-22T23:28:06.900 INFO:teuthology.orchestra.run.trial045.stdout:{"epoch":25,"fsid":"4b60f18f-6660-4731-b731-dc85c4078413","created":"2026-02-22T23:25:25.062615+0000","modified":"2026-02-22T23:26:18.877642+0000","last_up_change":"2026-02-22T23:25:34.696475+0000","last_in_change":"2026-02-22T23:25:26.208612+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-22T23:25:35.209511+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6.059999942779541,"score_stable":6.059999942779541,"optimal_score":0.33000001311302185,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2026-02-22T23:25:40.737184+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":19,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ef9d15a7-661e-40c5-a418-7f794c0975b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.45:6801","nonce":1146005631}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.45:6803","nonce":1146005631}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.45:6807","nonce":1146005631}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.45:6805","nonce":1146005631}]},"public_addr":"10.20.193.45:6801/1146005631","cluster_addr":"10.20.193.45:6803/1146005631","heartbeat_back_addr":"10.20.193.45:6807/1146005631","heartbeat_front_addr":"10.20.193.45:6805/1146005631","state":["exists","up"]},{"osd":1,"uuid":"9e62cdef-b0a0-4f67-a778-ac4f7d97ed7e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.45:6800","nonce":628358795}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.45:6802","nonce":628358795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.45:6806","nonce":628358795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.45:6804","nonce":628358795}]},"public_addr":"10.20.193.45:6800/628358795","cluster_addr":"10.20.193.45:6802/628358795","heartbeat_back_addr":"10.20.193.45:6806/628358795","heartbeat_front_addr":"10.20.193.45:6804/628358795","state":["exists","up"]},{"osd":2,"uuid":"bfcf94e1-2623-4443-aaf8-f525210ab7b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.45:6808","nonce":2128209266}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.45:6809","nonce":2128209266}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.45:6811","nonce":2128209266}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.45:6810","nonce":2128209266}]},"public_addr":"10.20.193.45:6808/2128209266","cluster_addr":"10.20.193.45:6809/2128209266","heartbeat_back_addr":"10.20.193.45:6811/2128209266","heartbeat_front_addr":"10.20.193.45:6810/2128209266","state":["exists","up"]},{"osd":3,"uuid":"32e9109d-09f0-4c75-bfbe-bb0fa237ca08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.73:6805","nonce":3607388566}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.73:6806","nonce":3607388566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.73:6808","nonce":3607388566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.73:6807","nonce":3607388566}]},"public_addr":"10.20.193.73:6805/3607388566","cluster_addr":"10.20.193.73:6806/3607388566","heartbeat_back_addr":"10.20.193.73:6808/3607388566","heartbeat_front_addr":"10.20.193.73:6807/3607388566","state":["exists","up"]},{"osd":4,"uuid":"311ec782-d282-48e9-9545-41ac3acb1ac8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.73:6801","nonce":3756325394}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.73:6802","nonce":3756325394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.73:6804","nonce":3756325394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.73:6803","nonce":3756325394}]},"public_addr":"10.20.193.73:6801/3756325394","cluster_addr":"10.20.193.73:6802/3756325394","heartbeat_back_addr":"10.20.193.73:6804/3756325394","heartbeat_front_addr":"10.20.193.73:6803/3756325394","state":["exists","up"]},{"osd":5,"uuid":"4569df35-5988-4308-9e5d-a6b26171c346","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.73:6809","nonce":1794330816}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.73:6810","nonce":1794330816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.73:6812","nonce":1794330816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.73:6811","nonce":1794330816}]},"public_addr":"10.20.193.73:6809/1794330816","cluster_addr":"10.20.193.73:6810/1794330816","heartbeat_back_addr":"10.20.193.73:6812/1794330816","heartbeat_front_addr":"10.20.193.73:6811/1794330816","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-22T23:25:32.907422+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-22T23:25:33.439017+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-22T23:25:32.880978+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-22T23:25:32.610909+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-22T23:25:32.663485+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-22T23:25:33.016218+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-22T23:28:06.901 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.898+0000 7f23a008f640 1 -- 10.20.193.45:0/3801046510 >> v1:10.20.193.73:6800/2222410180 conn(0x7f236803f830 legacy=0x7f2368041cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:06.901 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.898+0000 7f23a008f640 10 monclient: shutdown 2026-02-22T23:28:06.901 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.898+0000 7f23a008f640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T23:28:06.901 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.898+0000 7f23a008f640 1 -- 10.20.193.45:0/3801046510 >> v1:10.20.193.45:6793/0 conn(0x7f23981361c0 legacy=0x7f23981d37c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:06.901 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.898+0000 7f23a008f640 1 -- 10.20.193.45:0/3801046510 shutdown_connections 2026-02-22T23:28:06.902 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.898+0000 7f23a008f640 1 -- 10.20.193.45:0/3801046510 >> 10.20.193.45:0/3801046510 conn(0x7f23980a7780 msgr2=0x7f23980a5b20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:28:06.902 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.898+0000 7f23a008f640 1 -- 10.20.193.45:0/3801046510 shutdown_connections 2026-02-22T23:28:06.902 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:06.898+0000 7f23a008f640 1 -- 10.20.193.45:0/3801046510 wait complete. 2026-02-22T23:28:07.908 INFO:tasks.ceph:Scrubbing osd.0 2026-02-22T23:28:07.908 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2026-02-22T23:28:07.980 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:07.978+0000 7f23e37a0640 10 monclient: get_monmap_and_config 2026-02-22T23:28:07.980 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:07.978+0000 7f23e37a0640 10 monclient: build_initial_monmap 2026-02-22T23:28:07.980 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:07.978+0000 7f23e37a0640 10 monclient: monmap: 2026-02-22T23:28:07.981 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-22T23:28:07.981 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:28:07.981 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:28:07.979792+0000 2026-02-22T23:28:07.981 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:28:07.979792+0000 2026-02-22T23:28:07.981 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-22T23:28:07.981 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:28:07.981 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-22T23:28:07.981 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.noname-f 2026-02-22T23:28:07.981 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.noname-b 2026-02-22T23:28:07.981 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.noname-g 2026-02-22T23:28:07.981 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.noname-c 2026-02-22T23:28:07.981 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.noname-h 2026-02-22T23:28:07.982 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.noname-d 2026-02-22T23:28:07.982 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.noname-i 2026-02-22T23:28:07.982 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.noname-e 2026-02-22T23:28:07.982 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:07.982 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:07.978+0000 7f23e37a0640 1 Processor -- start 2026-02-22T23:28:07.982 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:07.979+0000 7f23e37a0640 1 -- start start 2026-02-22T23:28:07.982 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:07.979+0000 7f23e37a0640 10 monclient: init 2026-02-22T23:28:07.991 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:07.979+0000 7f23e37a0640 10 monclient: _reopen_session rank -1 2026-02-22T23:28:07.991 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:07.979+0000 7f23e37a0640 10 monclient: _add_conns ranks=[6,2,4,7,3,1,5,0,8] 2026-02-22T23:28:07.992 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:07.979+0000 7f23e37a0640 10 monclient(hunting): picked mon.noname-d con 0x7f23dc136c00 addr v1:10.20.193.45:6792/0 2026-02-22T23:28:07.992 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:07.979+0000 7f23e37a0640 10 monclient(hunting): picked mon.noname-b con 0x7f23dc0a0910 addr v1:10.20.193.45:6790/0 2026-02-22T23:28:07.992 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:07.979+0000 7f23e37a0640 10 monclient(hunting): picked mon.noname-c con 0x7f23dc0a2a70 addr v1:10.20.193.45:6791/0 2026-02-22T23:28:07.992 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:07.979+0000 7f23e37a0640 1 -- --> v1:10.20.193.45:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23dc0a30b0 con 0x7f23dc0a0910 2026-02-22T23:28:07.992 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:07.979+0000 7f23e37a0640 1 -- --> v1:10.20.193.45:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23dc0a0d90 con 0x7f23dc0a2a70 2026-02-22T23:28:07.992 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:07.979+0000 7f23e37a0640 1 -- --> v1:10.20.193.45:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23dc0a7d10 con 0x7f23dc136c00 2026-02-22T23:28:07.992 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:07.979+0000 7f23e37a0640 10 monclient(hunting): _renew_subs 2026-02-22T23:28:07.992 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:07.979+0000 7f23e37a0640 10 monclient(hunting): authenticate will time out at 819.596518s 2026-02-22T23:28:07.992 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:07.979+0000 7f23e1515640 1 --1- >> v1:10.20.193.45:6792/0 conn(0x7f23dc136c00 0x7f23dc136fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.45:6792/0 says I am v1:10.20.193.45:36842/0 (socket says 10.20.193.45:36842) 2026-02-22T23:28:07.992 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:07.979+0000 7f23e1515640 1 -- 10.20.193.45:0/1536757941 learned_addr learned my addr 10.20.193.45:0/1536757941 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-22T23:28:07.993 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:07.979+0000 7f23e0d14640 1 --1- 10.20.193.45:0/1536757941 >> v1:10.20.193.45:6790/0 conn(0x7f23dc0a0910 0x7f23dc13ba80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.45:6790/0 says I am v1:10.20.193.45:60194/0 (socket says 10.20.193.45:60194) 2026-02-22T23:28:07.993 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:07.979+0000 7f23cbfff640 1 -- 10.20.193.45:0/1536757941 <== mon.6 v1:10.20.193.45:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1960268453 0 0) 0x7f23dc0a7d10 con 0x7f23dc136c00 2026-02-22T23:28:07.993 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:07.979+0000 7f23cbfff640 10 monclient(hunting): _negotiate 2026-02-22T23:28:07.993 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:07.979+0000 7f23cbfff640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:28:07.993 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:07.979+0000 7f23cbfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:28:07.993 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:07.979+0000 7f23cbfff640 10 monclient(hunting): my global_id is 114216 2026-02-22T23:28:07.993 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:07.979+0000 7f23cbfff640 1 -- 10.20.193.45:0/1536757941 --> v1:10.20.193.45:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f23c4003620 con 0x7f23dc136c00 2026-02-22T23:28:07.993 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:07.979+0000 7f23cbfff640 1 -- 10.20.193.45:0/1536757941 <== mon.4 v1:10.20.193.45:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3756812615 0 0) 0x7f23dc0a0d90 con 0x7f23dc0a2a70 2026-02-22T23:28:07.993 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:07.979+0000 7f23cbfff640 10 monclient(hunting): _negotiate 2026-02-22T23:28:07.993 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:07.979+0000 7f23cbfff640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:28:07.993 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:07.979+0000 7f23cbfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:28:07.993 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:07.979+0000 7f23cbfff640 10 monclient(hunting): my global_id is 114223 2026-02-22T23:28:07.994 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:07.979+0000 7f23cbfff640 1 -- 10.20.193.45:0/1536757941 --> v1:10.20.193.45:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f23dc0a7d10 con 0x7f23dc0a2a70 2026-02-22T23:28:07.994 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:07.979+0000 7f23cbfff640 1 -- 10.20.193.45:0/1536757941 <== mon.2 v1:10.20.193.45:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 879499036 0 0) 0x7f23dc0a30b0 con 0x7f23dc0a0910 2026-02-22T23:28:07.994 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:07.979+0000 7f23cbfff640 10 monclient(hunting): _negotiate 2026-02-22T23:28:07.994 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:07.979+0000 7f23cbfff640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:28:07.994 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:07.979+0000 7f23cbfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:28:07.994 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:07.979+0000 7f23cbfff640 10 monclient(hunting): my global_id is 4754 2026-02-22T23:28:07.994 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:07.979+0000 7f23cbfff640 1 -- 10.20.193.45:0/1536757941 --> v1:10.20.193.45:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f23dc0a0d90 con 0x7f23dc0a0910 2026-02-22T23:28:07.994 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:07.979+0000 7f23cbfff640 1 -- 10.20.193.45:0/1536757941 <== mon.6 v1:10.20.193.45:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2703599033 0 0) 0x7f23c4003620 con 0x7f23dc136c00 2026-02-22T23:28:07.994 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:07.979+0000 7f23cbfff640 1 -- 10.20.193.45:0/1536757941 >> v1:10.20.193.45:6791/0 conn(0x7f23dc0a2a70 legacy=0x7f23dc13f1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:07.994 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:07.979+0000 7f23cbfff640 1 -- 10.20.193.45:0/1536757941 >> v1:10.20.193.45:6790/0 conn(0x7f23dc0a0910 legacy=0x7f23dc13ba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:07.994 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:07.979+0000 7f23cbfff640 10 monclient: _finish_hunting 0 2026-02-22T23:28:07.994 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:07.979+0000 7f23cbfff640 1 monclient: found mon.noname-d 2026-02-22T23:28:07.994 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:07.979+0000 7f23cbfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T23:28:07.995 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:07.979+0000 7f23cbfff640 10 monclient: _send_mon_message to mon.noname-d at v1:10.20.193.45:6792/0 2026-02-22T23:28:07.995 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:07.979+0000 7f23cbfff640 1 -- 10.20.193.45:0/1536757941 --> v1:10.20.193.45:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23dc143900 con 0x7f23dc136c00 2026-02-22T23:28:07.995 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:07.979+0000 7f23cbfff640 10 monclient: _finish_auth 0 2026-02-22T23:28:07.995 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:07.979+0000 7f23cbfff640 10 monclient: _check_auth_tickets 2026-02-22T23:28:07.995 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:07.979+0000 7f23cbfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T23:28:07.995 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:07.979+0000 7f23cbfff640 1 -- 10.20.193.45:0/1536757941 <== mon.6 v1:10.20.193.45:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f23cc003040 con 0x7f23dc136c00 2026-02-22T23:28:07.995 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:07.979+0000 7f23cbfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:28:07.995 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:07.979+0000 7f23cbfff640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2026-02-22T23:28:07.995 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:07.979+0000 7f23cbfff640 10 monclient: dump: 2026-02-22T23:28:07.995 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:28:07.995 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:28:07.995 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:07.996 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:07.996 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:28:07.996 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:28:07.996 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:28:07.996 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:28:07.996 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:28:07.996 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:28:07.996 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:28:07.996 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:28:07.996 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:28:07.996 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:28:07.997 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:28:07.997 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:07.997 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:07.979+0000 7f23e37a0640 5 monclient: authenticate success, global_id 114216 2026-02-22T23:28:07.997 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:07.979+0000 7f23e37a0640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-22T23:28:07.997 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:07.979+0000 7f23cbfff640 1 -- 10.20.193.45:0/1536757941 <== mon.6 v1:10.20.193.45:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f23cc0031e0 con 0x7f23dc136c00 2026-02-22T23:28:07.997 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:07.979+0000 7f23cbfff640 10 monclient: handle_config config(0 keys) 2026-02-22T23:28:07.997 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:07.979+0000 7f23cbfff640 1 -- 10.20.193.45:0/1536757941 <== mon.6 v1:10.20.193.45:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f23cc004ce0 con 0x7f23dc136c00 2026-02-22T23:28:07.997 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:07.979+0000 7f23e37a0640 10 monclient: get_monmap_and_config success 2026-02-22T23:28:07.997 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:07.979+0000 7f23cbfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:28:07.997 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:07.979+0000 7f23e37a0640 4 set_mon_vals no callback set 2026-02-22T23:28:07.997 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:07.980+0000 7f23cbfff640 10 monclient: got monmap 1 from mon.d (according to old e1) 2026-02-22T23:28:07.998 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:07.980+0000 7f23cbfff640 10 monclient: dump: 2026-02-22T23:28:07.998 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:28:07.998 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:28:07.998 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:07.998 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:07.998 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:28:07.998 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:28:07.998 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:28:07.998 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:28:07.998 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:28:07.998 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:28:07.999 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:28:07.999 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:28:07.999 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:28:07.999 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:28:07.999 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:28:07.999 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:07.999 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:07.980+0000 7f23e37a0640 10 monclient: shutdown 2026-02-22T23:28:07.999 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:07.980+0000 7f23e37a0640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T23:28:07.999 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:07.980+0000 7f23e37a0640 1 -- 10.20.193.45:0/1536757941 >> v1:10.20.193.45:6792/0 conn(0x7f23dc136c00 legacy=0x7f23dc136fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:08.000 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:07.980+0000 7f23e37a0640 1 -- 10.20.193.45:0/1536757941 shutdown_connections 2026-02-22T23:28:08.000 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:07.980+0000 7f23e37a0640 1 -- 10.20.193.45:0/1536757941 >> 10.20.193.45:0/1536757941 conn(0x7f23dc0a7690 msgr2=0x7f23dc0a3b60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:28:08.000 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:07.980+0000 7f23e37a0640 1 -- 10.20.193.45:0/1536757941 shutdown_connections 2026-02-22T23:28:08.000 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:07.980+0000 7f23e37a0640 1 -- 10.20.193.45:0/1536757941 wait complete. 2026-02-22T23:28:08.000 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:07.980+0000 7f23e37a0640 10 monclient: build_initial_monmap 2026-02-22T23:28:08.000 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:07.980+0000 7f23e37a0640 10 monclient: monmap: 2026-02-22T23:28:08.000 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-22T23:28:08.000 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T23:28:08.000 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-22T23:28:08.000 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-22T23:28:08.000 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-22T23:28:08.000 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-22T23:28:08.001 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-22T23:28:08.001 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.noname-f 2026-02-22T23:28:08.001 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.noname-b 2026-02-22T23:28:08.001 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.noname-g 2026-02-22T23:28:08.001 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.noname-c 2026-02-22T23:28:08.001 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.noname-h 2026-02-22T23:28:08.001 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.noname-d 2026-02-22T23:28:08.001 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.noname-i 2026-02-22T23:28:08.001 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.noname-e 2026-02-22T23:28:08.001 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:08.002 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:07.980+0000 7f23e37a0640 1 Processor -- start 2026-02-22T23:28:08.002 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:07.980+0000 7f23e37a0640 1 -- start start 2026-02-22T23:28:08.002 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:07.980+0000 7f23e37a0640 10 monclient: init 2026-02-22T23:28:08.002 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:07.981+0000 7f23e37a0640 10 monclient: _reopen_session rank -1 2026-02-22T23:28:08.002 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:07.981+0000 7f23e37a0640 10 monclient: _add_conns ranks=[0,7,4,3,2,5,6,8,1] 2026-02-22T23:28:08.002 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:07.981+0000 7f23e37a0640 10 monclient(hunting): picked mon.noname-a con 0x7f23dc0a0910 addr v1:10.20.193.45:6789/0 2026-02-22T23:28:08.002 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:07.981+0000 7f23e37a0640 10 monclient(hunting): picked mon.noname-i con 0x7f23dc0a2a70 addr v1:10.20.193.73:6792/0 2026-02-22T23:28:08.002 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:07.981+0000 7f23e37a0640 10 monclient(hunting): picked mon.noname-c con 0x7f23dc136c00 addr v1:10.20.193.45:6791/0 2026-02-22T23:28:08.002 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:07.981+0000 7f23e37a0640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23dc135e30 con 0x7f23dc0a0910 2026-02-22T23:28:08.002 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:07.981+0000 7f23e37a0640 1 -- --> v1:10.20.193.45:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23dc1ce570 con 0x7f23dc136c00 2026-02-22T23:28:08.002 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:07.981+0000 7f23e37a0640 1 -- --> v1:10.20.193.73:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23dc12f1e0 con 0x7f23dc0a2a70 2026-02-22T23:28:08.002 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:07.981+0000 7f23e37a0640 10 monclient(hunting): _renew_subs 2026-02-22T23:28:08.003 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:07.981+0000 7f23e37a0640 10 monclient(hunting): authenticate will time out at 819.598206s 2026-02-22T23:28:08.003 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:07.981+0000 7f23e1515640 1 --1- >> v1:10.20.193.45:6789/0 conn(0x7f23dc0a0910 0x7f23dc1cd750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.45:6789/0 says I am v1:10.20.193.45:38456/0 (socket says 10.20.193.45:38456) 2026-02-22T23:28:08.003 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:07.981+0000 7f23e1515640 1 -- 10.20.193.45:0/1837910154 learned_addr learned my addr 10.20.193.45:0/1837910154 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-22T23:28:08.003 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:07.981+0000 7f23c9ffb640 1 -- 10.20.193.45:0/1837910154 <== mon.4 v1:10.20.193.45:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2899686971 0 0) 0x7f23dc1ce570 con 0x7f23dc136c00 2026-02-22T23:28:08.003 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:07.981+0000 7f23c9ffb640 10 monclient(hunting): _negotiate 2026-02-22T23:28:08.003 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:07.981+0000 7f23c9ffb640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:28:08.003 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:07.981+0000 7f23c9ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:28:08.003 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:07.981+0000 7f23c9ffb640 10 monclient(hunting): my global_id is 114232 2026-02-22T23:28:08.003 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:07.981+0000 7f23c9ffb640 1 -- 10.20.193.45:0/1837910154 --> v1:10.20.193.45:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f23ac003620 con 0x7f23dc136c00 2026-02-22T23:28:08.003 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:07.981+0000 7f23c9ffb640 1 -- 10.20.193.45:0/1837910154 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2232960034 0 0) 0x7f23dc135e30 con 0x7f23dc0a0910 2026-02-22T23:28:08.003 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:07.981+0000 7f23c9ffb640 10 monclient(hunting): _negotiate 2026-02-22T23:28:08.003 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:07.981+0000 7f23c9ffb640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:28:08.004 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:07.981+0000 7f23c9ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:28:08.004 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:07.981+0000 7f23c9ffb640 10 monclient(hunting): my global_id is 4644 2026-02-22T23:28:08.004 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:07.981+0000 7f23c9ffb640 1 -- 10.20.193.45:0/1837910154 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f23dc1ce570 con 0x7f23dc0a0910 2026-02-22T23:28:08.004 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:07.981+0000 7f23c9ffb640 1 -- 10.20.193.45:0/1837910154 <== mon.4 v1:10.20.193.45:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4114564583 0 0) 0x7f23ac003620 con 0x7f23dc136c00 2026-02-22T23:28:08.004 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:07.981+0000 7f23c9ffb640 1 -- 10.20.193.45:0/1837910154 --> v1:10.20.193.45:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f23dc135e30 con 0x7f23dc136c00 2026-02-22T23:28:08.004 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:07.981+0000 7f23c9ffb640 1 -- 10.20.193.45:0/1837910154 <== mon.4 v1:10.20.193.45:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f23d8003110 con 0x7f23dc136c00 2026-02-22T23:28:08.004 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:07.981+0000 7f23c9ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-22T23:28:08.004 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:07.981+0000 7f23c9ffb640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-22T23:28:08.004 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:07.981+0000 7f23c9ffb640 10 monclient(hunting): dump: 2026-02-22T23:28:08.004 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:28:08.004 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:28:08.004 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:08.005 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:08.005 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:28:08.005 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:28:08.005 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:28:08.005 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:28:08.005 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:28:08.005 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:28:08.005 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:28:08.005 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:28:08.005 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:28:08.005 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:28:08.005 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:28:08.005 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:08.006 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:07.981+0000 7f23c9ffb640 10 monclient(hunting): _finish_auth 0 2026-02-22T23:28:08.006 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:07.981+0000 7f23c9ffb640 1 -- 10.20.193.45:0/1837910154 <== mon.0 v1:10.20.193.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 420086171 0 0) 0x7f23dc1ce570 con 0x7f23dc0a0910 2026-02-22T23:28:08.006 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:07.981+0000 7f23c9ffb640 1 -- 10.20.193.45:0/1837910154 --> v1:10.20.193.45:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f23ac003620 con 0x7f23dc0a0910 2026-02-22T23:28:08.006 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:07.981+0000 7f23c9ffb640 1 -- 10.20.193.45:0/1837910154 <== mon.0 v1:10.20.193.45:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f23cc0048e0 con 0x7f23dc0a0910 2026-02-22T23:28:08.006 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:07.981+0000 7f23c9ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-22T23:28:08.006 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:07.981+0000 7f23c9ffb640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-22T23:28:08.006 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:07.981+0000 7f23c9ffb640 10 monclient(hunting): dump: 2026-02-22T23:28:08.006 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:28:08.006 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:28:08.006 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:08.006 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:08.006 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:28:08.007 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:28:08.007 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:28:08.007 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:28:08.007 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:28:08.007 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:28:08.007 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:28:08.007 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:28:08.007 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:28:08.007 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:28:08.007 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:28:08.007 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:08.007 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:07.981+0000 7f23c9ffb640 1 -- 10.20.193.45:0/1837910154 <== mon.4 v1:10.20.193.45:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4031384707 0 0) 0x7f23dc135e30 con 0x7f23dc136c00 2026-02-22T23:28:08.007 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:07.981+0000 7f23c9ffb640 1 -- 10.20.193.45:0/1837910154 >> v1:10.20.193.73:6792/0 conn(0x7f23dc0a2a70 legacy=0x7f23dc1cde60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:08.008 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:07.981+0000 7f23c9ffb640 1 -- 10.20.193.45:0/1837910154 >> v1:10.20.193.45:6789/0 conn(0x7f23dc0a0910 legacy=0x7f23dc1cd750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:08.008 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:07.981+0000 7f23c9ffb640 10 monclient: _finish_hunting 0 2026-02-22T23:28:08.008 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:07.981+0000 7f23c9ffb640 1 monclient: found mon.c 2026-02-22T23:28:08.008 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:07.981+0000 7f23c9ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T23:28:08.008 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:07.981+0000 7f23c9ffb640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.45:6791/0 2026-02-22T23:28:08.008 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:07.981+0000 7f23c9ffb640 1 -- 10.20.193.45:0/1837910154 --> v1:10.20.193.45:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23dc131030 con 0x7f23dc136c00 2026-02-22T23:28:08.008 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:07.981+0000 7f23c9ffb640 10 monclient: _finish_auth 0 2026-02-22T23:28:08.008 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:07.981+0000 7f23c9ffb640 10 monclient: _check_auth_tickets 2026-02-22T23:28:08.008 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:07.981+0000 7f23c9ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T23:28:08.008 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:07.981+0000 7f23e37a0640 5 monclient: authenticate success, global_id 114232 2026-02-22T23:28:08.008 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:07.981+0000 7f23e37a0640 10 monclient: _renew_subs 2026-02-22T23:28:08.009 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:07.981+0000 7f23e37a0640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.45:6791/0 2026-02-22T23:28:08.009 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:07.981+0000 7f23e37a0640 1 -- 10.20.193.45:0/1837910154 --> v1:10.20.193.45:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f23dc0a2290 con 0x7f23dc136c00 2026-02-22T23:28:08.009 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:07.981+0000 7f23c9ffb640 1 -- 10.20.193.45:0/1837910154 <== mon.4 v1:10.20.193.45:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f23d8003ac0 con 0x7f23dc136c00 2026-02-22T23:28:08.009 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:07.981+0000 7f23e37a0640 10 monclient: _renew_subs 2026-02-22T23:28:08.009 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:07.981+0000 7f23e37a0640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.45:6791/0 2026-02-22T23:28:08.009 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:07.981+0000 7f23e37a0640 1 -- 10.20.193.45:0/1837910154 --> v1:10.20.193.45:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7f23dc130d50 con 0x7f23dc136c00 2026-02-22T23:28:08.009 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:07.981+0000 7f23c9ffb640 10 monclient: handle_config config(0 keys) 2026-02-22T23:28:08.009 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:07.981+0000 7f23c9ffb640 1 -- 10.20.193.45:0/1837910154 <== mon.4 v1:10.20.193.45:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f23d8003fb0 con 0x7f23dc136c00 2026-02-22T23:28:08.009 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:07.981+0000 7f23c9ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:28:08.009 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:07.981+0000 7f23cb7fe640 4 set_mon_vals no callback set 2026-02-22T23:28:08.009 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:07.981+0000 7f23c9ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T23:28:08.010 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:07.981+0000 7f23c9ffb640 10 monclient: dump: 2026-02-22T23:28:08.010 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:28:08.010 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:28:08.010 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:08.010 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:08.010 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:28:08.010 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:28:08.010 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:28:08.010 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:28:08.010 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:28:08.010 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:28:08.011 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:28:08.011 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:28:08.011 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:28:08.011 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:28:08.011 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:28:08.011 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:08.011 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:07.981+0000 7f23e37a0640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.45:6791/0 2026-02-22T23:28:08.011 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:07.982+0000 7f23e37a0640 1 -- 10.20.193.45:0/1837910154 --> v1:10.20.193.45:6791/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f23dc072ef0 con 0x7f23dc136c00 2026-02-22T23:28:08.011 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:07.982+0000 7f23c9ffb640 1 -- 10.20.193.45:0/1837910154 <== mon.4 v1:10.20.193.45:6791/0 7 ==== mgrmap(e 5) ==== 50225+0+0 (unknown 2330357642 0 0) 0x7f23d80041d0 con 0x7f23dc136c00 2026-02-22T23:28:08.011 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:07.982+0000 7f23c9ffb640 1 -- 10.20.193.45:0/1837910154 <== mon.4 v1:10.20.193.45:6791/0 8 ==== osd_map(25..25 src has 1..25) ==== 3502+0+0 (unknown 129690100 0 0) 0x7f23d804cdc0 con 0x7f23dc136c00 2026-02-22T23:28:08.011 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:07.982+0000 7f23c9ffb640 1 -- 10.20.193.45:0/1837910154 --> v1:10.20.193.45:6801/1146005631 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f23ac04a640 con 0x7f23ac0469d0 2026-02-22T23:28:08.011 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:07.982+0000 7f23c9ffb640 1 -- 10.20.193.45:0/1837910154 <== mon.4 v1:10.20.193.45:6791/0 9 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (unknown 2663167439 0 0) 0x7f23d804d170 con 0x7f23dc136c00 2026-02-22T23:28:08.011 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:07.982+0000 7f23c9ffb640 10 monclient: handle_get_version_reply finishing 1 version 25 2026-02-22T23:28:08.012 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:07.982+0000 7f23e0d14640 10 monclient: get_auth_request con 0x7f23ac0469d0 auth_method 0 2026-02-22T23:28:08.012 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:07.982+0000 7f23e1515640 10 monclient: get_auth_request con 0x7f23ac03fe40 auth_method 0 2026-02-22T23:28:08.012 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:07.983+0000 7f23c9ffb640 1 -- 10.20.193.45:0/1837910154 <== osd.0 v1:10.20.193.45:6801/1146005631 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (unknown 0 0 3365489958) 0x7f23ac04a640 con 0x7f23ac0469d0 2026-02-22T23:28:08.012 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:07.989+0000 7f23e37a0640 1 -- 10.20.193.45:0/1837910154 --> v1:10.20.193.45:6801/1146005631 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f23dc140d70 con 0x7f23ac0469d0 2026-02-22T23:28:08.012 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:07.989+0000 7f23c9ffb640 1 -- 10.20.193.45:0/1837910154 <== osd.0 v1:10.20.193.45:6801/1146005631 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (unknown 0 0 119112422) 0x7f23dc140d70 con 0x7f23ac0469d0 2026-02-22T23:28:08.012 INFO:teuthology.orchestra.run.trial045.stdout:{ 2026-02-22T23:28:08.012 INFO:teuthology.orchestra.run.trial045.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-22T23:28:08.013 INFO:teuthology.orchestra.run.trial045.stdout:} 2026-02-22T23:28:08.014 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:07.989+0000 7f23e37a0640 1 -- 10.20.193.45:0/1837910154 >> v1:10.20.193.45:6801/1146005631 conn(0x7f23ac0469d0 legacy=0x7f23ac048df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:08.014 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:07.989+0000 7f23e37a0640 1 -- 10.20.193.45:0/1837910154 >> v1:10.20.193.73:6800/2222410180 conn(0x7f23ac03fe40 legacy=0x7f23ac042300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:08.015 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:07.989+0000 7f23e37a0640 10 monclient: shutdown 2026-02-22T23:28:08.015 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:07.989+0000 7f23e37a0640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T23:28:08.015 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:07.989+0000 7f23e37a0640 1 -- 10.20.193.45:0/1837910154 >> v1:10.20.193.45:6791/0 conn(0x7f23dc136c00 legacy=0x7f23dc1d59b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:08.015 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:07.989+0000 7f23e1d16640 1 -- 10.20.193.45:0/1837910154 reap_dead start 2026-02-22T23:28:08.015 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:07.989+0000 7f23e37a0640 1 -- 10.20.193.45:0/1837910154 shutdown_connections 2026-02-22T23:28:08.015 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:07.989+0000 7f23e37a0640 1 -- 10.20.193.45:0/1837910154 >> 10.20.193.45:0/1837910154 conn(0x7f23dc0a7690 msgr2=0x7f23dc142520 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:28:08.015 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:07.989+0000 7f23e37a0640 1 -- 10.20.193.45:0/1837910154 shutdown_connections 2026-02-22T23:28:08.015 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:07.989+0000 7f23e37a0640 1 -- 10.20.193.45:0/1837910154 wait complete. 2026-02-22T23:28:08.016 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2026-02-22T23:28:08.098 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.083+0000 7f331d2b2640 10 monclient: get_monmap_and_config 2026-02-22T23:28:08.098 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.083+0000 7f331d2b2640 10 monclient: build_initial_monmap 2026-02-22T23:28:08.098 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.083+0000 7f331d2b2640 10 monclient: monmap: 2026-02-22T23:28:08.098 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-22T23:28:08.099 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:28:08.099 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:28:08.084482+0000 2026-02-22T23:28:08.099 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:28:08.084482+0000 2026-02-22T23:28:08.099 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-22T23:28:08.099 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:28:08.099 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-22T23:28:08.100 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.noname-f 2026-02-22T23:28:08.100 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.noname-b 2026-02-22T23:28:08.100 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.noname-g 2026-02-22T23:28:08.100 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.noname-c 2026-02-22T23:28:08.100 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.noname-h 2026-02-22T23:28:08.100 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.noname-d 2026-02-22T23:28:08.100 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.noname-i 2026-02-22T23:28:08.101 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.noname-e 2026-02-22T23:28:08.101 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:08.101 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.083+0000 7f331d2b2640 1 Processor -- start 2026-02-22T23:28:08.101 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.083+0000 7f331d2b2640 1 -- start start 2026-02-22T23:28:08.101 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.083+0000 7f331d2b2640 10 monclient: init 2026-02-22T23:28:08.101 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.083+0000 7f331d2b2640 10 monclient: _reopen_session rank -1 2026-02-22T23:28:08.101 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.084+0000 7f331d2b2640 10 monclient: _add_conns ranks=[1,7,5,4,3,8,6,2,0] 2026-02-22T23:28:08.102 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.084+0000 7f331d2b2640 10 monclient(hunting): picked mon.noname-f con 0x7f33180a2900 addr v1:10.20.193.73:6789/0 2026-02-22T23:28:08.102 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.084+0000 7f331d2b2640 10 monclient(hunting): picked mon.noname-i con 0x7f331809d4d0 addr v1:10.20.193.73:6792/0 2026-02-22T23:28:08.102 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.084+0000 7f331d2b2640 10 monclient(hunting): picked mon.noname-h con 0x7f33180a33f0 addr v1:10.20.193.73:6791/0 2026-02-22T23:28:08.102 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.084+0000 7f331d2b2640 1 -- --> v1:10.20.193.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f33180a11d0 con 0x7f33180a2900 2026-02-22T23:28:08.102 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.084+0000 7f331d2b2640 1 -- --> v1:10.20.193.73:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3318073c30 con 0x7f33180a33f0 2026-02-22T23:28:08.102 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.084+0000 7f331d2b2640 1 -- --> v1:10.20.193.73:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f33180a47b0 con 0x7f331809d4d0 2026-02-22T23:28:08.103 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.084+0000 7f331d2b2640 10 monclient(hunting): _renew_subs 2026-02-22T23:28:08.103 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.084+0000 7f331d2b2640 10 monclient(hunting): authenticate will time out at 819.701067s 2026-02-22T23:28:08.103 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.084+0000 7f331cab1640 1 --1- >> v1:10.20.193.73:6791/0 conn(0x7f33180a33f0 0x7f331813f250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.73:6791/0 says I am v1:10.20.193.45:51628/0 (socket says 10.20.193.45:51628) 2026-02-22T23:28:08.103 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.084+0000 7f331cab1640 1 -- 10.20.193.45:0/2176199568 learned_addr learned my addr 10.20.193.45:0/2176199568 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-22T23:28:08.103 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.084+0000 7f3316ffd640 1 -- 10.20.193.45:0/2176199568 <== mon.7 v1:10.20.193.73:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 468878179 0 0) 0x7f33180a47b0 con 0x7f331809d4d0 2026-02-22T23:28:08.103 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.084+0000 7f3316ffd640 10 monclient(hunting): _negotiate 2026-02-22T23:28:08.103 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.084+0000 7f3316ffd640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:28:08.104 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.084+0000 7f3316ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:28:08.104 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.084+0000 7f3316ffd640 10 monclient(hunting): my global_id is 4579 2026-02-22T23:28:08.104 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.084+0000 7f3316ffd640 1 -- 10.20.193.45:0/2176199568 --> v1:10.20.193.73:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f32fc003620 con 0x7f331809d4d0 2026-02-22T23:28:08.104 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.084+0000 7f3316ffd640 1 -- 10.20.193.45:0/2176199568 <== mon.5 v1:10.20.193.73:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3326631538 0 0) 0x7f3318073c30 con 0x7f33180a33f0 2026-02-22T23:28:08.104 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.084+0000 7f3316ffd640 10 monclient(hunting): _negotiate 2026-02-22T23:28:08.104 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.084+0000 7f3316ffd640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:28:08.105 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.084+0000 7f3316ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:28:08.105 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.084+0000 7f3316ffd640 10 monclient(hunting): my global_id is 114188 2026-02-22T23:28:08.105 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.084+0000 7f3316ffd640 1 -- 10.20.193.45:0/2176199568 --> v1:10.20.193.73:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f33180a47b0 con 0x7f33180a33f0 2026-02-22T23:28:08.105 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.084+0000 7f3316ffd640 1 -- 10.20.193.45:0/2176199568 <== mon.7 v1:10.20.193.73:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4005312371 0 0) 0x7f32fc003620 con 0x7f331809d4d0 2026-02-22T23:28:08.105 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.084+0000 7f3316ffd640 1 -- 10.20.193.45:0/2176199568 >> v1:10.20.193.73:6791/0 conn(0x7f33180a33f0 legacy=0x7f331813f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:08.105 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.084+0000 7f3316ffd640 1 -- 10.20.193.45:0/2176199568 >> v1:10.20.193.73:6789/0 conn(0x7f33180a2900 legacy=0x7f33180a2ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:08.105 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.084+0000 7f3316ffd640 10 monclient: _finish_hunting 0 2026-02-22T23:28:08.106 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.084+0000 7f3316ffd640 1 monclient: found mon.noname-i 2026-02-22T23:28:08.106 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.084+0000 7f3316ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T23:28:08.106 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.084+0000 7f3316ffd640 10 monclient: _send_mon_message to mon.noname-i at v1:10.20.193.73:6792/0 2026-02-22T23:28:08.106 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.084+0000 7f3316ffd640 1 -- 10.20.193.45:0/2176199568 --> v1:10.20.193.73:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f331806f000 con 0x7f331809d4d0 2026-02-22T23:28:08.106 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.084+0000 7f3316ffd640 10 monclient: _finish_auth 0 2026-02-22T23:28:08.106 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.084+0000 7f3316ffd640 10 monclient: _check_auth_tickets 2026-02-22T23:28:08.106 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.084+0000 7f3316ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T23:28:08.107 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.084+0000 7f3316ffd640 1 -- 10.20.193.45:0/2176199568 <== mon.7 v1:10.20.193.73:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f3308003040 con 0x7f331809d4d0 2026-02-22T23:28:08.107 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.084+0000 7f3316ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:28:08.107 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.084+0000 7f3316ffd640 10 monclient: got monmap 1 from mon.noname-i (according to old e1) 2026-02-22T23:28:08.107 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.084+0000 7f3316ffd640 10 monclient: dump: 2026-02-22T23:28:08.107 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:28:08.107 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:28:08.107 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:08.108 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:08.108 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:28:08.108 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:28:08.108 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:28:08.108 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:28:08.108 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:28:08.108 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:28:08.108 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:28:08.108 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:28:08.108 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:28:08.109 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:28:08.109 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:28:08.109 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:08.109 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.084+0000 7f331d2b2640 5 monclient: authenticate success, global_id 4579 2026-02-22T23:28:08.109 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.084+0000 7f331d2b2640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-22T23:28:08.109 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.084+0000 7f3316ffd640 1 -- 10.20.193.45:0/2176199568 <== mon.7 v1:10.20.193.73:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f33080031e0 con 0x7f331809d4d0 2026-02-22T23:28:08.109 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.084+0000 7f3316ffd640 10 monclient: handle_config config(0 keys) 2026-02-22T23:28:08.109 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.084+0000 7f3316ffd640 1 -- 10.20.193.45:0/2176199568 <== mon.7 v1:10.20.193.73:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f3308003a50 con 0x7f331809d4d0 2026-02-22T23:28:08.109 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.084+0000 7f3316ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:28:08.109 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.084+0000 7f3316ffd640 10 monclient: got monmap 1 from mon.i (according to old e1) 2026-02-22T23:28:08.110 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.084+0000 7f3316ffd640 10 monclient: dump: 2026-02-22T23:28:08.110 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:28:08.110 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:28:08.110 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:08.110 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:08.110 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:28:08.110 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:28:08.110 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:28:08.110 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:28:08.110 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:28:08.110 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:28:08.111 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:28:08.111 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:28:08.111 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:28:08.111 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:28:08.111 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:28:08.111 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:08.111 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.084+0000 7f331d2b2640 10 monclient: get_monmap_and_config success 2026-02-22T23:28:08.111 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.084+0000 7f331d2b2640 4 set_mon_vals no callback set 2026-02-22T23:28:08.111 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.084+0000 7f331d2b2640 10 monclient: shutdown 2026-02-22T23:28:08.111 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.084+0000 7f331d2b2640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T23:28:08.112 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.084+0000 7f331d2b2640 1 -- 10.20.193.45:0/2176199568 >> v1:10.20.193.73:6792/0 conn(0x7f331809d4d0 legacy=0x7f331813bb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:08.112 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.085+0000 7f331d2b2640 1 -- 10.20.193.45:0/2176199568 shutdown_connections 2026-02-22T23:28:08.112 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.085+0000 7f331d2b2640 1 -- 10.20.193.45:0/2176199568 >> 10.20.193.45:0/2176199568 conn(0x7f33180a39f0 msgr2=0x7f33180a3dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:28:08.112 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.085+0000 7f331d2b2640 1 -- 10.20.193.45:0/2176199568 shutdown_connections 2026-02-22T23:28:08.112 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.085+0000 7f331d2b2640 1 -- 10.20.193.45:0/2176199568 wait complete. 2026-02-22T23:28:08.112 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.085+0000 7f331d2b2640 10 monclient: build_initial_monmap 2026-02-22T23:28:08.112 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.085+0000 7f331d2b2640 10 monclient: monmap: 2026-02-22T23:28:08.112 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-22T23:28:08.112 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T23:28:08.112 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-22T23:28:08.113 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-22T23:28:08.113 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-22T23:28:08.113 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-22T23:28:08.113 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-22T23:28:08.113 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.noname-f 2026-02-22T23:28:08.113 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.noname-b 2026-02-22T23:28:08.113 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.noname-g 2026-02-22T23:28:08.113 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.noname-c 2026-02-22T23:28:08.113 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.noname-h 2026-02-22T23:28:08.113 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.noname-d 2026-02-22T23:28:08.114 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.noname-i 2026-02-22T23:28:08.114 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.noname-e 2026-02-22T23:28:08.114 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:08.114 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.085+0000 7f331d2b2640 1 Processor -- start 2026-02-22T23:28:08.114 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.085+0000 7f331d2b2640 1 -- start start 2026-02-22T23:28:08.114 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.085+0000 7f331d2b2640 10 monclient: init 2026-02-22T23:28:08.114 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.085+0000 7f331d2b2640 10 monclient: _reopen_session rank -1 2026-02-22T23:28:08.114 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.085+0000 7f331d2b2640 10 monclient: _add_conns ranks=[3,6,4,7,2,1,5,8,0] 2026-02-22T23:28:08.114 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.085+0000 7f331d2b2640 10 monclient(hunting): picked mon.noname-g con 0x7f331809d4d0 addr v1:10.20.193.73:6790/0 2026-02-22T23:28:08.114 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.085+0000 7f331d2b2640 10 monclient(hunting): picked mon.noname-d con 0x7f33180a2900 addr v1:10.20.193.45:6792/0 2026-02-22T23:28:08.115 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.085+0000 7f331d2b2640 10 monclient(hunting): picked mon.noname-c con 0x7f33180a33f0 addr v1:10.20.193.45:6791/0 2026-02-22T23:28:08.115 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.085+0000 7f331d2b2640 1 -- --> v1:10.20.193.73:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3318126d60 con 0x7f331809d4d0 2026-02-22T23:28:08.115 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.085+0000 7f331d2b2640 1 -- --> v1:10.20.193.45:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3318073230 con 0x7f33180a33f0 2026-02-22T23:28:08.115 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.085+0000 7f331d2b2640 1 -- --> v1:10.20.193.45:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3318072ce0 con 0x7f33180a2900 2026-02-22T23:28:08.115 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.085+0000 7f331d2b2640 10 monclient(hunting): _renew_subs 2026-02-22T23:28:08.115 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.085+0000 7f331d2b2640 10 monclient(hunting): authenticate will time out at 819.702868s 2026-02-22T23:28:08.115 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.085+0000 7f33177fe640 1 --1- >> v1:10.20.193.45:6792/0 conn(0x7f33180a2900 0x7f33181d2b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.45:6792/0 says I am v1:10.20.193.45:36856/0 (socket says 10.20.193.45:36856) 2026-02-22T23:28:08.115 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.085+0000 7f33177fe640 1 -- 10.20.193.45:0/949563097 learned_addr learned my addr 10.20.193.45:0/949563097 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-22T23:28:08.115 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.086+0000 7f3314ff9640 1 -- 10.20.193.45:0/949563097 <== mon.6 v1:10.20.193.45:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 339955883 0 0) 0x7f3318072ce0 con 0x7f33180a2900 2026-02-22T23:28:08.115 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.086+0000 7f3314ff9640 10 monclient(hunting): _negotiate 2026-02-22T23:28:08.115 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.086+0000 7f3314ff9640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:28:08.115 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.086+0000 7f3314ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:28:08.115 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.086+0000 7f3314ff9640 10 monclient(hunting): my global_id is 114225 2026-02-22T23:28:08.115 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.086+0000 7f3314ff9640 1 -- 10.20.193.45:0/949563097 --> v1:10.20.193.45:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f32e8003620 con 0x7f33180a2900 2026-02-22T23:28:08.115 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.086+0000 7f3314ff9640 1 -- 10.20.193.45:0/949563097 <== mon.4 v1:10.20.193.45:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1026158755 0 0) 0x7f3318073230 con 0x7f33180a33f0 2026-02-22T23:28:08.115 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.086+0000 7f3314ff9640 10 monclient(hunting): _negotiate 2026-02-22T23:28:08.116 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.086+0000 7f3314ff9640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:28:08.116 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.086+0000 7f3314ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:28:08.116 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.086+0000 7f3314ff9640 10 monclient(hunting): my global_id is 114241 2026-02-22T23:28:08.116 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.086+0000 7f3314ff9640 1 -- 10.20.193.45:0/949563097 --> v1:10.20.193.45:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3318072ce0 con 0x7f33180a33f0 2026-02-22T23:28:08.116 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.086+0000 7f3314ff9640 1 -- 10.20.193.45:0/949563097 <== mon.6 v1:10.20.193.45:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3020179962 0 0) 0x7f32e8003620 con 0x7f33180a2900 2026-02-22T23:28:08.116 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.086+0000 7f3314ff9640 1 -- 10.20.193.45:0/949563097 --> v1:10.20.193.45:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3318073230 con 0x7f33180a2900 2026-02-22T23:28:08.116 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.086+0000 7f3314ff9640 1 -- 10.20.193.45:0/949563097 <== mon.4 v1:10.20.193.45:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3814817459 0 0) 0x7f3318072ce0 con 0x7f33180a33f0 2026-02-22T23:28:08.116 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.086+0000 7f3314ff9640 1 -- 10.20.193.45:0/949563097 --> v1:10.20.193.45:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f32e8003620 con 0x7f33180a33f0 2026-02-22T23:28:08.116 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.086+0000 7f3314ff9640 1 -- 10.20.193.45:0/949563097 <== mon.6 v1:10.20.193.45:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f33080036d0 con 0x7f33180a2900 2026-02-22T23:28:08.116 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.086+0000 7f3314ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-22T23:28:08.116 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.086+0000 7f3314ff9640 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2026-02-22T23:28:08.116 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.086+0000 7f3314ff9640 10 monclient(hunting): dump: 2026-02-22T23:28:08.116 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:28:08.116 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:28:08.116 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:08.116 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:08.116 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:28:08.116 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:28:08.117 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:28:08.117 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:28:08.117 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:28:08.117 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:28:08.117 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:28:08.117 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:28:08.117 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:28:08.117 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:28:08.117 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:28:08.117 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:08.117 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.086+0000 7f3314ff9640 10 monclient(hunting): _finish_auth 0 2026-02-22T23:28:08.117 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.086+0000 7f3314ff9640 1 -- 10.20.193.45:0/949563097 <== mon.4 v1:10.20.193.45:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f330c003500 con 0x7f33180a33f0 2026-02-22T23:28:08.117 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.086+0000 7f3314ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-22T23:28:08.117 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.086+0000 7f3314ff9640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-22T23:28:08.117 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.086+0000 7f3314ff9640 10 monclient(hunting): dump: 2026-02-22T23:28:08.117 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:28:08.117 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:28:08.117 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:08.118 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:08.118 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:28:08.118 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:28:08.118 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:28:08.118 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:28:08.118 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:28:08.118 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:28:08.118 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:28:08.118 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:28:08.118 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:28:08.118 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:28:08.118 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:28:08.118 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:08.118 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.086+0000 7f3314ff9640 1 -- 10.20.193.45:0/949563097 <== mon.6 v1:10.20.193.45:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3698744309 0 0) 0x7f3318073230 con 0x7f33180a2900 2026-02-22T23:28:08.118 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.086+0000 7f3314ff9640 1 -- 10.20.193.45:0/949563097 >> v1:10.20.193.45:6791/0 conn(0x7f33180a33f0 legacy=0x7f33181d6290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:08.118 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.086+0000 7f3314ff9640 1 -- 10.20.193.45:0/949563097 >> v1:10.20.193.73:6790/0 conn(0x7f331809d4d0 legacy=0x7f33181cdb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:08.118 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.086+0000 7f3314ff9640 10 monclient: _finish_hunting 0 2026-02-22T23:28:08.118 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.086+0000 7f3314ff9640 1 monclient: found mon.d 2026-02-22T23:28:08.119 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.086+0000 7f3314ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T23:28:08.119 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.086+0000 7f3314ff9640 10 monclient: _send_mon_message to mon.d at v1:10.20.193.45:6792/0 2026-02-22T23:28:08.119 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.086+0000 7f3314ff9640 1 -- 10.20.193.45:0/949563097 --> v1:10.20.193.45:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3318125ad0 con 0x7f33180a2900 2026-02-22T23:28:08.119 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.086+0000 7f3314ff9640 10 monclient: _finish_auth 0 2026-02-22T23:28:08.119 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.086+0000 7f3314ff9640 10 monclient: _check_auth_tickets 2026-02-22T23:28:08.119 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.086+0000 7f3314ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T23:28:08.119 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.086+0000 7f331d2b2640 5 monclient: authenticate success, global_id 114225 2026-02-22T23:28:08.119 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.086+0000 7f331d2b2640 10 monclient: _renew_subs 2026-02-22T23:28:08.119 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.086+0000 7f331d2b2640 10 monclient: _send_mon_message to mon.d at v1:10.20.193.45:6792/0 2026-02-22T23:28:08.119 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.086+0000 7f331d2b2640 1 -- 10.20.193.45:0/949563097 --> v1:10.20.193.45:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f3318126a80 con 0x7f33180a2900 2026-02-22T23:28:08.119 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.086+0000 7f331d2b2640 10 monclient: _renew_subs 2026-02-22T23:28:08.119 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.086+0000 7f331d2b2640 10 monclient: _send_mon_message to mon.d at v1:10.20.193.45:6792/0 2026-02-22T23:28:08.119 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.086+0000 7f331d2b2640 1 -- 10.20.193.45:0/949563097 --> v1:10.20.193.45:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7f33181240e0 con 0x7f33180a2900 2026-02-22T23:28:08.119 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.086+0000 7f3314ff9640 1 -- 10.20.193.45:0/949563097 <== mon.6 v1:10.20.193.45:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3308003060 con 0x7f33180a2900 2026-02-22T23:28:08.119 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.086+0000 7f3314ff9640 10 monclient: handle_config config(0 keys) 2026-02-22T23:28:08.119 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.086+0000 7f3314ff9640 1 -- 10.20.193.45:0/949563097 <== mon.6 v1:10.20.193.45:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f3308002a20 con 0x7f33180a2900 2026-02-22T23:28:08.119 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.086+0000 7f3314ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:28:08.120 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.086+0000 7f3314ff9640 10 monclient: got monmap 1 from mon.d (according to old e1) 2026-02-22T23:28:08.120 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.086+0000 7f33167fc640 4 set_mon_vals no callback set 2026-02-22T23:28:08.120 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.086+0000 7f3314ff9640 10 monclient: dump: 2026-02-22T23:28:08.120 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:28:08.120 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:28:08.120 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:08.120 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:08.120 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:28:08.120 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:28:08.120 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:28:08.120 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:28:08.120 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:28:08.120 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:28:08.120 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:28:08.120 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:28:08.120 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:28:08.120 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:28:08.120 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:28:08.121 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:08.121 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.086+0000 7f331d2b2640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T23:28:08.121 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.086+0000 7f331d2b2640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T23:28:08.121 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.086+0000 7f331d2b2640 10 monclient: _send_mon_message to mon.d at v1:10.20.193.45:6792/0 2026-02-22T23:28:08.121 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.086+0000 7f331d2b2640 1 -- 10.20.193.45:0/949563097 --> v1:10.20.193.45:6792/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3318073e70 con 0x7f33180a2900 2026-02-22T23:28:08.121 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.086+0000 7f3314ff9640 1 -- 10.20.193.45:0/949563097 <== mon.6 v1:10.20.193.45:6792/0 7 ==== mgrmap(e 5) ==== 50225+0+0 (unknown 2330357642 0 0) 0x7f3308004090 con 0x7f33180a2900 2026-02-22T23:28:08.121 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.087+0000 7f3314ff9640 1 -- 10.20.193.45:0/949563097 <== mon.6 v1:10.20.193.45:6792/0 8 ==== osd_map(25..25 src has 1..25) ==== 3502+0+0 (unknown 129690100 0 0) 0x7f330804dbc0 con 0x7f33180a2900 2026-02-22T23:28:08.121 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.087+0000 7f3317fff640 10 monclient: get_auth_request con 0x7f32e803fde0 auth_method 0 2026-02-22T23:28:08.121 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.089+0000 7f3314ff9640 1 -- 10.20.193.45:0/949563097 <== mon.6 v1:10.20.193.45:6792/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (unknown 1092875540 0 2568732696) 0x7f3318073e70 con 0x7f33180a2900 2026-02-22T23:28:08.121 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.089+0000 7f3314ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T23:28:08.121 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.089+0000 7f3314ff9640 10 monclient: _finish_command 1 = system:0 2026-02-22T23:28:08.173 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.171+0000 7f331d2b2640 1 -- 10.20.193.45:0/949563097 --> v1:10.20.193.73:6800/2222410180 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7f33180a2510 con 0x7f32e803fde0 2026-02-22T23:28:08.173 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.171+0000 7f3314ff9640 1 -- 10.20.193.45:0/949563097 <== mgr.4111 v1:10.20.193.73:6800/2222410180 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (unknown 2057319476 0 0) 0x7f33180a2510 con 0x7f32e803fde0 2026-02-22T23:28:08.173 INFO:teuthology.orchestra.run.trial045.stderr:instructed osd(s) 0 to deep-scrub 2026-02-22T23:28:08.174 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.172+0000 7f331d2b2640 1 -- 10.20.193.45:0/949563097 >> v1:10.20.193.73:6800/2222410180 conn(0x7f32e803fde0 legacy=0x7f32e80422a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:08.174 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.172+0000 7f331d2b2640 10 monclient: shutdown 2026-02-22T23:28:08.174 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.172+0000 7f331d2b2640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T23:28:08.174 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.172+0000 7f331d2b2640 1 -- 10.20.193.45:0/949563097 >> v1:10.20.193.45:6792/0 conn(0x7f33180a2900 legacy=0x7f33181d2b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:08.174 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.172+0000 7f331d2b2640 1 -- 10.20.193.45:0/949563097 shutdown_connections 2026-02-22T23:28:08.174 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.172+0000 7f331d2b2640 1 -- 10.20.193.45:0/949563097 >> 10.20.193.45:0/949563097 conn(0x7f33180a39f0 msgr2=0x7f3318140020 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:28:08.174 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.172+0000 7f331d2b2640 1 -- 10.20.193.45:0/949563097 shutdown_connections 2026-02-22T23:28:08.174 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.172+0000 7f331d2b2640 1 -- 10.20.193.45:0/949563097 wait complete. 2026-02-22T23:28:08.181 INFO:tasks.ceph:Scrubbing osd.1 2026-02-22T23:28:08.181 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2026-02-22T23:28:08.256 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.249+0000 7f6ad7e57640 10 monclient: get_monmap_and_config 2026-02-22T23:28:08.256 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.249+0000 7f6ad7e57640 10 monclient: build_initial_monmap 2026-02-22T23:28:08.256 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.249+0000 7f6ad7e57640 10 monclient: monmap: 2026-02-22T23:28:08.256 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-22T23:28:08.256 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:28:08.256 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:28:08.250417+0000 2026-02-22T23:28:08.257 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:28:08.250417+0000 2026-02-22T23:28:08.257 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-22T23:28:08.257 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:28:08.257 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-22T23:28:08.257 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.noname-f 2026-02-22T23:28:08.257 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.noname-b 2026-02-22T23:28:08.257 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.noname-g 2026-02-22T23:28:08.257 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.noname-c 2026-02-22T23:28:08.257 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.noname-h 2026-02-22T23:28:08.257 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.noname-d 2026-02-22T23:28:08.257 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.noname-i 2026-02-22T23:28:08.257 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.noname-e 2026-02-22T23:28:08.258 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:08.258 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.249+0000 7f6ad7e57640 1 Processor -- start 2026-02-22T23:28:08.258 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.249+0000 7f6ad7e57640 1 -- start start 2026-02-22T23:28:08.258 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.249+0000 7f6ad7e57640 10 monclient: init 2026-02-22T23:28:08.258 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.249+0000 7f6ad7e57640 10 monclient: _reopen_session rank -1 2026-02-22T23:28:08.258 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.249+0000 7f6ad7e57640 10 monclient: _add_conns ranks=[6,3,1,0,4,8,5,7,2] 2026-02-22T23:28:08.258 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.249+0000 7f6ad7e57640 10 monclient(hunting): picked mon.noname-d con 0x7f6ad00a1a60 addr v1:10.20.193.45:6792/0 2026-02-22T23:28:08.258 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.249+0000 7f6ad7e57640 10 monclient(hunting): picked mon.noname-g con 0x7f6ad00a0910 addr v1:10.20.193.73:6790/0 2026-02-22T23:28:08.258 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.249+0000 7f6ad7e57640 10 monclient(hunting): picked mon.noname-f con 0x7f6ad013cca0 addr v1:10.20.193.73:6789/0 2026-02-22T23:28:08.258 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.249+0000 7f6ad7e57640 1 -- --> v1:10.20.193.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ad0137660 con 0x7f6ad013cca0 2026-02-22T23:28:08.258 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.249+0000 7f6ad7e57640 1 -- --> v1:10.20.193.73:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ad00a7d40 con 0x7f6ad00a0910 2026-02-22T23:28:08.258 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.249+0000 7f6ad7e57640 1 -- --> v1:10.20.193.45:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ad00a0d90 con 0x7f6ad00a1a60 2026-02-22T23:28:08.258 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.249+0000 7f6ad7e57640 10 monclient(hunting): _renew_subs 2026-02-22T23:28:08.258 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.249+0000 7f6ad7e57640 10 monclient(hunting): authenticate will time out at 819.866979s 2026-02-22T23:28:08.258 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.250+0000 7f6ad5bcc640 1 --1- >> v1:10.20.193.45:6792/0 conn(0x7f6ad00a1a60 0x7f6ad0136840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.45:6792/0 says I am v1:10.20.193.45:36866/0 (socket says 10.20.193.45:36866) 2026-02-22T23:28:08.259 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.250+0000 7f6ad5bcc640 1 -- 10.20.193.45:0/981209649 learned_addr learned my addr 10.20.193.45:0/981209649 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-22T23:28:08.259 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.250+0000 7f6ad4bca640 1 -- 10.20.193.45:0/981209649 <== mon.6 v1:10.20.193.45:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1829738240 0 0) 0x7f6ad00a0d90 con 0x7f6ad00a1a60 2026-02-22T23:28:08.259 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.250+0000 7f6ad4bca640 10 monclient(hunting): _negotiate 2026-02-22T23:28:08.259 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.250+0000 7f6ad4bca640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:28:08.259 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.250+0000 7f6ad4bca640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:28:08.259 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.250+0000 7f6ad4bca640 10 monclient(hunting): my global_id is 114234 2026-02-22T23:28:08.259 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.250+0000 7f6ad4bca640 1 -- 10.20.193.45:0/981209649 --> v1:10.20.193.45:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6ab8003620 con 0x7f6ad00a1a60 2026-02-22T23:28:08.259 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.250+0000 7f6ad4bca640 1 -- 10.20.193.45:0/981209649 <== mon.1 v1:10.20.193.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2136160619 0 0) 0x7f6ad0137660 con 0x7f6ad013cca0 2026-02-22T23:28:08.259 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.250+0000 7f6ad4bca640 10 monclient(hunting): _negotiate 2026-02-22T23:28:08.259 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.250+0000 7f6ad4bca640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:28:08.259 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.250+0000 7f6ad4bca640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:28:08.259 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.250+0000 7f6ad4bca640 10 monclient(hunting): my global_id is 114220 2026-02-22T23:28:08.259 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.250+0000 7f6ad4bca640 1 -- 10.20.193.45:0/981209649 --> v1:10.20.193.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6ad00a0d90 con 0x7f6ad013cca0 2026-02-22T23:28:08.259 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.250+0000 7f6ad4bca640 1 -- 10.20.193.45:0/981209649 <== mon.6 v1:10.20.193.45:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3654517241 0 0) 0x7f6ab8003620 con 0x7f6ad00a1a60 2026-02-22T23:28:08.259 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.250+0000 7f6ad4bca640 1 -- 10.20.193.45:0/981209649 >> v1:10.20.193.73:6790/0 conn(0x7f6ad00a0910 legacy=0x7f6ad0136f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:08.259 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.250+0000 7f6ad4bca640 1 -- 10.20.193.45:0/981209649 >> v1:10.20.193.73:6789/0 conn(0x7f6ad013cca0 legacy=0x7f6ad013f090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:08.259 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.250+0000 7f6ad4bca640 10 monclient: _finish_hunting 0 2026-02-22T23:28:08.260 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.250+0000 7f6ad4bca640 1 monclient: found mon.noname-d 2026-02-22T23:28:08.260 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.250+0000 7f6ad4bca640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T23:28:08.260 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.250+0000 7f6ad4bca640 10 monclient: _send_mon_message to mon.noname-d at v1:10.20.193.45:6792/0 2026-02-22T23:28:08.260 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.250+0000 7f6ad4bca640 1 -- 10.20.193.45:0/981209649 --> v1:10.20.193.45:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ad01437e0 con 0x7f6ad00a1a60 2026-02-22T23:28:08.260 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.250+0000 7f6ad4bca640 10 monclient: _finish_auth 0 2026-02-22T23:28:08.260 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.250+0000 7f6ad4bca640 10 monclient: _check_auth_tickets 2026-02-22T23:28:08.260 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.250+0000 7f6ad4bca640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T23:28:08.260 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.250+0000 7f6ad4bca640 1 -- 10.20.193.45:0/981209649 <== mon.6 v1:10.20.193.45:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f6ac0003040 con 0x7f6ad00a1a60 2026-02-22T23:28:08.260 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.250+0000 7f6ad4bca640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:28:08.260 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.250+0000 7f6ad4bca640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2026-02-22T23:28:08.260 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.250+0000 7f6ad4bca640 10 monclient: dump: 2026-02-22T23:28:08.260 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:28:08.260 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:28:08.260 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:08.260 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:08.260 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:28:08.260 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:28:08.261 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:28:08.261 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:28:08.261 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:28:08.261 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:28:08.261 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:28:08.261 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:28:08.261 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:28:08.261 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:28:08.261 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:28:08.261 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:08.261 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.250+0000 7f6ad7e57640 5 monclient: authenticate success, global_id 114234 2026-02-22T23:28:08.261 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.250+0000 7f6ad7e57640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-22T23:28:08.261 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.250+0000 7f6ad4bca640 1 -- 10.20.193.45:0/981209649 <== mon.6 v1:10.20.193.45:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6ac0003260 con 0x7f6ad00a1a60 2026-02-22T23:28:08.261 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.250+0000 7f6ad4bca640 10 monclient: handle_config config(0 keys) 2026-02-22T23:28:08.261 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.250+0000 7f6ad4bca640 1 -- 10.20.193.45:0/981209649 <== mon.6 v1:10.20.193.45:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f6ac0004ce0 con 0x7f6ad00a1a60 2026-02-22T23:28:08.261 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.250+0000 7f6ad4bca640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:28:08.261 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.250+0000 7f6ad4bca640 10 monclient: got monmap 1 from mon.d (according to old e1) 2026-02-22T23:28:08.262 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.250+0000 7f6ad4bca640 10 monclient: dump: 2026-02-22T23:28:08.262 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:28:08.262 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:28:08.262 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:08.262 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:08.262 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:28:08.262 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:28:08.262 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:28:08.262 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:28:08.262 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:28:08.262 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:28:08.262 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:28:08.262 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:28:08.262 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:28:08.262 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:28:08.262 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:28:08.262 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:08.263 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.250+0000 7f6ad7e57640 10 monclient: get_monmap_and_config success 2026-02-22T23:28:08.263 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.250+0000 7f6ad7e57640 4 set_mon_vals no callback set 2026-02-22T23:28:08.263 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.250+0000 7f6ad7e57640 10 monclient: shutdown 2026-02-22T23:28:08.263 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.250+0000 7f6ad7e57640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T23:28:08.263 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.250+0000 7f6ad7e57640 1 -- 10.20.193.45:0/981209649 >> v1:10.20.193.45:6792/0 conn(0x7f6ad00a1a60 legacy=0x7f6ad0136840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:08.263 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.250+0000 7f6ad7e57640 1 -- 10.20.193.45:0/981209649 shutdown_connections 2026-02-22T23:28:08.263 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.250+0000 7f6ad7e57640 1 -- 10.20.193.45:0/981209649 >> 10.20.193.45:0/981209649 conn(0x7f6ad00a7690 msgr2=0x7f6ad00a3b60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:28:08.263 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.250+0000 7f6ad7e57640 1 -- 10.20.193.45:0/981209649 shutdown_connections 2026-02-22T23:28:08.263 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.250+0000 7f6ad7e57640 1 -- 10.20.193.45:0/981209649 wait complete. 2026-02-22T23:28:08.263 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.251+0000 7f6ad7e57640 10 monclient: build_initial_monmap 2026-02-22T23:28:08.263 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.251+0000 7f6ad7e57640 10 monclient: monmap: 2026-02-22T23:28:08.263 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-22T23:28:08.263 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T23:28:08.263 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-22T23:28:08.263 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-22T23:28:08.263 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-22T23:28:08.264 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-22T23:28:08.264 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-22T23:28:08.264 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.noname-f 2026-02-22T23:28:08.264 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.noname-b 2026-02-22T23:28:08.264 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.noname-g 2026-02-22T23:28:08.264 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.noname-c 2026-02-22T23:28:08.264 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.noname-h 2026-02-22T23:28:08.264 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.noname-d 2026-02-22T23:28:08.264 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.noname-i 2026-02-22T23:28:08.264 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.noname-e 2026-02-22T23:28:08.264 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:08.264 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.251+0000 7f6ad7e57640 1 Processor -- start 2026-02-22T23:28:08.264 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.251+0000 7f6ad7e57640 1 -- start start 2026-02-22T23:28:08.264 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.251+0000 7f6ad7e57640 10 monclient: init 2026-02-22T23:28:08.264 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.251+0000 7f6ad7e57640 10 monclient: _reopen_session rank -1 2026-02-22T23:28:08.264 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.251+0000 7f6ad7e57640 10 monclient: _add_conns ranks=[2,4,3,8,1,0,5,7,6] 2026-02-22T23:28:08.264 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.251+0000 7f6ad7e57640 10 monclient(hunting): picked mon.noname-b con 0x7f6ad00a0910 addr v1:10.20.193.45:6790/0 2026-02-22T23:28:08.265 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.251+0000 7f6ad7e57640 10 monclient(hunting): picked mon.noname-c con 0x7f6ad00a1a60 addr v1:10.20.193.45:6791/0 2026-02-22T23:28:08.265 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.251+0000 7f6ad7e57640 10 monclient(hunting): picked mon.noname-g con 0x7f6ad013cca0 addr v1:10.20.193.73:6790/0 2026-02-22T23:28:08.265 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.251+0000 7f6ad7e57640 1 -- --> v1:10.20.193.45:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ad013b110 con 0x7f6ad00a0910 2026-02-22T23:28:08.265 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.251+0000 7f6ad7e57640 1 -- --> v1:10.20.193.73:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ad0142a80 con 0x7f6ad013cca0 2026-02-22T23:28:08.265 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.251+0000 7f6ad7e57640 1 -- --> v1:10.20.193.45:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ad013a730 con 0x7f6ad00a1a60 2026-02-22T23:28:08.265 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.251+0000 7f6ad7e57640 10 monclient(hunting): _renew_subs 2026-02-22T23:28:08.265 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.251+0000 7f6ad7e57640 10 monclient(hunting): authenticate will time out at 819.868616s 2026-02-22T23:28:08.265 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.251+0000 7f6ad5bcc640 1 --1- >> v1:10.20.193.45:6790/0 conn(0x7f6ad00a0910 0x7f6ad0136da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.45:6790/0 says I am v1:10.20.193.45:60206/0 (socket says 10.20.193.45:60206) 2026-02-22T23:28:08.265 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.251+0000 7f6ad5bcc640 1 -- 10.20.193.45:0/1373188296 learned_addr learned my addr 10.20.193.45:0/1373188296 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-22T23:28:08.265 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.251+0000 7f6abe7fc640 1 -- 10.20.193.45:0/1373188296 <== mon.2 v1:10.20.193.45:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2353897938 0 0) 0x7f6ad01437e0 con 0x7f6ad00a0910 2026-02-22T23:28:08.265 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.251+0000 7f6abe7fc640 10 monclient(hunting): _negotiate 2026-02-22T23:28:08.265 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.251+0000 7f6abe7fc640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:28:08.265 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.251+0000 7f6abe7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:28:08.265 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.251+0000 7f6abe7fc640 10 monclient(hunting): my global_id is 4763 2026-02-22T23:28:08.265 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.251+0000 7f6abe7fc640 1 -- 10.20.193.45:0/1373188296 --> v1:10.20.193.45:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6aa0003620 con 0x7f6ad00a0910 2026-02-22T23:28:08.265 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.251+0000 7f6abe7fc640 1 -- 10.20.193.45:0/1373188296 <== mon.4 v1:10.20.193.45:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3194059693 0 0) 0x7f6ad013a730 con 0x7f6ad00a1a60 2026-02-22T23:28:08.266 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.251+0000 7f6abe7fc640 10 monclient(hunting): _negotiate 2026-02-22T23:28:08.266 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.251+0000 7f6abe7fc640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:28:08.266 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.251+0000 7f6abe7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:28:08.266 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.251+0000 7f6abe7fc640 10 monclient(hunting): my global_id is 114250 2026-02-22T23:28:08.266 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.251+0000 7f6abe7fc640 1 -- 10.20.193.45:0/1373188296 --> v1:10.20.193.45:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6ad01437e0 con 0x7f6ad00a1a60 2026-02-22T23:28:08.266 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.251+0000 7f6abe7fc640 1 -- 10.20.193.45:0/1373188296 <== mon.4 v1:10.20.193.45:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 715650390 0 0) 0x7f6ad01437e0 con 0x7f6ad00a1a60 2026-02-22T23:28:08.266 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.251+0000 7f6abe7fc640 1 -- 10.20.193.45:0/1373188296 --> v1:10.20.193.45:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6ad013a730 con 0x7f6ad00a1a60 2026-02-22T23:28:08.266 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.251+0000 7f6abe7fc640 1 -- 10.20.193.45:0/1373188296 <== mon.2 v1:10.20.193.45:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1539539736 0 0) 0x7f6aa0003620 con 0x7f6ad00a0910 2026-02-22T23:28:08.266 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.251+0000 7f6abe7fc640 1 -- 10.20.193.45:0/1373188296 --> v1:10.20.193.45:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6ad01437e0 con 0x7f6ad00a0910 2026-02-22T23:28:08.266 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.251+0000 7f6abe7fc640 1 -- 10.20.193.45:0/1373188296 <== mon.4 v1:10.20.193.45:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f6ac4003250 con 0x7f6ad00a1a60 2026-02-22T23:28:08.266 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.251+0000 7f6abe7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-22T23:28:08.266 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.251+0000 7f6abe7fc640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-22T23:28:08.266 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.251+0000 7f6abe7fc640 10 monclient(hunting): dump: 2026-02-22T23:28:08.266 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:28:08.266 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:28:08.266 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:08.266 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:08.266 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:28:08.267 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:28:08.267 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:28:08.267 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:28:08.267 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:28:08.267 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:28:08.267 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:28:08.267 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:28:08.267 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:28:08.267 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:28:08.267 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:28:08.267 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:08.267 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.251+0000 7f6abe7fc640 10 monclient(hunting): _finish_auth 0 2026-02-22T23:28:08.267 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.251+0000 7f6abe7fc640 1 -- 10.20.193.45:0/1373188296 <== mon.2 v1:10.20.193.45:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f6ac0004c20 con 0x7f6ad00a0910 2026-02-22T23:28:08.267 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.251+0000 7f6abe7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-22T23:28:08.267 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.251+0000 7f6abe7fc640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-22T23:28:08.268 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.251+0000 7f6abe7fc640 10 monclient(hunting): dump: 2026-02-22T23:28:08.268 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:28:08.268 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:28:08.268 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:08.268 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:08.268 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:28:08.268 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:28:08.268 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:28:08.268 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:28:08.268 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:28:08.269 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:28:08.269 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:28:08.269 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:28:08.269 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:28:08.269 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:28:08.269 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:28:08.269 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:08.269 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.251+0000 7f6abe7fc640 1 -- 10.20.193.45:0/1373188296 <== mon.4 v1:10.20.193.45:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1478910673 0 0) 0x7f6ad013a730 con 0x7f6ad00a1a60 2026-02-22T23:28:08.269 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.252+0000 7f6abe7fc640 1 -- 10.20.193.45:0/1373188296 >> v1:10.20.193.73:6790/0 conn(0x7f6ad013cca0 legacy=0x7f6ad01d5d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:08.269 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.252+0000 7f6abe7fc640 1 -- 10.20.193.45:0/1373188296 >> v1:10.20.193.45:6790/0 conn(0x7f6ad00a0910 legacy=0x7f6ad0136da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:08.269 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.252+0000 7f6abe7fc640 10 monclient: _finish_hunting 0 2026-02-22T23:28:08.269 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.252+0000 7f6abe7fc640 1 monclient: found mon.c 2026-02-22T23:28:08.269 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.252+0000 7f6abe7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T23:28:08.269 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.252+0000 7f6abe7fc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.45:6791/0 2026-02-22T23:28:08.269 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.252+0000 7f6abe7fc640 1 -- 10.20.193.45:0/1373188296 --> v1:10.20.193.45:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ad01400b0 con 0x7f6ad00a1a60 2026-02-22T23:28:08.269 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.252+0000 7f6abe7fc640 10 monclient: _finish_auth 0 2026-02-22T23:28:08.270 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.252+0000 7f6abe7fc640 10 monclient: _check_auth_tickets 2026-02-22T23:28:08.270 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.252+0000 7f6abe7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T23:28:08.270 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.252+0000 7f6ad7e57640 5 monclient: authenticate success, global_id 114250 2026-02-22T23:28:08.270 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.252+0000 7f6ad7e57640 10 monclient: _renew_subs 2026-02-22T23:28:08.270 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.252+0000 7f6ad7e57640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.45:6791/0 2026-02-22T23:28:08.270 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.252+0000 7f6ad7e57640 1 -- 10.20.193.45:0/1373188296 --> v1:10.20.193.45:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f6ad00a2bd0 con 0x7f6ad00a1a60 2026-02-22T23:28:08.270 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.252+0000 7f6ad7e57640 10 monclient: _renew_subs 2026-02-22T23:28:08.270 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.252+0000 7f6ad7e57640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.45:6791/0 2026-02-22T23:28:08.270 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.252+0000 7f6ad7e57640 1 -- 10.20.193.45:0/1373188296 --> v1:10.20.193.45:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7f6ad013a450 con 0x7f6ad00a1a60 2026-02-22T23:28:08.270 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.252+0000 7f6abe7fc640 1 -- 10.20.193.45:0/1373188296 <== mon.4 v1:10.20.193.45:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6ac40036a0 con 0x7f6ad00a1a60 2026-02-22T23:28:08.270 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.252+0000 7f6abe7fc640 10 monclient: handle_config config(0 keys) 2026-02-22T23:28:08.270 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.252+0000 7f6abe7fc640 1 -- 10.20.193.45:0/1373188296 <== mon.4 v1:10.20.193.45:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f6ac4003c50 con 0x7f6ad00a1a60 2026-02-22T23:28:08.270 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.252+0000 7f6abe7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:28:08.270 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.252+0000 7f6abffff640 4 set_mon_vals no callback set 2026-02-22T23:28:08.270 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.252+0000 7f6abe7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T23:28:08.270 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.252+0000 7f6abe7fc640 10 monclient: dump: 2026-02-22T23:28:08.270 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:28:08.271 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:28:08.271 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:08.271 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:08.271 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:28:08.271 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:28:08.271 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:28:08.271 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:28:08.271 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:28:08.271 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:28:08.271 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:28:08.271 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:28:08.271 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:28:08.271 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:28:08.271 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:28:08.271 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:08.271 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.252+0000 7f6ad7e57640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.45:6791/0 2026-02-22T23:28:08.271 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.252+0000 7f6ad7e57640 1 -- 10.20.193.45:0/1373188296 --> v1:10.20.193.45:6791/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f6ad0138db0 con 0x7f6ad00a1a60 2026-02-22T23:28:08.272 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.252+0000 7f6abe7fc640 1 -- 10.20.193.45:0/1373188296 <== mon.4 v1:10.20.193.45:6791/0 7 ==== mgrmap(e 5) ==== 50225+0+0 (unknown 2330357642 0 0) 0x7f6ac4003e70 con 0x7f6ad00a1a60 2026-02-22T23:28:08.272 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.252+0000 7f6abe7fc640 1 -- 10.20.193.45:0/1373188296 <== mon.4 v1:10.20.193.45:6791/0 8 ==== osd_map(25..25 src has 1..25) ==== 3502+0+0 (unknown 129690100 0 0) 0x7f6ac404ca80 con 0x7f6ad00a1a60 2026-02-22T23:28:08.272 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.252+0000 7f6abe7fc640 1 -- 10.20.193.45:0/1373188296 --> v1:10.20.193.45:6800/628358795 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6aa004a660 con 0x7f6aa00469f0 2026-02-22T23:28:08.272 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.252+0000 7f6abe7fc640 1 -- 10.20.193.45:0/1373188296 <== mon.4 v1:10.20.193.45:6791/0 9 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (unknown 2663167439 0 0) 0x7f6ac404ce90 con 0x7f6ad00a1a60 2026-02-22T23:28:08.272 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.252+0000 7f6abe7fc640 10 monclient: handle_get_version_reply finishing 1 version 25 2026-02-22T23:28:08.272 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.252+0000 7f6ad5bcc640 10 monclient: get_auth_request con 0x7f6aa003fdf0 auth_method 0 2026-02-22T23:28:08.272 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.252+0000 7f6ad63cd640 10 monclient: get_auth_request con 0x7f6aa00469f0 auth_method 0 2026-02-22T23:28:08.272 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.253+0000 7f6abe7fc640 1 -- 10.20.193.45:0/1373188296 <== osd.1 v1:10.20.193.45:6800/628358795 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (unknown 0 0 3365489958) 0x7f6aa004a660 con 0x7f6aa00469f0 2026-02-22T23:28:08.273 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.259+0000 7f6ad7e57640 1 -- 10.20.193.45:0/1373188296 --> v1:10.20.193.45:6800/628358795 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f6ad009e210 con 0x7f6aa00469f0 2026-02-22T23:28:08.273 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.259+0000 7f6abe7fc640 1 -- 10.20.193.45:0/1373188296 <== osd.1 v1:10.20.193.45:6800/628358795 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (unknown 0 0 119112422) 0x7f6ad009e210 con 0x7f6aa00469f0 2026-02-22T23:28:08.273 INFO:teuthology.orchestra.run.trial045.stdout:{ 2026-02-22T23:28:08.273 INFO:teuthology.orchestra.run.trial045.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-22T23:28:08.273 INFO:teuthology.orchestra.run.trial045.stdout:} 2026-02-22T23:28:08.274 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.259+0000 7f6ad7e57640 1 -- 10.20.193.45:0/1373188296 >> v1:10.20.193.45:6800/628358795 conn(0x7f6aa00469f0 legacy=0x7f6aa0048e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:08.274 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.259+0000 7f6ad7e57640 1 -- 10.20.193.45:0/1373188296 >> v1:10.20.193.73:6800/2222410180 conn(0x7f6aa003fdf0 legacy=0x7f6aa00422b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:08.274 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.259+0000 7f6ad7e57640 10 monclient: shutdown 2026-02-22T23:28:08.275 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.259+0000 7f6ad7e57640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T23:28:08.275 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.259+0000 7f6ad7e57640 1 -- 10.20.193.45:0/1373188296 >> v1:10.20.193.45:6791/0 conn(0x7f6ad00a1a60 legacy=0x7f6ad01d2660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:08.275 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.259+0000 7f6ad63cd640 1 -- 10.20.193.45:0/1373188296 reap_dead start 2026-02-22T23:28:08.275 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.259+0000 7f6ad7e57640 1 -- 10.20.193.45:0/1373188296 shutdown_connections 2026-02-22T23:28:08.275 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.259+0000 7f6ad7e57640 1 -- 10.20.193.45:0/1373188296 >> 10.20.193.45:0/1373188296 conn(0x7f6ad00a7690 msgr2=0x7f6ad013c480 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:28:08.275 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.259+0000 7f6ad7e57640 1 -- 10.20.193.45:0/1373188296 shutdown_connections 2026-02-22T23:28:08.275 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.259+0000 7f6ad7e57640 1 -- 10.20.193.45:0/1373188296 wait complete. 2026-02-22T23:28:08.275 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2026-02-22T23:28:08.344 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.342+0000 7eff03140640 10 monclient: get_monmap_and_config 2026-02-22T23:28:08.344 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.342+0000 7eff03140640 10 monclient: build_initial_monmap 2026-02-22T23:28:08.345 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.342+0000 7eff03140640 10 monclient: monmap: 2026-02-22T23:28:08.345 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-22T23:28:08.345 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:28:08.345 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:28:08.343877+0000 2026-02-22T23:28:08.345 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:28:08.343877+0000 2026-02-22T23:28:08.345 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-22T23:28:08.345 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:28:08.345 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-22T23:28:08.345 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.noname-f 2026-02-22T23:28:08.345 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.noname-b 2026-02-22T23:28:08.345 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.noname-g 2026-02-22T23:28:08.345 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.noname-c 2026-02-22T23:28:08.345 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.noname-h 2026-02-22T23:28:08.346 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.noname-d 2026-02-22T23:28:08.346 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.noname-i 2026-02-22T23:28:08.346 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.noname-e 2026-02-22T23:28:08.346 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:08.346 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.343+0000 7eff03140640 1 Processor -- start 2026-02-22T23:28:08.346 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.343+0000 7eff03140640 1 -- start start 2026-02-22T23:28:08.346 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.343+0000 7eff03140640 10 monclient: init 2026-02-22T23:28:08.352 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.343+0000 7eff03140640 10 monclient: _reopen_session rank -1 2026-02-22T23:28:08.352 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.343+0000 7eff03140640 10 monclient: _add_conns ranks=[1,5,7,8,6,3,0,4,2] 2026-02-22T23:28:08.353 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.343+0000 7eff03140640 10 monclient(hunting): picked mon.noname-f con 0x7efefc0a5e00 addr v1:10.20.193.73:6789/0 2026-02-22T23:28:08.353 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.343+0000 7eff03140640 10 monclient(hunting): picked mon.noname-h con 0x7efefc0a68f0 addr v1:10.20.193.73:6791/0 2026-02-22T23:28:08.353 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.343+0000 7eff03140640 10 monclient(hunting): picked mon.noname-i con 0x7efefc0a6d00 addr v1:10.20.193.73:6792/0 2026-02-22T23:28:08.353 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.343+0000 7eff03140640 1 -- --> v1:10.20.193.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efefc0a2d00 con 0x7efefc0a5e00 2026-02-22T23:28:08.353 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.343+0000 7eff03140640 1 -- --> v1:10.20.193.73:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efefc0a2fe0 con 0x7efefc0a68f0 2026-02-22T23:28:08.353 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.343+0000 7eff03140640 1 -- --> v1:10.20.193.73:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efefc0a32c0 con 0x7efefc0a6d00 2026-02-22T23:28:08.353 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.343+0000 7eff03140640 10 monclient(hunting): _renew_subs 2026-02-22T23:28:08.353 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.343+0000 7eff03140640 10 monclient(hunting): authenticate will time out at 819.960526s 2026-02-22T23:28:08.353 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.343+0000 7eff00eb5640 1 --1- >> v1:10.20.193.73:6789/0 conn(0x7efefc0a5e00 0x7efefc0a61e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.73:6789/0 says I am v1:10.20.193.45:48004/0 (socket says 10.20.193.45:48004) 2026-02-22T23:28:08.353 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.343+0000 7eff00eb5640 1 -- 10.20.193.45:0/1099748923 learned_addr learned my addr 10.20.193.45:0/1099748923 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-22T23:28:08.353 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.343+0000 7eff016b6640 1 --1- 10.20.193.45:0/1099748923 >> v1:10.20.193.73:6792/0 conn(0x7efefc0a6d00 0x7efefc1417b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.73:6792/0 says I am v1:10.20.193.45:33290/0 (socket says 10.20.193.45:33290) 2026-02-22T23:28:08.354 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.344+0000 7efef37fe640 1 -- 10.20.193.45:0/1099748923 <== mon.1 v1:10.20.193.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3591971501 0 0) 0x7efefc0a2d00 con 0x7efefc0a5e00 2026-02-22T23:28:08.354 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.344+0000 7efef37fe640 10 monclient(hunting): _negotiate 2026-02-22T23:28:08.354 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.344+0000 7efef37fe640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:28:08.354 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.344+0000 7efef37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:28:08.354 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.344+0000 7efef37fe640 10 monclient(hunting): my global_id is 114229 2026-02-22T23:28:08.354 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.344+0000 7efef37fe640 1 -- 10.20.193.45:0/1099748923 --> v1:10.20.193.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efee8003620 con 0x7efefc0a5e00 2026-02-22T23:28:08.354 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.344+0000 7efef37fe640 1 -- 10.20.193.45:0/1099748923 <== mon.7 v1:10.20.193.73:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1887613817 0 0) 0x7efefc0a32c0 con 0x7efefc0a6d00 2026-02-22T23:28:08.354 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.344+0000 7efef37fe640 10 monclient(hunting): _negotiate 2026-02-22T23:28:08.354 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.344+0000 7efef37fe640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:28:08.354 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.344+0000 7efef37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:28:08.355 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.344+0000 7efef37fe640 10 monclient(hunting): my global_id is 4588 2026-02-22T23:28:08.355 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.344+0000 7efef37fe640 1 -- 10.20.193.45:0/1099748923 --> v1:10.20.193.73:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efefc0a2d00 con 0x7efefc0a6d00 2026-02-22T23:28:08.355 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.344+0000 7efef37fe640 1 -- 10.20.193.45:0/1099748923 <== mon.5 v1:10.20.193.73:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1064071462 0 0) 0x7efefc0a2fe0 con 0x7efefc0a68f0 2026-02-22T23:28:08.355 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.344+0000 7efef37fe640 10 monclient(hunting): _negotiate 2026-02-22T23:28:08.355 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.344+0000 7efef37fe640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:28:08.355 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.344+0000 7efef37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:28:08.355 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.344+0000 7efef37fe640 10 monclient(hunting): my global_id is 114197 2026-02-22T23:28:08.355 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.344+0000 7efef37fe640 1 -- 10.20.193.45:0/1099748923 --> v1:10.20.193.73:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efefc0a32c0 con 0x7efefc0a68f0 2026-02-22T23:28:08.355 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.344+0000 7efef37fe640 1 -- 10.20.193.45:0/1099748923 <== mon.1 v1:10.20.193.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2191605665 0 0) 0x7efee8003620 con 0x7efefc0a5e00 2026-02-22T23:28:08.355 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.344+0000 7efef37fe640 1 -- 10.20.193.45:0/1099748923 >> v1:10.20.193.73:6792/0 conn(0x7efefc0a6d00 legacy=0x7efefc1417b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:08.355 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.344+0000 7efef37fe640 1 -- 10.20.193.45:0/1099748923 >> v1:10.20.193.73:6791/0 conn(0x7efefc0a68f0 legacy=0x7efefc13e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:08.355 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.344+0000 7efef37fe640 10 monclient: _finish_hunting 0 2026-02-22T23:28:08.355 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.344+0000 7efef37fe640 1 monclient: found mon.noname-f 2026-02-22T23:28:08.355 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.344+0000 7efef37fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T23:28:08.356 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.344+0000 7efef37fe640 10 monclient: _send_mon_message to mon.noname-f at v1:10.20.193.73:6789/0 2026-02-22T23:28:08.356 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.344+0000 7efef37fe640 1 -- 10.20.193.45:0/1099748923 --> v1:10.20.193.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efefc0a35a0 con 0x7efefc0a5e00 2026-02-22T23:28:08.356 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.344+0000 7efef37fe640 10 monclient: _finish_auth 0 2026-02-22T23:28:08.356 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.344+0000 7efef37fe640 10 monclient: _check_auth_tickets 2026-02-22T23:28:08.356 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.344+0000 7efef37fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T23:28:08.356 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.344+0000 7efef37fe640 1 -- 10.20.193.45:0/1099748923 <== mon.1 v1:10.20.193.73:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7efeec003040 con 0x7efefc0a5e00 2026-02-22T23:28:08.356 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.344+0000 7eff03140640 5 monclient: authenticate success, global_id 114229 2026-02-22T23:28:08.356 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.344+0000 7eff03140640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-22T23:28:08.356 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.344+0000 7efef37fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:28:08.356 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.344+0000 7efef37fe640 10 monclient: got monmap 1 from mon.noname-f (according to old e1) 2026-02-22T23:28:08.356 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.344+0000 7efef37fe640 10 monclient: dump: 2026-02-22T23:28:08.356 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:28:08.356 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:28:08.356 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:08.356 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:08.357 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:28:08.357 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:28:08.357 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:28:08.357 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:28:08.357 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:28:08.357 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:28:08.357 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:28:08.357 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:28:08.357 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:28:08.357 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:28:08.357 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:28:08.357 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:08.357 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.344+0000 7eff03140640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-22T23:28:08.357 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.344+0000 7efef37fe640 1 -- 10.20.193.45:0/1099748923 <== mon.1 v1:10.20.193.73:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7efeec0031e0 con 0x7efefc0a5e00 2026-02-22T23:28:08.358 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.344+0000 7efef37fe640 10 monclient: handle_config config(0 keys) 2026-02-22T23:28:08.358 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.344+0000 7efef37fe640 1 -- 10.20.193.45:0/1099748923 <== mon.1 v1:10.20.193.73:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7efeec004ce0 con 0x7efefc0a5e00 2026-02-22T23:28:08.358 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.344+0000 7eff03140640 10 monclient: get_monmap_and_config success 2026-02-22T23:28:08.358 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.344+0000 7efef37fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:28:08.358 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.344+0000 7eff03140640 4 set_mon_vals no callback set 2026-02-22T23:28:08.358 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.344+0000 7efef37fe640 10 monclient: got monmap 1 from mon.f (according to old e1) 2026-02-22T23:28:08.358 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.344+0000 7efef37fe640 10 monclient: dump: 2026-02-22T23:28:08.358 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:28:08.358 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:28:08.358 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:08.358 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:08.358 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:28:08.358 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:28:08.358 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:28:08.359 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:28:08.359 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:28:08.359 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:28:08.359 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:28:08.359 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:28:08.359 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:28:08.359 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:28:08.359 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:28:08.359 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:08.359 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.344+0000 7eff03140640 10 monclient: shutdown 2026-02-22T23:28:08.359 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.344+0000 7eff03140640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T23:28:08.359 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.344+0000 7eff03140640 1 -- 10.20.193.45:0/1099748923 >> v1:10.20.193.73:6789/0 conn(0x7efefc0a5e00 legacy=0x7efefc0a61e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:08.359 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.344+0000 7eff03140640 1 -- 10.20.193.45:0/1099748923 shutdown_connections 2026-02-22T23:28:08.359 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.344+0000 7eff03140640 1 -- 10.20.193.45:0/1099748923 >> 10.20.193.45:0/1099748923 conn(0x7efefc0abb50 msgr2=0x7efefc0a7f00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:28:08.360 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.344+0000 7eff03140640 1 -- 10.20.193.45:0/1099748923 shutdown_connections 2026-02-22T23:28:08.360 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.344+0000 7eff03140640 1 -- 10.20.193.45:0/1099748923 wait complete. 2026-02-22T23:28:08.360 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.345+0000 7eff03140640 10 monclient: build_initial_monmap 2026-02-22T23:28:08.360 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.345+0000 7eff03140640 10 monclient: monmap: 2026-02-22T23:28:08.360 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-22T23:28:08.360 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T23:28:08.360 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-22T23:28:08.360 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-22T23:28:08.360 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-22T23:28:08.360 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-22T23:28:08.360 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-22T23:28:08.360 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.noname-f 2026-02-22T23:28:08.360 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.noname-b 2026-02-22T23:28:08.360 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.noname-g 2026-02-22T23:28:08.361 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.noname-c 2026-02-22T23:28:08.361 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.noname-h 2026-02-22T23:28:08.361 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.noname-d 2026-02-22T23:28:08.361 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.noname-i 2026-02-22T23:28:08.361 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.noname-e 2026-02-22T23:28:08.361 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:08.361 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.345+0000 7eff03140640 1 Processor -- start 2026-02-22T23:28:08.361 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.345+0000 7eff03140640 1 -- start start 2026-02-22T23:28:08.361 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.345+0000 7eff03140640 10 monclient: init 2026-02-22T23:28:08.361 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.345+0000 7eff03140640 10 monclient: _reopen_session rank -1 2026-02-22T23:28:08.361 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.345+0000 7eff03140640 10 monclient: _add_conns ranks=[0,1,7,8,4,3,6,2,5] 2026-02-22T23:28:08.361 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.345+0000 7eff03140640 10 monclient(hunting): picked mon.noname-a con 0x7efefc0a5e00 addr v1:10.20.193.45:6789/0 2026-02-22T23:28:08.361 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.345+0000 7eff03140640 10 monclient(hunting): picked mon.noname-f con 0x7efefc0a68f0 addr v1:10.20.193.73:6789/0 2026-02-22T23:28:08.361 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.345+0000 7eff03140640 10 monclient(hunting): picked mon.noname-i con 0x7efefc0a6d00 addr v1:10.20.193.73:6792/0 2026-02-22T23:28:08.362 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.345+0000 7eff03140640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efefc138a20 con 0x7efefc0a5e00 2026-02-22T23:28:08.362 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.345+0000 7eff03140640 1 -- --> v1:10.20.193.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efefc138180 con 0x7efefc0a68f0 2026-02-22T23:28:08.362 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.345+0000 7eff03140640 1 -- --> v1:10.20.193.73:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efefc138740 con 0x7efefc0a6d00 2026-02-22T23:28:08.362 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.345+0000 7eff03140640 10 monclient(hunting): _renew_subs 2026-02-22T23:28:08.362 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.345+0000 7eff03140640 10 monclient(hunting): authenticate will time out at 819.962584s 2026-02-22T23:28:08.362 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.345+0000 7eff00eb5640 1 --1- >> v1:10.20.193.45:6789/0 conn(0x7efefc0a5e00 0x7efefc1d01a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.45:6789/0 says I am v1:10.20.193.45:38458/0 (socket says 10.20.193.45:38458) 2026-02-22T23:28:08.362 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.345+0000 7eff00eb5640 1 -- 10.20.193.45:0/64939530 learned_addr learned my addr 10.20.193.45:0/64939530 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-22T23:28:08.362 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.345+0000 7efef17fa640 1 -- 10.20.193.45:0/64939530 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1232201067 0 0) 0x7efefc0a35a0 con 0x7efefc0a5e00 2026-02-22T23:28:08.362 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.345+0000 7efef17fa640 10 monclient(hunting): _negotiate 2026-02-22T23:28:08.362 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.345+0000 7efef17fa640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:28:08.362 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.345+0000 7efef17fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:28:08.362 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.345+0000 7efef17fa640 10 monclient(hunting): my global_id is 4653 2026-02-22T23:28:08.362 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.345+0000 7efef17fa640 1 -- 10.20.193.45:0/64939530 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efecc003620 con 0x7efefc0a5e00 2026-02-22T23:28:08.363 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.345+0000 7efef17fa640 1 -- 10.20.193.45:0/64939530 <== mon.1 v1:10.20.193.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 600532092 0 0) 0x7efefc138180 con 0x7efefc0a68f0 2026-02-22T23:28:08.363 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.345+0000 7efef17fa640 10 monclient(hunting): _negotiate 2026-02-22T23:28:08.363 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.345+0000 7efef17fa640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:28:08.363 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.345+0000 7efef17fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:28:08.363 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.345+0000 7efef17fa640 10 monclient(hunting): my global_id is 114238 2026-02-22T23:28:08.363 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.345+0000 7efef17fa640 1 -- 10.20.193.45:0/64939530 --> v1:10.20.193.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efefc0a35a0 con 0x7efefc0a68f0 2026-02-22T23:28:08.363 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.345+0000 7efef17fa640 1 -- 10.20.193.45:0/64939530 <== mon.7 v1:10.20.193.73:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 221370679 0 0) 0x7efefc138740 con 0x7efefc0a6d00 2026-02-22T23:28:08.363 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.345+0000 7efef17fa640 10 monclient(hunting): _negotiate 2026-02-22T23:28:08.363 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.345+0000 7efef17fa640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:28:08.363 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.345+0000 7efef17fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:28:08.363 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.345+0000 7efef17fa640 10 monclient(hunting): my global_id is 4597 2026-02-22T23:28:08.363 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.345+0000 7efef17fa640 1 -- 10.20.193.45:0/64939530 --> v1:10.20.193.73:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efefc138180 con 0x7efefc0a6d00 2026-02-22T23:28:08.363 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.345+0000 7efef17fa640 1 -- 10.20.193.45:0/64939530 <== mon.0 v1:10.20.193.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2213533535 0 0) 0x7efecc003620 con 0x7efefc0a5e00 2026-02-22T23:28:08.363 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.345+0000 7efef17fa640 1 -- 10.20.193.45:0/64939530 --> v1:10.20.193.45:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7efefc138740 con 0x7efefc0a5e00 2026-02-22T23:28:08.363 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.345+0000 7efef17fa640 1 -- 10.20.193.45:0/64939530 <== mon.0 v1:10.20.193.45:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7efeec003000 con 0x7efefc0a5e00 2026-02-22T23:28:08.364 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.345+0000 7efef17fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-22T23:28:08.364 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.345+0000 7efef17fa640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T23:28:08.364 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.345+0000 7efef17fa640 10 monclient(hunting): dump: 2026-02-22T23:28:08.364 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:28:08.364 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:28:08.364 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:08.364 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:08.364 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:28:08.364 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:28:08.364 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:28:08.364 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:28:08.364 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:28:08.365 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:28:08.365 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:28:08.365 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:28:08.365 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:28:08.365 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:28:08.365 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:28:08.365 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:08.365 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.345+0000 7efef17fa640 10 monclient(hunting): _finish_auth 0 2026-02-22T23:28:08.366 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.346+0000 7efef17fa640 1 -- 10.20.193.45:0/64939530 <== mon.0 v1:10.20.193.45:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1279485829 0 0) 0x7efefc138740 con 0x7efefc0a5e00 2026-02-22T23:28:08.366 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.346+0000 7efef17fa640 1 -- 10.20.193.45:0/64939530 >> v1:10.20.193.73:6792/0 conn(0x7efefc0a6d00 legacy=0x7efefc1d8670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:08.366 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.346+0000 7efef17fa640 1 -- 10.20.193.45:0/64939530 >> v1:10.20.193.73:6789/0 conn(0x7efefc0a68f0 legacy=0x7efefc1d4f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:08.366 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.346+0000 7efef17fa640 10 monclient: _finish_hunting 0 2026-02-22T23:28:08.366 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.346+0000 7efef17fa640 1 monclient: found mon.a 2026-02-22T23:28:08.366 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.346+0000 7efef17fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T23:28:08.366 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.346+0000 7efef17fa640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-22T23:28:08.366 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.346+0000 7efef17fa640 1 -- 10.20.193.45:0/64939530 --> v1:10.20.193.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efefc138460 con 0x7efefc0a5e00 2026-02-22T23:28:08.366 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.346+0000 7efef17fa640 10 monclient: _finish_auth 0 2026-02-22T23:28:08.366 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.346+0000 7efef17fa640 10 monclient: _check_auth_tickets 2026-02-22T23:28:08.366 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.346+0000 7efef17fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T23:28:08.366 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.346+0000 7eff03140640 5 monclient: authenticate success, global_id 4653 2026-02-22T23:28:08.367 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.346+0000 7eff03140640 10 monclient: _renew_subs 2026-02-22T23:28:08.367 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.346+0000 7eff03140640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-22T23:28:08.367 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.346+0000 7eff03140640 1 -- 10.20.193.45:0/64939530 --> v1:10.20.193.45:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7efefc1368f0 con 0x7efefc0a5e00 2026-02-22T23:28:08.367 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.346+0000 7eff03140640 10 monclient: _renew_subs 2026-02-22T23:28:08.367 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.346+0000 7eff03140640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-22T23:28:08.367 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.346+0000 7eff03140640 1 -- 10.20.193.45:0/64939530 --> v1:10.20.193.45:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7efefc1d0a90 con 0x7efefc0a5e00 2026-02-22T23:28:08.367 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.346+0000 7efef17fa640 1 -- 10.20.193.45:0/64939530 <== mon.0 v1:10.20.193.45:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7efeec004c10 con 0x7efefc0a5e00 2026-02-22T23:28:08.367 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.346+0000 7efef17fa640 10 monclient: handle_config config(0 keys) 2026-02-22T23:28:08.367 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.346+0000 7efef17fa640 1 -- 10.20.193.45:0/64939530 <== mon.0 v1:10.20.193.45:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7efeec005180 con 0x7efefc0a5e00 2026-02-22T23:28:08.367 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.346+0000 7efef17fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:28:08.367 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.346+0000 7efef2ffd640 4 set_mon_vals no callback set 2026-02-22T23:28:08.367 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.346+0000 7efef17fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T23:28:08.367 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.346+0000 7efef17fa640 10 monclient: dump: 2026-02-22T23:28:08.367 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:28:08.368 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:28:08.368 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:08.368 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:08.368 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:28:08.368 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:28:08.368 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:28:08.368 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:28:08.368 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:28:08.368 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:28:08.368 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:28:08.368 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:28:08.368 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:28:08.368 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:28:08.368 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:28:08.369 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:08.369 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.346+0000 7eff03140640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T23:28:08.369 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.346+0000 7eff03140640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T23:28:08.369 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.346+0000 7eff03140640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-22T23:28:08.369 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.346+0000 7eff03140640 1 -- 10.20.193.45:0/64939530 --> v1:10.20.193.45:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efefc142720 con 0x7efefc0a5e00 2026-02-22T23:28:08.369 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.346+0000 7efef17fa640 1 -- 10.20.193.45:0/64939530 <== mon.0 v1:10.20.193.45:6789/0 7 ==== mgrmap(e 5) ==== 50225+0+0 (unknown 2330357642 0 0) 0x7efeec0053a0 con 0x7efefc0a5e00 2026-02-22T23:28:08.369 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.346+0000 7efef17fa640 1 -- 10.20.193.45:0/64939530 <== mon.0 v1:10.20.193.45:6789/0 8 ==== osd_map(25..25 src has 1..25) ==== 3502+0+0 (unknown 129690100 0 0) 0x7efeec04da70 con 0x7efefc0a5e00 2026-02-22T23:28:08.369 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.347+0000 7efef3fff640 10 monclient: get_auth_request con 0x7efecc03f9e0 auth_method 0 2026-02-22T23:28:08.369 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.349+0000 7efef17fa640 1 -- 10.20.193.45:0/64939530 <== mon.0 v1:10.20.193.45:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (unknown 1092875540 0 2568732696) 0x7efefc142720 con 0x7efefc0a5e00 2026-02-22T23:28:08.369 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.349+0000 7efef17fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T23:28:08.369 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.349+0000 7efef17fa640 10 monclient: _finish_command 1 = system:0 2026-02-22T23:28:08.433 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.430+0000 7eff03140640 1 -- 10.20.193.45:0/64939530 --> v1:10.20.193.73:6800/2222410180 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7efefc0a2fe0 con 0x7efecc03f9e0 2026-02-22T23:28:08.433 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.430+0000 7efef17fa640 1 -- 10.20.193.45:0/64939530 <== mgr.4111 v1:10.20.193.73:6800/2222410180 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (unknown 489605429 0 0) 0x7efefc0a2fe0 con 0x7efecc03f9e0 2026-02-22T23:28:08.433 INFO:teuthology.orchestra.run.trial045.stderr:instructed osd(s) 1 to deep-scrub 2026-02-22T23:28:08.434 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.431+0000 7eff03140640 1 -- 10.20.193.45:0/64939530 >> v1:10.20.193.73:6800/2222410180 conn(0x7efecc03f9e0 legacy=0x7efecc041ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:08.434 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.431+0000 7eff03140640 10 monclient: shutdown 2026-02-22T23:28:08.434 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.431+0000 7eff03140640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T23:28:08.434 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.431+0000 7eff03140640 1 -- 10.20.193.45:0/64939530 >> v1:10.20.193.45:6789/0 conn(0x7efefc0a5e00 legacy=0x7efefc1d01a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:08.434 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.431+0000 7eff03140640 1 -- 10.20.193.45:0/64939530 shutdown_connections 2026-02-22T23:28:08.434 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.431+0000 7eff03140640 1 -- 10.20.193.45:0/64939530 >> 10.20.193.45:0/64939530 conn(0x7efefc0abb50 msgr2=0x7efefc0a4010 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:28:08.434 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.431+0000 7eff03140640 1 -- 10.20.193.45:0/64939530 shutdown_connections 2026-02-22T23:28:08.435 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.431+0000 7eff03140640 1 -- 10.20.193.45:0/64939530 wait complete. 2026-02-22T23:28:08.441 INFO:tasks.ceph:Scrubbing osd.2 2026-02-22T23:28:08.441 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2026-02-22T23:28:08.513 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.511+0000 7f08e791c640 10 monclient: get_monmap_and_config 2026-02-22T23:28:08.513 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.511+0000 7f08e791c640 10 monclient: build_initial_monmap 2026-02-22T23:28:08.513 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.511+0000 7f08e791c640 10 monclient: monmap: 2026-02-22T23:28:08.513 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-22T23:28:08.513 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:28:08.513 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:28:08.512859+0000 2026-02-22T23:28:08.513 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:28:08.512859+0000 2026-02-22T23:28:08.513 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-22T23:28:08.513 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:28:08.514 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-22T23:28:08.514 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.noname-f 2026-02-22T23:28:08.514 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.noname-b 2026-02-22T23:28:08.514 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.noname-g 2026-02-22T23:28:08.514 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.noname-c 2026-02-22T23:28:08.514 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.noname-h 2026-02-22T23:28:08.514 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.noname-d 2026-02-22T23:28:08.514 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.noname-i 2026-02-22T23:28:08.514 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.noname-e 2026-02-22T23:28:08.514 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:08.520 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.512+0000 7f08e791c640 1 Processor -- start 2026-02-22T23:28:08.520 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.512+0000 7f08e791c640 1 -- start start 2026-02-22T23:28:08.520 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.512+0000 7f08e791c640 10 monclient: init 2026-02-22T23:28:08.520 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.512+0000 7f08e791c640 10 monclient: _reopen_session rank -1 2026-02-22T23:28:08.520 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.512+0000 7f08e791c640 10 monclient: _add_conns ranks=[7,0,6,1,8,2,5,3,4] 2026-02-22T23:28:08.520 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.512+0000 7f08e791c640 10 monclient(hunting): picked mon.noname-i con 0x7f08e0138ae0 addr v1:10.20.193.73:6792/0 2026-02-22T23:28:08.520 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.512+0000 7f08e791c640 10 monclient(hunting): picked mon.noname-a con 0x7f08e01395d0 addr v1:10.20.193.45:6789/0 2026-02-22T23:28:08.520 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.512+0000 7f08e791c640 10 monclient(hunting): picked mon.noname-d con 0x7f08e00a3e20 addr v1:10.20.193.45:6792/0 2026-02-22T23:28:08.521 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.512+0000 7f08e791c640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f08e00745c0 con 0x7f08e01395d0 2026-02-22T23:28:08.521 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.512+0000 7f08e791c640 1 -- --> v1:10.20.193.45:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f08e00a2b90 con 0x7f08e00a3e20 2026-02-22T23:28:08.521 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.512+0000 7f08e791c640 1 -- --> v1:10.20.193.73:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f08e00a3150 con 0x7f08e0138ae0 2026-02-22T23:28:08.521 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.512+0000 7f08e791c640 10 monclient(hunting): _renew_subs 2026-02-22T23:28:08.521 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.512+0000 7f08e791c640 10 monclient(hunting): authenticate will time out at 820.129598s 2026-02-22T23:28:08.521 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.512+0000 7f08e4e90640 1 --1- >> v1:10.20.193.45:6789/0 conn(0x7f08e01395d0 0x7f08e013df30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.45:6789/0 says I am v1:10.20.193.45:38466/0 (socket says 10.20.193.45:38466) 2026-02-22T23:28:08.521 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.512+0000 7f08e4e90640 1 -- 10.20.193.45:0/650314802 learned_addr learned my addr 10.20.193.45:0/650314802 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-22T23:28:08.521 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.512+0000 7f08cffff640 1 -- 10.20.193.45:0/650314802 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2161587995 0 0) 0x7f08e00745c0 con 0x7f08e01395d0 2026-02-22T23:28:08.521 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.512+0000 7f08cffff640 10 monclient(hunting): _negotiate 2026-02-22T23:28:08.521 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.512+0000 7f08cffff640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:28:08.521 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.512+0000 7f08cffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:28:08.521 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.512+0000 7f08cffff640 10 monclient(hunting): my global_id is 4662 2026-02-22T23:28:08.521 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.512+0000 7f08cffff640 1 -- 10.20.193.45:0/650314802 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f08c8003620 con 0x7f08e01395d0 2026-02-22T23:28:08.521 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.512+0000 7f08cffff640 1 -- 10.20.193.45:0/650314802 <== mon.6 v1:10.20.193.45:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 223315103 0 0) 0x7f08e00a2b90 con 0x7f08e00a3e20 2026-02-22T23:28:08.522 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.512+0000 7f08cffff640 10 monclient(hunting): _negotiate 2026-02-22T23:28:08.522 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.512+0000 7f08cffff640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:28:08.522 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.512+0000 7f08cffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:28:08.522 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.512+0000 7f08cffff640 10 monclient(hunting): my global_id is 114243 2026-02-22T23:28:08.522 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.512+0000 7f08cffff640 1 -- 10.20.193.45:0/650314802 --> v1:10.20.193.45:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f08e00745c0 con 0x7f08e00a3e20 2026-02-22T23:28:08.522 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.512+0000 7f08cffff640 1 -- 10.20.193.45:0/650314802 <== mon.7 v1:10.20.193.73:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2632627462 0 0) 0x7f08e00a3150 con 0x7f08e0138ae0 2026-02-22T23:28:08.522 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.512+0000 7f08cffff640 10 monclient(hunting): _negotiate 2026-02-22T23:28:08.522 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.512+0000 7f08cffff640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:28:08.522 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.512+0000 7f08cffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:28:08.522 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.512+0000 7f08cffff640 10 monclient(hunting): my global_id is 4606 2026-02-22T23:28:08.523 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.512+0000 7f08cffff640 1 -- 10.20.193.45:0/650314802 --> v1:10.20.193.73:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f08e00a2b90 con 0x7f08e0138ae0 2026-02-22T23:28:08.523 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.513+0000 7f08cffff640 1 -- 10.20.193.45:0/650314802 <== mon.0 v1:10.20.193.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1270760589 0 0) 0x7f08c8003620 con 0x7f08e01395d0 2026-02-22T23:28:08.523 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.513+0000 7f08cffff640 1 -- 10.20.193.45:0/650314802 >> v1:10.20.193.73:6792/0 conn(0x7f08e0138ae0 legacy=0x7f08e0138ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:08.523 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.513+0000 7f08cffff640 1 -- 10.20.193.45:0/650314802 >> v1:10.20.193.45:6792/0 conn(0x7f08e00a3e20 legacy=0x7f08e0141660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:08.523 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.513+0000 7f08cffff640 10 monclient: _finish_hunting 0 2026-02-22T23:28:08.523 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.513+0000 7f08cffff640 1 monclient: found mon.noname-a 2026-02-22T23:28:08.523 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.513+0000 7f08cffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T23:28:08.523 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.513+0000 7f08cffff640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.45:6789/0 2026-02-22T23:28:08.523 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.513+0000 7f08cffff640 1 -- 10.20.193.45:0/650314802 --> v1:10.20.193.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08e00a7000 con 0x7f08e01395d0 2026-02-22T23:28:08.523 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.513+0000 7f08cffff640 10 monclient: _finish_auth 0 2026-02-22T23:28:08.523 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.513+0000 7f08cffff640 10 monclient: _check_auth_tickets 2026-02-22T23:28:08.523 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.513+0000 7f08cffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T23:28:08.523 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.513+0000 7f08cffff640 1 -- 10.20.193.45:0/650314802 <== mon.0 v1:10.20.193.45:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f08d4003040 con 0x7f08e01395d0 2026-02-22T23:28:08.523 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.513+0000 7f08cffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:28:08.523 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.513+0000 7f08cffff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T23:28:08.523 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.513+0000 7f08cffff640 10 monclient: dump: 2026-02-22T23:28:08.524 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:28:08.524 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:28:08.524 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:08.524 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:08.524 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:28:08.524 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:28:08.524 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:28:08.524 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:28:08.524 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:28:08.524 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:28:08.524 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:28:08.524 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:28:08.524 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:28:08.524 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:28:08.524 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:28:08.524 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:08.524 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.513+0000 7f08e791c640 5 monclient: authenticate success, global_id 4662 2026-02-22T23:28:08.524 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.513+0000 7f08e791c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-22T23:28:08.525 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.513+0000 7f08cffff640 1 -- 10.20.193.45:0/650314802 <== mon.0 v1:10.20.193.45:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f08d4003260 con 0x7f08e01395d0 2026-02-22T23:28:08.525 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.513+0000 7f08cffff640 10 monclient: handle_config config(0 keys) 2026-02-22T23:28:08.525 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.513+0000 7f08cffff640 1 -- 10.20.193.45:0/650314802 <== mon.0 v1:10.20.193.45:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f08d4004ce0 con 0x7f08e01395d0 2026-02-22T23:28:08.525 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.513+0000 7f08e791c640 10 monclient: get_monmap_and_config success 2026-02-22T23:28:08.525 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.513+0000 7f08e791c640 4 set_mon_vals no callback set 2026-02-22T23:28:08.525 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.513+0000 7f08cffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:28:08.525 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.513+0000 7f08cffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T23:28:08.525 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.513+0000 7f08cffff640 10 monclient: dump: 2026-02-22T23:28:08.525 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:28:08.525 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:28:08.525 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:08.525 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:08.525 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:28:08.525 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:28:08.525 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:28:08.525 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:28:08.525 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:28:08.526 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:28:08.526 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:28:08.526 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:28:08.526 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:28:08.526 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:28:08.526 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:28:08.526 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:08.526 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.513+0000 7f08e791c640 10 monclient: shutdown 2026-02-22T23:28:08.526 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.513+0000 7f08e791c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T23:28:08.526 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.513+0000 7f08e791c640 1 -- 10.20.193.45:0/650314802 >> v1:10.20.193.45:6789/0 conn(0x7f08e01395d0 legacy=0x7f08e013df30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:08.526 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.513+0000 7f08e791c640 1 -- 10.20.193.45:0/650314802 shutdown_connections 2026-02-22T23:28:08.526 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.513+0000 7f08e791c640 1 -- 10.20.193.45:0/650314802 >> 10.20.193.45:0/650314802 conn(0x7f08e00a8000 msgr2=0x7f08e00a8410 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:28:08.526 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.513+0000 7f08e791c640 1 -- 10.20.193.45:0/650314802 shutdown_connections 2026-02-22T23:28:08.526 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.513+0000 7f08e791c640 1 -- 10.20.193.45:0/650314802 wait complete. 2026-02-22T23:28:08.526 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.513+0000 7f08e791c640 10 monclient: build_initial_monmap 2026-02-22T23:28:08.526 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.513+0000 7f08e791c640 10 monclient: monmap: 2026-02-22T23:28:08.526 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-22T23:28:08.527 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T23:28:08.527 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-22T23:28:08.527 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-22T23:28:08.527 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-22T23:28:08.527 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-22T23:28:08.527 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-22T23:28:08.527 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.noname-f 2026-02-22T23:28:08.527 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.noname-b 2026-02-22T23:28:08.527 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.noname-g 2026-02-22T23:28:08.527 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.noname-c 2026-02-22T23:28:08.527 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.noname-h 2026-02-22T23:28:08.527 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.noname-d 2026-02-22T23:28:08.527 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.noname-i 2026-02-22T23:28:08.527 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.noname-e 2026-02-22T23:28:08.527 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:08.527 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.513+0000 7f08e791c640 1 Processor -- start 2026-02-22T23:28:08.527 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.513+0000 7f08e791c640 1 -- start start 2026-02-22T23:28:08.527 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.513+0000 7f08e791c640 10 monclient: init 2026-02-22T23:28:08.528 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.514+0000 7f08e791c640 10 monclient: _reopen_session rank -1 2026-02-22T23:28:08.528 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.514+0000 7f08e791c640 10 monclient: _add_conns ranks=[5,7,2,6,3,4,8,0,1] 2026-02-22T23:28:08.528 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.514+0000 7f08e791c640 10 monclient(hunting): picked mon.noname-h con 0x7f08e00a3e20 addr v1:10.20.193.73:6791/0 2026-02-22T23:28:08.528 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.514+0000 7f08e791c640 10 monclient(hunting): picked mon.noname-i con 0x7f08e0138ae0 addr v1:10.20.193.73:6792/0 2026-02-22T23:28:08.528 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.514+0000 7f08e791c640 10 monclient(hunting): picked mon.noname-b con 0x7f08e01395d0 addr v1:10.20.193.45:6790/0 2026-02-22T23:28:08.528 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.514+0000 7f08e791c640 1 -- --> v1:10.20.193.45:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f08e013e450 con 0x7f08e01395d0 2026-02-22T23:28:08.528 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.514+0000 7f08e791c640 1 -- --> v1:10.20.193.73:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f08e0140f30 con 0x7f08e00a3e20 2026-02-22T23:28:08.528 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.514+0000 7f08e791c640 1 -- --> v1:10.20.193.73:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f08e00aa740 con 0x7f08e0138ae0 2026-02-22T23:28:08.528 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.514+0000 7f08e791c640 10 monclient(hunting): _renew_subs 2026-02-22T23:28:08.528 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.514+0000 7f08e791c640 10 monclient(hunting): authenticate will time out at 820.131208s 2026-02-22T23:28:08.528 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.514+0000 7f08e5e92640 1 --1- >> v1:10.20.193.45:6790/0 conn(0x7f08e01395d0 0x7f08e01d7df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.45:6790/0 says I am v1:10.20.193.45:60218/0 (socket says 10.20.193.45:60218) 2026-02-22T23:28:08.528 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.514+0000 7f08e5e92640 1 -- 10.20.193.45:0/3101497568 learned_addr learned my addr 10.20.193.45:0/3101497568 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-22T23:28:08.528 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.514+0000 7f08cdffb640 1 -- 10.20.193.45:0/3101497568 <== mon.2 v1:10.20.193.45:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1154701160 0 0) 0x7f08e013e450 con 0x7f08e01395d0 2026-02-22T23:28:08.528 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.514+0000 7f08cdffb640 10 monclient(hunting): _negotiate 2026-02-22T23:28:08.528 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.514+0000 7f08cdffb640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:28:08.528 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.514+0000 7f08cdffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:28:08.528 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.514+0000 7f08cdffb640 10 monclient(hunting): my global_id is 4772 2026-02-22T23:28:08.529 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.514+0000 7f08cdffb640 1 -- 10.20.193.45:0/3101497568 --> v1:10.20.193.45:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f08b0003620 con 0x7f08e01395d0 2026-02-22T23:28:08.529 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.514+0000 7f08cdffb640 1 -- 10.20.193.45:0/3101497568 <== mon.7 v1:10.20.193.73:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1929550077 0 0) 0x7f08e00aa740 con 0x7f08e0138ae0 2026-02-22T23:28:08.529 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.514+0000 7f08cdffb640 10 monclient(hunting): _negotiate 2026-02-22T23:28:08.529 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.514+0000 7f08cdffb640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:28:08.529 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.514+0000 7f08cdffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:28:08.529 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.514+0000 7f08cdffb640 10 monclient(hunting): my global_id is 4615 2026-02-22T23:28:08.529 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.514+0000 7f08cdffb640 1 -- 10.20.193.45:0/3101497568 --> v1:10.20.193.73:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f08e013e450 con 0x7f08e0138ae0 2026-02-22T23:28:08.529 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.514+0000 7f08cdffb640 1 -- 10.20.193.45:0/3101497568 <== mon.2 v1:10.20.193.45:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1273131400 0 0) 0x7f08b0003620 con 0x7f08e01395d0 2026-02-22T23:28:08.529 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.514+0000 7f08cdffb640 1 -- 10.20.193.45:0/3101497568 --> v1:10.20.193.45:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f08e00aa740 con 0x7f08e01395d0 2026-02-22T23:28:08.529 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.514+0000 7f08cdffb640 1 -- 10.20.193.45:0/3101497568 <== mon.2 v1:10.20.193.45:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f08dc003660 con 0x7f08e01395d0 2026-02-22T23:28:08.529 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.514+0000 7f08cdffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-22T23:28:08.529 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.514+0000 7f08cdffb640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-22T23:28:08.529 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.514+0000 7f08cdffb640 10 monclient(hunting): dump: 2026-02-22T23:28:08.529 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:28:08.529 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:28:08.529 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:08.529 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:08.529 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:28:08.530 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:28:08.530 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:28:08.530 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:28:08.530 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:28:08.530 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:28:08.530 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:28:08.530 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:28:08.530 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:28:08.530 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:28:08.530 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:28:08.530 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:08.530 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.514+0000 7f08cdffb640 10 monclient(hunting): _finish_auth 0 2026-02-22T23:28:08.530 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.514+0000 7f08cdffb640 1 -- 10.20.193.45:0/3101497568 <== mon.5 v1:10.20.193.73:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2088733548 0 0) 0x7f08e0140f30 con 0x7f08e00a3e20 2026-02-22T23:28:08.530 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.514+0000 7f08cdffb640 10 monclient(hunting): _negotiate 2026-02-22T23:28:08.530 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.514+0000 7f08cdffb640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:28:08.530 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.514+0000 7f08cdffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:28:08.530 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.514+0000 7f08cdffb640 10 monclient(hunting): my global_id is 114206 2026-02-22T23:28:08.530 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.514+0000 7f08cdffb640 1 -- 10.20.193.45:0/3101497568 --> v1:10.20.193.73:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f08b0003620 con 0x7f08e00a3e20 2026-02-22T23:28:08.531 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.514+0000 7f08cdffb640 1 -- 10.20.193.45:0/3101497568 <== mon.7 v1:10.20.193.73:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2579685395 0 0) 0x7f08e013e450 con 0x7f08e0138ae0 2026-02-22T23:28:08.531 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.514+0000 7f08cdffb640 1 -- 10.20.193.45:0/3101497568 --> v1:10.20.193.73:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f08e0140f30 con 0x7f08e0138ae0 2026-02-22T23:28:08.531 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.514+0000 7f08cdffb640 1 -- 10.20.193.45:0/3101497568 <== mon.7 v1:10.20.193.73:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f08d4003410 con 0x7f08e0138ae0 2026-02-22T23:28:08.531 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.514+0000 7f08cdffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-22T23:28:08.531 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.514+0000 7f08cdffb640 10 monclient(hunting): got monmap 1 from mon.i (according to old e1) 2026-02-22T23:28:08.531 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.514+0000 7f08cdffb640 10 monclient(hunting): dump: 2026-02-22T23:28:08.531 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:28:08.531 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:28:08.531 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:08.531 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:08.531 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:28:08.531 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:28:08.531 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:28:08.531 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:28:08.531 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:28:08.531 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:28:08.531 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:28:08.531 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:28:08.532 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:28:08.532 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:28:08.532 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:28:08.532 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:08.532 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.514+0000 7f08cdffb640 1 -- 10.20.193.45:0/3101497568 <== mon.2 v1:10.20.193.45:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3349579395 0 0) 0x7f08e00aa740 con 0x7f08e01395d0 2026-02-22T23:28:08.532 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.514+0000 7f08cdffb640 1 -- 10.20.193.45:0/3101497568 >> v1:10.20.193.73:6792/0 conn(0x7f08e0138ae0 legacy=0x7f08e01d46c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:08.532 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.514+0000 7f08cdffb640 1 -- 10.20.193.45:0/3101497568 >> v1:10.20.193.73:6791/0 conn(0x7f08e00a3e20 legacy=0x7f08e0142460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:08.532 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.514+0000 7f08cdffb640 10 monclient: _finish_hunting 0 2026-02-22T23:28:08.532 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.514+0000 7f08cdffb640 1 monclient: found mon.b 2026-02-22T23:28:08.532 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.514+0000 7f08cdffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T23:28:08.532 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.514+0000 7f08cdffb640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.45:6790/0 2026-02-22T23:28:08.532 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.514+0000 7f08cdffb640 1 -- 10.20.193.45:0/3101497568 --> v1:10.20.193.45:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08e00a6700 con 0x7f08e01395d0 2026-02-22T23:28:08.532 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.514+0000 7f08cdffb640 10 monclient: _finish_auth 0 2026-02-22T23:28:08.532 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.514+0000 7f08cdffb640 10 monclient: _check_auth_tickets 2026-02-22T23:28:08.532 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.514+0000 7f08cdffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T23:28:08.532 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.514+0000 7f08e791c640 5 monclient: authenticate success, global_id 4772 2026-02-22T23:28:08.532 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.514+0000 7f08e791c640 10 monclient: _renew_subs 2026-02-22T23:28:08.533 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.514+0000 7f08e791c640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.45:6790/0 2026-02-22T23:28:08.533 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.514+0000 7f08e791c640 1 -- 10.20.193.45:0/3101497568 --> v1:10.20.193.45:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f08e00aac90 con 0x7f08e01395d0 2026-02-22T23:28:08.533 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.514+0000 7f08e791c640 10 monclient: _renew_subs 2026-02-22T23:28:08.533 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.514+0000 7f08e791c640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.45:6790/0 2026-02-22T23:28:08.533 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.514+0000 7f08e791c640 1 -- 10.20.193.45:0/3101497568 --> v1:10.20.193.45:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f08e013ec40 con 0x7f08e01395d0 2026-02-22T23:28:08.533 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.514+0000 7f08cdffb640 1 -- 10.20.193.45:0/3101497568 <== mon.2 v1:10.20.193.45:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f08dc003880 con 0x7f08e01395d0 2026-02-22T23:28:08.533 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.514+0000 7f08cdffb640 10 monclient: handle_config config(0 keys) 2026-02-22T23:28:08.533 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.514+0000 7f08cdffb640 1 -- 10.20.193.45:0/3101497568 <== mon.2 v1:10.20.193.45:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f08dc004080 con 0x7f08e01395d0 2026-02-22T23:28:08.533 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.514+0000 7f08cdffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:28:08.533 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.514+0000 7f08cdffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-22T23:28:08.533 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.514+0000 7f08cdffb640 10 monclient: dump: 2026-02-22T23:28:08.534 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:28:08.534 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:28:08.534 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:08.534 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:08.534 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:28:08.534 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:28:08.534 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:28:08.534 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:28:08.534 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:28:08.535 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:28:08.535 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:28:08.535 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:28:08.535 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:28:08.535 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:28:08.535 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:28:08.535 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:08.535 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.514+0000 7f08cf7fe640 4 set_mon_vals no callback set 2026-02-22T23:28:08.535 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.515+0000 7f08e791c640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.45:6790/0 2026-02-22T23:28:08.535 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.515+0000 7f08e791c640 1 -- 10.20.193.45:0/3101497568 --> v1:10.20.193.45:6790/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f08e00008d0 con 0x7f08e01395d0 2026-02-22T23:28:08.536 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.515+0000 7f08cdffb640 1 -- 10.20.193.45:0/3101497568 <== mon.2 v1:10.20.193.45:6790/0 7 ==== mgrmap(e 5) ==== 50225+0+0 (unknown 2330357642 0 0) 0x7f08dc004220 con 0x7f08e01395d0 2026-02-22T23:28:08.536 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.515+0000 7f08cdffb640 1 -- 10.20.193.45:0/3101497568 <== mon.2 v1:10.20.193.45:6790/0 8 ==== osd_map(25..25 src has 1..25) ==== 3502+0+0 (unknown 129690100 0 0) 0x7f08dc04de40 con 0x7f08e01395d0 2026-02-22T23:28:08.536 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.515+0000 7f08cdffb640 1 -- 10.20.193.45:0/3101497568 --> v1:10.20.193.45:6808/2128209266 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f08b004a7b0 con 0x7f08b0046b40 2026-02-22T23:28:08.536 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.515+0000 7f08cdffb640 1 -- 10.20.193.45:0/3101497568 <== mon.2 v1:10.20.193.45:6790/0 9 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (unknown 2663167439 0 0) 0x7f08dc04e280 con 0x7f08e01395d0 2026-02-22T23:28:08.536 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.515+0000 7f08cdffb640 10 monclient: handle_get_version_reply finishing 1 version 25 2026-02-22T23:28:08.536 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.515+0000 7f08e5691640 10 monclient: get_auth_request con 0x7f08b003ff90 auth_method 0 2026-02-22T23:28:08.536 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.515+0000 7f08e4e90640 10 monclient: get_auth_request con 0x7f08b0046b40 auth_method 0 2026-02-22T23:28:08.536 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.516+0000 7f08cdffb640 1 -- 10.20.193.45:0/3101497568 <== osd.2 v1:10.20.193.45:6808/2128209266 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (unknown 0 0 3365489958) 0x7f08b004a7b0 con 0x7f08b0046b40 2026-02-22T23:28:08.537 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.521+0000 7f08e791c640 1 -- 10.20.193.45:0/3101497568 --> v1:10.20.193.45:6808/2128209266 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f08e0142d50 con 0x7f08b0046b40 2026-02-22T23:28:08.537 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.522+0000 7f08cdffb640 1 -- 10.20.193.45:0/3101497568 <== osd.2 v1:10.20.193.45:6808/2128209266 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (unknown 0 0 119112422) 0x7f08e0142d50 con 0x7f08b0046b40 2026-02-22T23:28:08.538 INFO:teuthology.orchestra.run.trial045.stdout:{ 2026-02-22T23:28:08.538 INFO:teuthology.orchestra.run.trial045.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-22T23:28:08.538 INFO:teuthology.orchestra.run.trial045.stdout:} 2026-02-22T23:28:08.540 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.522+0000 7f08e791c640 1 -- 10.20.193.45:0/3101497568 >> v1:10.20.193.45:6808/2128209266 conn(0x7f08b0046b40 legacy=0x7f08b0048f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:08.540 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.522+0000 7f08e791c640 1 -- 10.20.193.45:0/3101497568 >> v1:10.20.193.73:6800/2222410180 conn(0x7f08b003ff90 legacy=0x7f08b0042450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:08.540 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.522+0000 7f08e791c640 10 monclient: shutdown 2026-02-22T23:28:08.540 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.522+0000 7f08e791c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T23:28:08.540 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.522+0000 7f08e791c640 1 -- 10.20.193.45:0/3101497568 >> v1:10.20.193.45:6790/0 conn(0x7f08e01395d0 legacy=0x7f08e01d7df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:08.540 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.522+0000 7f08e5e92640 1 -- 10.20.193.45:0/3101497568 reap_dead start 2026-02-22T23:28:08.540 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.522+0000 7f08e791c640 1 -- 10.20.193.45:0/3101497568 shutdown_connections 2026-02-22T23:28:08.541 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.522+0000 7f08e791c640 1 -- 10.20.193.45:0/3101497568 >> 10.20.193.45:0/3101497568 conn(0x7f08e00a8000 msgr2=0x7f08e00a4290 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:28:08.541 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.522+0000 7f08e791c640 1 -- 10.20.193.45:0/3101497568 shutdown_connections 2026-02-22T23:28:08.541 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.522+0000 7f08e791c640 1 -- 10.20.193.45:0/3101497568 wait complete. 2026-02-22T23:28:08.541 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2026-02-22T23:28:08.608 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.606+0000 7f36346b0640 10 monclient: get_monmap_and_config 2026-02-22T23:28:08.608 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.606+0000 7f36346b0640 10 monclient: build_initial_monmap 2026-02-22T23:28:08.608 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.606+0000 7f36346b0640 10 monclient: monmap: 2026-02-22T23:28:08.608 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-22T23:28:08.608 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:28:08.608 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:28:08.607618+0000 2026-02-22T23:28:08.608 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:28:08.607618+0000 2026-02-22T23:28:08.608 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-22T23:28:08.609 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:28:08.609 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-22T23:28:08.609 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.noname-f 2026-02-22T23:28:08.609 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.noname-b 2026-02-22T23:28:08.609 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.noname-g 2026-02-22T23:28:08.609 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.noname-c 2026-02-22T23:28:08.609 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.noname-h 2026-02-22T23:28:08.609 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.noname-d 2026-02-22T23:28:08.609 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.noname-i 2026-02-22T23:28:08.609 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.noname-e 2026-02-22T23:28:08.609 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:08.609 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.606+0000 7f36346b0640 1 Processor -- start 2026-02-22T23:28:08.609 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.606+0000 7f36346b0640 1 -- start start 2026-02-22T23:28:08.609 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.606+0000 7f36346b0640 10 monclient: init 2026-02-22T23:28:08.614 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.607+0000 7f36346b0640 10 monclient: _reopen_session rank -1 2026-02-22T23:28:08.615 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.607+0000 7f36346b0640 10 monclient: _add_conns ranks=[0,1,4,3,5,8,7,2,6] 2026-02-22T23:28:08.615 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.607+0000 7f36346b0640 10 monclient(hunting): picked mon.noname-a con 0x7f362c0a4610 addr v1:10.20.193.45:6789/0 2026-02-22T23:28:08.615 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.607+0000 7f36346b0640 10 monclient(hunting): picked mon.noname-f con 0x7f362c0a5100 addr v1:10.20.193.73:6789/0 2026-02-22T23:28:08.615 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.607+0000 7f36346b0640 10 monclient(hunting): picked mon.noname-c con 0x7f362c0a3f10 addr v1:10.20.193.45:6791/0 2026-02-22T23:28:08.615 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.607+0000 7f36346b0640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f362c06f720 con 0x7f362c0a4610 2026-02-22T23:28:08.615 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.607+0000 7f36346b0640 1 -- --> v1:10.20.193.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f362c0a7250 con 0x7f362c0a5100 2026-02-22T23:28:08.615 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.607+0000 7f36346b0640 1 -- --> v1:10.20.193.45:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f362c0a2c90 con 0x7f362c0a3f10 2026-02-22T23:28:08.615 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.607+0000 7f36346b0640 10 monclient(hunting): _renew_subs 2026-02-22T23:28:08.615 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.607+0000 7f36346b0640 10 monclient(hunting): authenticate will time out at 820.224247s 2026-02-22T23:28:08.615 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.607+0000 7f3632425640 1 --1- >> v1:10.20.193.45:6789/0 conn(0x7f362c0a4610 0x7f362c0a49f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.45:6789/0 says I am v1:10.20.193.45:38480/0 (socket says 10.20.193.45:38480) 2026-02-22T23:28:08.615 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.607+0000 7f3632425640 1 -- 10.20.193.45:0/2484297764 learned_addr learned my addr 10.20.193.45:0/2484297764 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-22T23:28:08.615 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.607+0000 7f3631423640 1 -- 10.20.193.45:0/2484297764 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2749882860 0 0) 0x7f362c06f720 con 0x7f362c0a4610 2026-02-22T23:28:08.615 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.607+0000 7f3631423640 10 monclient(hunting): _negotiate 2026-02-22T23:28:08.615 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.607+0000 7f3631423640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:28:08.615 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.607+0000 7f3631423640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:28:08.616 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.607+0000 7f3631423640 10 monclient(hunting): my global_id is 4671 2026-02-22T23:28:08.616 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.607+0000 7f3631423640 1 -- 10.20.193.45:0/2484297764 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3614003620 con 0x7f362c0a4610 2026-02-22T23:28:08.616 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.607+0000 7f3631423640 1 -- 10.20.193.45:0/2484297764 <== mon.4 v1:10.20.193.45:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 116597874 0 0) 0x7f362c0a2c90 con 0x7f362c0a3f10 2026-02-22T23:28:08.616 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.607+0000 7f3631423640 10 monclient(hunting): _negotiate 2026-02-22T23:28:08.616 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.607+0000 7f3631423640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:28:08.616 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.607+0000 7f3631423640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:28:08.616 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.607+0000 7f3631423640 10 monclient(hunting): my global_id is 114259 2026-02-22T23:28:08.616 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.607+0000 7f3631423640 1 -- 10.20.193.45:0/2484297764 --> v1:10.20.193.45:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f362c06f720 con 0x7f362c0a3f10 2026-02-22T23:28:08.616 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.607+0000 7f3631423640 1 -- 10.20.193.45:0/2484297764 <== mon.4 v1:10.20.193.45:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2401468207 0 0) 0x7f362c06f720 con 0x7f362c0a3f10 2026-02-22T23:28:08.616 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.607+0000 7f3631423640 1 -- 10.20.193.45:0/2484297764 >> v1:10.20.193.73:6789/0 conn(0x7f362c0a5100 legacy=0x7f362c13de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:08.616 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.607+0000 7f3631423640 1 -- 10.20.193.45:0/2484297764 >> v1:10.20.193.45:6789/0 conn(0x7f362c0a4610 legacy=0x7f362c0a49f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:08.616 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.607+0000 7f3631423640 10 monclient: _finish_hunting 0 2026-02-22T23:28:08.616 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.607+0000 7f3631423640 1 monclient: found mon.noname-c 2026-02-22T23:28:08.616 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.607+0000 7f3631423640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T23:28:08.616 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.607+0000 7f3631423640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.45:6791/0 2026-02-22T23:28:08.616 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.607+0000 7f3631423640 1 -- 10.20.193.45:0/2484297764 --> v1:10.20.193.45:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f362c0a3250 con 0x7f362c0a3f10 2026-02-22T23:28:08.616 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.607+0000 7f3631423640 10 monclient: _finish_auth 0 2026-02-22T23:28:08.617 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.607+0000 7f3631423640 10 monclient: _check_auth_tickets 2026-02-22T23:28:08.617 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.607+0000 7f3631423640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T23:28:08.617 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.607+0000 7f3631423640 1 -- 10.20.193.45:0/2484297764 <== mon.4 v1:10.20.193.45:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f36280033a0 con 0x7f362c0a3f10 2026-02-22T23:28:08.617 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.607+0000 7f3631423640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:28:08.617 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.607+0000 7f3631423640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-22T23:28:08.617 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.607+0000 7f3631423640 10 monclient: dump: 2026-02-22T23:28:08.617 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:28:08.617 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:28:08.617 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:08.617 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:08.617 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:28:08.617 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:28:08.617 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:28:08.617 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:28:08.617 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:28:08.617 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:28:08.617 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:28:08.617 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:28:08.618 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:28:08.618 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:28:08.618 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:28:08.618 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:08.618 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.607+0000 7f36346b0640 5 monclient: authenticate success, global_id 114259 2026-02-22T23:28:08.618 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.607+0000 7f36346b0640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-22T23:28:08.618 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.607+0000 7f3631423640 1 -- 10.20.193.45:0/2484297764 <== mon.4 v1:10.20.193.45:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f36280035c0 con 0x7f362c0a3f10 2026-02-22T23:28:08.618 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.607+0000 7f3631423640 10 monclient: handle_config config(0 keys) 2026-02-22T23:28:08.618 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.607+0000 7f3631423640 1 -- 10.20.193.45:0/2484297764 <== mon.4 v1:10.20.193.45:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f3628003dd0 con 0x7f362c0a3f10 2026-02-22T23:28:08.618 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.607+0000 7f3631423640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:28:08.618 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.607+0000 7f3631423640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T23:28:08.618 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.607+0000 7f3631423640 10 monclient: dump: 2026-02-22T23:28:08.618 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:28:08.618 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:28:08.618 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:08.618 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:08.618 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:28:08.619 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:28:08.619 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:28:08.619 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:28:08.619 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:28:08.619 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:28:08.619 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:28:08.619 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:28:08.619 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:28:08.619 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:28:08.619 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:28:08.619 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:08.619 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.607+0000 7f36346b0640 10 monclient: get_monmap_and_config success 2026-02-22T23:28:08.619 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.607+0000 7f36346b0640 4 set_mon_vals no callback set 2026-02-22T23:28:08.619 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.608+0000 7f36346b0640 10 monclient: shutdown 2026-02-22T23:28:08.619 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.608+0000 7f36346b0640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T23:28:08.619 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.608+0000 7f36346b0640 1 -- 10.20.193.45:0/2484297764 >> v1:10.20.193.45:6791/0 conn(0x7f362c0a3f10 legacy=0x7f362c1415a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:08.619 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.608+0000 7f36346b0640 1 -- 10.20.193.45:0/2484297764 shutdown_connections 2026-02-22T23:28:08.619 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.608+0000 7f36346b0640 1 -- 10.20.193.45:0/2484297764 >> 10.20.193.45:0/2484297764 conn(0x7f362c0a7f70 msgr2=0x7f362c0a8380 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:28:08.620 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.608+0000 7f36346b0640 1 -- 10.20.193.45:0/2484297764 shutdown_connections 2026-02-22T23:28:08.620 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.608+0000 7f36346b0640 1 -- 10.20.193.45:0/2484297764 wait complete. 2026-02-22T23:28:08.620 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.608+0000 7f36346b0640 10 monclient: build_initial_monmap 2026-02-22T23:28:08.620 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.608+0000 7f36346b0640 10 monclient: monmap: 2026-02-22T23:28:08.620 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-22T23:28:08.620 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T23:28:08.620 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-22T23:28:08.620 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-22T23:28:08.620 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-22T23:28:08.620 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-22T23:28:08.620 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-22T23:28:08.620 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.noname-f 2026-02-22T23:28:08.620 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.noname-b 2026-02-22T23:28:08.620 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.noname-g 2026-02-22T23:28:08.620 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.noname-c 2026-02-22T23:28:08.620 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.noname-h 2026-02-22T23:28:08.621 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.noname-d 2026-02-22T23:28:08.621 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.noname-i 2026-02-22T23:28:08.621 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.noname-e 2026-02-22T23:28:08.621 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:08.621 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.608+0000 7f36346b0640 1 Processor -- start 2026-02-22T23:28:08.621 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.608+0000 7f36346b0640 1 -- start start 2026-02-22T23:28:08.621 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.608+0000 7f36346b0640 10 monclient: init 2026-02-22T23:28:08.621 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.609+0000 7f36346b0640 10 monclient: _reopen_session rank -1 2026-02-22T23:28:08.621 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.609+0000 7f36346b0640 10 monclient: _add_conns ranks=[7,3,8,0,6,4,2,1,5] 2026-02-22T23:28:08.621 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.609+0000 7f36346b0640 10 monclient(hunting): picked mon.noname-i con 0x7f362c0a3f10 addr v1:10.20.193.73:6792/0 2026-02-22T23:28:08.621 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.609+0000 7f36346b0640 10 monclient(hunting): picked mon.noname-g con 0x7f362c0a4610 addr v1:10.20.193.73:6790/0 2026-02-22T23:28:08.621 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.609+0000 7f36346b0640 10 monclient(hunting): picked mon.noname-e con 0x7f362c0a5100 addr v1:10.20.193.45:6793/0 2026-02-22T23:28:08.621 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.609+0000 7f36346b0640 1 -- --> v1:10.20.193.73:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f362c122430 con 0x7f362c0a4610 2026-02-22T23:28:08.621 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.609+0000 7f36346b0640 1 -- --> v1:10.20.193.73:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f362c0a1ad0 con 0x7f362c0a3f10 2026-02-22T23:28:08.621 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.609+0000 7f36346b0640 1 -- --> v1:10.20.193.45:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f362c0a1580 con 0x7f362c0a5100 2026-02-22T23:28:08.621 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.609+0000 7f36346b0640 10 monclient(hunting): _renew_subs 2026-02-22T23:28:08.621 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.609+0000 7f36346b0640 10 monclient(hunting): authenticate will time out at 820.226081s 2026-02-22T23:28:08.622 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.609+0000 7f3632c26640 1 --1- >> v1:10.20.193.45:6793/0 conn(0x7f362c0a5100 0x7f362c141f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.45:6793/0 says I am v1:10.20.193.45:41108/0 (socket says 10.20.193.45:41108) 2026-02-22T23:28:08.622 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.609+0000 7f3632c26640 1 -- 10.20.193.45:0/180307186 learned_addr learned my addr 10.20.193.45:0/180307186 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-22T23:28:08.622 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.609+0000 7f3612ffd640 1 -- 10.20.193.45:0/180307186 <== mon.8 v1:10.20.193.45:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 508646650 0 0) 0x7f362c0a1580 con 0x7f362c0a5100 2026-02-22T23:28:08.622 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.609+0000 7f3612ffd640 10 monclient(hunting): _negotiate 2026-02-22T23:28:08.622 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.609+0000 7f3612ffd640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:28:08.622 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.609+0000 7f3612ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:28:08.622 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.609+0000 7f3612ffd640 10 monclient(hunting): my global_id is 4724 2026-02-22T23:28:08.622 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.609+0000 7f3612ffd640 1 -- 10.20.193.45:0/180307186 --> v1:10.20.193.45:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f35fc003620 con 0x7f362c0a5100 2026-02-22T23:28:08.622 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.609+0000 7f3612ffd640 1 -- 10.20.193.45:0/180307186 <== mon.8 v1:10.20.193.45:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3902511720 0 0) 0x7f35fc003620 con 0x7f362c0a5100 2026-02-22T23:28:08.622 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.609+0000 7f3612ffd640 1 -- 10.20.193.45:0/180307186 --> v1:10.20.193.45:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f362c0a1580 con 0x7f362c0a5100 2026-02-22T23:28:08.622 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.609+0000 7f3612ffd640 1 -- 10.20.193.45:0/180307186 <== mon.8 v1:10.20.193.45:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f3628003ab0 con 0x7f362c0a5100 2026-02-22T23:28:08.622 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.609+0000 7f3612ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-22T23:28:08.622 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.609+0000 7f3612ffd640 10 monclient(hunting): got monmap 1 from mon.noname-e (according to old e1) 2026-02-22T23:28:08.622 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.609+0000 7f3612ffd640 10 monclient(hunting): dump: 2026-02-22T23:28:08.622 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:28:08.622 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:28:08.622 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:08.623 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:08.623 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:28:08.623 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:28:08.623 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:28:08.623 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:28:08.623 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:28:08.623 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:28:08.623 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:28:08.623 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:28:08.623 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:28:08.623 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:28:08.623 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:28:08.623 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:08.623 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.609+0000 7f3612ffd640 10 monclient(hunting): _finish_auth 0 2026-02-22T23:28:08.623 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.609+0000 7f3612ffd640 1 -- 10.20.193.45:0/180307186 <== mon.3 v1:10.20.193.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3612741307 0 0) 0x7f362c122430 con 0x7f362c0a4610 2026-02-22T23:28:08.623 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.609+0000 7f3612ffd640 10 monclient(hunting): _negotiate 2026-02-22T23:28:08.623 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.609+0000 7f3612ffd640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:28:08.623 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.609+0000 7f3612ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:28:08.624 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.609+0000 7f3612ffd640 10 monclient(hunting): my global_id is 4665 2026-02-22T23:28:08.624 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.609+0000 7f3612ffd640 1 -- 10.20.193.45:0/180307186 --> v1:10.20.193.73:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f35fc003620 con 0x7f362c0a4610 2026-02-22T23:28:08.624 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.609+0000 7f3612ffd640 1 -- 10.20.193.45:0/180307186 <== mon.7 v1:10.20.193.73:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 5386125 0 0) 0x7f362c0a1ad0 con 0x7f362c0a3f10 2026-02-22T23:28:08.624 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.609+0000 7f3612ffd640 10 monclient(hunting): _negotiate 2026-02-22T23:28:08.624 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.609+0000 7f3612ffd640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:28:08.624 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.609+0000 7f3612ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:28:08.624 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.609+0000 7f3612ffd640 10 monclient(hunting): my global_id is 4624 2026-02-22T23:28:08.624 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.609+0000 7f3612ffd640 1 -- 10.20.193.45:0/180307186 --> v1:10.20.193.73:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f362c122430 con 0x7f362c0a3f10 2026-02-22T23:28:08.624 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.609+0000 7f3612ffd640 1 -- 10.20.193.45:0/180307186 <== mon.8 v1:10.20.193.45:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3219546793 0 0) 0x7f362c0a1580 con 0x7f362c0a5100 2026-02-22T23:28:08.624 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.609+0000 7f3612ffd640 1 -- 10.20.193.45:0/180307186 >> v1:10.20.193.73:6792/0 conn(0x7f362c0a3f10 legacy=0x7f362c141140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:08.624 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.609+0000 7f3612ffd640 1 -- 10.20.193.45:0/180307186 >> v1:10.20.193.73:6790/0 conn(0x7f362c0a4610 legacy=0x7f362c141850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:08.624 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.609+0000 7f3612ffd640 10 monclient: _finish_hunting 0 2026-02-22T23:28:08.624 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.609+0000 7f3612ffd640 1 monclient: found mon.e 2026-02-22T23:28:08.624 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.609+0000 7f3612ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T23:28:08.624 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.609+0000 7f3612ffd640 10 monclient: _send_mon_message to mon.e at v1:10.20.193.45:6793/0 2026-02-22T23:28:08.624 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.609+0000 7f3612ffd640 1 -- 10.20.193.45:0/180307186 --> v1:10.20.193.45:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f362c06e7c0 con 0x7f362c0a5100 2026-02-22T23:28:08.624 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.609+0000 7f3612ffd640 10 monclient: _finish_auth 0 2026-02-22T23:28:08.625 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.609+0000 7f3612ffd640 10 monclient: _check_auth_tickets 2026-02-22T23:28:08.625 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.609+0000 7f3612ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T23:28:08.625 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.609+0000 7f36346b0640 5 monclient: authenticate success, global_id 4724 2026-02-22T23:28:08.625 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.609+0000 7f36346b0640 10 monclient: _renew_subs 2026-02-22T23:28:08.625 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.609+0000 7f36346b0640 10 monclient: _send_mon_message to mon.e at v1:10.20.193.45:6793/0 2026-02-22T23:28:08.625 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.609+0000 7f36346b0640 1 -- 10.20.193.45:0/180307186 --> v1:10.20.193.45:6793/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f362c123880 con 0x7f362c0a5100 2026-02-22T23:28:08.625 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.609+0000 7f36346b0640 10 monclient: _renew_subs 2026-02-22T23:28:08.625 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.609+0000 7f36346b0640 10 monclient: _send_mon_message to mon.e at v1:10.20.193.45:6793/0 2026-02-22T23:28:08.625 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.609+0000 7f3612ffd640 1 -- 10.20.193.45:0/180307186 <== mon.8 v1:10.20.193.45:6793/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3628004090 con 0x7f362c0a5100 2026-02-22T23:28:08.625 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.609+0000 7f36346b0640 1 -- 10.20.193.45:0/180307186 --> v1:10.20.193.45:6793/0 -- mon_subscribe({osdmap=0}) -- 0x7f362c1d8b50 con 0x7f362c0a5100 2026-02-22T23:28:08.625 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.609+0000 7f3612ffd640 10 monclient: handle_config config(0 keys) 2026-02-22T23:28:08.625 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.609+0000 7f3612ffd640 1 -- 10.20.193.45:0/180307186 <== mon.8 v1:10.20.193.45:6793/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f3628004640 con 0x7f362c0a5100 2026-02-22T23:28:08.625 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.609+0000 7f3612ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:28:08.625 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.609+0000 7f3630c22640 4 set_mon_vals no callback set 2026-02-22T23:28:08.625 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.609+0000 7f3612ffd640 10 monclient: got monmap 1 from mon.e (according to old e1) 2026-02-22T23:28:08.625 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.609+0000 7f3612ffd640 10 monclient: dump: 2026-02-22T23:28:08.625 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:28:08.626 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:28:08.626 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:08.626 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:08.626 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:28:08.626 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:28:08.626 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:28:08.626 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:28:08.626 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:28:08.626 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:28:08.626 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:28:08.626 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:28:08.626 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:28:08.626 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:28:08.626 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:28:08.626 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:08.626 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.610+0000 7f36346b0640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T23:28:08.626 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.610+0000 7f36346b0640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T23:28:08.626 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.610+0000 7f36346b0640 10 monclient: _send_mon_message to mon.e at v1:10.20.193.45:6793/0 2026-02-22T23:28:08.627 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.610+0000 7f36346b0640 1 -- 10.20.193.45:0/180307186 --> v1:10.20.193.45:6793/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f362c0008d0 con 0x7f362c0a5100 2026-02-22T23:28:08.627 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.610+0000 7f3612ffd640 1 -- 10.20.193.45:0/180307186 <== mon.8 v1:10.20.193.45:6793/0 7 ==== mgrmap(e 5) ==== 50225+0+0 (unknown 2330357642 0 0) 0x7f3628004860 con 0x7f362c0a5100 2026-02-22T23:28:08.627 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.610+0000 7f3612ffd640 1 -- 10.20.193.45:0/180307186 <== mon.8 v1:10.20.193.45:6793/0 8 ==== osd_map(25..25 src has 1..25) ==== 3502+0+0 (unknown 129690100 0 0) 0x7f362804df30 con 0x7f362c0a5100 2026-02-22T23:28:08.627 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.610+0000 7f3632425640 10 monclient: get_auth_request con 0x7f35fc03f930 auth_method 0 2026-02-22T23:28:08.627 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.612+0000 7f3612ffd640 1 -- 10.20.193.45:0/180307186 <== mon.8 v1:10.20.193.45:6793/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (unknown 1092875540 0 2568732696) 0x7f3628017bb0 con 0x7f362c0a5100 2026-02-22T23:28:08.627 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.612+0000 7f3612ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T23:28:08.627 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.612+0000 7f3612ffd640 10 monclient: _finish_command 1 = system:0 2026-02-22T23:28:08.697 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.695+0000 7f36346b0640 1 -- 10.20.193.45:0/180307186 --> v1:10.20.193.73:6800/2222410180 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7f362c0a0520 con 0x7f35fc03f930 2026-02-22T23:28:08.697 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.695+0000 7f3612ffd640 1 -- 10.20.193.45:0/180307186 <== mgr.4111 v1:10.20.193.73:6800/2222410180 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (unknown 3049115190 0 0) 0x7f362c0a0520 con 0x7f35fc03f930 2026-02-22T23:28:08.697 INFO:teuthology.orchestra.run.trial045.stderr:instructed osd(s) 2 to deep-scrub 2026-02-22T23:28:08.698 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.696+0000 7f36346b0640 1 -- 10.20.193.45:0/180307186 >> v1:10.20.193.73:6800/2222410180 conn(0x7f35fc03f930 legacy=0x7f35fc041df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:08.698 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.696+0000 7f36346b0640 10 monclient: shutdown 2026-02-22T23:28:08.698 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.696+0000 7f36346b0640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T23:28:08.698 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.696+0000 7f36346b0640 1 -- 10.20.193.45:0/180307186 >> v1:10.20.193.45:6793/0 conn(0x7f362c0a5100 legacy=0x7f362c141f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:08.698 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.696+0000 7f36346b0640 1 -- 10.20.193.45:0/180307186 shutdown_connections 2026-02-22T23:28:08.699 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.696+0000 7f36346b0640 1 -- 10.20.193.45:0/180307186 >> 10.20.193.45:0/180307186 conn(0x7f362c0a7f70 msgr2=0x7f362c0a9a90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:28:08.699 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.696+0000 7f36346b0640 1 -- 10.20.193.45:0/180307186 shutdown_connections 2026-02-22T23:28:08.699 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.696+0000 7f36346b0640 1 -- 10.20.193.45:0/180307186 wait complete. 2026-02-22T23:28:08.705 INFO:tasks.ceph:Scrubbing osd.3 2026-02-22T23:28:08.705 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2026-02-22T23:28:08.775 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.773+0000 7f427fe43640 10 monclient: get_monmap_and_config 2026-02-22T23:28:08.775 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.773+0000 7f427fe43640 10 monclient: build_initial_monmap 2026-02-22T23:28:08.775 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.773+0000 7f427fe43640 10 monclient: monmap: 2026-02-22T23:28:08.775 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-22T23:28:08.775 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:28:08.776 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:28:08.775095+0000 2026-02-22T23:28:08.776 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:28:08.775095+0000 2026-02-22T23:28:08.776 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-22T23:28:08.776 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:28:08.776 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-22T23:28:08.776 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.noname-f 2026-02-22T23:28:08.776 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.noname-b 2026-02-22T23:28:08.776 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.noname-g 2026-02-22T23:28:08.776 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.noname-c 2026-02-22T23:28:08.776 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.noname-h 2026-02-22T23:28:08.776 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.noname-d 2026-02-22T23:28:08.776 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.noname-i 2026-02-22T23:28:08.777 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.noname-e 2026-02-22T23:28:08.777 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:08.784 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.774+0000 7f427fe43640 1 Processor -- start 2026-02-22T23:28:08.784 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.774+0000 7f427fe43640 1 -- start start 2026-02-22T23:28:08.785 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.774+0000 7f427fe43640 10 monclient: init 2026-02-22T23:28:08.785 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.774+0000 7f427fe43640 10 monclient: _reopen_session rank -1 2026-02-22T23:28:08.785 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.774+0000 7f427fe43640 10 monclient: _add_conns ranks=[0,7,8,5,2,4,3,1,6] 2026-02-22T23:28:08.785 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.774+0000 7f427fe43640 10 monclient(hunting): picked mon.noname-a con 0x7f42780a1a60 addr v1:10.20.193.45:6789/0 2026-02-22T23:28:08.785 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.774+0000 7f427fe43640 10 monclient(hunting): picked mon.noname-i con 0x7f42780a0910 addr v1:10.20.193.73:6792/0 2026-02-22T23:28:08.785 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.774+0000 7f427fe43640 10 monclient(hunting): picked mon.noname-e con 0x7f427813cca0 addr v1:10.20.193.45:6793/0 2026-02-22T23:28:08.785 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.774+0000 7f427fe43640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4278137660 con 0x7f42780a1a60 2026-02-22T23:28:08.785 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.774+0000 7f427fe43640 1 -- --> v1:10.20.193.73:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42780a7d40 con 0x7f42780a0910 2026-02-22T23:28:08.785 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.774+0000 7f427fe43640 1 -- --> v1:10.20.193.45:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42780a0d90 con 0x7f427813cca0 2026-02-22T23:28:08.785 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.774+0000 7f427fe43640 10 monclient(hunting): _renew_subs 2026-02-22T23:28:08.785 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.774+0000 7f427fe43640 10 monclient(hunting): authenticate will time out at 820.391673s 2026-02-22T23:28:08.786 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.774+0000 7f427dbb8640 1 --1- >> v1:10.20.193.45:6789/0 conn(0x7f42780a1a60 0x7f4278136840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.45:6789/0 says I am v1:10.20.193.45:38486/0 (socket says 10.20.193.45:38486) 2026-02-22T23:28:08.786 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.774+0000 7f427dbb8640 1 -- 10.20.193.45:0/1571228011 learned_addr learned my addr 10.20.193.45:0/1571228011 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-22T23:28:08.786 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.774+0000 7f427dbb8640 1 -- 10.20.193.45:0/1571228011 >> v1:10.20.193.45:6789/0 conn(0x7f42780a1a60 legacy=0x7f4278136840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2026-02-22T23:28:08.786 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.774+0000 7f427dbb8640 1 -- 10.20.193.45:0/1571228011 >> v1:10.20.193.45:6789/0 conn(0x7f42780a1a60 legacy=0x7f4278136840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-22T23:28:08.786 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.774+0000 7f427dbb8640 1 --1- 10.20.193.45:0/1571228011 >> v1:10.20.193.45:6789/0 conn(0x7f42780a1a60 0x7f4278136840 :-1 s=OPENED pgs=201 cs=1 l=1).handle_message read tag failed 2026-02-22T23:28:08.786 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.774+0000 7f427dbb8640 1 --1- 10.20.193.45:0/1571228011 >> v1:10.20.193.45:6789/0 conn(0x7f42780a1a60 0x7f4278136840 :-1 s=OPENED pgs=201 cs=1 l=1).fault on lossy channel, failing 2026-02-22T23:28:08.786 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.774+0000 7f427cbb6640 10 monclient(hunting): ms_handle_reset hunted mon v1:10.20.193.45:6789/0 2026-02-22T23:28:08.786 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.774+0000 7f427cbb6640 1 -- 10.20.193.45:0/1571228011 <== mon.8 v1:10.20.193.45:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 20158870 0 0) 0x7f42780a0d90 con 0x7f427813cca0 2026-02-22T23:28:08.786 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.774+0000 7f427cbb6640 10 monclient(hunting): _negotiate 2026-02-22T23:28:08.786 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.774+0000 7f427cbb6640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:28:08.786 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.774+0000 7f427cbb6640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:28:08.786 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.774+0000 7f427cbb6640 10 monclient(hunting): my global_id is 4733 2026-02-22T23:28:08.787 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.774+0000 7f427cbb6640 1 -- 10.20.193.45:0/1571228011 --> v1:10.20.193.45:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4260003620 con 0x7f427813cca0 2026-02-22T23:28:08.787 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.775+0000 7f427cbb6640 1 -- 10.20.193.45:0/1571228011 <== mon.8 v1:10.20.193.45:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1002020888 0 0) 0x7f4260003620 con 0x7f427813cca0 2026-02-22T23:28:08.787 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.775+0000 7f427cbb6640 1 -- 10.20.193.45:0/1571228011 >> v1:10.20.193.73:6792/0 conn(0x7f42780a0910 legacy=0x7f4278136f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:08.787 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.775+0000 7f427cbb6640 1 -- 10.20.193.45:0/1571228011 >> v1:10.20.193.45:6789/0 conn(0x7f42780a1a60 legacy=0x7f4278136840 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T23:28:08.787 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.775+0000 7f427cbb6640 10 monclient: _finish_hunting 0 2026-02-22T23:28:08.787 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.775+0000 7f427cbb6640 1 monclient: found mon.noname-e 2026-02-22T23:28:08.787 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.775+0000 7f427cbb6640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T23:28:08.787 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.775+0000 7f427cbb6640 10 monclient: _send_mon_message to mon.noname-e at v1:10.20.193.45:6793/0 2026-02-22T23:28:08.787 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.775+0000 7f427cbb6640 1 -- 10.20.193.45:0/1571228011 --> v1:10.20.193.45:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42781437e0 con 0x7f427813cca0 2026-02-22T23:28:08.787 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.775+0000 7f427cbb6640 10 monclient: _finish_auth 0 2026-02-22T23:28:08.787 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.775+0000 7f427cbb6640 10 monclient: _check_auth_tickets 2026-02-22T23:28:08.787 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.775+0000 7f427cbb6640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T23:28:08.788 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.775+0000 7f427cbb6640 1 -- 10.20.193.45:0/1571228011 <== mon.8 v1:10.20.193.45:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f42740033c0 con 0x7f427813cca0 2026-02-22T23:28:08.788 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.775+0000 7f427fe43640 5 monclient: authenticate success, global_id 4733 2026-02-22T23:28:08.788 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.775+0000 7f427fe43640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-22T23:28:08.788 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.775+0000 7f427cbb6640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:28:08.788 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.775+0000 7f427cbb6640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2026-02-22T23:28:08.788 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.775+0000 7f427cbb6640 10 monclient: dump: 2026-02-22T23:28:08.788 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:28:08.788 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:28:08.788 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:08.788 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:08.788 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:28:08.788 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:28:08.788 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:28:08.789 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:28:08.789 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:28:08.789 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:28:08.789 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:28:08.789 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:28:08.789 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:28:08.789 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:28:08.789 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:28:08.789 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:08.789 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.775+0000 7f427fe43640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-22T23:28:08.789 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.775+0000 7f427cbb6640 1 -- 10.20.193.45:0/1571228011 <== mon.8 v1:10.20.193.45:6793/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f42740035e0 con 0x7f427813cca0 2026-02-22T23:28:08.789 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.775+0000 7f427cbb6640 10 monclient: handle_config config(0 keys) 2026-02-22T23:28:08.789 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.775+0000 7f427cbb6640 1 -- 10.20.193.45:0/1571228011 <== mon.8 v1:10.20.193.45:6793/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f4274003dd0 con 0x7f427813cca0 2026-02-22T23:28:08.790 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.775+0000 7f427cbb6640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:28:08.790 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.775+0000 7f427cbb6640 10 monclient: got monmap 1 from mon.e (according to old e1) 2026-02-22T23:28:08.790 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.775+0000 7f427cbb6640 10 monclient: dump: 2026-02-22T23:28:08.790 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:28:08.790 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:28:08.790 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:08.790 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:08.790 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:28:08.790 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:28:08.790 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:28:08.790 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:28:08.790 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:28:08.790 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:28:08.791 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:28:08.791 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:28:08.791 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:28:08.791 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:28:08.791 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:28:08.791 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:08.791 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.775+0000 7f427fe43640 10 monclient: get_monmap_and_config success 2026-02-22T23:28:08.791 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.775+0000 7f427fe43640 4 set_mon_vals no callback set 2026-02-22T23:28:08.791 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.775+0000 7f427fe43640 10 monclient: shutdown 2026-02-22T23:28:08.791 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.775+0000 7f427fe43640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T23:28:08.791 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.775+0000 7f427fe43640 1 -- 10.20.193.45:0/1571228011 >> v1:10.20.193.45:6793/0 conn(0x7f427813cca0 legacy=0x7f427813f090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:08.791 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.775+0000 7f427fe43640 1 -- 10.20.193.45:0/1571228011 shutdown_connections 2026-02-22T23:28:08.791 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.775+0000 7f427fe43640 1 -- 10.20.193.45:0/1571228011 >> 10.20.193.45:0/1571228011 conn(0x7f42780a7690 msgr2=0x7f42780a3b60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:28:08.792 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.775+0000 7f427fe43640 1 -- 10.20.193.45:0/1571228011 shutdown_connections 2026-02-22T23:28:08.792 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.775+0000 7f427fe43640 1 -- 10.20.193.45:0/1571228011 wait complete. 2026-02-22T23:28:08.792 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.775+0000 7f427fe43640 10 monclient: build_initial_monmap 2026-02-22T23:28:08.792 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.775+0000 7f427fe43640 10 monclient: monmap: 2026-02-22T23:28:08.792 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-22T23:28:08.792 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T23:28:08.792 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-22T23:28:08.792 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-22T23:28:08.792 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-22T23:28:08.792 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-22T23:28:08.792 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-22T23:28:08.792 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.noname-f 2026-02-22T23:28:08.793 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.noname-b 2026-02-22T23:28:08.793 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.noname-g 2026-02-22T23:28:08.793 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.noname-c 2026-02-22T23:28:08.793 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.noname-h 2026-02-22T23:28:08.793 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.noname-d 2026-02-22T23:28:08.793 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.noname-i 2026-02-22T23:28:08.793 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.noname-e 2026-02-22T23:28:08.793 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:08.793 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.776+0000 7f427fe43640 1 Processor -- start 2026-02-22T23:28:08.793 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.776+0000 7f427fe43640 1 -- start start 2026-02-22T23:28:08.793 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.776+0000 7f427fe43640 10 monclient: init 2026-02-22T23:28:08.793 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.776+0000 7f427fe43640 10 monclient: _reopen_session rank -1 2026-02-22T23:28:08.793 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.776+0000 7f427fe43640 10 monclient: _add_conns ranks=[6,7,8,3,5,4,0,2,1] 2026-02-22T23:28:08.794 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.776+0000 7f427fe43640 10 monclient(hunting): picked mon.noname-d con 0x7f42780a0910 addr v1:10.20.193.45:6792/0 2026-02-22T23:28:08.794 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.776+0000 7f427fe43640 10 monclient(hunting): picked mon.noname-i con 0x7f42780a1a60 addr v1:10.20.193.73:6792/0 2026-02-22T23:28:08.794 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.776+0000 7f427fe43640 10 monclient(hunting): picked mon.noname-e con 0x7f427813cca0 addr v1:10.20.193.45:6793/0 2026-02-22T23:28:08.794 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.776+0000 7f427fe43640 1 -- --> v1:10.20.193.45:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4278137b50 con 0x7f42780a0910 2026-02-22T23:28:08.794 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.776+0000 7f427fe43640 1 -- --> v1:10.20.193.73:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4278137df0 con 0x7f42780a1a60 2026-02-22T23:28:08.794 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.776+0000 7f427fe43640 1 -- --> v1:10.20.193.45:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42781383b0 con 0x7f427813cca0 2026-02-22T23:28:08.794 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.776+0000 7f427fe43640 10 monclient(hunting): _renew_subs 2026-02-22T23:28:08.794 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.776+0000 7f427fe43640 10 monclient(hunting): authenticate will time out at 820.393412s 2026-02-22T23:28:08.794 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.776+0000 7f427dbb8640 1 --1- >> v1:10.20.193.45:6792/0 conn(0x7f42780a0910 0x7f427809e5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.45:6792/0 says I am v1:10.20.193.45:36882/0 (socket says 10.20.193.45:36882) 2026-02-22T23:28:08.794 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.776+0000 7f427e3b9640 1 --1- >> v1:10.20.193.45:6793/0 conn(0x7f427813cca0 0x7f42781d86b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.45:6793/0 says I am v1:10.20.193.45:41128/0 (socket says 10.20.193.45:41128) 2026-02-22T23:28:08.794 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.776+0000 7f427dbb8640 1 -- 10.20.193.45:0/2538020016 learned_addr learned my addr 10.20.193.45:0/2538020016 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-22T23:28:08.794 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.776+0000 7f42667fc640 1 -- 10.20.193.45:0/2538020016 <== mon.8 v1:10.20.193.45:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 77613209 0 0) 0x7f42781383b0 con 0x7f427813cca0 2026-02-22T23:28:08.795 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.776+0000 7f42667fc640 10 monclient(hunting): _negotiate 2026-02-22T23:28:08.795 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.776+0000 7f42667fc640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:28:08.795 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.776+0000 7f42667fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:28:08.795 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.776+0000 7f42667fc640 10 monclient(hunting): my global_id is 4742 2026-02-22T23:28:08.795 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.776+0000 7f42667fc640 1 -- 10.20.193.45:0/2538020016 --> v1:10.20.193.45:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4248003620 con 0x7f427813cca0 2026-02-22T23:28:08.795 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.776+0000 7f42667fc640 1 -- 10.20.193.45:0/2538020016 <== mon.6 v1:10.20.193.45:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1162762931 0 0) 0x7f4278137b50 con 0x7f42780a0910 2026-02-22T23:28:08.795 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.776+0000 7f42667fc640 10 monclient(hunting): _negotiate 2026-02-22T23:28:08.795 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.776+0000 7f42667fc640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:28:08.795 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.776+0000 7f42667fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:28:08.795 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.776+0000 7f42667fc640 10 monclient(hunting): my global_id is 114252 2026-02-22T23:28:08.795 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.776+0000 7f42667fc640 1 -- 10.20.193.45:0/2538020016 --> v1:10.20.193.45:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f42781383b0 con 0x7f42780a0910 2026-02-22T23:28:08.795 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.776+0000 7f42667fc640 1 -- 10.20.193.45:0/2538020016 <== mon.8 v1:10.20.193.45:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3753327109 0 0) 0x7f4248003620 con 0x7f427813cca0 2026-02-22T23:28:08.795 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.776+0000 7f42667fc640 1 -- 10.20.193.45:0/2538020016 --> v1:10.20.193.45:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4278137b50 con 0x7f427813cca0 2026-02-22T23:28:08.796 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.776+0000 7f42667fc640 1 -- 10.20.193.45:0/2538020016 <== mon.8 v1:10.20.193.45:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f4274003ad0 con 0x7f427813cca0 2026-02-22T23:28:08.796 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.776+0000 7f42667fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-22T23:28:08.796 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.776+0000 7f42667fc640 10 monclient(hunting): got monmap 1 from mon.noname-e (according to old e1) 2026-02-22T23:28:08.796 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.776+0000 7f42667fc640 10 monclient(hunting): dump: 2026-02-22T23:28:08.796 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:28:08.796 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:28:08.796 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:08.796 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:08.796 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:28:08.796 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:28:08.796 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:28:08.796 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:28:08.796 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:28:08.797 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:28:08.797 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:28:08.797 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:28:08.797 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:28:08.797 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:28:08.797 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:28:08.797 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:08.797 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.776+0000 7f42667fc640 10 monclient(hunting): _finish_auth 0 2026-02-22T23:28:08.797 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.776+0000 7f42667fc640 1 -- 10.20.193.45:0/2538020016 <== mon.7 v1:10.20.193.73:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1077258586 0 0) 0x7f4278137df0 con 0x7f42780a1a60 2026-02-22T23:28:08.797 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.776+0000 7f42667fc640 10 monclient(hunting): _negotiate 2026-02-22T23:28:08.797 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.776+0000 7f42667fc640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:28:08.797 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.776+0000 7f42667fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:28:08.797 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.776+0000 7f42667fc640 10 monclient(hunting): my global_id is 4642 2026-02-22T23:28:08.798 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.776+0000 7f42667fc640 1 -- 10.20.193.45:0/2538020016 --> v1:10.20.193.73:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4248003620 con 0x7f42780a1a60 2026-02-22T23:28:08.798 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.776+0000 7f42667fc640 1 -- 10.20.193.45:0/2538020016 <== mon.6 v1:10.20.193.45:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 943603083 0 0) 0x7f42781383b0 con 0x7f42780a0910 2026-02-22T23:28:08.798 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.776+0000 7f42667fc640 1 -- 10.20.193.45:0/2538020016 --> v1:10.20.193.45:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4278137df0 con 0x7f42780a0910 2026-02-22T23:28:08.798 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.776+0000 7f42667fc640 1 -- 10.20.193.45:0/2538020016 <== mon.8 v1:10.20.193.45:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1691925526 0 0) 0x7f4278137b50 con 0x7f427813cca0 2026-02-22T23:28:08.798 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.776+0000 7f42667fc640 1 -- 10.20.193.45:0/2538020016 >> v1:10.20.193.73:6792/0 conn(0x7f42780a1a60 legacy=0x7f427809ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:08.798 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.776+0000 7f42667fc640 1 -- 10.20.193.45:0/2538020016 >> v1:10.20.193.45:6792/0 conn(0x7f42780a0910 legacy=0x7f427809e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:08.798 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.776+0000 7f42667fc640 10 monclient: _finish_hunting 0 2026-02-22T23:28:08.798 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.776+0000 7f42667fc640 1 monclient: found mon.e 2026-02-22T23:28:08.798 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.776+0000 7f42667fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T23:28:08.798 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.776+0000 7f42667fc640 10 monclient: _send_mon_message to mon.e at v1:10.20.193.45:6793/0 2026-02-22T23:28:08.798 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.776+0000 7f42667fc640 1 -- 10.20.193.45:0/2538020016 --> v1:10.20.193.45:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4278142a10 con 0x7f427813cca0 2026-02-22T23:28:08.798 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.776+0000 7f42667fc640 10 monclient: _finish_auth 0 2026-02-22T23:28:08.799 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.776+0000 7f42667fc640 10 monclient: _check_auth_tickets 2026-02-22T23:28:08.799 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.776+0000 7f42667fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T23:28:08.799 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.776+0000 7f427fe43640 5 monclient: authenticate success, global_id 4742 2026-02-22T23:28:08.799 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.776+0000 7f427fe43640 10 monclient: _renew_subs 2026-02-22T23:28:08.799 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.776+0000 7f427fe43640 10 monclient: _send_mon_message to mon.e at v1:10.20.193.45:6793/0 2026-02-22T23:28:08.799 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.776+0000 7f427fe43640 1 -- 10.20.193.45:0/2538020016 --> v1:10.20.193.45:6793/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f42780a2b00 con 0x7f427813cca0 2026-02-22T23:28:08.799 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.776+0000 7f427fe43640 10 monclient: _renew_subs 2026-02-22T23:28:08.799 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.776+0000 7f427fe43640 10 monclient: _send_mon_message to mon.e at v1:10.20.193.45:6793/0 2026-02-22T23:28:08.799 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.776+0000 7f427fe43640 1 -- 10.20.193.45:0/2538020016 --> v1:10.20.193.45:6793/0 -- mon_subscribe({osdmap=0}) -- 0x7f4278072810 con 0x7f427813cca0 2026-02-22T23:28:08.799 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.776+0000 7f42667fc640 1 -- 10.20.193.45:0/2538020016 <== mon.8 v1:10.20.193.45:6793/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4274003fa0 con 0x7f427813cca0 2026-02-22T23:28:08.799 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.776+0000 7f42667fc640 10 monclient: handle_config config(0 keys) 2026-02-22T23:28:08.799 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.776+0000 7f42667fc640 1 -- 10.20.193.45:0/2538020016 <== mon.8 v1:10.20.193.45:6793/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f4274004510 con 0x7f427813cca0 2026-02-22T23:28:08.799 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.776+0000 7f42667fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:28:08.800 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.776+0000 7f42667fc640 10 monclient: got monmap 1 from mon.e (according to old e1) 2026-02-22T23:28:08.800 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.776+0000 7f4267fff640 4 set_mon_vals no callback set 2026-02-22T23:28:08.800 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.776+0000 7f42667fc640 10 monclient: dump: 2026-02-22T23:28:08.800 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:28:08.800 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:28:08.800 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:08.800 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:08.800 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:28:08.800 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:28:08.800 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:28:08.800 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:28:08.800 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:28:08.800 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:28:08.801 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:28:08.801 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:28:08.801 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:28:08.801 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:28:08.801 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:28:08.801 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:08.801 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.777+0000 7f427fe43640 10 monclient: _send_mon_message to mon.e at v1:10.20.193.45:6793/0 2026-02-22T23:28:08.801 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.777+0000 7f427fe43640 1 -- 10.20.193.45:0/2538020016 --> v1:10.20.193.45:6793/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f42780a6b80 con 0x7f427813cca0 2026-02-22T23:28:08.801 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.777+0000 7f42667fc640 1 -- 10.20.193.45:0/2538020016 <== mon.8 v1:10.20.193.45:6793/0 7 ==== mgrmap(e 5) ==== 50225+0+0 (unknown 2330357642 0 0) 0x7f4274003460 con 0x7f427813cca0 2026-02-22T23:28:08.801 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.777+0000 7f42667fc640 1 -- 10.20.193.45:0/2538020016 <== mon.8 v1:10.20.193.45:6793/0 8 ==== osd_map(25..25 src has 1..25) ==== 3502+0+0 (unknown 129690100 0 0) 0x7f427404ddf0 con 0x7f427813cca0 2026-02-22T23:28:08.801 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.777+0000 7f42667fc640 1 -- 10.20.193.45:0/2538020016 --> v1:10.20.193.73:6805/3607388566 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f424804a280 con 0x7f4248046610 2026-02-22T23:28:08.801 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.777+0000 7f42667fc640 1 -- 10.20.193.45:0/2538020016 <== mon.8 v1:10.20.193.45:6793/0 9 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (unknown 2663167439 0 0) 0x7f427404e250 con 0x7f427813cca0 2026-02-22T23:28:08.802 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.777+0000 7f42667fc640 10 monclient: handle_get_version_reply finishing 1 version 25 2026-02-22T23:28:08.802 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.777+0000 7f427dbb8640 10 monclient: get_auth_request con 0x7f424803fa10 auth_method 0 2026-02-22T23:28:08.802 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.778+0000 7f427d3b7640 10 monclient: get_auth_request con 0x7f4248046610 auth_method 0 2026-02-22T23:28:08.802 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.778+0000 7f42667fc640 1 -- 10.20.193.45:0/2538020016 <== osd.3 v1:10.20.193.73:6805/3607388566 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (unknown 0 0 3365489958) 0x7f424804a280 con 0x7f4248046610 2026-02-22T23:28:08.802 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.785+0000 7f427fe43640 1 -- 10.20.193.45:0/2538020016 --> v1:10.20.193.73:6805/3607388566 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f427809f640 con 0x7f4248046610 2026-02-22T23:28:08.803 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.785+0000 7f42667fc640 1 -- 10.20.193.45:0/2538020016 <== osd.3 v1:10.20.193.73:6805/3607388566 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (unknown 0 0 119112422) 0x7f427809f640 con 0x7f4248046610 2026-02-22T23:28:08.803 INFO:teuthology.orchestra.run.trial045.stdout:{ 2026-02-22T23:28:08.803 INFO:teuthology.orchestra.run.trial045.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-22T23:28:08.803 INFO:teuthology.orchestra.run.trial045.stdout:} 2026-02-22T23:28:08.805 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.785+0000 7f427fe43640 1 -- 10.20.193.45:0/2538020016 >> v1:10.20.193.73:6805/3607388566 conn(0x7f4248046610 legacy=0x7f4248048a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:08.805 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.785+0000 7f427fe43640 1 -- 10.20.193.45:0/2538020016 >> v1:10.20.193.73:6800/2222410180 conn(0x7f424803fa10 legacy=0x7f4248041ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:08.805 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.785+0000 7f427fe43640 10 monclient: shutdown 2026-02-22T23:28:08.805 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.785+0000 7f427fe43640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T23:28:08.805 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.785+0000 7f427fe43640 1 -- 10.20.193.45:0/2538020016 >> v1:10.20.193.45:6793/0 conn(0x7f427813cca0 legacy=0x7f42781d86b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:08.805 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.785+0000 7f427e3b9640 1 -- 10.20.193.45:0/2538020016 reap_dead start 2026-02-22T23:28:08.805 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.785+0000 7f427fe43640 1 -- 10.20.193.45:0/2538020016 shutdown_connections 2026-02-22T23:28:08.806 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.785+0000 7f427fe43640 1 -- 10.20.193.45:0/2538020016 >> 10.20.193.45:0/2538020016 conn(0x7f42780a7690 msgr2=0x7f42780a4f60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:28:08.806 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.785+0000 7f427fe43640 1 -- 10.20.193.45:0/2538020016 shutdown_connections 2026-02-22T23:28:08.806 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.785+0000 7f427fe43640 1 -- 10.20.193.45:0/2538020016 wait complete. 2026-02-22T23:28:08.806 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2026-02-22T23:28:08.882 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.872+0000 7f2f26005640 10 monclient: get_monmap_and_config 2026-02-22T23:28:08.882 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.872+0000 7f2f26005640 10 monclient: build_initial_monmap 2026-02-22T23:28:08.882 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.872+0000 7f2f26005640 10 monclient: monmap: 2026-02-22T23:28:08.882 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-22T23:28:08.882 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:28:08.882 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:28:08.873926+0000 2026-02-22T23:28:08.883 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:28:08.873926+0000 2026-02-22T23:28:08.883 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-22T23:28:08.883 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:28:08.883 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-22T23:28:08.883 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.noname-f 2026-02-22T23:28:08.883 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.noname-b 2026-02-22T23:28:08.883 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.noname-g 2026-02-22T23:28:08.883 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.noname-c 2026-02-22T23:28:08.883 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.noname-h 2026-02-22T23:28:08.883 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.noname-d 2026-02-22T23:28:08.883 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.noname-i 2026-02-22T23:28:08.884 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.noname-e 2026-02-22T23:28:08.884 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:08.884 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.873+0000 7f2f26005640 1 Processor -- start 2026-02-22T23:28:08.884 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.873+0000 7f2f26005640 1 -- start start 2026-02-22T23:28:08.884 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.873+0000 7f2f26005640 10 monclient: init 2026-02-22T23:28:08.884 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.873+0000 7f2f26005640 10 monclient: _reopen_session rank -1 2026-02-22T23:28:08.884 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.873+0000 7f2f26005640 10 monclient: _add_conns ranks=[6,3,2,8,4,7,1,5,0] 2026-02-22T23:28:08.884 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.873+0000 7f2f26005640 10 monclient(hunting): picked mon.noname-d con 0x7f2f2009e5d0 addr v1:10.20.193.45:6792/0 2026-02-22T23:28:08.884 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.873+0000 7f2f26005640 10 monclient(hunting): picked mon.noname-g con 0x7f2f2009f700 addr v1:10.20.193.73:6790/0 2026-02-22T23:28:08.884 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.873+0000 7f2f26005640 10 monclient(hunting): picked mon.noname-b con 0x7f2f2009f0c0 addr v1:10.20.193.45:6790/0 2026-02-22T23:28:08.884 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.873+0000 7f2f26005640 1 -- --> v1:10.20.193.45:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2f200a0560 con 0x7f2f2009f0c0 2026-02-22T23:28:08.885 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.873+0000 7f2f26005640 1 -- --> v1:10.20.193.73:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2f2009fcc0 con 0x7f2f2009f700 2026-02-22T23:28:08.885 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.873+0000 7f2f26005640 1 -- --> v1:10.20.193.45:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2f200a2e90 con 0x7f2f2009e5d0 2026-02-22T23:28:08.885 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.873+0000 7f2f26005640 10 monclient(hunting): _renew_subs 2026-02-22T23:28:08.885 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.873+0000 7f2f26005640 10 monclient(hunting): authenticate will time out at 820.490530s 2026-02-22T23:28:08.885 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.873+0000 7f2f1f7fe640 1 --1- >> v1:10.20.193.45:6792/0 conn(0x7f2f2009e5d0 0x7f2f2009e9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.45:6792/0 says I am v1:10.20.193.45:36898/0 (socket says 10.20.193.45:36898) 2026-02-22T23:28:08.885 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.873+0000 7f2f1f7fe640 1 -- 10.20.193.45:0/479463920 learned_addr learned my addr 10.20.193.45:0/479463920 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-22T23:28:08.885 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.873+0000 7f2f1e7fc640 1 -- 10.20.193.45:0/479463920 <== mon.6 v1:10.20.193.45:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3505412802 0 0) 0x7f2f200a2e90 con 0x7f2f2009e5d0 2026-02-22T23:28:08.885 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.873+0000 7f2f1e7fc640 10 monclient(hunting): _negotiate 2026-02-22T23:28:08.885 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.873+0000 7f2f1e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:28:08.885 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.873+0000 7f2f1e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:28:08.885 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.873+0000 7f2f1e7fc640 10 monclient(hunting): my global_id is 114261 2026-02-22T23:28:08.885 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.873+0000 7f2f1e7fc640 1 -- 10.20.193.45:0/479463920 --> v1:10.20.193.45:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2f04003620 con 0x7f2f2009e5d0 2026-02-22T23:28:08.886 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.873+0000 7f2f1e7fc640 1 -- 10.20.193.45:0/479463920 <== mon.2 v1:10.20.193.45:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 224922162 0 0) 0x7f2f200a0560 con 0x7f2f2009f0c0 2026-02-22T23:28:08.886 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.873+0000 7f2f1e7fc640 10 monclient(hunting): _negotiate 2026-02-22T23:28:08.886 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.873+0000 7f2f1e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:28:08.886 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.873+0000 7f2f1e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:28:08.886 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.873+0000 7f2f1e7fc640 10 monclient(hunting): my global_id is 4781 2026-02-22T23:28:08.886 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.873+0000 7f2f1e7fc640 1 -- 10.20.193.45:0/479463920 --> v1:10.20.193.45:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2f200a2e90 con 0x7f2f2009f0c0 2026-02-22T23:28:08.886 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.873+0000 7f2f1e7fc640 1 -- 10.20.193.45:0/479463920 <== mon.6 v1:10.20.193.45:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2228546404 0 0) 0x7f2f04003620 con 0x7f2f2009e5d0 2026-02-22T23:28:08.886 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.873+0000 7f2f1e7fc640 1 -- 10.20.193.45:0/479463920 >> v1:10.20.193.73:6790/0 conn(0x7f2f2009f700 legacy=0x7f2f2013ac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T23:28:08.886 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.873+0000 7f2f1e7fc640 1 -- 10.20.193.45:0/479463920 >> v1:10.20.193.45:6790/0 conn(0x7f2f2009f0c0 legacy=0x7f2f2013e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:08.886 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.873+0000 7f2f1e7fc640 10 monclient: _finish_hunting 0 2026-02-22T23:28:08.886 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.873+0000 7f2f1e7fc640 1 monclient: found mon.noname-d 2026-02-22T23:28:08.886 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.873+0000 7f2f1e7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T23:28:08.887 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.873+0000 7f2f1e7fc640 10 monclient: _send_mon_message to mon.noname-d at v1:10.20.193.45:6792/0 2026-02-22T23:28:08.887 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.873+0000 7f2f1e7fc640 1 -- 10.20.193.45:0/479463920 --> v1:10.20.193.45:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f200a3130 con 0x7f2f2009e5d0 2026-02-22T23:28:08.887 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.873+0000 7f2f1e7fc640 10 monclient: _finish_auth 0 2026-02-22T23:28:08.887 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.873+0000 7f2f1e7fc640 10 monclient: _check_auth_tickets 2026-02-22T23:28:08.887 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.873+0000 7f2f1e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T23:28:08.887 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.873+0000 7f2f1e7fc640 1 -- 10.20.193.45:0/479463920 <== mon.6 v1:10.20.193.45:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f2f0c003040 con 0x7f2f2009e5d0 2026-02-22T23:28:08.887 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.873+0000 7f2f26005640 5 monclient: authenticate success, global_id 114261 2026-02-22T23:28:08.887 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.873+0000 7f2f26005640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-22T23:28:08.887 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.873+0000 7f2f1e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:28:08.887 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.873+0000 7f2f1e7fc640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2026-02-22T23:28:08.887 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.873+0000 7f2f1e7fc640 10 monclient: dump: 2026-02-22T23:28:08.887 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:28:08.887 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:28:08.888 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:08.888 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:08.888 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:28:08.888 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:28:08.888 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:28:08.888 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:28:08.888 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:28:08.888 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:28:08.888 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:28:08.888 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:28:08.888 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:28:08.888 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:28:08.888 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:28:08.889 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:08.889 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.873+0000 7f2f26005640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-22T23:28:08.889 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.873+0000 7f2f1e7fc640 1 -- 10.20.193.45:0/479463920 <== mon.6 v1:10.20.193.45:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2f0c0031e0 con 0x7f2f2009e5d0 2026-02-22T23:28:08.889 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.873+0000 7f2f1e7fc640 10 monclient: handle_config config(0 keys) 2026-02-22T23:28:08.889 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.873+0000 7f2f1e7fc640 1 -- 10.20.193.45:0/479463920 <== mon.6 v1:10.20.193.45:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f2f0c004ce0 con 0x7f2f2009e5d0 2026-02-22T23:28:08.889 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.873+0000 7f2f26005640 10 monclient: get_monmap_and_config success 2026-02-22T23:28:08.889 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.873+0000 7f2f26005640 4 set_mon_vals no callback set 2026-02-22T23:28:08.889 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.873+0000 7f2f1e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:28:08.889 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.873+0000 7f2f1e7fc640 10 monclient: got monmap 1 from mon.d (according to old e1) 2026-02-22T23:28:08.889 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.873+0000 7f2f1e7fc640 10 monclient: dump: 2026-02-22T23:28:08.889 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:28:08.889 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:28:08.890 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:08.890 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:08.890 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:28:08.890 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:28:08.890 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:28:08.890 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:28:08.890 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:28:08.890 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:28:08.890 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:28:08.890 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:28:08.890 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:28:08.890 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:28:08.890 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:28:08.891 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:08.891 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.874+0000 7f2f26005640 10 monclient: shutdown 2026-02-22T23:28:08.891 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.874+0000 7f2f26005640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T23:28:08.891 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.874+0000 7f2f26005640 1 -- 10.20.193.45:0/479463920 >> v1:10.20.193.45:6792/0 conn(0x7f2f2009e5d0 legacy=0x7f2f2009e9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:08.891 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.874+0000 7f2f26005640 1 -- 10.20.193.45:0/479463920 shutdown_connections 2026-02-22T23:28:08.891 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.874+0000 7f2f26005640 1 -- 10.20.193.45:0/479463920 >> 10.20.193.45:0/479463920 conn(0x7f2f200a7780 msgr2=0x7f2f200a3b60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:28:08.891 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.874+0000 7f2f26005640 1 -- 10.20.193.45:0/479463920 shutdown_connections 2026-02-22T23:28:08.891 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.874+0000 7f2f26005640 1 -- 10.20.193.45:0/479463920 wait complete. 2026-02-22T23:28:08.891 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.874+0000 7f2f26005640 10 monclient: build_initial_monmap 2026-02-22T23:28:08.891 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.874+0000 7f2f26005640 10 monclient: monmap: 2026-02-22T23:28:08.891 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-22T23:28:08.891 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T23:28:08.892 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-22T23:28:08.892 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-22T23:28:08.892 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-22T23:28:08.892 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-22T23:28:08.892 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-22T23:28:08.892 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.noname-f 2026-02-22T23:28:08.892 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.noname-b 2026-02-22T23:28:08.892 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.noname-g 2026-02-22T23:28:08.892 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.noname-c 2026-02-22T23:28:08.892 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.noname-h 2026-02-22T23:28:08.892 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.noname-d 2026-02-22T23:28:08.892 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.noname-i 2026-02-22T23:28:08.892 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.noname-e 2026-02-22T23:28:08.893 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:08.893 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.874+0000 7f2f26005640 1 Processor -- start 2026-02-22T23:28:08.893 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.874+0000 7f2f26005640 1 -- start start 2026-02-22T23:28:08.893 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.874+0000 7f2f26005640 10 monclient: init 2026-02-22T23:28:08.893 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.875+0000 7f2f26005640 10 monclient: _reopen_session rank -1 2026-02-22T23:28:08.893 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.875+0000 7f2f26005640 10 monclient: _add_conns ranks=[7,5,3,2,0,4,6,1,8] 2026-02-22T23:28:08.893 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.875+0000 7f2f26005640 10 monclient(hunting): picked mon.noname-i con 0x7f2f2009e5d0 addr v1:10.20.193.73:6792/0 2026-02-22T23:28:08.893 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.875+0000 7f2f26005640 10 monclient(hunting): picked mon.noname-h con 0x7f2f2009f0c0 addr v1:10.20.193.73:6791/0 2026-02-22T23:28:08.893 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.875+0000 7f2f26005640 10 monclient(hunting): picked mon.noname-g con 0x7f2f20127090 addr v1:10.20.193.73:6790/0 2026-02-22T23:28:08.893 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.875+0000 7f2f26005640 1 -- --> v1:10.20.193.73:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2f20129d60 con 0x7f2f20127090 2026-02-22T23:28:08.893 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.875+0000 7f2f26005640 1 -- --> v1:10.20.193.73:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2f201294c0 con 0x7f2f2009f0c0 2026-02-22T23:28:08.893 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.875+0000 7f2f26005640 1 -- --> v1:10.20.193.73:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2f201297a0 con 0x7f2f2009e5d0 2026-02-22T23:28:08.894 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.875+0000 7f2f26005640 10 monclient(hunting): _renew_subs 2026-02-22T23:28:08.894 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.875+0000 7f2f26005640 10 monclient(hunting): authenticate will time out at 820.492217s 2026-02-22T23:28:08.894 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.875+0000 7f2f1f7fe640 1 --1- >> v1:10.20.193.73:6792/0 conn(0x7f2f2009e5d0 0x7f2f20126270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.73:6792/0 says I am v1:10.20.193.45:33342/0 (socket says 10.20.193.45:33342) 2026-02-22T23:28:08.894 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.875+0000 7f2f1f7fe640 1 -- 10.20.193.45:0/4081520062 learned_addr learned my addr 10.20.193.45:0/4081520062 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-22T23:28:08.894 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.875+0000 7f2efbfff640 1 -- 10.20.193.45:0/4081520062 <== mon.5 v1:10.20.193.73:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 580142848 0 0) 0x7f2f201294c0 con 0x7f2f2009f0c0 2026-02-22T23:28:08.894 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.875+0000 7f2efbfff640 10 monclient(hunting): _negotiate 2026-02-22T23:28:08.894 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.875+0000 7f2efbfff640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:28:08.894 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.875+0000 7f2efbfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:28:08.894 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.875+0000 7f2efbfff640 10 monclient(hunting): my global_id is 114215 2026-02-22T23:28:08.894 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.875+0000 7f2efbfff640 1 -- 10.20.193.45:0/4081520062 --> v1:10.20.193.73:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2ef0003620 con 0x7f2f2009f0c0 2026-02-22T23:28:08.894 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.875+0000 7f2efbfff640 1 -- 10.20.193.45:0/4081520062 <== mon.3 v1:10.20.193.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1938855734 0 0) 0x7f2f20129d60 con 0x7f2f20127090 2026-02-22T23:28:08.894 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.875+0000 7f2efbfff640 10 monclient(hunting): _negotiate 2026-02-22T23:28:08.895 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.875+0000 7f2efbfff640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:28:08.895 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.875+0000 7f2efbfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:28:08.895 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.875+0000 7f2efbfff640 10 monclient(hunting): my global_id is 4674 2026-02-22T23:28:08.895 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.875+0000 7f2efbfff640 1 -- 10.20.193.45:0/4081520062 --> v1:10.20.193.73:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2f201294c0 con 0x7f2f20127090 2026-02-22T23:28:08.895 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.875+0000 7f2efbfff640 1 -- 10.20.193.45:0/4081520062 <== mon.7 v1:10.20.193.73:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 293831327 0 0) 0x7f2f201297a0 con 0x7f2f2009e5d0 2026-02-22T23:28:08.895 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.875+0000 7f2efbfff640 10 monclient(hunting): _negotiate 2026-02-22T23:28:08.895 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.875+0000 7f2efbfff640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:28:08.895 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.875+0000 7f2efbfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:28:08.895 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.875+0000 7f2efbfff640 10 monclient(hunting): my global_id is 4651 2026-02-22T23:28:08.895 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.875+0000 7f2efbfff640 1 -- 10.20.193.45:0/4081520062 --> v1:10.20.193.73:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2f20129d60 con 0x7f2f2009e5d0 2026-02-22T23:28:08.895 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.875+0000 7f2efbfff640 1 -- 10.20.193.45:0/4081520062 <== mon.5 v1:10.20.193.73:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 762729638 0 0) 0x7f2ef0003620 con 0x7f2f2009f0c0 2026-02-22T23:28:08.895 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.875+0000 7f2efbfff640 1 -- 10.20.193.45:0/4081520062 --> v1:10.20.193.73:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2f201297a0 con 0x7f2f2009f0c0 2026-02-22T23:28:08.895 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.875+0000 7f2efbfff640 1 -- 10.20.193.45:0/4081520062 <== mon.5 v1:10.20.193.73:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f2f10003120 con 0x7f2f2009f0c0 2026-02-22T23:28:08.896 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.875+0000 7f2efbfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-22T23:28:08.896 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.875+0000 7f2efbfff640 10 monclient(hunting): got monmap 1 from mon.noname-h (according to old e1) 2026-02-22T23:28:08.896 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.875+0000 7f2efbfff640 10 monclient(hunting): dump: 2026-02-22T23:28:08.896 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:28:08.896 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:28:08.896 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:08.896 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:08.896 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:28:08.896 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:28:08.896 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:28:08.896 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:28:08.896 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:28:08.896 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:28:08.897 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:28:08.897 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:28:08.897 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:28:08.897 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:28:08.897 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:28:08.897 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:08.897 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.875+0000 7f2efbfff640 10 monclient(hunting): _finish_auth 0 2026-02-22T23:28:08.897 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.875+0000 7f2efbfff640 1 -- 10.20.193.45:0/4081520062 <== mon.3 v1:10.20.193.73:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3607572060 0 0) 0x7f2f201294c0 con 0x7f2f20127090 2026-02-22T23:28:08.897 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.875+0000 7f2efbfff640 1 -- 10.20.193.45:0/4081520062 --> v1:10.20.193.73:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2ef0003620 con 0x7f2f20127090 2026-02-22T23:28:08.897 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.875+0000 7f2efbfff640 1 -- 10.20.193.45:0/4081520062 <== mon.3 v1:10.20.193.73:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f2f14003620 con 0x7f2f20127090 2026-02-22T23:28:08.897 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.875+0000 7f2efbfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-22T23:28:08.897 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.875+0000 7f2efbfff640 10 monclient(hunting): got monmap 1 from mon.g (according to old e1) 2026-02-22T23:28:08.898 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.875+0000 7f2efbfff640 10 monclient(hunting): dump: 2026-02-22T23:28:08.898 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:28:08.898 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:28:08.898 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:08.898 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:08.898 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:28:08.898 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:28:08.898 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:28:08.898 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:28:08.898 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:28:08.898 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:28:08.898 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:28:08.898 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:28:08.899 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:28:08.899 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:28:08.899 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:28:08.899 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:08.899 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.875+0000 7f2efbfff640 1 -- 10.20.193.45:0/4081520062 <== mon.5 v1:10.20.193.73:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 939003144 0 0) 0x7f2f201297a0 con 0x7f2f2009f0c0 2026-02-22T23:28:08.899 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.875+0000 7f2efbfff640 1 -- 10.20.193.45:0/4081520062 >> v1:10.20.193.73:6792/0 conn(0x7f2f2009e5d0 legacy=0x7f2f20126270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:08.899 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.875+0000 7f2efbfff640 1 -- 10.20.193.45:0/4081520062 >> v1:10.20.193.73:6790/0 conn(0x7f2f20127090 legacy=0x7f2f201d7a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:08.899 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.876+0000 7f2efbfff640 10 monclient: _finish_hunting 0 2026-02-22T23:28:08.899 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.876+0000 7f2efbfff640 1 monclient: found mon.h 2026-02-22T23:28:08.899 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.876+0000 7f2efbfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T23:28:08.899 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.876+0000 7f2efbfff640 10 monclient: _send_mon_message to mon.h at v1:10.20.193.73:6791/0 2026-02-22T23:28:08.899 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.876+0000 7f2efbfff640 1 -- 10.20.193.45:0/4081520062 --> v1:10.20.193.73:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f20136590 con 0x7f2f2009f0c0 2026-02-22T23:28:08.900 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.876+0000 7f2efbfff640 10 monclient: _finish_auth 0 2026-02-22T23:28:08.900 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.876+0000 7f2efbfff640 10 monclient: _check_auth_tickets 2026-02-22T23:28:08.900 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.876+0000 7f2efbfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T23:28:08.900 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.876+0000 7f2f26005640 5 monclient: authenticate success, global_id 114215 2026-02-22T23:28:08.900 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.876+0000 7f2f26005640 10 monclient: _renew_subs 2026-02-22T23:28:08.900 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.876+0000 7f2f26005640 10 monclient: _send_mon_message to mon.h at v1:10.20.193.73:6791/0 2026-02-22T23:28:08.900 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.876+0000 7f2f26005640 1 -- 10.20.193.45:0/4081520062 --> v1:10.20.193.73:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f2f20127a40 con 0x7f2f2009f0c0 2026-02-22T23:28:08.900 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.876+0000 7f2f26005640 10 monclient: _renew_subs 2026-02-22T23:28:08.900 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.876+0000 7f2f26005640 10 monclient: _send_mon_message to mon.h at v1:10.20.193.73:6791/0 2026-02-22T23:28:08.900 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.876+0000 7f2f26005640 1 -- 10.20.193.45:0/4081520062 --> v1:10.20.193.73:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7f2f201d9320 con 0x7f2f2009f0c0 2026-02-22T23:28:08.900 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.876+0000 7f2efbfff640 1 -- 10.20.193.45:0/4081520062 <== mon.5 v1:10.20.193.73:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2f10003670 con 0x7f2f2009f0c0 2026-02-22T23:28:08.900 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.876+0000 7f2efbfff640 10 monclient: handle_config config(0 keys) 2026-02-22T23:28:08.900 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.876+0000 7f2efbfff640 1 -- 10.20.193.45:0/4081520062 <== mon.5 v1:10.20.193.73:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f2f10003ba0 con 0x7f2f2009f0c0 2026-02-22T23:28:08.901 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.876+0000 7f2efbfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:28:08.901 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.876+0000 7f2f1dffb640 4 set_mon_vals no callback set 2026-02-22T23:28:08.901 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.876+0000 7f2efbfff640 10 monclient: got monmap 1 from mon.h (according to old e1) 2026-02-22T23:28:08.901 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.876+0000 7f2efbfff640 10 monclient: dump: 2026-02-22T23:28:08.901 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:28:08.901 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:28:08.901 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:08.901 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:08.901 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:28:08.901 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:28:08.901 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:28:08.901 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:28:08.901 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:28:08.902 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:28:08.902 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:28:08.902 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:28:08.902 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:28:08.902 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:28:08.902 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:28:08.902 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:08.902 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.876+0000 7f2f26005640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T23:28:08.902 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.876+0000 7f2f26005640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T23:28:08.902 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.876+0000 7f2f26005640 10 monclient: _send_mon_message to mon.h at v1:10.20.193.73:6791/0 2026-02-22T23:28:08.902 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.876+0000 7f2f26005640 1 -- 10.20.193.45:0/4081520062 --> v1:10.20.193.73:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f200a0560 con 0x7f2f2009f0c0 2026-02-22T23:28:08.902 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.876+0000 7f2efbfff640 1 -- 10.20.193.45:0/4081520062 <== mon.5 v1:10.20.193.73:6791/0 7 ==== mgrmap(e 5) ==== 50225+0+0 (unknown 2330357642 0 0) 0x7f2f10010180 con 0x7f2f2009f0c0 2026-02-22T23:28:08.903 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.877+0000 7f2efbfff640 1 -- 10.20.193.45:0/4081520062 <== mon.5 v1:10.20.193.73:6791/0 8 ==== osd_map(25..25 src has 1..25) ==== 3502+0+0 (unknown 129690100 0 0) 0x7f2f1004c8a0 con 0x7f2f2009f0c0 2026-02-22T23:28:08.903 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.877+0000 7f2f1f7fe640 10 monclient: get_auth_request con 0x7f2ef003fd80 auth_method 0 2026-02-22T23:28:08.903 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.879+0000 7f2efbfff640 1 -- 10.20.193.45:0/4081520062 <== mon.5 v1:10.20.193.73:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (unknown 1092875540 0 2568732696) 0x7f2f200a0560 con 0x7f2f2009f0c0 2026-02-22T23:28:08.903 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.879+0000 7f2efbfff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T23:28:08.903 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.879+0000 7f2efbfff640 10 monclient: _finish_command 1 = system:0 2026-02-22T23:28:08.963 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.962+0000 7f2f26005640 1 -- 10.20.193.45:0/4081520062 --> v1:10.20.193.73:6800/2222410180 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7f2f2009deb0 con 0x7f2ef003fd80 2026-02-22T23:28:08.964 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.962+0000 7f2efbfff640 1 -- 10.20.193.45:0/4081520062 <== mgr.4111 v1:10.20.193.73:6800/2222410180 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (unknown 3526570807 0 0) 0x7f2f2009deb0 con 0x7f2ef003fd80 2026-02-22T23:28:08.964 INFO:teuthology.orchestra.run.trial045.stderr:instructed osd(s) 3 to deep-scrub 2026-02-22T23:28:08.965 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.963+0000 7f2f26005640 1 -- 10.20.193.45:0/4081520062 >> v1:10.20.193.73:6800/2222410180 conn(0x7f2ef003fd80 legacy=0x7f2ef0042240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:08.965 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.963+0000 7f2f26005640 10 monclient: shutdown 2026-02-22T23:28:08.965 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.963+0000 7f2f26005640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T23:28:08.965 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.963+0000 7f2f26005640 1 -- 10.20.193.45:0/4081520062 >> v1:10.20.193.73:6791/0 conn(0x7f2f2009f0c0 legacy=0x7f2f20126980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:08.965 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.963+0000 7f2f26005640 1 -- 10.20.193.45:0/4081520062 shutdown_connections 2026-02-22T23:28:08.965 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.963+0000 7f2f26005640 1 -- 10.20.193.45:0/4081520062 >> 10.20.193.45:0/4081520062 conn(0x7f2f200a7780 msgr2=0x7f2f200a5780 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:28:08.965 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.963+0000 7f2f26005640 1 -- 10.20.193.45:0/4081520062 shutdown_connections 2026-02-22T23:28:08.965 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:08.963+0000 7f2f26005640 1 -- 10.20.193.45:0/4081520062 wait complete. 2026-02-22T23:28:08.972 INFO:tasks.ceph:Scrubbing osd.4 2026-02-22T23:28:08.973 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2026-02-22T23:28:09.043 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.042+0000 7f88f93d3640 10 monclient: get_monmap_and_config 2026-02-22T23:28:09.044 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.042+0000 7f88f93d3640 10 monclient: build_initial_monmap 2026-02-22T23:28:09.044 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.042+0000 7f88f93d3640 10 monclient: monmap: 2026-02-22T23:28:09.044 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-22T23:28:09.044 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:28:09.044 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:28:09.043634+0000 2026-02-22T23:28:09.044 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:28:09.043634+0000 2026-02-22T23:28:09.044 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-22T23:28:09.044 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:28:09.044 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-22T23:28:09.045 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.noname-f 2026-02-22T23:28:09.045 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.noname-b 2026-02-22T23:28:09.045 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.noname-g 2026-02-22T23:28:09.045 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.noname-c 2026-02-22T23:28:09.045 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.noname-h 2026-02-22T23:28:09.045 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.noname-d 2026-02-22T23:28:09.045 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.noname-i 2026-02-22T23:28:09.045 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.noname-e 2026-02-22T23:28:09.045 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:09.053 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.042+0000 7f88f93d3640 1 Processor -- start 2026-02-22T23:28:09.053 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.042+0000 7f88f93d3640 1 -- start start 2026-02-22T23:28:09.053 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.042+0000 7f88f93d3640 10 monclient: init 2026-02-22T23:28:09.053 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.043+0000 7f88f93d3640 10 monclient: _reopen_session rank -1 2026-02-22T23:28:09.053 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.043+0000 7f88f93d3640 10 monclient: _add_conns ranks=[6,1,2,4,3,7,0,8,5] 2026-02-22T23:28:09.053 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.043+0000 7f88f93d3640 10 monclient(hunting): picked mon.noname-d con 0x7f88f4138ae0 addr v1:10.20.193.45:6792/0 2026-02-22T23:28:09.053 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.043+0000 7f88f93d3640 10 monclient(hunting): picked mon.noname-f con 0x7f88f41395d0 addr v1:10.20.193.73:6789/0 2026-02-22T23:28:09.053 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.043+0000 7f88f93d3640 10 monclient(hunting): picked mon.noname-b con 0x7f88f40a3e20 addr v1:10.20.193.45:6790/0 2026-02-22T23:28:09.054 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.043+0000 7f88f93d3640 1 -- --> v1:10.20.193.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f88f40745c0 con 0x7f88f41395d0 2026-02-22T23:28:09.054 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.043+0000 7f88f93d3640 1 -- --> v1:10.20.193.45:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f88f40a2b90 con 0x7f88f40a3e20 2026-02-22T23:28:09.054 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.043+0000 7f88f93d3640 1 -- --> v1:10.20.193.45:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f88f40a3150 con 0x7f88f4138ae0 2026-02-22T23:28:09.054 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.043+0000 7f88f93d3640 10 monclient(hunting): _renew_subs 2026-02-22T23:28:09.054 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.043+0000 7f88f93d3640 10 monclient(hunting): authenticate will time out at 820.660223s 2026-02-22T23:28:09.054 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.043+0000 7f88f2ffd640 1 --1- >> v1:10.20.193.45:6792/0 conn(0x7f88f4138ae0 0x7f88f4138ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.45:6792/0 says I am v1:10.20.193.45:36910/0 (socket says 10.20.193.45:36910) 2026-02-22T23:28:09.054 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.043+0000 7f88f37fe640 1 --1- >> v1:10.20.193.45:6790/0 conn(0x7f88f40a3e20 0x7f88f4141660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.45:6790/0 says I am v1:10.20.193.45:60238/0 (socket says 10.20.193.45:60238) 2026-02-22T23:28:09.054 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.043+0000 7f88f2ffd640 1 -- 10.20.193.45:0/3809361036 learned_addr learned my addr 10.20.193.45:0/3809361036 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-22T23:28:09.054 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.043+0000 7f88f1ffb640 1 -- 10.20.193.45:0/3809361036 <== mon.6 v1:10.20.193.45:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 229000555 0 0) 0x7f88f40a3150 con 0x7f88f4138ae0 2026-02-22T23:28:09.054 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.043+0000 7f88f1ffb640 10 monclient(hunting): _negotiate 2026-02-22T23:28:09.054 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.043+0000 7f88f1ffb640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:28:09.055 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.043+0000 7f88f1ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:28:09.055 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.043+0000 7f88f1ffb640 10 monclient(hunting): my global_id is 114270 2026-02-22T23:28:09.055 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.043+0000 7f88f1ffb640 1 -- 10.20.193.45:0/3809361036 --> v1:10.20.193.45:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f88e0003620 con 0x7f88f4138ae0 2026-02-22T23:28:09.055 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.043+0000 7f88f1ffb640 1 -- 10.20.193.45:0/3809361036 <== mon.2 v1:10.20.193.45:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1804153022 0 0) 0x7f88f40a2b90 con 0x7f88f40a3e20 2026-02-22T23:28:09.055 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.043+0000 7f88f1ffb640 10 monclient(hunting): _negotiate 2026-02-22T23:28:09.055 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.043+0000 7f88f1ffb640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:28:09.055 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.043+0000 7f88f1ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:28:09.055 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.043+0000 7f88f1ffb640 10 monclient(hunting): my global_id is 4790 2026-02-22T23:28:09.055 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.043+0000 7f88f1ffb640 1 -- 10.20.193.45:0/3809361036 --> v1:10.20.193.45:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f88f40a3150 con 0x7f88f40a3e20 2026-02-22T23:28:09.055 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.043+0000 7f88f1ffb640 1 -- 10.20.193.45:0/3809361036 <== mon.6 v1:10.20.193.45:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1623969852 0 0) 0x7f88e0003620 con 0x7f88f4138ae0 2026-02-22T23:28:09.055 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.043+0000 7f88f1ffb640 1 -- 10.20.193.45:0/3809361036 >> v1:10.20.193.45:6790/0 conn(0x7f88f40a3e20 legacy=0x7f88f4141660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:09.055 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.043+0000 7f88f1ffb640 1 -- 10.20.193.45:0/3809361036 >> v1:10.20.193.73:6789/0 conn(0x7f88f41395d0 legacy=0x7f88f413df30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:09.056 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.043+0000 7f88f1ffb640 10 monclient: _finish_hunting 0 2026-02-22T23:28:09.056 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.043+0000 7f88f1ffb640 1 monclient: found mon.noname-d 2026-02-22T23:28:09.056 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.043+0000 7f88f1ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T23:28:09.056 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.043+0000 7f88f1ffb640 10 monclient: _send_mon_message to mon.noname-d at v1:10.20.193.45:6792/0 2026-02-22T23:28:09.056 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.043+0000 7f88f1ffb640 1 -- 10.20.193.45:0/3809361036 --> v1:10.20.193.45:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88f40a7000 con 0x7f88f4138ae0 2026-02-22T23:28:09.056 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.043+0000 7f88f1ffb640 10 monclient: _finish_auth 0 2026-02-22T23:28:09.056 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.043+0000 7f88f1ffb640 10 monclient: _check_auth_tickets 2026-02-22T23:28:09.056 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.043+0000 7f88f1ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T23:28:09.056 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.043+0000 7f88f1ffb640 1 -- 10.20.193.45:0/3809361036 <== mon.6 v1:10.20.193.45:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f88e8003040 con 0x7f88f4138ae0 2026-02-22T23:28:09.056 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.043+0000 7f88f93d3640 5 monclient: authenticate success, global_id 114270 2026-02-22T23:28:09.056 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.043+0000 7f88f93d3640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-22T23:28:09.056 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.043+0000 7f88f1ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:28:09.056 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.043+0000 7f88f1ffb640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2026-02-22T23:28:09.057 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.043+0000 7f88f1ffb640 10 monclient: dump: 2026-02-22T23:28:09.057 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:28:09.057 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:28:09.057 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:09.057 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:09.057 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:28:09.057 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:28:09.057 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:28:09.057 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:28:09.057 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:28:09.057 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:28:09.057 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:28:09.058 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:28:09.058 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:28:09.058 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:28:09.058 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:28:09.058 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:09.058 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.043+0000 7f88f93d3640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-22T23:28:09.058 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.043+0000 7f88f1ffb640 1 -- 10.20.193.45:0/3809361036 <== mon.6 v1:10.20.193.45:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f88e80031e0 con 0x7f88f4138ae0 2026-02-22T23:28:09.058 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.043+0000 7f88f1ffb640 10 monclient: handle_config config(0 keys) 2026-02-22T23:28:09.058 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.043+0000 7f88f1ffb640 1 -- 10.20.193.45:0/3809361036 <== mon.6 v1:10.20.193.45:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f88e8004ce0 con 0x7f88f4138ae0 2026-02-22T23:28:09.058 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.043+0000 7f88f93d3640 10 monclient: get_monmap_and_config success 2026-02-22T23:28:09.058 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.043+0000 7f88f93d3640 4 set_mon_vals no callback set 2026-02-22T23:28:09.059 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.043+0000 7f88f1ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:28:09.059 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.043+0000 7f88f1ffb640 10 monclient: got monmap 1 from mon.d (according to old e1) 2026-02-22T23:28:09.059 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.043+0000 7f88f1ffb640 10 monclient: dump: 2026-02-22T23:28:09.059 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:28:09.059 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:28:09.059 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:09.059 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:09.060 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:28:09.060 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:28:09.060 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:28:09.060 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:28:09.060 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:28:09.060 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:28:09.061 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:28:09.061 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:28:09.061 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:28:09.061 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:28:09.061 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:28:09.061 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:09.062 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.044+0000 7f88f93d3640 10 monclient: shutdown 2026-02-22T23:28:09.062 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.044+0000 7f88f93d3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T23:28:09.062 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.044+0000 7f88f93d3640 1 -- 10.20.193.45:0/3809361036 >> v1:10.20.193.45:6792/0 conn(0x7f88f4138ae0 legacy=0x7f88f4138ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:09.062 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.044+0000 7f88f93d3640 1 -- 10.20.193.45:0/3809361036 shutdown_connections 2026-02-22T23:28:09.062 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.044+0000 7f88f93d3640 1 -- 10.20.193.45:0/3809361036 >> 10.20.193.45:0/3809361036 conn(0x7f88f40a8000 msgr2=0x7f88f40a8410 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:28:09.062 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.044+0000 7f88f93d3640 1 -- 10.20.193.45:0/3809361036 shutdown_connections 2026-02-22T23:28:09.062 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.044+0000 7f88f93d3640 1 -- 10.20.193.45:0/3809361036 wait complete. 2026-02-22T23:28:09.063 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.044+0000 7f88f93d3640 10 monclient: build_initial_monmap 2026-02-22T23:28:09.063 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.044+0000 7f88f93d3640 10 monclient: monmap: 2026-02-22T23:28:09.063 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-22T23:28:09.063 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T23:28:09.063 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-22T23:28:09.063 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-22T23:28:09.063 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-22T23:28:09.063 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-22T23:28:09.063 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-22T23:28:09.063 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.noname-f 2026-02-22T23:28:09.063 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.noname-b 2026-02-22T23:28:09.063 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.noname-g 2026-02-22T23:28:09.064 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.noname-c 2026-02-22T23:28:09.064 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.noname-h 2026-02-22T23:28:09.064 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.noname-d 2026-02-22T23:28:09.064 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.noname-i 2026-02-22T23:28:09.064 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.noname-e 2026-02-22T23:28:09.064 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:09.064 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.044+0000 7f88f93d3640 1 Processor -- start 2026-02-22T23:28:09.064 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.044+0000 7f88f93d3640 1 -- start start 2026-02-22T23:28:09.064 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.044+0000 7f88f93d3640 10 monclient: init 2026-02-22T23:28:09.065 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.044+0000 7f88f93d3640 10 monclient: _reopen_session rank -1 2026-02-22T23:28:09.065 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.044+0000 7f88f93d3640 10 monclient: _add_conns ranks=[0,4,7,1,5,6,2,3,8] 2026-02-22T23:28:09.065 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.044+0000 7f88f93d3640 10 monclient(hunting): picked mon.noname-a con 0x7f88f40a3e20 addr v1:10.20.193.45:6789/0 2026-02-22T23:28:09.065 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.044+0000 7f88f93d3640 10 monclient(hunting): picked mon.noname-c con 0x7f88f4138ae0 addr v1:10.20.193.45:6791/0 2026-02-22T23:28:09.065 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.044+0000 7f88f93d3640 10 monclient(hunting): picked mon.noname-i con 0x7f88f41395d0 addr v1:10.20.193.73:6792/0 2026-02-22T23:28:09.065 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.044+0000 7f88f93d3640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f88f413a230 con 0x7f88f40a3e20 2026-02-22T23:28:09.066 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.044+0000 7f88f93d3640 1 -- --> v1:10.20.193.45:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f88f4137830 con 0x7f88f4138ae0 2026-02-22T23:28:09.066 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.044+0000 7f88f93d3640 1 -- --> v1:10.20.193.73:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f88f41425a0 con 0x7f88f41395d0 2026-02-22T23:28:09.066 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.044+0000 7f88f93d3640 10 monclient(hunting): _renew_subs 2026-02-22T23:28:09.066 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.044+0000 7f88f93d3640 10 monclient(hunting): authenticate will time out at 820.661882s 2026-02-22T23:28:09.066 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.044+0000 7f88f2ffd640 1 --1- >> v1:10.20.193.45:6789/0 conn(0x7f88f40a3e20 0x7f88f4135000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.45:6789/0 says I am v1:10.20.193.45:38492/0 (socket says 10.20.193.45:38492) 2026-02-22T23:28:09.066 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.044+0000 7f88f2ffd640 1 -- 10.20.193.45:0/4073178854 learned_addr learned my addr 10.20.193.45:0/4073178854 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-22T23:28:09.067 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.045+0000 7f88d37fe640 1 -- 10.20.193.45:0/4073178854 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1164561181 0 0) 0x7f88f413a230 con 0x7f88f40a3e20 2026-02-22T23:28:09.067 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.045+0000 7f88d37fe640 10 monclient(hunting): _negotiate 2026-02-22T23:28:09.067 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.045+0000 7f88d37fe640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:28:09.067 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.045+0000 7f88d37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:28:09.067 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.045+0000 7f88d37fe640 10 monclient(hunting): my global_id is 4689 2026-02-22T23:28:09.067 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.045+0000 7f88d37fe640 1 -- 10.20.193.45:0/4073178854 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f88c0003620 con 0x7f88f40a3e20 2026-02-22T23:28:09.067 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.045+0000 7f88d37fe640 1 -- 10.20.193.45:0/4073178854 <== mon.4 v1:10.20.193.45:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2992422037 0 0) 0x7f88f4137830 con 0x7f88f4138ae0 2026-02-22T23:28:09.067 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.045+0000 7f88d37fe640 10 monclient(hunting): _negotiate 2026-02-22T23:28:09.068 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.045+0000 7f88d37fe640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:28:09.068 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.045+0000 7f88d37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:28:09.068 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.045+0000 7f88d37fe640 10 monclient(hunting): my global_id is 114268 2026-02-22T23:28:09.068 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.045+0000 7f88d37fe640 1 -- 10.20.193.45:0/4073178854 --> v1:10.20.193.45:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f88f413a230 con 0x7f88f4138ae0 2026-02-22T23:28:09.068 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.045+0000 7f88d37fe640 1 -- 10.20.193.45:0/4073178854 <== mon.4 v1:10.20.193.45:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 635748203 0 0) 0x7f88f413a230 con 0x7f88f4138ae0 2026-02-22T23:28:09.068 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.045+0000 7f88d37fe640 1 -- 10.20.193.45:0/4073178854 --> v1:10.20.193.45:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f88f4137830 con 0x7f88f4138ae0 2026-02-22T23:28:09.068 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.045+0000 7f88d37fe640 1 -- 10.20.193.45:0/4073178854 <== mon.0 v1:10.20.193.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 870538201 0 0) 0x7f88c0003620 con 0x7f88f40a3e20 2026-02-22T23:28:09.068 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.045+0000 7f88d37fe640 1 -- 10.20.193.45:0/4073178854 --> v1:10.20.193.45:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f88f413a230 con 0x7f88f40a3e20 2026-02-22T23:28:09.068 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.045+0000 7f88d37fe640 1 -- 10.20.193.45:0/4073178854 <== mon.4 v1:10.20.193.45:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f88dc003200 con 0x7f88f4138ae0 2026-02-22T23:28:09.068 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.045+0000 7f88d37fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-22T23:28:09.068 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.045+0000 7f88d37fe640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-22T23:28:09.068 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.045+0000 7f88d37fe640 10 monclient(hunting): dump: 2026-02-22T23:28:09.068 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:28:09.069 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:28:09.069 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:09.069 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:09.069 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:28:09.069 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:28:09.069 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:28:09.069 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:28:09.069 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:28:09.069 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:28:09.069 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:28:09.069 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:28:09.069 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:28:09.069 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:28:09.070 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:28:09.070 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:09.070 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.045+0000 7f88d37fe640 10 monclient(hunting): _finish_auth 0 2026-02-22T23:28:09.070 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.045+0000 7f88d37fe640 1 -- 10.20.193.45:0/4073178854 <== mon.7 v1:10.20.193.73:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1874280513 0 0) 0x7f88f41425a0 con 0x7f88f41395d0 2026-02-22T23:28:09.070 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.045+0000 7f88d37fe640 10 monclient(hunting): _negotiate 2026-02-22T23:28:09.070 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.045+0000 7f88d37fe640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:28:09.070 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.045+0000 7f88d37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:28:09.070 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.045+0000 7f88d37fe640 10 monclient(hunting): my global_id is 4660 2026-02-22T23:28:09.070 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.045+0000 7f88d37fe640 1 -- 10.20.193.45:0/4073178854 --> v1:10.20.193.73:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f88c0003620 con 0x7f88f41395d0 2026-02-22T23:28:09.070 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.045+0000 7f88d37fe640 1 -- 10.20.193.45:0/4073178854 <== mon.0 v1:10.20.193.45:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f88e8003040 con 0x7f88f40a3e20 2026-02-22T23:28:09.070 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.045+0000 7f88d37fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-22T23:28:09.070 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.045+0000 7f88d37fe640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-22T23:28:09.071 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.045+0000 7f88d37fe640 10 monclient(hunting): dump: 2026-02-22T23:28:09.071 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:28:09.071 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:28:09.071 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:09.071 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:09.071 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:28:09.071 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:28:09.071 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:28:09.071 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:28:09.071 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:28:09.071 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:28:09.071 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:28:09.071 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:28:09.072 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:28:09.072 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:28:09.072 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:28:09.072 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:09.072 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.045+0000 7f88d37fe640 1 -- 10.20.193.45:0/4073178854 <== mon.4 v1:10.20.193.45:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1156632257 0 0) 0x7f88f4137830 con 0x7f88f4138ae0 2026-02-22T23:28:09.072 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.045+0000 7f88d37fe640 1 -- 10.20.193.45:0/4073178854 >> v1:10.20.193.73:6792/0 conn(0x7f88f41395d0 legacy=0x7f88f41d7d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:09.072 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.045+0000 7f88d37fe640 1 -- 10.20.193.45:0/4073178854 >> v1:10.20.193.45:6789/0 conn(0x7f88f40a3e20 legacy=0x7f88f4135000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:09.072 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.045+0000 7f88d37fe640 10 monclient: _finish_hunting 0 2026-02-22T23:28:09.072 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.045+0000 7f88d37fe640 1 monclient: found mon.c 2026-02-22T23:28:09.072 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.045+0000 7f88d37fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T23:28:09.072 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.045+0000 7f88d37fe640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.45:6791/0 2026-02-22T23:28:09.072 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.045+0000 7f88d37fe640 1 -- 10.20.193.45:0/4073178854 --> v1:10.20.193.45:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88f40a8670 con 0x7f88f4138ae0 2026-02-22T23:28:09.073 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.045+0000 7f88d37fe640 10 monclient: _finish_auth 0 2026-02-22T23:28:09.073 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.045+0000 7f88d37fe640 10 monclient: _check_auth_tickets 2026-02-22T23:28:09.073 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.045+0000 7f88d37fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T23:28:09.073 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.045+0000 7f88f93d3640 5 monclient: authenticate success, global_id 114268 2026-02-22T23:28:09.073 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.045+0000 7f88f93d3640 10 monclient: _renew_subs 2026-02-22T23:28:09.073 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.045+0000 7f88f93d3640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.45:6791/0 2026-02-22T23:28:09.073 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.045+0000 7f88f93d3640 1 -- 10.20.193.45:0/4073178854 --> v1:10.20.193.45:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f88f4139f50 con 0x7f88f4138ae0 2026-02-22T23:28:09.073 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.045+0000 7f88d37fe640 1 -- 10.20.193.45:0/4073178854 <== mon.4 v1:10.20.193.45:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f88dc004570 con 0x7f88f4138ae0 2026-02-22T23:28:09.073 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.045+0000 7f88d37fe640 10 monclient: handle_config config(0 keys) 2026-02-22T23:28:09.073 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.045+0000 7f88f93d3640 10 monclient: _renew_subs 2026-02-22T23:28:09.073 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.045+0000 7f88d37fe640 1 -- 10.20.193.45:0/4073178854 <== mon.4 v1:10.20.193.45:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f88dc003a50 con 0x7f88f4138ae0 2026-02-22T23:28:09.073 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.045+0000 7f88f93d3640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.45:6791/0 2026-02-22T23:28:09.073 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.045+0000 7f88f93d3640 1 -- 10.20.193.45:0/4073178854 --> v1:10.20.193.45:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7f88f4140da0 con 0x7f88f4138ae0 2026-02-22T23:28:09.074 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.045+0000 7f88f17fa640 4 set_mon_vals no callback set 2026-02-22T23:28:09.074 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.045+0000 7f88d37fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:28:09.074 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.045+0000 7f88d37fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T23:28:09.074 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.045+0000 7f88d37fe640 10 monclient: dump: 2026-02-22T23:28:09.074 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:28:09.074 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:28:09.074 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:09.074 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:09.074 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:28:09.074 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:28:09.074 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:28:09.074 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:28:09.074 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:28:09.075 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:28:09.075 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:28:09.075 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:28:09.075 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:28:09.075 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:28:09.075 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:28:09.075 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:09.075 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.045+0000 7f88f93d3640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.45:6791/0 2026-02-22T23:28:09.075 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.045+0000 7f88f93d3640 1 -- 10.20.193.45:0/4073178854 --> v1:10.20.193.45:6791/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f88f4135e80 con 0x7f88f4138ae0 2026-02-22T23:28:09.075 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.045+0000 7f88d37fe640 1 -- 10.20.193.45:0/4073178854 <== mon.4 v1:10.20.193.45:6791/0 7 ==== mgrmap(e 5) ==== 50225+0+0 (unknown 2330357642 0 0) 0x7f88dc003bf0 con 0x7f88f4138ae0 2026-02-22T23:28:09.075 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.046+0000 7f88d37fe640 1 -- 10.20.193.45:0/4073178854 <== mon.4 v1:10.20.193.45:6791/0 8 ==== osd_map(25..25 src has 1..25) ==== 3502+0+0 (unknown 129690100 0 0) 0x7f88dc04c9a0 con 0x7f88f4138ae0 2026-02-22T23:28:09.076 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.046+0000 7f88d37fe640 1 -- 10.20.193.45:0/4073178854 --> v1:10.20.193.73:6801/3756325394 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f88c004a8c0 con 0x7f88c0046c50 2026-02-22T23:28:09.076 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.046+0000 7f88d37fe640 1 -- 10.20.193.45:0/4073178854 <== mon.4 v1:10.20.193.45:6791/0 9 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (unknown 2663167439 0 0) 0x7f88dc04ce10 con 0x7f88f4138ae0 2026-02-22T23:28:09.076 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.046+0000 7f88d37fe640 10 monclient: handle_get_version_reply finishing 1 version 25 2026-02-22T23:28:09.076 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.046+0000 7f88f2ffd640 10 monclient: get_auth_request con 0x7f88c0040050 auth_method 0 2026-02-22T23:28:09.076 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.046+0000 7f88f37fe640 10 monclient: get_auth_request con 0x7f88c0046c50 auth_method 0 2026-02-22T23:28:09.076 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.047+0000 7f88d37fe640 1 -- 10.20.193.45:0/4073178854 <== osd.4 v1:10.20.193.73:6801/3756325394 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (unknown 0 0 3365489958) 0x7f88c004a8c0 con 0x7f88c0046c50 2026-02-22T23:28:09.078 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.052+0000 7f88f93d3640 1 -- 10.20.193.45:0/4073178854 --> v1:10.20.193.73:6801/3756325394 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f88f40a2e70 con 0x7f88c0046c50 2026-02-22T23:28:09.078 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.053+0000 7f88d37fe640 1 -- 10.20.193.45:0/4073178854 <== osd.4 v1:10.20.193.73:6801/3756325394 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (unknown 0 0 119112422) 0x7f88e4002da0 con 0x7f88c0046c50 2026-02-22T23:28:09.079 INFO:teuthology.orchestra.run.trial045.stdout:{ 2026-02-22T23:28:09.080 INFO:teuthology.orchestra.run.trial045.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-22T23:28:09.080 INFO:teuthology.orchestra.run.trial045.stdout:} 2026-02-22T23:28:09.083 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.053+0000 7f88f93d3640 1 -- 10.20.193.45:0/4073178854 >> v1:10.20.193.73:6801/3756325394 conn(0x7f88c0046c50 legacy=0x7f88c0049070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:09.084 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.053+0000 7f88f93d3640 1 -- 10.20.193.45:0/4073178854 >> v1:10.20.193.73:6800/2222410180 conn(0x7f88c0040050 legacy=0x7f88c0042510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:09.084 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.053+0000 7f88f93d3640 10 monclient: shutdown 2026-02-22T23:28:09.084 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.053+0000 7f88f93d3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T23:28:09.084 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.053+0000 7f88f93d3640 1 -- 10.20.193.45:0/4073178854 >> v1:10.20.193.45:6791/0 conn(0x7f88f4138ae0 legacy=0x7f88f4135710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:09.084 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.053+0000 7f88f37fe640 1 -- 10.20.193.45:0/4073178854 reap_dead start 2026-02-22T23:28:09.084 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.053+0000 7f88f93d3640 1 -- 10.20.193.45:0/4073178854 shutdown_connections 2026-02-22T23:28:09.084 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.053+0000 7f88f93d3640 1 -- 10.20.193.45:0/4073178854 >> 10.20.193.45:0/4073178854 conn(0x7f88f40a8000 msgr2=0x7f88f40a9b40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:28:09.084 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.053+0000 7f88f93d3640 1 -- 10.20.193.45:0/4073178854 shutdown_connections 2026-02-22T23:28:09.084 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.053+0000 7f88f93d3640 1 -- 10.20.193.45:0/4073178854 wait complete. 2026-02-22T23:28:09.085 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2026-02-22T23:28:09.151 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.149+0000 7f7a3cd49640 10 monclient: get_monmap_and_config 2026-02-22T23:28:09.151 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.149+0000 7f7a3cd49640 10 monclient: build_initial_monmap 2026-02-22T23:28:09.151 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.149+0000 7f7a3cd49640 10 monclient: monmap: 2026-02-22T23:28:09.151 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-22T23:28:09.151 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:28:09.151 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:28:09.150834+0000 2026-02-22T23:28:09.151 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:28:09.150834+0000 2026-02-22T23:28:09.151 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-22T23:28:09.151 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:28:09.152 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-22T23:28:09.152 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.noname-f 2026-02-22T23:28:09.152 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.noname-b 2026-02-22T23:28:09.152 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.noname-g 2026-02-22T23:28:09.152 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.noname-c 2026-02-22T23:28:09.152 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.noname-h 2026-02-22T23:28:09.152 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.noname-d 2026-02-22T23:28:09.152 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.noname-i 2026-02-22T23:28:09.152 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.noname-e 2026-02-22T23:28:09.152 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:09.157 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.150+0000 7f7a3cd49640 1 Processor -- start 2026-02-22T23:28:09.157 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.150+0000 7f7a3cd49640 1 -- start start 2026-02-22T23:28:09.157 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.150+0000 7f7a3cd49640 10 monclient: init 2026-02-22T23:28:09.157 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.150+0000 7f7a3cd49640 10 monclient: _reopen_session rank -1 2026-02-22T23:28:09.157 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.150+0000 7f7a3cd49640 10 monclient: _add_conns ranks=[5,1,2,6,0,7,4,8,3] 2026-02-22T23:28:09.157 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.150+0000 7f7a3cd49640 10 monclient(hunting): picked mon.noname-h con 0x7f7a380a5e00 addr v1:10.20.193.73:6791/0 2026-02-22T23:28:09.157 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.150+0000 7f7a3cd49640 10 monclient(hunting): picked mon.noname-f con 0x7f7a380a68f0 addr v1:10.20.193.73:6789/0 2026-02-22T23:28:09.157 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.150+0000 7f7a3cd49640 10 monclient(hunting): picked mon.noname-b con 0x7f7a380a6d00 addr v1:10.20.193.45:6790/0 2026-02-22T23:28:09.157 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.150+0000 7f7a3cd49640 1 -- --> v1:10.20.193.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a380a2d00 con 0x7f7a380a68f0 2026-02-22T23:28:09.157 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.150+0000 7f7a3cd49640 1 -- --> v1:10.20.193.45:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a380a2fe0 con 0x7f7a380a6d00 2026-02-22T23:28:09.157 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.150+0000 7f7a3cd49640 1 -- --> v1:10.20.193.73:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a380a32c0 con 0x7f7a380a5e00 2026-02-22T23:28:09.157 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.150+0000 7f7a3cd49640 10 monclient(hunting): _renew_subs 2026-02-22T23:28:09.157 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.150+0000 7f7a3cd49640 10 monclient(hunting): authenticate will time out at 820.767676s 2026-02-22T23:28:09.157 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.150+0000 7f7a36d76640 1 --1- >> v1:10.20.193.45:6790/0 conn(0x7f7a380a6d00 0x7f7a381417b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.45:6790/0 says I am v1:10.20.193.45:60240/0 (socket says 10.20.193.45:60240) 2026-02-22T23:28:09.157 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.150+0000 7f7a36d76640 1 -- 10.20.193.45:0/3295026144 learned_addr learned my addr 10.20.193.45:0/3295026144 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-22T23:28:09.157 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.150+0000 7f7a35573640 1 -- 10.20.193.45:0/3295026144 <== mon.2 v1:10.20.193.45:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1842318186 0 0) 0x7f7a380a2fe0 con 0x7f7a380a6d00 2026-02-22T23:28:09.157 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.150+0000 7f7a35573640 10 monclient(hunting): _negotiate 2026-02-22T23:28:09.157 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.150+0000 7f7a35573640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:28:09.158 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.150+0000 7f7a35573640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:28:09.158 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.150+0000 7f7a35573640 10 monclient(hunting): my global_id is 4799 2026-02-22T23:28:09.158 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.150+0000 7f7a35573640 1 -- 10.20.193.45:0/3295026144 --> v1:10.20.193.45:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7a24003620 con 0x7f7a380a6d00 2026-02-22T23:28:09.158 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.151+0000 7f7a35573640 1 -- 10.20.193.45:0/3295026144 <== mon.2 v1:10.20.193.45:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 717638882 0 0) 0x7f7a24003620 con 0x7f7a380a6d00 2026-02-22T23:28:09.158 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.151+0000 7f7a35573640 1 -- 10.20.193.45:0/3295026144 >> v1:10.20.193.73:6791/0 conn(0x7f7a380a5e00 legacy=0x7f7a380a61e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:09.158 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.151+0000 7f7a35573640 1 -- 10.20.193.45:0/3295026144 >> v1:10.20.193.73:6789/0 conn(0x7f7a380a68f0 legacy=0x7f7a3813e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:09.158 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.151+0000 7f7a35573640 10 monclient: _finish_hunting 0 2026-02-22T23:28:09.158 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.151+0000 7f7a35573640 1 monclient: found mon.noname-b 2026-02-22T23:28:09.158 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.151+0000 7f7a35573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T23:28:09.158 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.151+0000 7f7a35573640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.45:6790/0 2026-02-22T23:28:09.158 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.151+0000 7f7a35573640 1 -- 10.20.193.45:0/3295026144 --> v1:10.20.193.45:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a380a35a0 con 0x7f7a380a6d00 2026-02-22T23:28:09.158 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.151+0000 7f7a35573640 10 monclient: _finish_auth 0 2026-02-22T23:28:09.158 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.151+0000 7f7a35573640 10 monclient: _check_auth_tickets 2026-02-22T23:28:09.158 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.151+0000 7f7a35573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T23:28:09.158 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.151+0000 7f7a3cd49640 5 monclient: authenticate success, global_id 4799 2026-02-22T23:28:09.158 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.151+0000 7f7a35573640 1 -- 10.20.193.45:0/3295026144 <== mon.2 v1:10.20.193.45:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f7a280033c0 con 0x7f7a380a6d00 2026-02-22T23:28:09.158 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.151+0000 7f7a35573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:28:09.158 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.151+0000 7f7a35573640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-22T23:28:09.158 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.151+0000 7f7a35573640 10 monclient: dump: 2026-02-22T23:28:09.158 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:28:09.158 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:28:09.158 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:09.158 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:09.159 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:28:09.159 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:28:09.159 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:28:09.159 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:28:09.159 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:28:09.159 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:28:09.159 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:28:09.159 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:28:09.159 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:28:09.159 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:28:09.159 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:28:09.159 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:09.159 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.151+0000 7f7a3cd49640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-22T23:28:09.159 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.151+0000 7f7a35573640 1 -- 10.20.193.45:0/3295026144 <== mon.2 v1:10.20.193.45:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7a28003560 con 0x7f7a380a6d00 2026-02-22T23:28:09.159 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.151+0000 7f7a35573640 10 monclient: handle_config config(0 keys) 2026-02-22T23:28:09.159 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.151+0000 7f7a35573640 1 -- 10.20.193.45:0/3295026144 <== mon.2 v1:10.20.193.45:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f7a28005060 con 0x7f7a380a6d00 2026-02-22T23:28:09.159 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.151+0000 7f7a3cd49640 10 monclient: get_monmap_and_config success 2026-02-22T23:28:09.159 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.151+0000 7f7a3cd49640 4 set_mon_vals no callback set 2026-02-22T23:28:09.159 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.151+0000 7f7a35573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:28:09.159 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.151+0000 7f7a35573640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-22T23:28:09.159 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.151+0000 7f7a35573640 10 monclient: dump: 2026-02-22T23:28:09.159 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:28:09.159 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:28:09.160 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:09.160 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:09.160 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:28:09.160 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:28:09.160 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:28:09.160 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:28:09.160 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:28:09.160 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:28:09.160 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:28:09.160 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:28:09.160 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:28:09.160 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:28:09.160 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:28:09.160 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:09.160 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.151+0000 7f7a3cd49640 10 monclient: shutdown 2026-02-22T23:28:09.160 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.151+0000 7f7a3cd49640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T23:28:09.160 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.151+0000 7f7a3cd49640 1 -- 10.20.193.45:0/3295026144 >> v1:10.20.193.45:6790/0 conn(0x7f7a380a6d00 legacy=0x7f7a381417b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:09.160 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.151+0000 7f7a3cd49640 1 -- 10.20.193.45:0/3295026144 shutdown_connections 2026-02-22T23:28:09.160 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.151+0000 7f7a3cd49640 1 -- 10.20.193.45:0/3295026144 >> 10.20.193.45:0/3295026144 conn(0x7f7a380abb50 msgr2=0x7f7a380a7f00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:28:09.160 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.151+0000 7f7a3cd49640 1 -- 10.20.193.45:0/3295026144 shutdown_connections 2026-02-22T23:28:09.160 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.151+0000 7f7a3cd49640 1 -- 10.20.193.45:0/3295026144 wait complete. 2026-02-22T23:28:09.160 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.151+0000 7f7a3cd49640 10 monclient: build_initial_monmap 2026-02-22T23:28:09.160 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.151+0000 7f7a3cd49640 10 monclient: monmap: 2026-02-22T23:28:09.161 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-22T23:28:09.161 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T23:28:09.161 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-22T23:28:09.161 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-22T23:28:09.161 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-22T23:28:09.161 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-22T23:28:09.161 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-22T23:28:09.161 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.noname-f 2026-02-22T23:28:09.161 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.noname-b 2026-02-22T23:28:09.161 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.noname-g 2026-02-22T23:28:09.161 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.noname-c 2026-02-22T23:28:09.161 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.noname-h 2026-02-22T23:28:09.161 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.noname-d 2026-02-22T23:28:09.161 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.noname-i 2026-02-22T23:28:09.161 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.noname-e 2026-02-22T23:28:09.161 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:09.161 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.152+0000 7f7a3cd49640 1 Processor -- start 2026-02-22T23:28:09.161 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.152+0000 7f7a3cd49640 1 -- start start 2026-02-22T23:28:09.161 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.152+0000 7f7a3cd49640 10 monclient: init 2026-02-22T23:28:09.161 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.152+0000 7f7a3cd49640 10 monclient: _reopen_session rank -1 2026-02-22T23:28:09.161 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.152+0000 7f7a3cd49640 10 monclient: _add_conns ranks=[2,7,3,4,8,1,0,5,6] 2026-02-22T23:28:09.161 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.152+0000 7f7a3cd49640 10 monclient(hunting): picked mon.noname-b con 0x7f7a380a5e00 addr v1:10.20.193.45:6790/0 2026-02-22T23:28:09.161 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.152+0000 7f7a3cd49640 10 monclient(hunting): picked mon.noname-i con 0x7f7a380a68f0 addr v1:10.20.193.73:6792/0 2026-02-22T23:28:09.162 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.152+0000 7f7a3cd49640 10 monclient(hunting): picked mon.noname-g con 0x7f7a380a6d00 addr v1:10.20.193.73:6790/0 2026-02-22T23:28:09.162 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.152+0000 7f7a3cd49640 1 -- --> v1:10.20.193.45:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a38140f40 con 0x7f7a380a5e00 2026-02-22T23:28:09.162 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.152+0000 7f7a3cd49640 1 -- --> v1:10.20.193.73:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a381291a0 con 0x7f7a380a6d00 2026-02-22T23:28:09.162 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.152+0000 7f7a3cd49640 1 -- --> v1:10.20.193.73:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a380a9e80 con 0x7f7a380a68f0 2026-02-22T23:28:09.162 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.152+0000 7f7a3cd49640 10 monclient(hunting): _renew_subs 2026-02-22T23:28:09.162 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.152+0000 7f7a3cd49640 10 monclient(hunting): authenticate will time out at 820.769505s 2026-02-22T23:28:09.162 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.152+0000 7f7a36575640 1 --1- >> v1:10.20.193.45:6790/0 conn(0x7f7a380a5e00 0x7f7a381251e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.45:6790/0 says I am v1:10.20.193.45:60256/0 (socket says 10.20.193.45:60256) 2026-02-22T23:28:09.162 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.152+0000 7f7a36575640 1 -- 10.20.193.45:0/892229396 learned_addr learned my addr 10.20.193.45:0/892229396 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-22T23:28:09.162 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.152+0000 7f7a1effd640 1 -- 10.20.193.45:0/892229396 <== mon.2 v1:10.20.193.45:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3901557205 0 0) 0x7f7a38140f40 con 0x7f7a380a5e00 2026-02-22T23:28:09.162 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.152+0000 7f7a1effd640 10 monclient(hunting): _negotiate 2026-02-22T23:28:09.162 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.152+0000 7f7a1effd640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:28:09.162 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.152+0000 7f7a1effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:28:09.162 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.152+0000 7f7a1effd640 10 monclient(hunting): my global_id is 4808 2026-02-22T23:28:09.162 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.152+0000 7f7a1effd640 1 -- 10.20.193.45:0/892229396 --> v1:10.20.193.45:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7a04003620 con 0x7f7a380a5e00 2026-02-22T23:28:09.162 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.152+0000 7f7a1effd640 1 -- 10.20.193.45:0/892229396 <== mon.2 v1:10.20.193.45:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 676671809 0 0) 0x7f7a04003620 con 0x7f7a380a5e00 2026-02-22T23:28:09.162 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.152+0000 7f7a1effd640 1 -- 10.20.193.45:0/892229396 --> v1:10.20.193.45:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7a38140f40 con 0x7f7a380a5e00 2026-02-22T23:28:09.162 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.152+0000 7f7a1effd640 1 -- 10.20.193.45:0/892229396 <== mon.2 v1:10.20.193.45:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f7a2c003340 con 0x7f7a380a5e00 2026-02-22T23:28:09.162 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.152+0000 7f7a1effd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-22T23:28:09.162 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.152+0000 7f7a1effd640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-22T23:28:09.162 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.152+0000 7f7a1effd640 10 monclient(hunting): dump: 2026-02-22T23:28:09.162 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:28:09.162 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:28:09.162 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:09.163 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:09.163 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:28:09.163 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:28:09.163 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:28:09.163 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:28:09.163 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:28:09.163 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:28:09.163 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:28:09.163 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:28:09.163 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:28:09.163 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:28:09.163 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:28:09.163 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:09.163 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.152+0000 7f7a1effd640 10 monclient(hunting): _finish_auth 0 2026-02-22T23:28:09.163 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.152+0000 7f7a1effd640 1 -- 10.20.193.45:0/892229396 <== mon.2 v1:10.20.193.45:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3788024647 0 0) 0x7f7a38140f40 con 0x7f7a380a5e00 2026-02-22T23:28:09.163 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.152+0000 7f7a1effd640 1 -- 10.20.193.45:0/892229396 >> v1:10.20.193.73:6792/0 conn(0x7f7a380a68f0 legacy=0x7f7a381258f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:09.163 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.152+0000 7f7a1effd640 1 -- 10.20.193.45:0/892229396 >> v1:10.20.193.73:6790/0 conn(0x7f7a380a6d00 legacy=0x7f7a381d7d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:09.163 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.152+0000 7f7a1effd640 10 monclient: _finish_hunting 0 2026-02-22T23:28:09.163 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.152+0000 7f7a1effd640 1 monclient: found mon.b 2026-02-22T23:28:09.163 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.152+0000 7f7a1effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T23:28:09.163 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.152+0000 7f7a1effd640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.45:6790/0 2026-02-22T23:28:09.163 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.152+0000 7f7a1effd640 1 -- 10.20.193.45:0/892229396 --> v1:10.20.193.45:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a380a9a70 con 0x7f7a380a5e00 2026-02-22T23:28:09.163 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.152+0000 7f7a1effd640 10 monclient: _finish_auth 0 2026-02-22T23:28:09.164 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.152+0000 7f7a1effd640 10 monclient: _check_auth_tickets 2026-02-22T23:28:09.164 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.152+0000 7f7a1effd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T23:28:09.164 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.152+0000 7f7a3cd49640 5 monclient: authenticate success, global_id 4808 2026-02-22T23:28:09.164 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.152+0000 7f7a3cd49640 10 monclient: _renew_subs 2026-02-22T23:28:09.164 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.152+0000 7f7a3cd49640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.45:6790/0 2026-02-22T23:28:09.164 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.152+0000 7f7a3cd49640 1 -- 10.20.193.45:0/892229396 --> v1:10.20.193.45:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f7a38126000 con 0x7f7a380a5e00 2026-02-22T23:28:09.164 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.152+0000 7f7a3cd49640 10 monclient: _renew_subs 2026-02-22T23:28:09.164 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.152+0000 7f7a3cd49640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.45:6790/0 2026-02-22T23:28:09.164 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.152+0000 7f7a3cd49640 1 -- 10.20.193.45:0/892229396 --> v1:10.20.193.45:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f7a38128ec0 con 0x7f7a380a5e00 2026-02-22T23:28:09.164 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.152+0000 7f7a1effd640 1 -- 10.20.193.45:0/892229396 <== mon.2 v1:10.20.193.45:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7a2c0039c0 con 0x7f7a380a5e00 2026-02-22T23:28:09.164 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.152+0000 7f7a1effd640 10 monclient: handle_config config(0 keys) 2026-02-22T23:28:09.164 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.152+0000 7f7a1effd640 1 -- 10.20.193.45:0/892229396 <== mon.2 v1:10.20.193.45:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f7a2c003fb0 con 0x7f7a380a5e00 2026-02-22T23:28:09.164 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.152+0000 7f7a1effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:28:09.164 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.152+0000 7f7a1effd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-22T23:28:09.164 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.152+0000 7f7a34d72640 4 set_mon_vals no callback set 2026-02-22T23:28:09.164 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.152+0000 7f7a1effd640 10 monclient: dump: 2026-02-22T23:28:09.164 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:28:09.164 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:28:09.164 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:09.164 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:09.164 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:28:09.164 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:28:09.164 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:28:09.165 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:28:09.165 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:28:09.165 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:28:09.165 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:28:09.165 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:28:09.165 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:28:09.165 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:28:09.165 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:28:09.165 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:09.165 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.153+0000 7f7a3cd49640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T23:28:09.165 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.153+0000 7f7a3cd49640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T23:28:09.165 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.153+0000 7f7a3cd49640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.45:6790/0 2026-02-22T23:28:09.165 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.153+0000 7f7a3cd49640 1 -- 10.20.193.45:0/892229396 --> v1:10.20.193.45:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a380aa390 con 0x7f7a380a5e00 2026-02-22T23:28:09.165 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.153+0000 7f7a1effd640 1 -- 10.20.193.45:0/892229396 <== mon.2 v1:10.20.193.45:6790/0 7 ==== mgrmap(e 5) ==== 50225+0+0 (unknown 2330357642 0 0) 0x7f7a2c004150 con 0x7f7a380a5e00 2026-02-22T23:28:09.165 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.153+0000 7f7a1effd640 1 -- 10.20.193.45:0/892229396 <== mon.2 v1:10.20.193.45:6790/0 8 ==== osd_map(25..25 src has 1..25) ==== 3502+0+0 (unknown 129690100 0 0) 0x7f7a2c04dd50 con 0x7f7a380a5e00 2026-02-22T23:28:09.165 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.153+0000 7f7a35d74640 10 monclient: get_auth_request con 0x7f7a0403f7b0 auth_method 0 2026-02-22T23:28:09.166 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.156+0000 7f7a1effd640 1 -- 10.20.193.45:0/892229396 <== mon.2 v1:10.20.193.45:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (unknown 1092875540 0 2568732696) 0x7f7a2c017950 con 0x7f7a380a5e00 2026-02-22T23:28:09.166 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.156+0000 7f7a1effd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T23:28:09.166 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.156+0000 7f7a1effd640 10 monclient: _finish_command 1 = system:0 2026-02-22T23:28:09.239 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.237+0000 7f7a3cd49640 1 -- 10.20.193.45:0/892229396 --> v1:10.20.193.73:6800/2222410180 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7f7a3806ce10 con 0x7f7a0403f7b0 2026-02-22T23:28:09.239 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.237+0000 7f7a1effd640 1 -- 10.20.193.45:0/892229396 <== mgr.4111 v1:10.20.193.73:6800/2222410180 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (unknown 3782719169 0 0) 0x7f7a3806ce10 con 0x7f7a0403f7b0 2026-02-22T23:28:09.239 INFO:teuthology.orchestra.run.trial045.stderr:instructed osd(s) 4 to deep-scrub 2026-02-22T23:28:09.240 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.238+0000 7f7a3cd49640 1 -- 10.20.193.45:0/892229396 >> v1:10.20.193.73:6800/2222410180 conn(0x7f7a0403f7b0 legacy=0x7f7a04041c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:09.240 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.238+0000 7f7a3cd49640 10 monclient: shutdown 2026-02-22T23:28:09.240 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.238+0000 7f7a3cd49640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T23:28:09.240 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.238+0000 7f7a3cd49640 1 -- 10.20.193.45:0/892229396 >> v1:10.20.193.45:6790/0 conn(0x7f7a380a5e00 legacy=0x7f7a381251e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:09.240 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.238+0000 7f7a3cd49640 1 -- 10.20.193.45:0/892229396 shutdown_connections 2026-02-22T23:28:09.240 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.238+0000 7f7a3cd49640 1 -- 10.20.193.45:0/892229396 >> 10.20.193.45:0/892229396 conn(0x7f7a380abb50 msgr2=0x7f7a381427b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:28:09.241 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.238+0000 7f7a3cd49640 1 -- 10.20.193.45:0/892229396 shutdown_connections 2026-02-22T23:28:09.241 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.238+0000 7f7a3cd49640 1 -- 10.20.193.45:0/892229396 wait complete. 2026-02-22T23:28:09.247 INFO:tasks.ceph:Scrubbing osd.5 2026-02-22T23:28:09.247 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2026-02-22T23:28:09.316 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.314+0000 7f2c72da9640 10 monclient: get_monmap_and_config 2026-02-22T23:28:09.316 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.314+0000 7f2c72da9640 10 monclient: build_initial_monmap 2026-02-22T23:28:09.316 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.314+0000 7f2c72da9640 10 monclient: monmap: 2026-02-22T23:28:09.316 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-22T23:28:09.316 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:28:09.316 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:28:09.315978+0000 2026-02-22T23:28:09.316 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:28:09.315978+0000 2026-02-22T23:28:09.317 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-22T23:28:09.317 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:28:09.317 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-22T23:28:09.317 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.noname-f 2026-02-22T23:28:09.317 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.noname-b 2026-02-22T23:28:09.317 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.noname-g 2026-02-22T23:28:09.317 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.noname-c 2026-02-22T23:28:09.317 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.noname-h 2026-02-22T23:28:09.317 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.noname-d 2026-02-22T23:28:09.317 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.noname-i 2026-02-22T23:28:09.317 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.noname-e 2026-02-22T23:28:09.317 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:09.325 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.315+0000 7f2c72da9640 1 Processor -- start 2026-02-22T23:28:09.325 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.315+0000 7f2c72da9640 1 -- start start 2026-02-22T23:28:09.325 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.315+0000 7f2c72da9640 10 monclient: init 2026-02-22T23:28:09.325 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.315+0000 7f2c72da9640 10 monclient: _reopen_session rank -1 2026-02-22T23:28:09.326 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.315+0000 7f2c72da9640 10 monclient: _add_conns ranks=[8,2,3,4,6,0,5,7,1] 2026-02-22T23:28:09.326 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.315+0000 7f2c72da9640 10 monclient(hunting): picked mon.noname-e con 0x7f2c6c138ae0 addr v1:10.20.193.45:6793/0 2026-02-22T23:28:09.326 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.315+0000 7f2c72da9640 10 monclient(hunting): picked mon.noname-b con 0x7f2c6c1395d0 addr v1:10.20.193.45:6790/0 2026-02-22T23:28:09.326 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.315+0000 7f2c72da9640 10 monclient(hunting): picked mon.noname-g con 0x7f2c6c0a3e20 addr v1:10.20.193.73:6790/0 2026-02-22T23:28:09.326 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.315+0000 7f2c72da9640 1 -- --> v1:10.20.193.45:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2c6c0745c0 con 0x7f2c6c1395d0 2026-02-22T23:28:09.326 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.315+0000 7f2c72da9640 1 -- --> v1:10.20.193.73:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2c6c0a2b90 con 0x7f2c6c0a3e20 2026-02-22T23:28:09.326 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.315+0000 7f2c72da9640 1 -- --> v1:10.20.193.45:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2c6c0a3150 con 0x7f2c6c138ae0 2026-02-22T23:28:09.326 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.315+0000 7f2c72da9640 10 monclient(hunting): _renew_subs 2026-02-22T23:28:09.326 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.315+0000 7f2c72da9640 10 monclient(hunting): authenticate will time out at 820.932569s 2026-02-22T23:28:09.326 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.315+0000 7f2c70b1e640 1 --1- >> v1:10.20.193.45:6793/0 conn(0x7f2c6c138ae0 0x7f2c6c138ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.45:6793/0 says I am v1:10.20.193.45:41132/0 (socket says 10.20.193.45:41132) 2026-02-22T23:28:09.326 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.315+0000 7f2c70b1e640 1 -- 10.20.193.45:0/1021660844 learned_addr learned my addr 10.20.193.45:0/1021660844 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-22T23:28:09.326 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.315+0000 7f2c637fe640 1 -- 10.20.193.45:0/1021660844 <== mon.8 v1:10.20.193.45:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1200644841 0 0) 0x7f2c6c0a3150 con 0x7f2c6c138ae0 2026-02-22T23:28:09.327 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.315+0000 7f2c637fe640 10 monclient(hunting): _negotiate 2026-02-22T23:28:09.327 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.315+0000 7f2c637fe640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:28:09.327 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.315+0000 7f2c637fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:28:09.327 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.315+0000 7f2c637fe640 10 monclient(hunting): my global_id is 4751 2026-02-22T23:28:09.327 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.315+0000 7f2c637fe640 1 -- 10.20.193.45:0/1021660844 --> v1:10.20.193.45:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2c58003620 con 0x7f2c6c138ae0 2026-02-22T23:28:09.327 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.315+0000 7f2c637fe640 1 -- 10.20.193.45:0/1021660844 <== mon.2 v1:10.20.193.45:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3708947105 0 0) 0x7f2c6c0745c0 con 0x7f2c6c1395d0 2026-02-22T23:28:09.327 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.315+0000 7f2c637fe640 10 monclient(hunting): _negotiate 2026-02-22T23:28:09.327 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.315+0000 7f2c637fe640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:28:09.327 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.315+0000 7f2c637fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:28:09.327 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.315+0000 7f2c637fe640 10 monclient(hunting): my global_id is 4817 2026-02-22T23:28:09.327 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.315+0000 7f2c637fe640 1 -- 10.20.193.45:0/1021660844 --> v1:10.20.193.45:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2c6c0a3150 con 0x7f2c6c1395d0 2026-02-22T23:28:09.327 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.315+0000 7f2c637fe640 1 -- 10.20.193.45:0/1021660844 <== mon.2 v1:10.20.193.45:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2770746219 0 0) 0x7f2c6c0a3150 con 0x7f2c6c1395d0 2026-02-22T23:28:09.328 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.315+0000 7f2c637fe640 1 -- 10.20.193.45:0/1021660844 >> v1:10.20.193.45:6793/0 conn(0x7f2c6c138ae0 legacy=0x7f2c6c138ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:09.328 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.315+0000 7f2c637fe640 1 -- 10.20.193.45:0/1021660844 >> v1:10.20.193.73:6790/0 conn(0x7f2c6c0a3e20 legacy=0x7f2c6c141660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T23:28:09.328 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.316+0000 7f2c637fe640 10 monclient: _finish_hunting 0 2026-02-22T23:28:09.328 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.316+0000 7f2c637fe640 1 monclient: found mon.noname-b 2026-02-22T23:28:09.328 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.316+0000 7f2c637fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T23:28:09.328 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.316+0000 7f2c637fe640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.45:6790/0 2026-02-22T23:28:09.328 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.316+0000 7f2c637fe640 1 -- 10.20.193.45:0/1021660844 --> v1:10.20.193.45:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c6c0a7000 con 0x7f2c6c1395d0 2026-02-22T23:28:09.328 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.316+0000 7f2c637fe640 10 monclient: _finish_auth 0 2026-02-22T23:28:09.328 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.316+0000 7f2c637fe640 10 monclient: _check_auth_tickets 2026-02-22T23:28:09.328 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.316+0000 7f2c637fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T23:28:09.328 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.316+0000 7f2c637fe640 1 -- 10.20.193.45:0/1021660844 <== mon.2 v1:10.20.193.45:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f2c54003020 con 0x7f2c6c1395d0 2026-02-22T23:28:09.328 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.316+0000 7f2c637fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:28:09.329 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.316+0000 7f2c637fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-22T23:28:09.329 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.316+0000 7f2c637fe640 10 monclient: dump: 2026-02-22T23:28:09.329 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:28:09.329 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:28:09.329 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:09.329 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:09.329 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:28:09.329 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:28:09.329 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:28:09.329 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:28:09.329 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:28:09.329 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:28:09.329 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:28:09.330 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:28:09.330 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:28:09.330 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:28:09.330 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:28:09.330 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:09.330 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.316+0000 7f2c72da9640 5 monclient: authenticate success, global_id 4817 2026-02-22T23:28:09.330 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.316+0000 7f2c72da9640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-22T23:28:09.330 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.316+0000 7f2c637fe640 1 -- 10.20.193.45:0/1021660844 <== mon.2 v1:10.20.193.45:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2c540031c0 con 0x7f2c6c1395d0 2026-02-22T23:28:09.330 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.316+0000 7f2c637fe640 10 monclient: handle_config config(0 keys) 2026-02-22T23:28:09.330 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.316+0000 7f2c637fe640 1 -- 10.20.193.45:0/1021660844 <== mon.2 v1:10.20.193.45:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f2c54003a50 con 0x7f2c6c1395d0 2026-02-22T23:28:09.330 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.316+0000 7f2c637fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:28:09.330 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.316+0000 7f2c637fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-22T23:28:09.331 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.316+0000 7f2c637fe640 10 monclient: dump: 2026-02-22T23:28:09.331 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:28:09.331 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:28:09.331 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:09.331 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:09.331 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:28:09.331 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:28:09.331 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:28:09.331 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:28:09.331 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:28:09.331 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:28:09.331 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:28:09.331 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:28:09.332 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:28:09.332 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:28:09.332 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:28:09.332 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:09.332 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.316+0000 7f2c72da9640 10 monclient: get_monmap_and_config success 2026-02-22T23:28:09.332 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.316+0000 7f2c72da9640 4 set_mon_vals no callback set 2026-02-22T23:28:09.332 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.316+0000 7f2c72da9640 10 monclient: shutdown 2026-02-22T23:28:09.332 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.316+0000 7f2c72da9640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T23:28:09.332 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.316+0000 7f2c72da9640 1 -- 10.20.193.45:0/1021660844 >> v1:10.20.193.45:6790/0 conn(0x7f2c6c1395d0 legacy=0x7f2c6c13df30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:09.332 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.316+0000 7f2c72da9640 1 -- 10.20.193.45:0/1021660844 shutdown_connections 2026-02-22T23:28:09.332 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.316+0000 7f2c72da9640 1 -- 10.20.193.45:0/1021660844 >> 10.20.193.45:0/1021660844 conn(0x7f2c6c0a8000 msgr2=0x7f2c6c0a8410 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:28:09.332 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.316+0000 7f2c72da9640 1 -- 10.20.193.45:0/1021660844 shutdown_connections 2026-02-22T23:28:09.333 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.316+0000 7f2c72da9640 1 -- 10.20.193.45:0/1021660844 wait complete. 2026-02-22T23:28:09.333 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.316+0000 7f2c72da9640 10 monclient: build_initial_monmap 2026-02-22T23:28:09.333 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.317+0000 7f2c72da9640 10 monclient: monmap: 2026-02-22T23:28:09.333 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-22T23:28:09.333 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T23:28:09.333 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-22T23:28:09.333 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-22T23:28:09.333 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-22T23:28:09.333 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-22T23:28:09.333 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-22T23:28:09.334 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.noname-f 2026-02-22T23:28:09.334 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.noname-b 2026-02-22T23:28:09.334 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.noname-g 2026-02-22T23:28:09.334 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.noname-c 2026-02-22T23:28:09.334 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.noname-h 2026-02-22T23:28:09.334 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.noname-d 2026-02-22T23:28:09.334 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.noname-i 2026-02-22T23:28:09.334 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.noname-e 2026-02-22T23:28:09.334 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:09.334 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.317+0000 7f2c72da9640 1 Processor -- start 2026-02-22T23:28:09.334 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.317+0000 7f2c72da9640 1 -- start start 2026-02-22T23:28:09.334 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.317+0000 7f2c72da9640 10 monclient: init 2026-02-22T23:28:09.335 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.317+0000 7f2c72da9640 10 monclient: _reopen_session rank -1 2026-02-22T23:28:09.335 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.317+0000 7f2c72da9640 10 monclient: _add_conns ranks=[6,5,2,8,7,3,0,4,1] 2026-02-22T23:28:09.335 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.317+0000 7f2c72da9640 10 monclient(hunting): picked mon.noname-d con 0x7f2c6c0a3e20 addr v1:10.20.193.45:6792/0 2026-02-22T23:28:09.335 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.317+0000 7f2c72da9640 10 monclient(hunting): picked mon.noname-h con 0x7f2c6c138ae0 addr v1:10.20.193.73:6791/0 2026-02-22T23:28:09.335 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.317+0000 7f2c72da9640 10 monclient(hunting): picked mon.noname-b con 0x7f2c6c1395d0 addr v1:10.20.193.45:6790/0 2026-02-22T23:28:09.335 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.317+0000 7f2c72da9640 1 -- --> v1:10.20.193.45:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2c6c13fa40 con 0x7f2c6c1395d0 2026-02-22T23:28:09.335 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.317+0000 7f2c72da9640 1 -- --> v1:10.20.193.73:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2c6c13fd20 con 0x7f2c6c138ae0 2026-02-22T23:28:09.335 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.317+0000 7f2c72da9640 1 -- --> v1:10.20.193.45:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2c6c1424e0 con 0x7f2c6c0a3e20 2026-02-22T23:28:09.335 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.317+0000 7f2c72da9640 10 monclient(hunting): _renew_subs 2026-02-22T23:28:09.335 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.317+0000 7f2c72da9640 10 monclient(hunting): authenticate will time out at 820.934580s 2026-02-22T23:28:09.335 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.317+0000 7f2c7131f640 1 --1- >> v1:10.20.193.45:6790/0 conn(0x7f2c6c1395d0 0x7f2c6c1d7950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.45:6790/0 says I am v1:10.20.193.45:60270/0 (socket says 10.20.193.45:60270) 2026-02-22T23:28:09.336 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.317+0000 7f2c7131f640 1 -- 10.20.193.45:0/1344743676 learned_addr learned my addr 10.20.193.45:0/1344743676 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-22T23:28:09.336 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.317+0000 7f2c617fa640 1 -- 10.20.193.45:0/1344743676 <== mon.2 v1:10.20.193.45:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1276513621 0 0) 0x7f2c6c13fa40 con 0x7f2c6c1395d0 2026-02-22T23:28:09.336 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.317+0000 7f2c617fa640 10 monclient(hunting): _negotiate 2026-02-22T23:28:09.336 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.317+0000 7f2c617fa640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:28:09.336 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.317+0000 7f2c617fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:28:09.336 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.317+0000 7f2c617fa640 10 monclient(hunting): my global_id is 4826 2026-02-22T23:28:09.336 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.317+0000 7f2c617fa640 1 -- 10.20.193.45:0/1344743676 --> v1:10.20.193.45:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2c3c003620 con 0x7f2c6c1395d0 2026-02-22T23:28:09.336 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.317+0000 7f2c617fa640 1 -- 10.20.193.45:0/1344743676 <== mon.6 v1:10.20.193.45:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2383302872 0 0) 0x7f2c6c1424e0 con 0x7f2c6c0a3e20 2026-02-22T23:28:09.336 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.317+0000 7f2c617fa640 10 monclient(hunting): _negotiate 2026-02-22T23:28:09.336 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.317+0000 7f2c617fa640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:28:09.336 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.317+0000 7f2c617fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:28:09.336 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.317+0000 7f2c617fa640 10 monclient(hunting): my global_id is 114279 2026-02-22T23:28:09.337 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.317+0000 7f2c617fa640 1 -- 10.20.193.45:0/1344743676 --> v1:10.20.193.45:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2c6c13fa40 con 0x7f2c6c0a3e20 2026-02-22T23:28:09.337 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.317+0000 7f2c617fa640 1 -- 10.20.193.45:0/1344743676 <== mon.2 v1:10.20.193.45:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1072780018 0 0) 0x7f2c3c003620 con 0x7f2c6c1395d0 2026-02-22T23:28:09.337 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.317+0000 7f2c617fa640 1 -- 10.20.193.45:0/1344743676 --> v1:10.20.193.45:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2c6c1424e0 con 0x7f2c6c1395d0 2026-02-22T23:28:09.337 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.317+0000 7f2c617fa640 1 -- 10.20.193.45:0/1344743676 <== mon.2 v1:10.20.193.45:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f2c68004620 con 0x7f2c6c1395d0 2026-02-22T23:28:09.337 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.317+0000 7f2c617fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-22T23:28:09.337 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.317+0000 7f2c617fa640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-22T23:28:09.337 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.317+0000 7f2c617fa640 10 monclient(hunting): dump: 2026-02-22T23:28:09.337 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:28:09.337 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:28:09.337 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:09.337 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:09.337 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:28:09.337 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:28:09.338 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:28:09.338 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:28:09.338 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:28:09.338 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:28:09.338 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:28:09.338 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:28:09.338 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:28:09.338 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:28:09.338 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:28:09.338 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:09.338 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.317+0000 7f2c617fa640 10 monclient(hunting): _finish_auth 0 2026-02-22T23:28:09.338 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.317+0000 7f2c617fa640 1 -- 10.20.193.45:0/1344743676 <== mon.6 v1:10.20.193.45:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2048840880 0 0) 0x7f2c6c13fa40 con 0x7f2c6c0a3e20 2026-02-22T23:28:09.339 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.317+0000 7f2c617fa640 1 -- 10.20.193.45:0/1344743676 --> v1:10.20.193.45:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2c3c003620 con 0x7f2c6c0a3e20 2026-02-22T23:28:09.339 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.317+0000 7f2c617fa640 1 -- 10.20.193.45:0/1344743676 <== mon.6 v1:10.20.193.45:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f2c5c002cf0 con 0x7f2c6c0a3e20 2026-02-22T23:28:09.339 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.317+0000 7f2c617fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-22T23:28:09.339 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.317+0000 7f2c617fa640 10 monclient(hunting): got monmap 1 from mon.d (according to old e1) 2026-02-22T23:28:09.339 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.317+0000 7f2c617fa640 10 monclient(hunting): dump: 2026-02-22T23:28:09.339 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:28:09.339 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:28:09.339 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:09.339 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:09.339 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:28:09.339 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:28:09.339 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:28:09.340 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:28:09.340 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:28:09.340 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:28:09.340 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:28:09.340 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:28:09.340 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:28:09.340 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:28:09.340 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:28:09.340 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:09.340 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.317+0000 7f2c617fa640 1 -- 10.20.193.45:0/1344743676 <== mon.2 v1:10.20.193.45:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3324428319 0 0) 0x7f2c6c1424e0 con 0x7f2c6c1395d0 2026-02-22T23:28:09.340 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.317+0000 7f2c617fa640 1 -- 10.20.193.45:0/1344743676 >> v1:10.20.193.45:6792/0 conn(0x7f2c6c0a3e20 legacy=0x7f2c6c141250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:09.340 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.317+0000 7f2c617fa640 1 -- 10.20.193.45:0/1344743676 >> v1:10.20.193.73:6791/0 conn(0x7f2c6c138ae0 legacy=0x7f2c6c1d4220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:09.340 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.317+0000 7f2c617fa640 10 monclient: _finish_hunting 0 2026-02-22T23:28:09.340 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.317+0000 7f2c617fa640 1 monclient: found mon.b 2026-02-22T23:28:09.341 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.317+0000 7f2c617fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T23:28:09.341 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.317+0000 7f2c617fa640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.45:6790/0 2026-02-22T23:28:09.341 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.317+0000 7f2c617fa640 1 -- 10.20.193.45:0/1344743676 --> v1:10.20.193.45:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c6c13f760 con 0x7f2c6c1395d0 2026-02-22T23:28:09.341 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.318+0000 7f2c617fa640 10 monclient: _finish_auth 0 2026-02-22T23:28:09.341 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.318+0000 7f2c617fa640 10 monclient: _check_auth_tickets 2026-02-22T23:28:09.341 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.318+0000 7f2c617fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T23:28:09.341 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.318+0000 7f2c72da9640 5 monclient: authenticate success, global_id 4826 2026-02-22T23:28:09.341 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.318+0000 7f2c72da9640 10 monclient: _renew_subs 2026-02-22T23:28:09.341 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.318+0000 7f2c72da9640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.45:6790/0 2026-02-22T23:28:09.341 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.318+0000 7f2c72da9640 1 -- 10.20.193.45:0/1344743676 --> v1:10.20.193.45:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f2c6c13e2a0 con 0x7f2c6c1395d0 2026-02-22T23:28:09.341 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.318+0000 7f2c72da9640 10 monclient: _renew_subs 2026-02-22T23:28:09.341 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.318+0000 7f2c72da9640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.45:6790/0 2026-02-22T23:28:09.342 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.318+0000 7f2c72da9640 1 -- 10.20.193.45:0/1344743676 --> v1:10.20.193.45:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f2c6c141b40 con 0x7f2c6c1395d0 2026-02-22T23:28:09.342 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.318+0000 7f2c617fa640 1 -- 10.20.193.45:0/1344743676 <== mon.2 v1:10.20.193.45:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2c680048c0 con 0x7f2c6c1395d0 2026-02-22T23:28:09.342 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.318+0000 7f2c617fa640 10 monclient: handle_config config(0 keys) 2026-02-22T23:28:09.342 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.318+0000 7f2c617fa640 1 -- 10.20.193.45:0/1344743676 <== mon.2 v1:10.20.193.45:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f2c68003050 con 0x7f2c6c1395d0 2026-02-22T23:28:09.342 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.318+0000 7f2c617fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:28:09.342 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.318+0000 7f2c62ffd640 4 set_mon_vals no callback set 2026-02-22T23:28:09.342 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.318+0000 7f2c617fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-22T23:28:09.342 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.318+0000 7f2c617fa640 10 monclient: dump: 2026-02-22T23:28:09.342 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:28:09.342 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:28:09.342 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:09.342 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:09.342 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:28:09.343 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:28:09.343 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:28:09.343 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:28:09.343 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:28:09.343 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:28:09.343 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:28:09.343 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:28:09.343 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:28:09.343 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:28:09.343 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:28:09.343 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:09.343 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.318+0000 7f2c72da9640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.45:6790/0 2026-02-22T23:28:09.343 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.318+0000 7f2c72da9640 1 -- 10.20.193.45:0/1344743676 --> v1:10.20.193.45:6790/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f2c6c13f5a0 con 0x7f2c6c1395d0 2026-02-22T23:28:09.344 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.318+0000 7f2c617fa640 1 -- 10.20.193.45:0/1344743676 <== mon.2 v1:10.20.193.45:6790/0 7 ==== mgrmap(e 5) ==== 50225+0+0 (unknown 2330357642 0 0) 0x7f2c680031f0 con 0x7f2c6c1395d0 2026-02-22T23:28:09.344 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.318+0000 7f2c617fa640 1 -- 10.20.193.45:0/1344743676 <== mon.2 v1:10.20.193.45:6790/0 8 ==== osd_map(25..25 src has 1..25) ==== 3502+0+0 (unknown 129690100 0 0) 0x7f2c6804def0 con 0x7f2c6c1395d0 2026-02-22T23:28:09.344 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.318+0000 7f2c617fa640 1 -- 10.20.193.45:0/1344743676 --> v1:10.20.193.73:6809/1794330816 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2c3c04a630 con 0x7f2c3c0469c0 2026-02-22T23:28:09.344 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.318+0000 7f2c617fa640 1 -- 10.20.193.45:0/1344743676 <== mon.2 v1:10.20.193.45:6790/0 9 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (unknown 2663167439 0 0) 0x7f2c6804e350 con 0x7f2c6c1395d0 2026-02-22T23:28:09.344 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.318+0000 7f2c617fa640 10 monclient: handle_get_version_reply finishing 1 version 25 2026-02-22T23:28:09.344 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.319+0000 7f2c70b1e640 10 monclient: get_auth_request con 0x7f2c3c03fe50 auth_method 0 2026-02-22T23:28:09.344 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.319+0000 7f2c63fff640 10 monclient: get_auth_request con 0x7f2c3c0469c0 auth_method 0 2026-02-22T23:28:09.344 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.320+0000 7f2c617fa640 1 -- 10.20.193.45:0/1344743676 <== osd.5 v1:10.20.193.73:6809/1794330816 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (unknown 0 0 3365489958) 0x7f2c54006e50 con 0x7f2c3c0469c0 2026-02-22T23:28:09.345 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.325+0000 7f2c72da9640 1 -- 10.20.193.45:0/1344743676 --> v1:10.20.193.73:6809/1794330816 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f2c6c0a6800 con 0x7f2c3c0469c0 2026-02-22T23:28:09.345 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.326+0000 7f2c617fa640 1 -- 10.20.193.45:0/1344743676 <== osd.5 v1:10.20.193.73:6809/1794330816 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (unknown 0 0 119112422) 0x7f2c6c0a6800 con 0x7f2c3c0469c0 2026-02-22T23:28:09.345 INFO:teuthology.orchestra.run.trial045.stdout:{ 2026-02-22T23:28:09.345 INFO:teuthology.orchestra.run.trial045.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-22T23:28:09.346 INFO:teuthology.orchestra.run.trial045.stdout:} 2026-02-22T23:28:09.347 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.326+0000 7f2c72da9640 1 -- 10.20.193.45:0/1344743676 >> v1:10.20.193.73:6809/1794330816 conn(0x7f2c3c0469c0 legacy=0x7f2c3c048de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:09.347 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.326+0000 7f2c72da9640 1 -- 10.20.193.45:0/1344743676 >> v1:10.20.193.73:6800/2222410180 conn(0x7f2c3c03fe50 legacy=0x7f2c3c042310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:09.347 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.326+0000 7f2c72da9640 10 monclient: shutdown 2026-02-22T23:28:09.347 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.326+0000 7f2c72da9640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T23:28:09.348 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.326+0000 7f2c72da9640 1 -- 10.20.193.45:0/1344743676 >> v1:10.20.193.45:6790/0 conn(0x7f2c6c1395d0 legacy=0x7f2c6c1d7950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:09.348 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.326+0000 7f2c7131f640 1 -- 10.20.193.45:0/1344743676 reap_dead start 2026-02-22T23:28:09.348 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.326+0000 7f2c72da9640 1 -- 10.20.193.45:0/1344743676 shutdown_connections 2026-02-22T23:28:09.348 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.326+0000 7f2c72da9640 1 -- 10.20.193.45:0/1344743676 >> 10.20.193.45:0/1344743676 conn(0x7f2c6c0a8000 msgr2=0x7f2c6c0a9b00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:28:09.348 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.326+0000 7f2c72da9640 1 -- 10.20.193.45:0/1344743676 shutdown_connections 2026-02-22T23:28:09.348 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.326+0000 7f2c72da9640 1 -- 10.20.193.45:0/1344743676 wait complete. 2026-02-22T23:28:09.348 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2026-02-22T23:28:09.415 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.414+0000 7fa85862b640 10 monclient: get_monmap_and_config 2026-02-22T23:28:09.415 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.414+0000 7fa85862b640 10 monclient: build_initial_monmap 2026-02-22T23:28:09.415 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.414+0000 7fa85862b640 10 monclient: monmap: 2026-02-22T23:28:09.415 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-22T23:28:09.415 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:28:09.415 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:28:09.415255+0000 2026-02-22T23:28:09.415 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:28:09.415255+0000 2026-02-22T23:28:09.415 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-22T23:28:09.415 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:28:09.415 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-22T23:28:09.415 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.noname-f 2026-02-22T23:28:09.415 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.noname-b 2026-02-22T23:28:09.415 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.noname-g 2026-02-22T23:28:09.416 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.noname-c 2026-02-22T23:28:09.416 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.noname-h 2026-02-22T23:28:09.416 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.noname-d 2026-02-22T23:28:09.416 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.noname-i 2026-02-22T23:28:09.416 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.noname-e 2026-02-22T23:28:09.416 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:09.423 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.414+0000 7fa85862b640 1 Processor -- start 2026-02-22T23:28:09.423 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.414+0000 7fa85862b640 1 -- start start 2026-02-22T23:28:09.423 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.414+0000 7fa85862b640 10 monclient: init 2026-02-22T23:28:09.423 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.414+0000 7fa85862b640 10 monclient: _reopen_session rank -1 2026-02-22T23:28:09.423 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.414+0000 7fa85862b640 10 monclient: _add_conns ranks=[1,6,7,4,2,0,8,3,5] 2026-02-22T23:28:09.424 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.414+0000 7fa85862b640 10 monclient(hunting): picked mon.noname-f con 0x7fa8500a1a60 addr v1:10.20.193.73:6789/0 2026-02-22T23:28:09.424 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.414+0000 7fa85862b640 10 monclient(hunting): picked mon.noname-d con 0x7fa85006f1e0 addr v1:10.20.193.45:6792/0 2026-02-22T23:28:09.424 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.414+0000 7fa85862b640 10 monclient(hunting): picked mon.noname-i con 0x7fa8500a0980 addr v1:10.20.193.73:6792/0 2026-02-22T23:28:09.424 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.414+0000 7fa85862b640 1 -- --> v1:10.20.193.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa85009df00 con 0x7fa8500a1a60 2026-02-22T23:28:09.424 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.414+0000 7fa85862b640 1 -- --> v1:10.20.193.45:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa850137660 con 0x7fa85006f1e0 2026-02-22T23:28:09.424 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.414+0000 7fa85862b640 1 -- --> v1:10.20.193.73:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa8500a4510 con 0x7fa8500a0980 2026-02-22T23:28:09.424 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.414+0000 7fa85862b640 10 monclient(hunting): _renew_subs 2026-02-22T23:28:09.424 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.414+0000 7fa85862b640 10 monclient(hunting): authenticate will time out at 821.031864s 2026-02-22T23:28:09.424 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.414+0000 7fa855b9f640 1 --1- >> v1:10.20.193.45:6792/0 conn(0x7fa85006f1e0 0x7fa850136f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.45:6792/0 says I am v1:10.20.193.45:36932/0 (socket says 10.20.193.45:36932) 2026-02-22T23:28:09.424 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.414+0000 7fa855b9f640 1 -- 10.20.193.45:0/813187807 learned_addr learned my addr 10.20.193.45:0/813187807 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-22T23:28:09.424 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.415+0000 7fa85539e640 1 -- 10.20.193.45:0/813187807 <== mon.6 v1:10.20.193.45:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 141040521 0 0) 0x7fa850137660 con 0x7fa85006f1e0 2026-02-22T23:28:09.425 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.415+0000 7fa85539e640 10 monclient(hunting): _negotiate 2026-02-22T23:28:09.425 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.415+0000 7fa85539e640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:28:09.425 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.415+0000 7fa85539e640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:28:09.425 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.415+0000 7fa85539e640 10 monclient(hunting): my global_id is 114288 2026-02-22T23:28:09.425 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.415+0000 7fa85539e640 1 -- 10.20.193.45:0/813187807 --> v1:10.20.193.45:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa838003620 con 0x7fa85006f1e0 2026-02-22T23:28:09.425 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.415+0000 7fa85539e640 1 -- 10.20.193.45:0/813187807 <== mon.6 v1:10.20.193.45:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3855069248 0 0) 0x7fa838003620 con 0x7fa85006f1e0 2026-02-22T23:28:09.425 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.415+0000 7fa85539e640 1 -- 10.20.193.45:0/813187807 >> v1:10.20.193.73:6792/0 conn(0x7fa8500a0980 legacy=0x7fa85013ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:09.425 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.415+0000 7fa85539e640 1 -- 10.20.193.45:0/813187807 >> v1:10.20.193.73:6789/0 conn(0x7fa8500a1a60 legacy=0x7fa850136840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:09.425 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.415+0000 7fa85539e640 10 monclient: _finish_hunting 0 2026-02-22T23:28:09.425 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.415+0000 7fa85539e640 1 monclient: found mon.noname-d 2026-02-22T23:28:09.425 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.415+0000 7fa85539e640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T23:28:09.426 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.415+0000 7fa85539e640 10 monclient: _send_mon_message to mon.noname-d at v1:10.20.193.45:6792/0 2026-02-22T23:28:09.426 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.415+0000 7fa85539e640 1 -- 10.20.193.45:0/813187807 --> v1:10.20.193.45:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa850143400 con 0x7fa85006f1e0 2026-02-22T23:28:09.426 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.415+0000 7fa85539e640 10 monclient: _finish_auth 0 2026-02-22T23:28:09.426 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.415+0000 7fa85539e640 10 monclient: _check_auth_tickets 2026-02-22T23:28:09.426 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.415+0000 7fa85539e640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T23:28:09.426 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.415+0000 7fa85862b640 5 monclient: authenticate success, global_id 114288 2026-02-22T23:28:09.426 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.415+0000 7fa85539e640 1 -- 10.20.193.45:0/813187807 <== mon.6 v1:10.20.193.45:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7fa844003040 con 0x7fa85006f1e0 2026-02-22T23:28:09.426 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.415+0000 7fa85862b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-22T23:28:09.426 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.415+0000 7fa85539e640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:28:09.426 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.415+0000 7fa85539e640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2026-02-22T23:28:09.426 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.415+0000 7fa85539e640 10 monclient: dump: 2026-02-22T23:28:09.426 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:28:09.427 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:28:09.427 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:09.427 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:09.427 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:28:09.427 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:28:09.427 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:28:09.427 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:28:09.427 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:28:09.427 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:28:09.427 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:28:09.427 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:28:09.427 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:28:09.427 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:28:09.428 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:28:09.428 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:09.428 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.415+0000 7fa85862b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-22T23:28:09.428 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.415+0000 7fa85539e640 1 -- 10.20.193.45:0/813187807 <== mon.6 v1:10.20.193.45:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa8440031e0 con 0x7fa85006f1e0 2026-02-22T23:28:09.428 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.415+0000 7fa85539e640 10 monclient: handle_config config(0 keys) 2026-02-22T23:28:09.428 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.415+0000 7fa85539e640 1 -- 10.20.193.45:0/813187807 <== mon.6 v1:10.20.193.45:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7fa844004ce0 con 0x7fa85006f1e0 2026-02-22T23:28:09.428 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.415+0000 7fa85539e640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:28:09.428 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.415+0000 7fa85539e640 10 monclient: got monmap 1 from mon.d (according to old e1) 2026-02-22T23:28:09.428 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.415+0000 7fa85539e640 10 monclient: dump: 2026-02-22T23:28:09.428 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:28:09.428 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:28:09.428 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:09.429 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:09.429 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:28:09.429 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:28:09.429 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:28:09.429 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:28:09.429 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:28:09.429 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:28:09.429 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:28:09.429 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:28:09.429 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:28:09.429 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:28:09.429 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:28:09.429 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:09.430 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.415+0000 7fa85862b640 10 monclient: get_monmap_and_config success 2026-02-22T23:28:09.430 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.415+0000 7fa85862b640 4 set_mon_vals no callback set 2026-02-22T23:28:09.430 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.415+0000 7fa85862b640 10 monclient: shutdown 2026-02-22T23:28:09.430 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.415+0000 7fa85862b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T23:28:09.430 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.415+0000 7fa85862b640 1 -- 10.20.193.45:0/813187807 >> v1:10.20.193.45:6792/0 conn(0x7fa85006f1e0 legacy=0x7fa850136f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:09.430 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.415+0000 7fa85862b640 1 -- 10.20.193.45:0/813187807 shutdown_connections 2026-02-22T23:28:09.430 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.415+0000 7fa85862b640 1 -- 10.20.193.45:0/813187807 >> 10.20.193.45:0/813187807 conn(0x7fa8500a7780 msgr2=0x7fa8500a3b60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:28:09.430 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.415+0000 7fa85862b640 1 -- 10.20.193.45:0/813187807 shutdown_connections 2026-02-22T23:28:09.430 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.415+0000 7fa85862b640 1 -- 10.20.193.45:0/813187807 wait complete. 2026-02-22T23:28:09.430 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.416+0000 7fa85862b640 10 monclient: build_initial_monmap 2026-02-22T23:28:09.430 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.416+0000 7fa85862b640 10 monclient: monmap: 2026-02-22T23:28:09.430 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-22T23:28:09.431 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T23:28:09.431 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-22T23:28:09.431 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-22T23:28:09.431 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-22T23:28:09.431 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-22T23:28:09.431 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-22T23:28:09.431 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.noname-f 2026-02-22T23:28:09.431 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.noname-b 2026-02-22T23:28:09.431 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.noname-g 2026-02-22T23:28:09.431 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.noname-c 2026-02-22T23:28:09.431 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.noname-h 2026-02-22T23:28:09.431 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.noname-d 2026-02-22T23:28:09.431 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.noname-i 2026-02-22T23:28:09.432 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.noname-e 2026-02-22T23:28:09.432 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:09.432 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.416+0000 7fa85862b640 1 Processor -- start 2026-02-22T23:28:09.432 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.416+0000 7fa85862b640 1 -- start start 2026-02-22T23:28:09.432 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.416+0000 7fa85862b640 10 monclient: init 2026-02-22T23:28:09.432 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.416+0000 7fa85862b640 10 monclient: _reopen_session rank -1 2026-02-22T23:28:09.432 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.416+0000 7fa85862b640 10 monclient: _add_conns ranks=[4,3,1,8,2,5,0,6,7] 2026-02-22T23:28:09.432 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.416+0000 7fa85862b640 10 monclient(hunting): picked mon.noname-c con 0x7fa8500a0980 addr v1:10.20.193.45:6791/0 2026-02-22T23:28:09.432 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.416+0000 7fa85862b640 10 monclient(hunting): picked mon.noname-g con 0x7fa8500a1a60 addr v1:10.20.193.73:6790/0 2026-02-22T23:28:09.432 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.416+0000 7fa85862b640 10 monclient(hunting): picked mon.noname-f con 0x7fa85013e2e0 addr v1:10.20.193.73:6789/0 2026-02-22T23:28:09.432 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.416+0000 7fa85862b640 1 -- --> v1:10.20.193.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa85011e2f0 con 0x7fa85013e2e0 2026-02-22T23:28:09.432 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.416+0000 7fa85862b640 1 -- --> v1:10.20.193.73:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa85011e5d0 con 0x7fa8500a1a60 2026-02-22T23:28:09.433 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.416+0000 7fa85862b640 1 -- --> v1:10.20.193.45:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa8500a0230 con 0x7fa8500a0980 2026-02-22T23:28:09.433 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.416+0000 7fa85862b640 10 monclient(hunting): _renew_subs 2026-02-22T23:28:09.433 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.416+0000 7fa85862b640 10 monclient(hunting): authenticate will time out at 821.033484s 2026-02-22T23:28:09.433 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.416+0000 7fa8563a0640 1 --1- >> v1:10.20.193.45:6791/0 conn(0x7fa8500a0980 0x7fa8501366b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.45:6791/0 says I am v1:10.20.193.45:57818/0 (socket says 10.20.193.45:57818) 2026-02-22T23:28:09.433 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.416+0000 7fa8563a0640 1 -- 10.20.193.45:0/767197726 learned_addr learned my addr 10.20.193.45:0/767197726 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-22T23:28:09.433 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.416+0000 7fa836ffd640 1 -- 10.20.193.45:0/767197726 <== mon.4 v1:10.20.193.45:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3388154472 0 0) 0x7fa8500a0230 con 0x7fa8500a0980 2026-02-22T23:28:09.433 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.416+0000 7fa836ffd640 10 monclient(hunting): _negotiate 2026-02-22T23:28:09.433 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.416+0000 7fa836ffd640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:28:09.433 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.416+0000 7fa836ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:28:09.433 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.416+0000 7fa836ffd640 10 monclient(hunting): my global_id is 114277 2026-02-22T23:28:09.433 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.416+0000 7fa836ffd640 1 -- 10.20.193.45:0/767197726 --> v1:10.20.193.45:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa820003620 con 0x7fa8500a0980 2026-02-22T23:28:09.433 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.416+0000 7fa836ffd640 1 -- 10.20.193.45:0/767197726 <== mon.1 v1:10.20.193.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3690742434 0 0) 0x7fa85011e2f0 con 0x7fa85013e2e0 2026-02-22T23:28:09.434 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.416+0000 7fa836ffd640 10 monclient(hunting): _negotiate 2026-02-22T23:28:09.434 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.416+0000 7fa836ffd640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:28:09.434 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.416+0000 7fa836ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:28:09.434 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.416+0000 7fa836ffd640 10 monclient(hunting): my global_id is 114283 2026-02-22T23:28:09.434 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.416+0000 7fa836ffd640 1 -- 10.20.193.45:0/767197726 --> v1:10.20.193.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa8500a0230 con 0x7fa85013e2e0 2026-02-22T23:28:09.434 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.416+0000 7fa836ffd640 1 -- 10.20.193.45:0/767197726 <== mon.4 v1:10.20.193.45:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3552497516 0 0) 0x7fa820003620 con 0x7fa8500a0980 2026-02-22T23:28:09.434 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.416+0000 7fa836ffd640 1 -- 10.20.193.45:0/767197726 --> v1:10.20.193.45:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa85011e2f0 con 0x7fa8500a0980 2026-02-22T23:28:09.434 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.416+0000 7fa836ffd640 1 -- 10.20.193.45:0/767197726 <== mon.4 v1:10.20.193.45:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7fa8400032e0 con 0x7fa8500a0980 2026-02-22T23:28:09.434 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.416+0000 7fa836ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-22T23:28:09.434 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.416+0000 7fa836ffd640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-22T23:28:09.434 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.416+0000 7fa836ffd640 10 monclient(hunting): dump: 2026-02-22T23:28:09.434 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:28:09.434 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:28:09.435 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:09.435 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:09.435 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:28:09.435 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:28:09.435 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:28:09.435 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:28:09.435 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:28:09.435 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:28:09.435 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:28:09.435 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:28:09.435 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:28:09.435 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:28:09.436 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:28:09.436 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:09.436 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.416+0000 7fa836ffd640 10 monclient(hunting): _finish_auth 0 2026-02-22T23:28:09.436 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.416+0000 7fa836ffd640 1 -- 10.20.193.45:0/767197726 <== mon.4 v1:10.20.193.45:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 709080830 0 0) 0x7fa85011e2f0 con 0x7fa8500a0980 2026-02-22T23:28:09.436 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.416+0000 7fa836ffd640 1 -- 10.20.193.45:0/767197726 >> v1:10.20.193.73:6790/0 conn(0x7fa8500a1a60 legacy=0x7fa8501d47a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:09.436 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.416+0000 7fa836ffd640 1 -- 10.20.193.45:0/767197726 >> v1:10.20.193.73:6789/0 conn(0x7fa85013e2e0 legacy=0x7fa8501d7ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:09.436 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.416+0000 7fa836ffd640 10 monclient: _finish_hunting 0 2026-02-22T23:28:09.436 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.416+0000 7fa836ffd640 1 monclient: found mon.c 2026-02-22T23:28:09.436 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.416+0000 7fa836ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T23:28:09.436 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.416+0000 7fa836ffd640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.45:6791/0 2026-02-22T23:28:09.436 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.416+0000 7fa836ffd640 1 -- 10.20.193.45:0/767197726 --> v1:10.20.193.45:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa85011e010 con 0x7fa8500a0980 2026-02-22T23:28:09.436 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.416+0000 7fa836ffd640 10 monclient: _finish_auth 0 2026-02-22T23:28:09.436 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.416+0000 7fa836ffd640 10 monclient: _check_auth_tickets 2026-02-22T23:28:09.437 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.416+0000 7fa836ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T23:28:09.437 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.416+0000 7fa85862b640 5 monclient: authenticate success, global_id 114277 2026-02-22T23:28:09.437 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.416+0000 7fa85862b640 10 monclient: _renew_subs 2026-02-22T23:28:09.437 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.416+0000 7fa85862b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.45:6791/0 2026-02-22T23:28:09.437 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.416+0000 7fa85862b640 1 -- 10.20.193.45:0/767197726 --> v1:10.20.193.45:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fa85013f810 con 0x7fa8500a0980 2026-02-22T23:28:09.437 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.416+0000 7fa85862b640 10 monclient: _renew_subs 2026-02-22T23:28:09.437 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.416+0000 7fa85862b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.45:6791/0 2026-02-22T23:28:09.437 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.416+0000 7fa85862b640 1 -- 10.20.193.45:0/767197726 --> v1:10.20.193.45:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7fa850136fa0 con 0x7fa8500a0980 2026-02-22T23:28:09.437 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.417+0000 7fa836ffd640 1 -- 10.20.193.45:0/767197726 <== mon.4 v1:10.20.193.45:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa8400039c0 con 0x7fa8500a0980 2026-02-22T23:28:09.437 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.417+0000 7fa836ffd640 10 monclient: handle_config config(0 keys) 2026-02-22T23:28:09.437 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.417+0000 7fa836ffd640 1 -- 10.20.193.45:0/767197726 <== mon.4 v1:10.20.193.45:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7fa840003eb0 con 0x7fa8500a0980 2026-02-22T23:28:09.437 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.417+0000 7fa836ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:28:09.437 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.417+0000 7fa836ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T23:28:09.438 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.417+0000 7fa854b9d640 4 set_mon_vals no callback set 2026-02-22T23:28:09.438 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.417+0000 7fa836ffd640 10 monclient: dump: 2026-02-22T23:28:09.438 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:28:09.438 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:28:09.438 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:09.438 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:09.438 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:28:09.438 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:28:09.438 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:28:09.438 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:28:09.438 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:28:09.438 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:28:09.438 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:28:09.439 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:28:09.439 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:28:09.439 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:28:09.439 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:28:09.439 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:09.439 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.417+0000 7fa85862b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T23:28:09.439 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.417+0000 7fa85862b640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T23:28:09.439 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.417+0000 7fa85862b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.45:6791/0 2026-02-22T23:28:09.439 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.417+0000 7fa85862b640 1 -- 10.20.193.45:0/767197726 --> v1:10.20.193.45:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa8500008d0 con 0x7fa8500a0980 2026-02-22T23:28:09.439 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.417+0000 7fa836ffd640 1 -- 10.20.193.45:0/767197726 <== mon.4 v1:10.20.193.45:6791/0 7 ==== mgrmap(e 5) ==== 50225+0+0 (unknown 2330357642 0 0) 0x7fa8400040d0 con 0x7fa8500a0980 2026-02-22T23:28:09.439 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.417+0000 7fa836ffd640 1 -- 10.20.193.45:0/767197726 <== mon.4 v1:10.20.193.45:6791/0 8 ==== osd_map(25..25 src has 1..25) ==== 3502+0+0 (unknown 129690100 0 0) 0x7fa84004dd30 con 0x7fa8500a0980 2026-02-22T23:28:09.440 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.417+0000 7fa855b9f640 10 monclient: get_auth_request con 0x7fa82003f8d0 auth_method 0 2026-02-22T23:28:09.440 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.420+0000 7fa836ffd640 1 -- 10.20.193.45:0/767197726 <== mon.4 v1:10.20.193.45:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (unknown 1092875540 0 2568732696) 0x7fa85009df00 con 0x7fa8500a0980 2026-02-22T23:28:09.440 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.420+0000 7fa836ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T23:28:09.440 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.420+0000 7fa836ffd640 10 monclient: _finish_command 1 = system:0 2026-02-22T23:28:09.504 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.502+0000 7fa85862b640 1 -- 10.20.193.45:0/767197726 --> v1:10.20.193.73:6800/2222410180 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7fa8500a0610 con 0x7fa82003f8d0 2026-02-22T23:28:09.504 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.502+0000 7fa836ffd640 1 -- 10.20.193.45:0/767197726 <== mgr.4111 v1:10.20.193.73:6800/2222410180 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (unknown 2264484800 0 0) 0x7fa8500a0610 con 0x7fa82003f8d0 2026-02-22T23:28:09.505 INFO:teuthology.orchestra.run.trial045.stderr:instructed osd(s) 5 to deep-scrub 2026-02-22T23:28:09.506 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.503+0000 7fa85862b640 1 -- 10.20.193.45:0/767197726 >> v1:10.20.193.73:6800/2222410180 conn(0x7fa82003f8d0 legacy=0x7fa820041d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:09.506 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.503+0000 7fa85862b640 10 monclient: shutdown 2026-02-22T23:28:09.506 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.503+0000 7fa85862b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T23:28:09.506 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.503+0000 7fa85862b640 1 -- 10.20.193.45:0/767197726 >> v1:10.20.193.45:6791/0 conn(0x7fa8500a0980 legacy=0x7fa8501366b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:09.506 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.503+0000 7fa85862b640 1 -- 10.20.193.45:0/767197726 shutdown_connections 2026-02-22T23:28:09.506 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.503+0000 7fa85862b640 1 -- 10.20.193.45:0/767197726 >> 10.20.193.45:0/767197726 conn(0x7fa8500a7780 msgr2=0x7fa8500a5a80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:28:09.506 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.503+0000 7fa85862b640 1 -- 10.20.193.45:0/767197726 shutdown_connections 2026-02-22T23:28:09.506 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.503+0000 7fa85862b640 1 -- 10.20.193.45:0/767197726 wait complete. 2026-02-22T23:28:09.513 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-22T23:28:09.581 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.580+0000 7fcee20da640 10 monclient: get_monmap_and_config 2026-02-22T23:28:09.582 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.580+0000 7fcee20da640 10 monclient: build_initial_monmap 2026-02-22T23:28:09.582 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.580+0000 7fcee20da640 10 monclient: monmap: 2026-02-22T23:28:09.582 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-22T23:28:09.582 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:28:09.582 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:28:09.581464+0000 2026-02-22T23:28:09.582 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:28:09.581464+0000 2026-02-22T23:28:09.582 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-22T23:28:09.582 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:28:09.582 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-22T23:28:09.582 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.noname-f 2026-02-22T23:28:09.582 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.noname-b 2026-02-22T23:28:09.582 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.noname-g 2026-02-22T23:28:09.582 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.noname-c 2026-02-22T23:28:09.583 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.noname-h 2026-02-22T23:28:09.583 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.noname-d 2026-02-22T23:28:09.583 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.noname-i 2026-02-22T23:28:09.583 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.noname-e 2026-02-22T23:28:09.583 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:09.588 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.580+0000 7fcee20da640 1 Processor -- start 2026-02-22T23:28:09.589 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.580+0000 7fcee20da640 1 -- start start 2026-02-22T23:28:09.589 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.580+0000 7fcee20da640 10 monclient: init 2026-02-22T23:28:09.589 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.580+0000 7fcee20da640 10 monclient: _reopen_session rank -1 2026-02-22T23:28:09.589 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.580+0000 7fcee20da640 10 monclient: _add_conns ranks=[4,5,2,6,0,3,7,8,1] 2026-02-22T23:28:09.589 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.580+0000 7fcee20da640 10 monclient(hunting): picked mon.noname-c con 0x7fcedc0a5d90 addr v1:10.20.193.45:6791/0 2026-02-22T23:28:09.589 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.581+0000 7fcee20da640 10 monclient(hunting): picked mon.noname-h con 0x7fcedc0a6880 addr v1:10.20.193.73:6791/0 2026-02-22T23:28:09.589 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.581+0000 7fcee20da640 10 monclient(hunting): picked mon.noname-b con 0x7fcedc0a3d30 addr v1:10.20.193.45:6790/0 2026-02-22T23:28:09.589 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.581+0000 7fcee20da640 1 -- --> v1:10.20.193.45:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcedc0a7200 con 0x7fcedc0a3d30 2026-02-22T23:28:09.589 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.581+0000 7fcee20da640 1 -- --> v1:10.20.193.45:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcedc0a8c90 con 0x7fcedc0a5d90 2026-02-22T23:28:09.589 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.581+0000 7fcee20da640 1 -- --> v1:10.20.193.73:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcedc0a6ef0 con 0x7fcedc0a6880 2026-02-22T23:28:09.589 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.581+0000 7fcee20da640 10 monclient(hunting): _renew_subs 2026-02-22T23:28:09.589 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.581+0000 7fcee20da640 10 monclient(hunting): authenticate will time out at 821.198043s 2026-02-22T23:28:09.589 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.581+0000 7fcedbfff640 1 --1- >> v1:10.20.193.45:6790/0 conn(0x7fcedc0a3d30 0x7fcedc141740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.45:6790/0 says I am v1:10.20.193.45:60280/0 (socket says 10.20.193.45:60280) 2026-02-22T23:28:09.589 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.581+0000 7fcedbfff640 1 -- 10.20.193.45:0/897818764 learned_addr learned my addr 10.20.193.45:0/897818764 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-22T23:28:09.589 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.581+0000 7fceda7fc640 1 -- 10.20.193.45:0/897818764 <== mon.2 v1:10.20.193.45:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1739083685 0 0) 0x7fcedc0a7200 con 0x7fcedc0a3d30 2026-02-22T23:28:09.589 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.581+0000 7fceda7fc640 10 monclient(hunting): _negotiate 2026-02-22T23:28:09.589 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.581+0000 7fceda7fc640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:28:09.589 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.581+0000 7fceda7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:28:09.589 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.581+0000 7fceda7fc640 10 monclient(hunting): my global_id is 4835 2026-02-22T23:28:09.590 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.581+0000 7fceda7fc640 1 -- 10.20.193.45:0/897818764 --> v1:10.20.193.45:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcec0003620 con 0x7fcedc0a3d30 2026-02-22T23:28:09.590 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.581+0000 7fceda7fc640 1 -- 10.20.193.45:0/897818764 <== mon.4 v1:10.20.193.45:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3484243645 0 0) 0x7fcedc0a8c90 con 0x7fcedc0a5d90 2026-02-22T23:28:09.590 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.581+0000 7fceda7fc640 10 monclient(hunting): _negotiate 2026-02-22T23:28:09.590 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.581+0000 7fceda7fc640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:28:09.590 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.581+0000 7fceda7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:28:09.590 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.581+0000 7fceda7fc640 10 monclient(hunting): my global_id is 114286 2026-02-22T23:28:09.590 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.581+0000 7fceda7fc640 1 -- 10.20.193.45:0/897818764 --> v1:10.20.193.45:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcedc0a7200 con 0x7fcedc0a5d90 2026-02-22T23:28:09.590 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.581+0000 7fceda7fc640 1 -- 10.20.193.45:0/897818764 <== mon.4 v1:10.20.193.45:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3219963290 0 0) 0x7fcedc0a7200 con 0x7fcedc0a5d90 2026-02-22T23:28:09.590 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.581+0000 7fceda7fc640 1 -- 10.20.193.45:0/897818764 >> v1:10.20.193.73:6791/0 conn(0x7fcedc0a6880 legacy=0x7fcedc13e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:09.590 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.581+0000 7fceda7fc640 1 -- 10.20.193.45:0/897818764 >> v1:10.20.193.45:6790/0 conn(0x7fcedc0a3d30 legacy=0x7fcedc141740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:09.590 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.581+0000 7fceda7fc640 10 monclient: _finish_hunting 0 2026-02-22T23:28:09.590 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.581+0000 7fceda7fc640 1 monclient: found mon.noname-c 2026-02-22T23:28:09.590 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.581+0000 7fceda7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T23:28:09.590 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.581+0000 7fceda7fc640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.45:6791/0 2026-02-22T23:28:09.590 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.581+0000 7fceda7fc640 1 -- 10.20.193.45:0/897818764 --> v1:10.20.193.45:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcedc0a2c20 con 0x7fcedc0a5d90 2026-02-22T23:28:09.590 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.581+0000 7fceda7fc640 10 monclient: _finish_auth 0 2026-02-22T23:28:09.590 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.581+0000 7fceda7fc640 10 monclient: _check_auth_tickets 2026-02-22T23:28:09.590 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.581+0000 7fceda7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T23:28:09.590 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.581+0000 7fceda7fc640 1 -- 10.20.193.45:0/897818764 <== mon.4 v1:10.20.193.45:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7fcec8003020 con 0x7fcedc0a5d90 2026-02-22T23:28:09.590 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.581+0000 7fcee20da640 5 monclient: authenticate success, global_id 114286 2026-02-22T23:28:09.591 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.581+0000 7fcee20da640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-22T23:28:09.591 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.581+0000 7fceda7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:28:09.591 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.581+0000 7fceda7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-22T23:28:09.591 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.581+0000 7fceda7fc640 10 monclient: dump: 2026-02-22T23:28:09.591 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:28:09.591 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:28:09.591 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:09.591 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:09.591 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:28:09.591 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:28:09.591 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:28:09.591 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:28:09.591 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:28:09.591 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:28:09.591 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:28:09.591 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:28:09.591 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:28:09.591 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:28:09.591 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:28:09.591 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:09.591 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.581+0000 7fcee20da640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-22T23:28:09.592 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.581+0000 7fceda7fc640 1 -- 10.20.193.45:0/897818764 <== mon.4 v1:10.20.193.45:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fcec80031c0 con 0x7fcedc0a5d90 2026-02-22T23:28:09.592 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.581+0000 7fceda7fc640 10 monclient: handle_config config(0 keys) 2026-02-22T23:28:09.592 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.581+0000 7fceda7fc640 1 -- 10.20.193.45:0/897818764 <== mon.4 v1:10.20.193.45:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7fcec8003a50 con 0x7fcedc0a5d90 2026-02-22T23:28:09.592 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.581+0000 7fcee20da640 10 monclient: get_monmap_and_config success 2026-02-22T23:28:09.592 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.581+0000 7fcee20da640 4 set_mon_vals no callback set 2026-02-22T23:28:09.592 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.581+0000 7fceda7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:28:09.592 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.581+0000 7fceda7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T23:28:09.592 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.581+0000 7fceda7fc640 10 monclient: dump: 2026-02-22T23:28:09.592 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:28:09.592 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:28:09.592 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:09.592 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:09.592 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:28:09.592 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:28:09.592 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:28:09.592 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:28:09.592 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:28:09.592 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:28:09.592 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:28:09.592 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:28:09.592 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:28:09.592 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:28:09.592 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:28:09.593 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:09.593 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.581+0000 7fcee20da640 10 monclient: shutdown 2026-02-22T23:28:09.593 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.581+0000 7fcee20da640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T23:28:09.593 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.581+0000 7fcee20da640 1 -- 10.20.193.45:0/897818764 >> v1:10.20.193.45:6791/0 conn(0x7fcedc0a5d90 legacy=0x7fcedc0a6170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:09.593 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.581+0000 7fcee20da640 1 -- 10.20.193.45:0/897818764 shutdown_connections 2026-02-22T23:28:09.593 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.581+0000 7fcee20da640 1 -- 10.20.193.45:0/897818764 >> 10.20.193.45:0/897818764 conn(0x7fcedc0ab9c0 msgr2=0x7fcedc0a7e90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:28:09.593 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.581+0000 7fcee20da640 1 -- 10.20.193.45:0/897818764 shutdown_connections 2026-02-22T23:28:09.593 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.581+0000 7fcee20da640 1 -- 10.20.193.45:0/897818764 wait complete. 2026-02-22T23:28:09.593 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.582+0000 7fcee20da640 10 monclient: build_initial_monmap 2026-02-22T23:28:09.593 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.582+0000 7fcee20da640 10 monclient: monmap: 2026-02-22T23:28:09.593 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-22T23:28:09.593 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T23:28:09.593 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-22T23:28:09.593 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-22T23:28:09.593 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-22T23:28:09.593 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-22T23:28:09.593 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-22T23:28:09.593 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.noname-f 2026-02-22T23:28:09.593 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.noname-b 2026-02-22T23:28:09.593 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.noname-g 2026-02-22T23:28:09.593 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.noname-c 2026-02-22T23:28:09.594 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.noname-h 2026-02-22T23:28:09.594 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.noname-d 2026-02-22T23:28:09.594 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.noname-i 2026-02-22T23:28:09.594 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.noname-e 2026-02-22T23:28:09.594 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:09.594 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.582+0000 7fcee20da640 1 Processor -- start 2026-02-22T23:28:09.594 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.582+0000 7fcee20da640 1 -- start start 2026-02-22T23:28:09.594 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.582+0000 7fcee20da640 10 monclient: init 2026-02-22T23:28:09.594 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.582+0000 7fcee20da640 10 monclient: _reopen_session rank -1 2026-02-22T23:28:09.594 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.582+0000 7fcee20da640 10 monclient: _add_conns ranks=[7,0,4,3,6,8,5,2,1] 2026-02-22T23:28:09.594 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.582+0000 7fcee20da640 10 monclient(hunting): picked mon.noname-i con 0x7fcedc0a3d30 addr v1:10.20.193.73:6792/0 2026-02-22T23:28:09.594 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.582+0000 7fcee20da640 10 monclient(hunting): picked mon.noname-a con 0x7fcedc0a5d90 addr v1:10.20.193.45:6789/0 2026-02-22T23:28:09.594 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.582+0000 7fcee20da640 10 monclient(hunting): picked mon.noname-c con 0x7fcedc0a6880 addr v1:10.20.193.45:6791/0 2026-02-22T23:28:09.594 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.582+0000 7fcee20da640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcedc128ef0 con 0x7fcedc0a5d90 2026-02-22T23:28:09.594 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.582+0000 7fcee20da640 1 -- --> v1:10.20.193.45:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcedc0a9e20 con 0x7fcedc0a6880 2026-02-22T23:28:09.594 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.582+0000 7fcee20da640 1 -- --> v1:10.20.193.73:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcedc126c00 con 0x7fcedc0a3d30 2026-02-22T23:28:09.594 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.582+0000 7fcee20da640 10 monclient(hunting): _renew_subs 2026-02-22T23:28:09.594 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.582+0000 7fcee20da640 10 monclient(hunting): authenticate will time out at 821.199639s 2026-02-22T23:28:09.594 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.582+0000 7fcedbfff640 1 --1- >> v1:10.20.193.45:6791/0 conn(0x7fcedc0a6880 0x7fcedc1d7b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.45:6791/0 says I am v1:10.20.193.45:57836/0 (socket says 10.20.193.45:57836) 2026-02-22T23:28:09.594 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.582+0000 7fcedbfff640 1 -- 10.20.193.45:0/2433760302 learned_addr learned my addr 10.20.193.45:0/2433760302 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-22T23:28:09.594 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.582+0000 7fceb7fff640 1 -- 10.20.193.45:0/2433760302 <== mon.4 v1:10.20.193.45:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 311028629 0 0) 0x7fcedc0a9e20 con 0x7fcedc0a6880 2026-02-22T23:28:09.594 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.582+0000 7fceb7fff640 10 monclient(hunting): _negotiate 2026-02-22T23:28:09.595 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.582+0000 7fceb7fff640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:28:09.595 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.582+0000 7fceb7fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:28:09.595 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.582+0000 7fceb7fff640 10 monclient(hunting): my global_id is 114295 2026-02-22T23:28:09.595 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.582+0000 7fceb7fff640 1 -- 10.20.193.45:0/2433760302 --> v1:10.20.193.45:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fceac003620 con 0x7fcedc0a6880 2026-02-22T23:28:09.595 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.582+0000 7fceb7fff640 1 -- 10.20.193.45:0/2433760302 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1137150719 0 0) 0x7fcedc128ef0 con 0x7fcedc0a5d90 2026-02-22T23:28:09.595 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.582+0000 7fceb7fff640 10 monclient(hunting): _negotiate 2026-02-22T23:28:09.595 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.582+0000 7fceb7fff640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:28:09.595 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.582+0000 7fceb7fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:28:09.595 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.582+0000 7fceb7fff640 10 monclient(hunting): my global_id is 4698 2026-02-22T23:28:09.595 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.582+0000 7fceb7fff640 1 -- 10.20.193.45:0/2433760302 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcedc0a9e20 con 0x7fcedc0a5d90 2026-02-22T23:28:09.595 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.582+0000 7fceb7fff640 1 -- 10.20.193.45:0/2433760302 <== mon.4 v1:10.20.193.45:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2221070437 0 0) 0x7fceac003620 con 0x7fcedc0a6880 2026-02-22T23:28:09.595 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.582+0000 7fceb7fff640 1 -- 10.20.193.45:0/2433760302 --> v1:10.20.193.45:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fcedc128ef0 con 0x7fcedc0a6880 2026-02-22T23:28:09.595 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.582+0000 7fceb7fff640 1 -- 10.20.193.45:0/2433760302 <== mon.4 v1:10.20.193.45:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7fced0003130 con 0x7fcedc0a6880 2026-02-22T23:28:09.595 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.582+0000 7fceb7fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-22T23:28:09.595 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.582+0000 7fceb7fff640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-22T23:28:09.595 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.582+0000 7fceb7fff640 10 monclient(hunting): dump: 2026-02-22T23:28:09.595 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:28:09.595 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:28:09.595 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:09.595 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:09.595 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:28:09.595 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:28:09.595 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:28:09.595 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:28:09.596 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:28:09.596 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:28:09.596 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:28:09.596 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:28:09.596 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:28:09.596 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:28:09.596 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:28:09.596 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:09.596 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.582+0000 7fceb7fff640 10 monclient(hunting): _finish_auth 0 2026-02-22T23:28:09.596 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.582+0000 7fceb7fff640 1 -- 10.20.193.45:0/2433760302 <== mon.7 v1:10.20.193.73:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3735960884 0 0) 0x7fcedc126c00 con 0x7fcedc0a3d30 2026-02-22T23:28:09.596 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.582+0000 7fceb7fff640 10 monclient(hunting): _negotiate 2026-02-22T23:28:09.596 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.582+0000 7fceb7fff640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:28:09.596 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.582+0000 7fceb7fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:28:09.596 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.582+0000 7fceb7fff640 10 monclient(hunting): my global_id is 4678 2026-02-22T23:28:09.596 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.582+0000 7fceb7fff640 1 -- 10.20.193.45:0/2433760302 --> v1:10.20.193.73:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fceac003620 con 0x7fcedc0a3d30 2026-02-22T23:28:09.596 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.582+0000 7fceb7fff640 1 -- 10.20.193.45:0/2433760302 <== mon.0 v1:10.20.193.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2857616425 0 0) 0x7fcedc0a9e20 con 0x7fcedc0a5d90 2026-02-22T23:28:09.596 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.582+0000 7fceb7fff640 1 -- 10.20.193.45:0/2433760302 --> v1:10.20.193.45:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fcedc126c00 con 0x7fcedc0a5d90 2026-02-22T23:28:09.596 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.582+0000 7fceb7fff640 1 -- 10.20.193.45:0/2433760302 <== mon.0 v1:10.20.193.45:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7fcecc003200 con 0x7fcedc0a5d90 2026-02-22T23:28:09.596 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.582+0000 7fceb7fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-22T23:28:09.596 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.582+0000 7fceb7fff640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-22T23:28:09.596 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.582+0000 7fceb7fff640 10 monclient(hunting): dump: 2026-02-22T23:28:09.596 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:28:09.596 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:28:09.597 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:09.597 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:09.597 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:28:09.597 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:28:09.597 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:28:09.597 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:28:09.597 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:28:09.597 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:28:09.597 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:28:09.597 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:28:09.597 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:28:09.597 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:28:09.597 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:28:09.597 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:09.597 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.583+0000 7fceb7fff640 1 -- 10.20.193.45:0/2433760302 <== mon.4 v1:10.20.193.45:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2489555890 0 0) 0x7fcedc128ef0 con 0x7fcedc0a6880 2026-02-22T23:28:09.597 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.583+0000 7fceb7fff640 1 -- 10.20.193.45:0/2433760302 >> v1:10.20.193.73:6792/0 conn(0x7fcedc0a3d30 legacy=0x7fcedc141590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:09.597 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.583+0000 7fceb7fff640 1 -- 10.20.193.45:0/2433760302 >> v1:10.20.193.45:6789/0 conn(0x7fcedc0a5d90 legacy=0x7fcedc1d4460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:09.597 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.583+0000 7fceb7fff640 10 monclient: _finish_hunting 0 2026-02-22T23:28:09.597 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.583+0000 7fceb7fff640 1 monclient: found mon.c 2026-02-22T23:28:09.597 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.583+0000 7fceb7fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T23:28:09.597 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.583+0000 7fceb7fff640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.45:6791/0 2026-02-22T23:28:09.597 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.583+0000 7fceb7fff640 1 -- 10.20.193.45:0/2433760302 --> v1:10.20.193.45:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcedc128c10 con 0x7fcedc0a6880 2026-02-22T23:28:09.597 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.583+0000 7fceb7fff640 10 monclient: _finish_auth 0 2026-02-22T23:28:09.597 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.583+0000 7fceb7fff640 10 monclient: _check_auth_tickets 2026-02-22T23:28:09.598 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.583+0000 7fceb7fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T23:28:09.598 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.583+0000 7fcee20da640 5 monclient: authenticate success, global_id 114295 2026-02-22T23:28:09.598 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.583+0000 7fcee20da640 10 monclient: _renew_subs 2026-02-22T23:28:09.598 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.583+0000 7fcee20da640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.45:6791/0 2026-02-22T23:28:09.598 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.583+0000 7fcee20da640 1 -- 10.20.193.45:0/2433760302 --> v1:10.20.193.45:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fcedc141ca0 con 0x7fcedc0a6880 2026-02-22T23:28:09.598 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.583+0000 7fcee20da640 10 monclient: _renew_subs 2026-02-22T23:28:09.598 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.583+0000 7fcee20da640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.45:6791/0 2026-02-22T23:28:09.598 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.583+0000 7fcee20da640 1 -- 10.20.193.45:0/2433760302 --> v1:10.20.193.45:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7fcedc1cf0e0 con 0x7fcedc0a6880 2026-02-22T23:28:09.598 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.583+0000 7fceb7fff640 1 -- 10.20.193.45:0/2433760302 <== mon.4 v1:10.20.193.45:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fced0003450 con 0x7fcedc0a6880 2026-02-22T23:28:09.598 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.583+0000 7fceb7fff640 10 monclient: handle_config config(0 keys) 2026-02-22T23:28:09.598 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.583+0000 7fceb7fff640 1 -- 10.20.193.45:0/2433760302 <== mon.4 v1:10.20.193.45:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7fced0005250 con 0x7fcedc0a6880 2026-02-22T23:28:09.598 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.583+0000 7fceb7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:28:09.598 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.583+0000 7fced9ffb640 4 set_mon_vals no callback set 2026-02-22T23:28:09.598 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.583+0000 7fceb7fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T23:28:09.598 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.583+0000 7fceb7fff640 10 monclient: dump: 2026-02-22T23:28:09.598 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:28:09.598 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:28:09.598 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:09.598 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:09.598 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:28:09.598 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:28:09.598 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:28:09.598 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:28:09.598 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:28:09.598 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:28:09.598 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:28:09.599 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:28:09.599 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:28:09.599 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:28:09.599 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:28:09.599 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:09.599 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.583+0000 7fceb7fff640 1 -- 10.20.193.45:0/2433760302 <== mon.4 v1:10.20.193.45:6791/0 7 ==== mgrmap(e 5) ==== 50225+0+0 (unknown 2330357642 0 0) 0x7fced0011830 con 0x7fcedc0a6880 2026-02-22T23:28:09.599 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.583+0000 7fcee20da640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T23:28:09.599 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.583+0000 7fcee20da640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T23:28:09.599 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.583+0000 7fcee20da640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.45:6791/0 2026-02-22T23:28:09.599 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.583+0000 7fcee20da640 1 -- 10.20.193.45:0/2433760302 --> v1:10.20.193.45:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcedc0a1b50 con 0x7fcedc0a6880 2026-02-22T23:28:09.599 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.583+0000 7fceb7fff640 1 -- 10.20.193.45:0/2433760302 <== mon.4 v1:10.20.193.45:6791/0 8 ==== osd_map(25..25 src has 1..25) ==== 3502+0+0 (unknown 129690100 0 0) 0x7fced004de80 con 0x7fcedc0a6880 2026-02-22T23:28:09.599 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.583+0000 7fcedb7fe640 10 monclient: get_auth_request con 0x7fceac03ff90 auth_method 0 2026-02-22T23:28:09.599 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.586+0000 7fceb7fff640 1 -- 10.20.193.45:0/2433760302 <== mon.4 v1:10.20.193.45:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (unknown 1092875540 0 2568732696) 0x7fced0017aa0 con 0x7fcedc0a6880 2026-02-22T23:28:09.599 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.586+0000 7fceb7fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T23:28:09.599 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.586+0000 7fceb7fff640 10 monclient: _finish_command 1 = system:0 2026-02-22T23:28:09.670 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.668+0000 7fcee20da640 1 -- 10.20.193.45:0/2433760302 --> v1:10.20.193.73:6800/2222410180 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fcedc06ce10 con 0x7fceac03ff90 2026-02-22T23:28:09.670 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.669+0000 7fceb7fff640 1 -- 10.20.193.45:0/2433760302 <== mgr.4111 v1:10.20.193.73:6800/2222410180 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+33968 (unknown 2965378022 0 3168226460) 0x7fcedc06ce10 con 0x7fceac03ff90 2026-02-22T23:28:09.671 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-22T23:28:09.672 INFO:teuthology.orchestra.run.trial045.stderr:dumped all 2026-02-22T23:28:09.672 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.670+0000 7fcee20da640 1 -- 10.20.193.45:0/2433760302 >> v1:10.20.193.73:6800/2222410180 conn(0x7fceac03ff90 legacy=0x7fceac042450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:09.672 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.670+0000 7fcee20da640 10 monclient: shutdown 2026-02-22T23:28:09.672 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.670+0000 7fcee20da640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T23:28:09.673 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.670+0000 7fcee20da640 1 -- 10.20.193.45:0/2433760302 >> v1:10.20.193.45:6791/0 conn(0x7fcedc0a6880 legacy=0x7fcedc1d7b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:09.673 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.670+0000 7fcee20da640 1 -- 10.20.193.45:0/2433760302 shutdown_connections 2026-02-22T23:28:09.673 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.670+0000 7fcee20da640 1 -- 10.20.193.45:0/2433760302 >> 10.20.193.45:0/2433760302 conn(0x7fcedc0ab9c0 msgr2=0x7fcedc142280 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:28:09.673 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.670+0000 7fcee20da640 1 -- 10.20.193.45:0/2433760302 shutdown_connections 2026-02-22T23:28:09.673 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:09.670+0000 7fcee20da640 1 -- 10.20.193.45:0/2433760302 wait complete. 2026-02-22T23:28:09.679 INFO:teuthology.orchestra.run.trial045.stdout:{"pg_ready":true,"pg_map":{"version":98,"stamp":"2026-02-22T23:28:09.209289+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":147,"num_write_kb":2674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":115,"ondisk_log_size":115,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":163224,"kb_used_data":1424,"kb_used_omap":9,"kb_used_meta":161654,"kb_avail":566067816,"statfs":{"total":579820584960,"available":579653443584,"internally_reserved":0,"allocated":1458176,"data_stored":1521850,"data_compressed":22320,"data_compressed_allocated":81920,"data_compressed_original":1024000,"omap_allocated":9561,"internal_metadata":165534375},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001318"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":31,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-22T23:26:19.181052+0000","last_change":"2026-02-22T23:25:44.735205+0000","last_active":"2026-02-22T23:26:19.181052+0000","last_peered":"2026-02-22T23:26:19.181052+0000","last_clean":"2026-02-22T23:26:19.181052+0000","last_became_active":"2026-02-22T23:25:42.732237+0000","last_became_peered":"2026-02-22T23:25:42.732237+0000","last_unstale":"2026-02-22T23:26:19.181052+0000","last_undegraded":"2026-02-22T23:26:19.181052+0000","last_fullsized":"2026-02-22T23:26:19.181052+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:25:41.723660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:25:41.723660+0000","last_clean_scrub_stamp":"2026-02-22T23:25:41.723660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:02:39.156862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000197314,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":32,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-22T23:26:18.881919+0000","last_change":"2026-02-22T23:25:44.734485+0000","last_active":"2026-02-22T23:26:18.881919+0000","last_peered":"2026-02-22T23:26:18.881919+0000","last_clean":"2026-02-22T23:26:18.881919+0000","last_became_active":"2026-02-22T23:25:42.731608+0000","last_became_peered":"2026-02-22T23:25:42.731608+0000","last_unstale":"2026-02-22T23:26:18.881919+0000","last_undegraded":"2026-02-22T23:26:18.881919+0000","last_fullsized":"2026-02-22T23:26:18.881919+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:25:41.723660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:25:41.723660+0000","last_clean_scrub_stamp":"2026-02-22T23:25:41.723660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:38:27.110138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044396600000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":31,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-22T23:26:19.180763+0000","last_change":"2026-02-22T23:25:44.735342+0000","last_active":"2026-02-22T23:26:19.180763+0000","last_peered":"2026-02-22T23:26:19.180763+0000","last_clean":"2026-02-22T23:26:19.180763+0000","last_became_active":"2026-02-22T23:25:42.732947+0000","last_became_peered":"2026-02-22T23:25:42.732947+0000","last_unstale":"2026-02-22T23:26:19.180763+0000","last_undegraded":"2026-02-22T23:26:19.180763+0000","last_fullsized":"2026-02-22T23:26:19.180763+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:25:41.723660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:25:41.723660+0000","last_clean_scrub_stamp":"2026-02-22T23:25:41.723660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T02:33:36.757781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00031882900000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":31,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-22T23:26:18.882218+0000","last_change":"2026-02-22T23:25:44.771461+0000","last_active":"2026-02-22T23:26:18.882218+0000","last_peered":"2026-02-22T23:26:18.882218+0000","last_clean":"2026-02-22T23:26:18.882218+0000","last_became_active":"2026-02-22T23:25:42.729582+0000","last_became_peered":"2026-02-22T23:25:42.729582+0000","last_unstale":"2026-02-22T23:26:18.882218+0000","last_undegraded":"2026-02-22T23:26:18.882218+0000","last_fullsized":"2026-02-22T23:26:18.882218+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:25:41.723660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:25:41.723660+0000","last_clean_scrub_stamp":"2026-02-22T23:25:41.723660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T06:30:33.437324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00022341099999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"19'2","reported_seq":33,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-22T23:26:19.179750+0000","last_change":"2026-02-22T23:25:44.735543+0000","last_active":"2026-02-22T23:26:19.179750+0000","last_peered":"2026-02-22T23:26:19.179750+0000","last_clean":"2026-02-22T23:26:19.179750+0000","last_became_active":"2026-02-22T23:25:42.733018+0000","last_became_peered":"2026-02-22T23:25:42.733018+0000","last_unstale":"2026-02-22T23:26:19.179750+0000","last_undegraded":"2026-02-22T23:26:19.179750+0000","last_fullsized":"2026-02-22T23:26:19.179750+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:25:41.723660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:25:41.723660+0000","last_clean_scrub_stamp":"2026-02-22T23:25:41.723660+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T04:28:19.249844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044642500000000002,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":32,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-22T23:26:19.178926+0000","last_change":"2026-02-22T23:25:44.734019+0000","last_active":"2026-02-22T23:26:19.178926+0000","last_peered":"2026-02-22T23:26:19.178926+0000","last_clean":"2026-02-22T23:26:19.178926+0000","last_became_active":"2026-02-22T23:25:42.729332+0000","last_became_peered":"2026-02-22T23:25:42.729332+0000","last_unstale":"2026-02-22T23:26:19.178926+0000","last_undegraded":"2026-02-22T23:26:19.178926+0000","last_fullsized":"2026-02-22T23:26:19.178926+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:25:41.723660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:25:41.723660+0000","last_clean_scrub_stamp":"2026-02-22T23:25:41.723660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T05:15:12.260477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00028113600000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":31,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-22T23:26:19.180610+0000","last_change":"2026-02-22T23:25:44.735208+0000","last_active":"2026-02-22T23:26:19.180610+0000","last_peered":"2026-02-22T23:26:19.180610+0000","last_clean":"2026-02-22T23:26:19.180610+0000","last_became_active":"2026-02-22T23:25:42.732106+0000","last_became_peered":"2026-02-22T23:25:42.732106+0000","last_unstale":"2026-02-22T23:26:19.180610+0000","last_undegraded":"2026-02-22T23:26:19.180610+0000","last_fullsized":"2026-02-22T23:26:19.180610+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:25:41.723660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:25:41.723660+0000","last_clean_scrub_stamp":"2026-02-22T23:25:41.723660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:35:08.328395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000186295,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"17'1","reported_seq":32,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-22T23:26:19.179503+0000","last_change":"2026-02-22T23:25:44.735244+0000","last_active":"2026-02-22T23:26:19.179503+0000","last_peered":"2026-02-22T23:26:19.179503+0000","last_clean":"2026-02-22T23:26:19.179503+0000","last_became_active":"2026-02-22T23:25:42.732702+0000","last_became_peered":"2026-02-22T23:25:42.732702+0000","last_unstale":"2026-02-22T23:26:19.179503+0000","last_undegraded":"2026-02-22T23:26:19.179503+0000","last_fullsized":"2026-02-22T23:26:19.179503+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:25:41.723660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:25:41.723660+0000","last_clean_scrub_stamp":"2026-02-22T23:25:41.723660+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T01:00:00.519442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00023975299999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"14'112","reported_seq":168,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-22T23:26:19.180475+0000","last_change":"2026-02-22T23:25:36.890023+0000","last_active":"2026-02-22T23:26:19.180475+0000","last_peered":"2026-02-22T23:26:19.180475+0000","last_clean":"2026-02-22T23:26:19.180475+0000","last_became_active":"2026-02-22T23:25:36.889147+0000","last_became_peered":"2026-02-22T23:25:36.889147+0000","last_unstale":"2026-02-22T23:26:19.180475+0000","last_undegraded":"2026-02-22T23:26:19.180475+0000","last_fullsized":"2026-02-22T23:26:19.180475+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:25:35.704171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:25:35.704171+0000","last_clean_scrub_stamp":"2026-02-22T23:25:35.704171+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T02:46:45.050923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":1057856,"data_compressed":22320,"data_compressed_allocated":81920,"data_compressed_original":1024000,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":12,"seq":51539607585,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":282624,"data_stored":606254,"data_compressed":11160,"data_compressed_allocated":40960,"data_compressed_original":512000,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":12,"seq":51539607584,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27192,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344648,"statfs":{"total":96636764160,"available":96608919552,"internally_reserved":0,"allocated":225280,"data_stored":77345,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":12,"seq":51539607584,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27184,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344656,"statfs":{"total":96636764160,"available":96608927744,"internally_reserved":0,"allocated":221184,"data_stored":77326,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":12,"seq":51539607584,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":282624,"data_stored":606254,"data_compressed":11160,"data_compressed_allocated":40960,"data_compressed_original":512000,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":12,"seq":51539607584,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27188,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344652,"statfs":{"total":96636764160,"available":96608923648,"internally_reserved":0,"allocated":225280,"data_stored":77345,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":11,"seq":47244640289,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27176,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344664,"statfs":{"total":96636764160,"available":96608935936,"internally_reserved":0,"allocated":221184,"data_stored":77326,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27589065},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":528928,"data_compressed":11160,"data_compressed_allocated":40960,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":528928,"data_compressed":11160,"data_compressed_allocated":40960,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-22T23:28:09.684 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2026-02-22T23:25:41.723660+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=23, tm_min=25, tm_sec=41, tm_wday=6, tm_yday=53, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=23, tm_min=28, tm_sec=6, tm_wday=6, tm_yday=53, tm_isdst=0) 2026-02-22T23:28:09.684 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2026-02-22T23:25:41.723660+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=23, tm_min=25, tm_sec=41, tm_wday=6, tm_yday=53, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=23, tm_min=28, tm_sec=6, tm_wday=6, tm_yday=53, tm_isdst=0) 2026-02-22T23:28:09.685 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2026-02-22T23:25:41.723660+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=23, tm_min=25, tm_sec=41, tm_wday=6, tm_yday=53, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=23, tm_min=28, tm_sec=6, tm_wday=6, tm_yday=53, tm_isdst=0) 2026-02-22T23:28:09.685 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2026-02-22T23:25:41.723660+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=23, tm_min=25, tm_sec=41, tm_wday=6, tm_yday=53, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=23, tm_min=28, tm_sec=6, tm_wday=6, tm_yday=53, tm_isdst=0) 2026-02-22T23:28:09.685 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2026-02-22T23:25:41.723660+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=23, tm_min=25, tm_sec=41, tm_wday=6, tm_yday=53, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=23, tm_min=28, tm_sec=6, tm_wday=6, tm_yday=53, tm_isdst=0) 2026-02-22T23:28:09.685 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2026-02-22T23:25:41.723660+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=23, tm_min=25, tm_sec=41, tm_wday=6, tm_yday=53, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=23, tm_min=28, tm_sec=6, tm_wday=6, tm_yday=53, tm_isdst=0) 2026-02-22T23:28:09.685 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2026-02-22T23:25:41.723660+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=23, tm_min=25, tm_sec=41, tm_wday=6, tm_yday=53, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=23, tm_min=28, tm_sec=6, tm_wday=6, tm_yday=53, tm_isdst=0) 2026-02-22T23:28:09.685 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2026-02-22T23:25:41.723660+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=23, tm_min=25, tm_sec=41, tm_wday=6, tm_yday=53, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=23, tm_min=28, tm_sec=6, tm_wday=6, tm_yday=53, tm_isdst=0) 2026-02-22T23:28:09.686 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2026-02-22T23:25:35.704171+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=23, tm_min=25, tm_sec=35, tm_wday=6, tm_yday=53, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=23, tm_min=28, tm_sec=6, tm_wday=6, tm_yday=53, tm_isdst=0) 2026-02-22T23:28:09.686 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2026-02-22T23:28:29.687 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-22T23:28:29.764 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.756+0000 7f6fb5074640 10 monclient: get_monmap_and_config 2026-02-22T23:28:29.764 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.756+0000 7f6fb5074640 10 monclient: build_initial_monmap 2026-02-22T23:28:29.764 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.756+0000 7f6fb5074640 10 monclient: monmap: 2026-02-22T23:28:29.765 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-22T23:28:29.765 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:28:29.765 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:28:29.756760+0000 2026-02-22T23:28:29.765 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:28:29.756760+0000 2026-02-22T23:28:29.765 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-22T23:28:29.765 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:28:29.765 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-22T23:28:29.765 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.noname-f 2026-02-22T23:28:29.765 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.noname-b 2026-02-22T23:28:29.765 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.noname-g 2026-02-22T23:28:29.765 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.noname-c 2026-02-22T23:28:29.765 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.noname-h 2026-02-22T23:28:29.766 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.noname-d 2026-02-22T23:28:29.766 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.noname-i 2026-02-22T23:28:29.766 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.noname-e 2026-02-22T23:28:29.766 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:29.766 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.756+0000 7f6fb5074640 1 Processor -- start 2026-02-22T23:28:29.766 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.757+0000 7f6fb5074640 1 -- start start 2026-02-22T23:28:29.766 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.757+0000 7f6fb5074640 10 monclient: init 2026-02-22T23:28:29.766 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.757+0000 7f6fb5074640 10 monclient: _reopen_session rank -1 2026-02-22T23:28:29.766 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.757+0000 7f6fb5074640 10 monclient: _add_conns ranks=[0,3,6,8,7,1,5,2,4] 2026-02-22T23:28:29.766 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.757+0000 7f6fb5074640 10 monclient(hunting): picked mon.noname-a con 0x7f6fb009db40 addr v1:10.20.193.45:6789/0 2026-02-22T23:28:29.766 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.757+0000 7f6fb5074640 10 monclient(hunting): picked mon.noname-g con 0x7f6fb0138fb0 addr v1:10.20.193.73:6790/0 2026-02-22T23:28:29.766 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.757+0000 7f6fb5074640 10 monclient(hunting): picked mon.noname-d con 0x7f6fb01393f0 addr v1:10.20.193.45:6792/0 2026-02-22T23:28:29.767 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.757+0000 7f6fb5074640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6fb009bb20 con 0x7f6fb009db40 2026-02-22T23:28:29.767 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.757+0000 7f6fb5074640 1 -- --> v1:10.20.193.73:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6fb009bd90 con 0x7f6fb0138fb0 2026-02-22T23:28:29.767 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.757+0000 7f6fb5074640 1 -- --> v1:10.20.193.45:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6fb009c070 con 0x7f6fb01393f0 2026-02-22T23:28:29.767 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.757+0000 7f6fb5074640 10 monclient(hunting): _renew_subs 2026-02-22T23:28:29.767 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.757+0000 7f6fb5074640 10 monclient(hunting): authenticate will time out at 841.373344s 2026-02-22T23:28:29.767 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.757+0000 7f6faed76640 1 --1- >> v1:10.20.193.45:6789/0 conn(0x7f6fb009db40 0x7f6fb009df20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.45:6789/0 says I am v1:10.20.193.45:51496/0 (socket says 10.20.193.45:51496) 2026-02-22T23:28:29.767 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.757+0000 7f6faed76640 1 -- 10.20.193.45:0/297703055 learned_addr learned my addr 10.20.193.45:0/297703055 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-22T23:28:29.767 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.757+0000 7f6fadd74640 1 -- 10.20.193.45:0/297703055 <== mon.6 v1:10.20.193.45:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3683492265 0 0) 0x7f6fb009c070 con 0x7f6fb01393f0 2026-02-22T23:28:29.767 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.757+0000 7f6fadd74640 10 monclient(hunting): _negotiate 2026-02-22T23:28:29.767 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.757+0000 7f6fadd74640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:28:29.767 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.757+0000 7f6fadd74640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:28:29.767 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.757+0000 7f6fadd74640 10 monclient(hunting): my global_id is 114297 2026-02-22T23:28:29.768 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.757+0000 7f6fadd74640 1 -- 10.20.193.45:0/297703055 --> v1:10.20.193.45:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6f9c003620 con 0x7f6fb01393f0 2026-02-22T23:28:29.768 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.757+0000 7f6fadd74640 1 -- 10.20.193.45:0/297703055 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 425933981 0 0) 0x7f6fb009bb20 con 0x7f6fb009db40 2026-02-22T23:28:29.768 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.757+0000 7f6fadd74640 10 monclient(hunting): _negotiate 2026-02-22T23:28:29.768 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.757+0000 7f6fadd74640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:28:29.768 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.757+0000 7f6fadd74640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:28:29.768 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.757+0000 7f6fadd74640 10 monclient(hunting): my global_id is 4707 2026-02-22T23:28:29.768 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.757+0000 7f6fadd74640 1 -- 10.20.193.45:0/297703055 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6fb009c070 con 0x7f6fb009db40 2026-02-22T23:28:29.768 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.757+0000 7f6fadd74640 1 -- 10.20.193.45:0/297703055 <== mon.6 v1:10.20.193.45:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3638966910 0 0) 0x7f6f9c003620 con 0x7f6fb01393f0 2026-02-22T23:28:29.768 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.757+0000 7f6fadd74640 1 -- 10.20.193.45:0/297703055 >> v1:10.20.193.73:6790/0 conn(0x7f6fb0138fb0 legacy=0x7f6fb013dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:29.768 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.757+0000 7f6fadd74640 1 -- 10.20.193.45:0/297703055 >> v1:10.20.193.45:6789/0 conn(0x7f6fb009db40 legacy=0x7f6fb009df20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:29.768 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.757+0000 7f6fadd74640 10 monclient: _finish_hunting 0 2026-02-22T23:28:29.768 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.757+0000 7f6fadd74640 1 monclient: found mon.noname-d 2026-02-22T23:28:29.769 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.757+0000 7f6fadd74640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T23:28:29.769 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.757+0000 7f6fadd74640 10 monclient: _send_mon_message to mon.noname-d at v1:10.20.193.45:6792/0 2026-02-22T23:28:29.769 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.757+0000 7f6fadd74640 1 -- 10.20.193.45:0/297703055 --> v1:10.20.193.45:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6fb009c350 con 0x7f6fb01393f0 2026-02-22T23:28:29.769 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.757+0000 7f6fadd74640 10 monclient: _finish_auth 0 2026-02-22T23:28:29.769 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.757+0000 7f6fadd74640 10 monclient: _check_auth_tickets 2026-02-22T23:28:29.769 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.757+0000 7f6fadd74640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T23:28:29.769 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.757+0000 7f6fadd74640 1 -- 10.20.193.45:0/297703055 <== mon.6 v1:10.20.193.45:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f6fa00032f0 con 0x7f6fb01393f0 2026-02-22T23:28:29.769 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.757+0000 7f6fadd74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:28:29.769 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.757+0000 7f6fadd74640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2026-02-22T23:28:29.769 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.757+0000 7f6fadd74640 10 monclient: dump: 2026-02-22T23:28:29.769 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:28:29.769 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:28:29.770 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:29.770 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:29.770 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:28:29.770 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:28:29.770 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:28:29.770 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:28:29.770 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:28:29.770 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:28:29.770 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:28:29.770 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:28:29.770 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:28:29.770 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:28:29.770 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:28:29.771 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:29.771 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.757+0000 7f6fb5074640 5 monclient: authenticate success, global_id 114297 2026-02-22T23:28:29.771 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.757+0000 7f6fb5074640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-22T23:28:29.771 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.757+0000 7f6fadd74640 1 -- 10.20.193.45:0/297703055 <== mon.6 v1:10.20.193.45:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6fa0003490 con 0x7f6fb01393f0 2026-02-22T23:28:29.771 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.757+0000 7f6fadd74640 10 monclient: handle_config config(0 keys) 2026-02-22T23:28:29.771 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.757+0000 7f6fadd74640 1 -- 10.20.193.45:0/297703055 <== mon.6 v1:10.20.193.45:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f6fa0003dd0 con 0x7f6fb01393f0 2026-02-22T23:28:29.771 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.757+0000 7f6fadd74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:28:29.771 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.757+0000 7f6fadd74640 10 monclient: got monmap 1 from mon.d (according to old e1) 2026-02-22T23:28:29.771 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.757+0000 7f6fadd74640 10 monclient: dump: 2026-02-22T23:28:29.771 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:28:29.771 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:28:29.771 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:29.772 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:29.772 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:28:29.772 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:28:29.772 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:28:29.772 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:28:29.772 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:28:29.772 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:28:29.772 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:28:29.772 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:28:29.772 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:28:29.772 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:28:29.772 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:28:29.772 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:29.772 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.757+0000 7f6fb5074640 10 monclient: get_monmap_and_config success 2026-02-22T23:28:29.773 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.757+0000 7f6fb5074640 4 set_mon_vals no callback set 2026-02-22T23:28:29.773 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.758+0000 7f6fb5074640 10 monclient: shutdown 2026-02-22T23:28:29.773 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.758+0000 7f6fb5074640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T23:28:29.773 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.758+0000 7f6fb5074640 1 -- 10.20.193.45:0/297703055 >> v1:10.20.193.45:6792/0 conn(0x7f6fb01393f0 legacy=0x7f6fb0141460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:29.773 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.758+0000 7f6fb5074640 1 -- 10.20.193.45:0/297703055 shutdown_connections 2026-02-22T23:28:29.773 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.758+0000 7f6fb5074640 1 -- 10.20.193.45:0/297703055 >> 10.20.193.45:0/297703055 conn(0x7f6fb00a4320 msgr2=0x7f6fb00a4730 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:28:29.773 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.758+0000 7f6fb5074640 1 -- 10.20.193.45:0/297703055 shutdown_connections 2026-02-22T23:28:29.773 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.758+0000 7f6fb5074640 1 -- 10.20.193.45:0/297703055 wait complete. 2026-02-22T23:28:29.773 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.758+0000 7f6fb5074640 10 monclient: build_initial_monmap 2026-02-22T23:28:29.773 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.758+0000 7f6fb5074640 10 monclient: monmap: 2026-02-22T23:28:29.773 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-22T23:28:29.774 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T23:28:29.774 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-22T23:28:29.774 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-22T23:28:29.774 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-22T23:28:29.774 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-22T23:28:29.774 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-22T23:28:29.774 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.noname-f 2026-02-22T23:28:29.774 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.noname-b 2026-02-22T23:28:29.774 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.noname-g 2026-02-22T23:28:29.774 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.noname-c 2026-02-22T23:28:29.774 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.noname-h 2026-02-22T23:28:29.774 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.noname-d 2026-02-22T23:28:29.774 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.noname-i 2026-02-22T23:28:29.775 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.noname-e 2026-02-22T23:28:29.775 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:29.775 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.758+0000 7f6fb5074640 1 Processor -- start 2026-02-22T23:28:29.775 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.758+0000 7f6fb5074640 1 -- start start 2026-02-22T23:28:29.775 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.758+0000 7f6fb5074640 10 monclient: init 2026-02-22T23:28:29.775 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.758+0000 7f6fb5074640 10 monclient: _reopen_session rank -1 2026-02-22T23:28:29.775 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.758+0000 7f6fb5074640 10 monclient: _add_conns ranks=[2,1,0,6,8,3,5,7,4] 2026-02-22T23:28:29.775 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.758+0000 7f6fb5074640 10 monclient(hunting): picked mon.noname-b con 0x7f6fb009db40 addr v1:10.20.193.45:6790/0 2026-02-22T23:28:29.775 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.758+0000 7f6fb5074640 10 monclient(hunting): picked mon.noname-f con 0x7f6fb0138fb0 addr v1:10.20.193.73:6789/0 2026-02-22T23:28:29.775 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.758+0000 7f6fb5074640 10 monclient(hunting): picked mon.noname-a con 0x7f6fb01393f0 addr v1:10.20.193.45:6789/0 2026-02-22T23:28:29.775 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.758+0000 7f6fb5074640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6fb00a5620 con 0x7f6fb01393f0 2026-02-22T23:28:29.775 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.758+0000 7f6fb5074640 1 -- --> v1:10.20.193.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6fb0097810 con 0x7f6fb0138fb0 2026-02-22T23:28:29.776 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.758+0000 7f6fb5074640 1 -- --> v1:10.20.193.45:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6fb0097af0 con 0x7f6fb009db40 2026-02-22T23:28:29.776 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.758+0000 7f6fb5074640 10 monclient(hunting): _renew_subs 2026-02-22T23:28:29.776 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.758+0000 7f6fb5074640 10 monclient(hunting): authenticate will time out at 841.374939s 2026-02-22T23:28:29.776 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.758+0000 7f6faed76640 1 --1- >> v1:10.20.193.45:6790/0 conn(0x7f6fb009db40 0x7f6fb01cff20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.45:6790/0 says I am v1:10.20.193.45:54316/0 (socket says 10.20.193.45:54316) 2026-02-22T23:28:29.776 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.758+0000 7f6faf577640 1 --1- >> v1:10.20.193.45:6789/0 conn(0x7f6fb01393f0 0x7f6fb01d8620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.45:6789/0 says I am v1:10.20.193.45:51500/0 (socket says 10.20.193.45:51500) 2026-02-22T23:28:29.776 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.758+0000 7f6faed76640 1 -- 10.20.193.45:0/554241411 learned_addr learned my addr 10.20.193.45:0/554241411 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-22T23:28:29.776 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.759+0000 7f6f8f7fe640 1 -- 10.20.193.45:0/554241411 <== mon.2 v1:10.20.193.45:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3680614088 0 0) 0x7f6fb0097af0 con 0x7f6fb009db40 2026-02-22T23:28:29.776 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.759+0000 7f6f8f7fe640 10 monclient(hunting): _negotiate 2026-02-22T23:28:29.776 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.759+0000 7f6f8f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:28:29.776 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.759+0000 7f6f8f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:28:29.776 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.759+0000 7f6f8f7fe640 10 monclient(hunting): my global_id is 4844 2026-02-22T23:28:29.776 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.759+0000 7f6f8f7fe640 1 -- 10.20.193.45:0/554241411 --> v1:10.20.193.45:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6f7c003620 con 0x7f6fb009db40 2026-02-22T23:28:29.777 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.759+0000 7f6f8f7fe640 1 -- 10.20.193.45:0/554241411 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4284409066 0 0) 0x7f6fb009c350 con 0x7f6fb01393f0 2026-02-22T23:28:29.777 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.759+0000 7f6f8f7fe640 10 monclient(hunting): _negotiate 2026-02-22T23:28:29.777 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.759+0000 7f6f8f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:28:29.777 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.759+0000 7f6f8f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:28:29.777 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.759+0000 7f6f8f7fe640 10 monclient(hunting): my global_id is 4716 2026-02-22T23:28:29.777 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.759+0000 7f6f8f7fe640 1 -- 10.20.193.45:0/554241411 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6fb0097af0 con 0x7f6fb01393f0 2026-02-22T23:28:29.777 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.759+0000 7f6f8f7fe640 1 -- 10.20.193.45:0/554241411 <== mon.2 v1:10.20.193.45:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1395166104 0 0) 0x7f6f7c003620 con 0x7f6fb009db40 2026-02-22T23:28:29.777 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.759+0000 7f6f8f7fe640 1 -- 10.20.193.45:0/554241411 --> v1:10.20.193.45:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6fb009c350 con 0x7f6fb009db40 2026-02-22T23:28:29.777 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.759+0000 7f6f8f7fe640 1 -- 10.20.193.45:0/554241411 <== mon.1 v1:10.20.193.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2846785357 0 0) 0x7f6fb0097810 con 0x7f6fb0138fb0 2026-02-22T23:28:29.777 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.759+0000 7f6f8f7fe640 10 monclient(hunting): _negotiate 2026-02-22T23:28:29.777 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.759+0000 7f6f8f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:28:29.777 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.759+0000 7f6f8f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:28:29.777 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.759+0000 7f6f8f7fe640 10 monclient(hunting): my global_id is 114292 2026-02-22T23:28:29.778 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.759+0000 7f6f8f7fe640 1 -- 10.20.193.45:0/554241411 --> v1:10.20.193.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6f7c003620 con 0x7f6fb0138fb0 2026-02-22T23:28:29.778 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.759+0000 7f6f8f7fe640 1 -- 10.20.193.45:0/554241411 <== mon.0 v1:10.20.193.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3492519593 0 0) 0x7f6fb0097af0 con 0x7f6fb01393f0 2026-02-22T23:28:29.778 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.759+0000 7f6f8f7fe640 1 -- 10.20.193.45:0/554241411 --> v1:10.20.193.45:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6fb0097810 con 0x7f6fb01393f0 2026-02-22T23:28:29.778 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.759+0000 7f6f8f7fe640 1 -- 10.20.193.45:0/554241411 <== mon.2 v1:10.20.193.45:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f6fa40030d0 con 0x7f6fb009db40 2026-02-22T23:28:29.778 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.759+0000 7f6f8f7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-22T23:28:29.778 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.759+0000 7f6f8f7fe640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-22T23:28:29.778 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.759+0000 7f6f8f7fe640 10 monclient(hunting): dump: 2026-02-22T23:28:29.778 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:28:29.778 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:28:29.778 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:29.778 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:29.778 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:28:29.778 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:28:29.779 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:28:29.779 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:28:29.779 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:28:29.779 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:28:29.779 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:28:29.779 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:28:29.779 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:28:29.779 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:28:29.779 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:28:29.779 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:29.779 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.759+0000 7f6f8f7fe640 10 monclient(hunting): _finish_auth 0 2026-02-22T23:28:29.779 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.759+0000 7f6f8f7fe640 1 -- 10.20.193.45:0/554241411 <== mon.0 v1:10.20.193.45:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f6fa0003980 con 0x7f6fb01393f0 2026-02-22T23:28:29.779 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.759+0000 7f6f8f7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-22T23:28:29.780 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.759+0000 7f6f8f7fe640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-22T23:28:29.780 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.759+0000 7f6f8f7fe640 10 monclient(hunting): dump: 2026-02-22T23:28:29.780 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:28:29.780 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:28:29.780 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:29.780 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:29.780 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:28:29.780 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:28:29.780 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:28:29.780 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:28:29.780 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:28:29.780 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:28:29.781 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:28:29.781 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:28:29.781 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:28:29.781 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:28:29.781 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:28:29.781 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:29.781 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.759+0000 7f6f8f7fe640 1 -- 10.20.193.45:0/554241411 <== mon.2 v1:10.20.193.45:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2194397515 0 0) 0x7f6fb009c350 con 0x7f6fb009db40 2026-02-22T23:28:29.781 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.759+0000 7f6f8f7fe640 1 -- 10.20.193.45:0/554241411 >> v1:10.20.193.73:6789/0 conn(0x7f6fb0138fb0 legacy=0x7f6fb01d4ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:29.781 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.759+0000 7f6f8f7fe640 1 -- 10.20.193.45:0/554241411 >> v1:10.20.193.45:6789/0 conn(0x7f6fb01393f0 legacy=0x7f6fb01d8620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:29.781 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.759+0000 7f6f8f7fe640 10 monclient: _finish_hunting 0 2026-02-22T23:28:29.781 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.759+0000 7f6f8f7fe640 1 monclient: found mon.b 2026-02-22T23:28:29.782 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.759+0000 7f6f8f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T23:28:29.782 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.759+0000 7f6f8f7fe640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.45:6790/0 2026-02-22T23:28:29.782 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.759+0000 7f6f8f7fe640 1 -- 10.20.193.45:0/554241411 --> v1:10.20.193.45:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6fb009b290 con 0x7f6fb009db40 2026-02-22T23:28:29.782 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.759+0000 7f6f8f7fe640 10 monclient: _finish_auth 0 2026-02-22T23:28:29.782 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.759+0000 7f6f8f7fe640 10 monclient: _check_auth_tickets 2026-02-22T23:28:29.782 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.759+0000 7f6f8f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T23:28:29.782 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.759+0000 7f6fb5074640 5 monclient: authenticate success, global_id 4844 2026-02-22T23:28:29.782 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.759+0000 7f6fb5074640 10 monclient: _renew_subs 2026-02-22T23:28:29.782 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.759+0000 7f6fb5074640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.45:6790/0 2026-02-22T23:28:29.782 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.759+0000 7f6fb5074640 1 -- 10.20.193.45:0/554241411 --> v1:10.20.193.45:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f6fb00a72d0 con 0x7f6fb009db40 2026-02-22T23:28:29.782 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.759+0000 7f6fb5074640 10 monclient: _renew_subs 2026-02-22T23:28:29.782 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.759+0000 7f6fb5074640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.45:6790/0 2026-02-22T23:28:29.782 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.759+0000 7f6fb5074640 1 -- 10.20.193.45:0/554241411 --> v1:10.20.193.45:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f6fb0097f10 con 0x7f6fb009db40 2026-02-22T23:28:29.783 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.759+0000 7f6f8f7fe640 1 -- 10.20.193.45:0/554241411 <== mon.2 v1:10.20.193.45:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6fa40033e0 con 0x7f6fb009db40 2026-02-22T23:28:29.783 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.759+0000 7f6f8f7fe640 10 monclient: handle_config config(0 keys) 2026-02-22T23:28:29.783 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.759+0000 7f6f8f7fe640 1 -- 10.20.193.45:0/554241411 <== mon.2 v1:10.20.193.45:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f6fa4004ed0 con 0x7f6fb009db40 2026-02-22T23:28:29.783 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.759+0000 7f6f8f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:28:29.783 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.759+0000 7f6f8f7fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-22T23:28:29.783 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.759+0000 7f6f8f7fe640 10 monclient: dump: 2026-02-22T23:28:29.783 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:28:29.783 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:28:29.783 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:29.783 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:29.783 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:28:29.783 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:28:29.783 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:28:29.784 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:28:29.784 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:28:29.784 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:28:29.784 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:28:29.784 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:28:29.784 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:28:29.784 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:28:29.784 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:28:29.784 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:29.784 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.759+0000 7f6fad573640 4 set_mon_vals no callback set 2026-02-22T23:28:29.784 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.759+0000 7f6fb5074640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T23:28:29.784 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.759+0000 7f6fb5074640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T23:28:29.784 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.759+0000 7f6fb5074640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.45:6790/0 2026-02-22T23:28:29.785 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.759+0000 7f6fb5074640 1 -- 10.20.193.45:0/554241411 --> v1:10.20.193.45:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6fb0069b30 con 0x7f6fb009db40 2026-02-22T23:28:29.785 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.760+0000 7f6f8f7fe640 1 -- 10.20.193.45:0/554241411 <== mon.2 v1:10.20.193.45:6790/0 7 ==== mgrmap(e 5) ==== 50225+0+0 (unknown 2330357642 0 0) 0x7f6fa40114b0 con 0x7f6fb009db40 2026-02-22T23:28:29.785 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.760+0000 7f6f8f7fe640 1 -- 10.20.193.45:0/554241411 <== mon.2 v1:10.20.193.45:6790/0 8 ==== osd_map(25..25 src has 1..25) ==== 3502+0+0 (unknown 129690100 0 0) 0x7f6fa404dcf0 con 0x7f6fb009db40 2026-02-22T23:28:29.785 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.760+0000 7f6fae575640 10 monclient: get_auth_request con 0x7f6f7c040040 auth_method 0 2026-02-22T23:28:29.785 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.762+0000 7f6f8f7fe640 1 -- 10.20.193.45:0/554241411 <== mon.2 v1:10.20.193.45:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (unknown 1092875540 0 2568732696) 0x7f6fb0069b30 con 0x7f6fb009db40 2026-02-22T23:28:29.785 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.762+0000 7f6f8f7fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T23:28:29.785 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.762+0000 7f6f8f7fe640 10 monclient: _finish_command 1 = system:0 2026-02-22T23:28:29.845 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.844+0000 7f6fb5074640 1 -- 10.20.193.45:0/554241411 --> v1:10.20.193.73:6800/2222410180 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f6fb00744b0 con 0x7f6f7c040040 2026-02-22T23:28:29.846 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.845+0000 7f6f8f7fe640 1 -- 10.20.193.45:0/554241411 <== mgr.4111 v1:10.20.193.73:6800/2222410180 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+33979 (unknown 2965378022 0 1140831360) 0x7f6fb00744b0 con 0x7f6f7c040040 2026-02-22T23:28:29.846 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-22T23:28:29.847 INFO:teuthology.orchestra.run.trial045.stderr:dumped all 2026-02-22T23:28:29.847 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.846+0000 7f6fb5074640 1 -- 10.20.193.45:0/554241411 >> v1:10.20.193.73:6800/2222410180 conn(0x7f6f7c040040 legacy=0x7f6f7c042500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:29.848 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.846+0000 7f6fb5074640 10 monclient: shutdown 2026-02-22T23:28:29.848 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.846+0000 7f6fb5074640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T23:28:29.848 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.846+0000 7f6fb5074640 1 -- 10.20.193.45:0/554241411 >> v1:10.20.193.45:6790/0 conn(0x7f6fb009db40 legacy=0x7f6fb01cff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:29.848 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.846+0000 7f6fb5074640 1 -- 10.20.193.45:0/554241411 shutdown_connections 2026-02-22T23:28:29.848 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.846+0000 7f6fb5074640 1 -- 10.20.193.45:0/554241411 >> 10.20.193.45:0/554241411 conn(0x7f6fb00a4320 msgr2=0x7f6fb0094760 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:28:29.848 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.846+0000 7f6fb5074640 1 -- 10.20.193.45:0/554241411 shutdown_connections 2026-02-22T23:28:29.848 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.846+0000 7f6fb5074640 1 -- 10.20.193.45:0/554241411 wait complete. 2026-02-22T23:28:29.854 INFO:teuthology.orchestra.run.trial045.stdout:{"pg_ready":true,"pg_map":{"version":108,"stamp":"2026-02-22T23:28:29.211295+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":147,"num_write_kb":2674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":163184,"kb_used_data":1424,"kb_used_omap":9,"kb_used_meta":161654,"kb_avail":566067856,"statfs":{"total":579820584960,"available":579653484544,"internally_reserved":0,"allocated":1458176,"data_stored":1521850,"data_compressed":22320,"data_compressed_allocated":81920,"data_compressed_original":1024000,"omap_allocated":9561,"internal_metadata":165534375},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001178"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":40,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-22T23:28:10.156627+0000","last_change":"2026-02-22T23:28:10.156640+0000","last_active":"2026-02-22T23:28:10.156627+0000","last_peered":"2026-02-22T23:28:10.156627+0000","last_clean":"2026-02-22T23:28:10.156627+0000","last_became_active":"2026-02-22T23:25:42.732237+0000","last_became_peered":"2026-02-22T23:25:42.732237+0000","last_unstale":"2026-02-22T23:28:10.156627+0000","last_undegraded":"2026-02-22T23:28:10.156627+0000","last_fullsized":"2026-02-22T23:28:10.156627+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:28:10.156573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:28:10.156573+0000","last_clean_scrub_stamp":"2026-02-22T23:28:10.156573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T00:34:43.876735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000197314,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":41,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-22T23:28:09.981193+0000","last_change":"2026-02-22T23:28:09.981203+0000","last_active":"2026-02-22T23:28:09.981193+0000","last_peered":"2026-02-22T23:28:09.981193+0000","last_clean":"2026-02-22T23:28:09.981193+0000","last_became_active":"2026-02-22T23:25:42.731608+0000","last_became_peered":"2026-02-22T23:25:42.731608+0000","last_unstale":"2026-02-22T23:28:09.981193+0000","last_undegraded":"2026-02-22T23:28:09.981193+0000","last_fullsized":"2026-02-22T23:28:09.981193+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:28:09.981155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:28:09.981155+0000","last_clean_scrub_stamp":"2026-02-22T23:28:09.981155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T00:09:09.360212+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00044396600000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":40,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-22T23:28:12.162464+0000","last_change":"2026-02-22T23:28:12.162485+0000","last_active":"2026-02-22T23:28:12.162464+0000","last_peered":"2026-02-22T23:28:12.162464+0000","last_clean":"2026-02-22T23:28:12.162464+0000","last_became_active":"2026-02-22T23:25:42.732947+0000","last_became_peered":"2026-02-22T23:25:42.732947+0000","last_unstale":"2026-02-22T23:28:12.162464+0000","last_undegraded":"2026-02-22T23:28:12.162464+0000","last_fullsized":"2026-02-22T23:28:12.162464+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:28:12.162402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:28:12.162402+0000","last_clean_scrub_stamp":"2026-02-22T23:28:12.162402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T11:00:52.530900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00031882900000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":40,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-22T23:28:10.404640+0000","last_change":"2026-02-22T23:28:10.404653+0000","last_active":"2026-02-22T23:28:10.404640+0000","last_peered":"2026-02-22T23:28:10.404640+0000","last_clean":"2026-02-22T23:28:10.404640+0000","last_became_active":"2026-02-22T23:25:42.729582+0000","last_became_peered":"2026-02-22T23:25:42.729582+0000","last_unstale":"2026-02-22T23:28:10.404640+0000","last_undegraded":"2026-02-22T23:28:10.404640+0000","last_fullsized":"2026-02-22T23:28:10.404640+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:28:10.404588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:28:10.404588+0000","last_clean_scrub_stamp":"2026-02-22T23:28:10.404588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T10:40:15.681032+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00022341099999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"25'3","reported_seq":43,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-22T23:28:08.490284+0000","last_change":"2026-02-22T23:28:08.490308+0000","last_active":"2026-02-22T23:28:08.490284+0000","last_peered":"2026-02-22T23:28:08.490284+0000","last_clean":"2026-02-22T23:28:08.490284+0000","last_became_active":"2026-02-22T23:25:42.733018+0000","last_became_peered":"2026-02-22T23:25:42.733018+0000","last_unstale":"2026-02-22T23:28:08.490284+0000","last_undegraded":"2026-02-22T23:28:08.490284+0000","last_fullsized":"2026-02-22T23:28:08.490284+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'3","last_scrub_stamp":"2026-02-22T23:28:08.490195+0000","last_deep_scrub":"25'3","last_deep_scrub_stamp":"2026-02-22T23:28:08.490195+0000","last_clean_scrub_stamp":"2026-02-22T23:28:08.490195+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T05:13:38.877983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044642500000000002,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":41,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-22T23:28:09.895490+0000","last_change":"2026-02-22T23:28:09.895505+0000","last_active":"2026-02-22T23:28:09.895490+0000","last_peered":"2026-02-22T23:28:09.895490+0000","last_clean":"2026-02-22T23:28:09.895490+0000","last_became_active":"2026-02-22T23:25:42.729332+0000","last_became_peered":"2026-02-22T23:25:42.729332+0000","last_unstale":"2026-02-22T23:28:09.895490+0000","last_undegraded":"2026-02-22T23:28:09.895490+0000","last_fullsized":"2026-02-22T23:28:09.895490+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:28:09.895432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:28:09.895432+0000","last_clean_scrub_stamp":"2026-02-22T23:28:09.895432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T00:19:24.922488+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00028113600000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":40,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-22T23:28:08.707379+0000","last_change":"2026-02-22T23:28:08.707390+0000","last_active":"2026-02-22T23:28:08.707379+0000","last_peered":"2026-02-22T23:28:08.707379+0000","last_clean":"2026-02-22T23:28:08.707379+0000","last_became_active":"2026-02-22T23:25:42.732106+0000","last_became_peered":"2026-02-22T23:25:42.732106+0000","last_unstale":"2026-02-22T23:28:08.707379+0000","last_undegraded":"2026-02-22T23:28:08.707379+0000","last_fullsized":"2026-02-22T23:28:08.707379+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:28:08.707337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:28:08.707337+0000","last_clean_scrub_stamp":"2026-02-22T23:28:08.707337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T05:33:52.874662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000186295,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"25'2","reported_seq":42,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-22T23:28:11.144004+0000","last_change":"2026-02-22T23:28:11.144030+0000","last_active":"2026-02-22T23:28:11.144004+0000","last_peered":"2026-02-22T23:28:11.144004+0000","last_clean":"2026-02-22T23:28:11.144004+0000","last_became_active":"2026-02-22T23:25:42.732702+0000","last_became_peered":"2026-02-22T23:25:42.732702+0000","last_unstale":"2026-02-22T23:28:11.144004+0000","last_undegraded":"2026-02-22T23:28:11.144004+0000","last_fullsized":"2026-02-22T23:28:11.144004+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'2","last_scrub_stamp":"2026-02-22T23:28:11.143923+0000","last_deep_scrub":"25'2","last_deep_scrub_stamp":"2026-02-22T23:28:11.143923+0000","last_clean_scrub_stamp":"2026-02-22T23:28:11.143923+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T04:15:52.331376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00023975299999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"25'114","reported_seq":179,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-22T23:28:09.203358+0000","last_change":"2026-02-22T23:28:09.203376+0000","last_active":"2026-02-22T23:28:09.203358+0000","last_peered":"2026-02-22T23:28:09.203358+0000","last_clean":"2026-02-22T23:28:09.203358+0000","last_became_active":"2026-02-22T23:25:36.889147+0000","last_became_peered":"2026-02-22T23:25:36.889147+0000","last_unstale":"2026-02-22T23:28:09.203358+0000","last_undegraded":"2026-02-22T23:28:09.203358+0000","last_fullsized":"2026-02-22T23:28:09.203358+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'114","last_scrub_stamp":"2026-02-22T23:28:09.203307+0000","last_deep_scrub":"25'114","last_deep_scrub_stamp":"2026-02-22T23:28:09.203307+0000","last_clean_scrub_stamp":"2026-02-22T23:28:09.203307+0000","objects_scrubbed":2,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T02:08:34.812639+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":1057856,"data_compressed":22320,"data_compressed_allocated":81920,"data_compressed_original":1024000,"omap_allocated":0,"internal_metadata":0},"log_size":114,"ondisk_log_size":114,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":12,"seq":51539607589,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":282624,"data_stored":606254,"data_compressed":11160,"data_compressed_allocated":40960,"data_compressed_original":512000,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":12,"seq":51539607588,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27180,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344660,"statfs":{"total":96636764160,"available":96608931840,"internally_reserved":0,"allocated":225280,"data_stored":77345,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":12,"seq":51539607588,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27176,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344664,"statfs":{"total":96636764160,"available":96608935936,"internally_reserved":0,"allocated":221184,"data_stored":77326,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":12,"seq":51539607588,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":282624,"data_stored":606254,"data_compressed":11160,"data_compressed_allocated":40960,"data_compressed_original":512000,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":12,"seq":51539607588,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27180,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344660,"statfs":{"total":96636764160,"available":96608931840,"internally_reserved":0,"allocated":225280,"data_stored":77345,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":11,"seq":47244640294,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27176,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344664,"statfs":{"total":96636764160,"available":96608935936,"internally_reserved":0,"allocated":221184,"data_stored":77326,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27589065},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":528928,"data_compressed":11160,"data_compressed_allocated":40960,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":528928,"data_compressed":11160,"data_compressed_allocated":40960,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-22T23:28:29.856 DEBUG:teuthology.orchestra.run.trial045:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2026-02-22T23:28:29.930 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.922+0000 7f33e6ef5640 10 monclient: get_monmap_and_config 2026-02-22T23:28:29.931 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.922+0000 7f33e6ef5640 10 monclient: build_initial_monmap 2026-02-22T23:28:29.931 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.922+0000 7f33e6ef5640 10 monclient: monmap: 2026-02-22T23:28:29.931 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-22T23:28:29.931 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:28:29.931 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:28:29.923137+0000 2026-02-22T23:28:29.931 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:28:29.923137+0000 2026-02-22T23:28:29.931 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-22T23:28:29.931 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:28:29.931 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-22T23:28:29.932 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.noname-f 2026-02-22T23:28:29.932 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.noname-b 2026-02-22T23:28:29.932 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.noname-g 2026-02-22T23:28:29.932 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.noname-c 2026-02-22T23:28:29.932 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.noname-h 2026-02-22T23:28:29.932 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.noname-d 2026-02-22T23:28:29.932 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.noname-i 2026-02-22T23:28:29.932 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.noname-e 2026-02-22T23:28:29.932 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:29.932 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.923+0000 7f33e6ef5640 1 Processor -- start 2026-02-22T23:28:29.932 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.923+0000 7f33e6ef5640 1 -- start start 2026-02-22T23:28:29.932 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.923+0000 7f33e6ef5640 10 monclient: init 2026-02-22T23:28:29.933 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.923+0000 7f33e6ef5640 10 monclient: _reopen_session rank -1 2026-02-22T23:28:29.933 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.923+0000 7f33e6ef5640 10 monclient: _add_conns ranks=[0,2,8,4,6,5,3,1,7] 2026-02-22T23:28:29.933 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.923+0000 7f33e6ef5640 10 monclient(hunting): picked mon.noname-a con 0x7f33e00a1a60 addr v1:10.20.193.45:6789/0 2026-02-22T23:28:29.933 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.923+0000 7f33e6ef5640 10 monclient(hunting): picked mon.noname-b con 0x7f33e006f1e0 addr v1:10.20.193.45:6790/0 2026-02-22T23:28:29.933 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.923+0000 7f33e6ef5640 10 monclient(hunting): picked mon.noname-e con 0x7f33e00a0980 addr v1:10.20.193.45:6793/0 2026-02-22T23:28:29.933 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.923+0000 7f33e6ef5640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f33e009df00 con 0x7f33e00a1a60 2026-02-22T23:28:29.933 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.923+0000 7f33e6ef5640 1 -- --> v1:10.20.193.45:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f33e0137660 con 0x7f33e006f1e0 2026-02-22T23:28:29.933 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.923+0000 7f33e6ef5640 1 -- --> v1:10.20.193.45:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f33e00a4510 con 0x7f33e00a0980 2026-02-22T23:28:29.933 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.923+0000 7f33e6ef5640 10 monclient(hunting): _renew_subs 2026-02-22T23:28:29.933 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.923+0000 7f33e6ef5640 10 monclient(hunting): authenticate will time out at 841.539697s 2026-02-22T23:28:29.933 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.923+0000 7f33e4c6a640 1 --1- >> v1:10.20.193.45:6789/0 conn(0x7f33e00a1a60 0x7f33e0136840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.45:6789/0 says I am v1:10.20.193.45:51504/0 (socket says 10.20.193.45:51504) 2026-02-22T23:28:29.933 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.923+0000 7f33e4c6a640 1 -- 10.20.193.45:0/3947103223 learned_addr learned my addr 10.20.193.45:0/3947103223 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-22T23:28:29.934 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.923+0000 7f33d77fe640 1 -- 10.20.193.45:0/3947103223 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1660370710 0 0) 0x7f33d0002920 con 0x7f33e00a1a60 2026-02-22T23:28:29.934 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.923+0000 7f33d77fe640 10 monclient(hunting): _negotiate 2026-02-22T23:28:29.934 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.923+0000 7f33d77fe640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:28:29.934 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.923+0000 7f33d77fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:28:29.934 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.923+0000 7f33d77fe640 10 monclient(hunting): my global_id is 4725 2026-02-22T23:28:29.934 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.923+0000 7f33d77fe640 1 -- 10.20.193.45:0/3947103223 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f33cc003620 con 0x7f33e00a1a60 2026-02-22T23:28:29.934 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.923+0000 7f33d77fe640 1 -- 10.20.193.45:0/3947103223 <== mon.8 v1:10.20.193.45:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1662010444 0 0) 0x7f33e00a4510 con 0x7f33e00a0980 2026-02-22T23:28:29.934 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.923+0000 7f33d77fe640 10 monclient(hunting): _negotiate 2026-02-22T23:28:29.934 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.923+0000 7f33d77fe640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:28:29.934 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.923+0000 7f33d77fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:28:29.934 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.923+0000 7f33d77fe640 10 monclient(hunting): my global_id is 4760 2026-02-22T23:28:29.934 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.923+0000 7f33d77fe640 1 -- 10.20.193.45:0/3947103223 --> v1:10.20.193.45:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f33d0002920 con 0x7f33e00a0980 2026-02-22T23:28:29.935 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.923+0000 7f33d77fe640 1 -- 10.20.193.45:0/3947103223 <== mon.2 v1:10.20.193.45:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1958162088 0 0) 0x7f33e0137660 con 0x7f33e006f1e0 2026-02-22T23:28:29.935 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.924+0000 7f33d77fe640 10 monclient(hunting): _negotiate 2026-02-22T23:28:29.935 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.924+0000 7f33d77fe640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:28:29.935 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.924+0000 7f33d77fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:28:29.935 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.924+0000 7f33d77fe640 10 monclient(hunting): my global_id is 4853 2026-02-22T23:28:29.935 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.924+0000 7f33d77fe640 1 -- 10.20.193.45:0/3947103223 --> v1:10.20.193.45:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f33e00a4510 con 0x7f33e006f1e0 2026-02-22T23:28:29.935 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.924+0000 7f33d77fe640 1 -- 10.20.193.45:0/3947103223 <== mon.0 v1:10.20.193.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3048398484 0 0) 0x7f33cc003620 con 0x7f33e00a1a60 2026-02-22T23:28:29.935 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.924+0000 7f33d77fe640 1 -- 10.20.193.45:0/3947103223 >> v1:10.20.193.45:6793/0 conn(0x7f33e00a0980 legacy=0x7f33e013ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:29.935 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.924+0000 7f33d77fe640 1 -- 10.20.193.45:0/3947103223 >> v1:10.20.193.45:6790/0 conn(0x7f33e006f1e0 legacy=0x7f33e0136f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:29.935 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.924+0000 7f33d77fe640 10 monclient: _finish_hunting 0 2026-02-22T23:28:29.935 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.924+0000 7f33d77fe640 1 monclient: found mon.noname-a 2026-02-22T23:28:29.935 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.924+0000 7f33d77fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T23:28:29.935 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.924+0000 7f33d77fe640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.45:6789/0 2026-02-22T23:28:29.936 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.924+0000 7f33d77fe640 1 -- 10.20.193.45:0/3947103223 --> v1:10.20.193.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33e0143400 con 0x7f33e00a1a60 2026-02-22T23:28:29.936 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.924+0000 7f33d77fe640 10 monclient: _finish_auth 0 2026-02-22T23:28:29.936 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.924+0000 7f33d77fe640 10 monclient: _check_auth_tickets 2026-02-22T23:28:29.936 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.924+0000 7f33d77fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T23:28:29.936 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.924+0000 7f33e6ef5640 5 monclient: authenticate success, global_id 4725 2026-02-22T23:28:29.936 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.924+0000 7f33e6ef5640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-22T23:28:29.936 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.924+0000 7f33d77fe640 1 -- 10.20.193.45:0/3947103223 <== mon.0 v1:10.20.193.45:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f33d0003210 con 0x7f33e00a1a60 2026-02-22T23:28:29.936 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.924+0000 7f33d77fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:28:29.936 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.924+0000 7f33d77fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T23:28:29.936 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.924+0000 7f33d77fe640 10 monclient: dump: 2026-02-22T23:28:29.936 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:28:29.936 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:28:29.936 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:29.937 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:29.937 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:28:29.937 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:28:29.937 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:28:29.937 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:28:29.937 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:28:29.937 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:28:29.937 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:28:29.937 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:28:29.937 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:28:29.937 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:28:29.937 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:28:29.937 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:29.938 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.924+0000 7f33e6ef5640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-22T23:28:29.938 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.924+0000 7f33d77fe640 1 -- 10.20.193.45:0/3947103223 <== mon.0 v1:10.20.193.45:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f33d00033b0 con 0x7f33e00a1a60 2026-02-22T23:28:29.938 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.924+0000 7f33d77fe640 10 monclient: handle_config config(0 keys) 2026-02-22T23:28:29.938 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.924+0000 7f33e6ef5640 10 monclient: get_monmap_and_config success 2026-02-22T23:28:29.938 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.924+0000 7f33d77fe640 1 -- 10.20.193.45:0/3947103223 <== mon.0 v1:10.20.193.45:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f33d0004ce0 con 0x7f33e00a1a60 2026-02-22T23:28:29.938 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.924+0000 7f33e6ef5640 4 set_mon_vals no callback set 2026-02-22T23:28:29.938 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.924+0000 7f33d77fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:28:29.938 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.924+0000 7f33d77fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T23:28:29.938 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.924+0000 7f33d77fe640 10 monclient: dump: 2026-02-22T23:28:29.938 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:28:29.938 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:28:29.939 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:29.939 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:29.939 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:28:29.939 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:28:29.939 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:28:29.939 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:28:29.939 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:28:29.939 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:28:29.939 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:28:29.939 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:28:29.939 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:28:29.939 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:28:29.939 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:28:29.940 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:29.940 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.924+0000 7f33e6ef5640 10 monclient: shutdown 2026-02-22T23:28:29.940 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.924+0000 7f33e6ef5640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T23:28:29.940 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.924+0000 7f33e6ef5640 1 -- 10.20.193.45:0/3947103223 >> v1:10.20.193.45:6789/0 conn(0x7f33e00a1a60 legacy=0x7f33e0136840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:29.940 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.924+0000 7f33e6ef5640 1 -- 10.20.193.45:0/3947103223 shutdown_connections 2026-02-22T23:28:29.940 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.924+0000 7f33e6ef5640 1 -- 10.20.193.45:0/3947103223 >> 10.20.193.45:0/3947103223 conn(0x7f33e00a7780 msgr2=0x7f33e00a3b60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:28:29.940 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.924+0000 7f33e6ef5640 1 -- 10.20.193.45:0/3947103223 shutdown_connections 2026-02-22T23:28:29.940 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.924+0000 7f33e6ef5640 1 -- 10.20.193.45:0/3947103223 wait complete. 2026-02-22T23:28:29.940 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.924+0000 7f33e6ef5640 10 monclient: build_initial_monmap 2026-02-22T23:28:29.940 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.924+0000 7f33e6ef5640 10 monclient: monmap: 2026-02-22T23:28:29.940 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-22T23:28:29.940 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T23:28:29.941 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-22T23:28:29.941 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-22T23:28:29.941 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-22T23:28:29.941 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-22T23:28:29.941 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-22T23:28:29.941 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.noname-f 2026-02-22T23:28:29.941 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.noname-b 2026-02-22T23:28:29.941 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.noname-g 2026-02-22T23:28:29.941 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.noname-c 2026-02-22T23:28:29.941 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.noname-h 2026-02-22T23:28:29.941 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.noname-d 2026-02-22T23:28:29.941 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.noname-i 2026-02-22T23:28:29.941 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.noname-e 2026-02-22T23:28:29.942 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:29.942 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.924+0000 7f33e6ef5640 1 Processor -- start 2026-02-22T23:28:29.942 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.925+0000 7f33e6ef5640 1 -- start start 2026-02-22T23:28:29.942 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.925+0000 7f33e6ef5640 10 monclient: init 2026-02-22T23:28:29.942 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.925+0000 7f33e6ef5640 10 monclient: _reopen_session rank -1 2026-02-22T23:28:29.942 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.925+0000 7f33e6ef5640 10 monclient: _add_conns ranks=[4,0,2,8,5,7,3,1,6] 2026-02-22T23:28:29.942 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.925+0000 7f33e6ef5640 10 monclient(hunting): picked mon.noname-c con 0x7f33e00a0980 addr v1:10.20.193.45:6791/0 2026-02-22T23:28:29.942 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.925+0000 7f33e6ef5640 10 monclient(hunting): picked mon.noname-a con 0x7f33e00a1a60 addr v1:10.20.193.45:6789/0 2026-02-22T23:28:29.942 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.925+0000 7f33e6ef5640 10 monclient(hunting): picked mon.noname-b con 0x7f33e0121620 addr v1:10.20.193.45:6790/0 2026-02-22T23:28:29.942 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.925+0000 7f33e6ef5640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f33e01245d0 con 0x7f33e00a1a60 2026-02-22T23:28:29.942 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.925+0000 7f33e6ef5640 1 -- --> v1:10.20.193.45:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f33e0142a80 con 0x7f33e0121620 2026-02-22T23:28:29.942 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.925+0000 7f33e6ef5640 1 -- --> v1:10.20.193.45:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f33e00a5f70 con 0x7f33e00a0980 2026-02-22T23:28:29.943 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.925+0000 7f33e6ef5640 10 monclient(hunting): _renew_subs 2026-02-22T23:28:29.943 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.925+0000 7f33e6ef5640 10 monclient(hunting): authenticate will time out at 841.541278s 2026-02-22T23:28:29.943 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.925+0000 7f33d7fff640 1 --1- >> v1:10.20.193.45:6789/0 conn(0x7f33e00a1a60 0x7f33e01d2490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.45:6789/0 says I am v1:10.20.193.45:51520/0 (socket says 10.20.193.45:51520) 2026-02-22T23:28:29.943 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.925+0000 7f33d7fff640 1 -- 10.20.193.45:0/2138713041 learned_addr learned my addr 10.20.193.45:0/2138713041 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-22T23:28:29.943 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.925+0000 7f33d57fa640 1 -- 10.20.193.45:0/2138713041 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2146334038 0 0) 0x7f33e01245d0 con 0x7f33e00a1a60 2026-02-22T23:28:29.943 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.925+0000 7f33d57fa640 10 monclient(hunting): _negotiate 2026-02-22T23:28:29.943 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.925+0000 7f33d57fa640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:28:29.943 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.925+0000 7f33d57fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:28:29.943 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.925+0000 7f33d57fa640 10 monclient(hunting): my global_id is 4734 2026-02-22T23:28:29.943 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.925+0000 7f33d57fa640 1 -- 10.20.193.45:0/2138713041 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f33b0003620 con 0x7f33e00a1a60 2026-02-22T23:28:29.943 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.925+0000 7f33d57fa640 1 -- 10.20.193.45:0/2138713041 <== mon.4 v1:10.20.193.45:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4046724581 0 0) 0x7f33e00a5f70 con 0x7f33e00a0980 2026-02-22T23:28:29.943 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.925+0000 7f33d57fa640 10 monclient(hunting): _negotiate 2026-02-22T23:28:29.944 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.925+0000 7f33d57fa640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:28:29.944 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.925+0000 7f33d57fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:28:29.944 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.925+0000 7f33d57fa640 10 monclient(hunting): my global_id is 114304 2026-02-22T23:28:29.944 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.925+0000 7f33d57fa640 1 -- 10.20.193.45:0/2138713041 --> v1:10.20.193.45:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f33e01245d0 con 0x7f33e00a0980 2026-02-22T23:28:29.944 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.925+0000 7f33d57fa640 1 -- 10.20.193.45:0/2138713041 <== mon.2 v1:10.20.193.45:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3633402050 0 0) 0x7f33e0142a80 con 0x7f33e0121620 2026-02-22T23:28:29.944 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.925+0000 7f33d57fa640 10 monclient(hunting): _negotiate 2026-02-22T23:28:29.944 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.925+0000 7f33d57fa640 10 monclient(hunting): _init_auth method 2 2026-02-22T23:28:29.944 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.925+0000 7f33d57fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T23:28:29.944 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.925+0000 7f33d57fa640 10 monclient(hunting): my global_id is 4862 2026-02-22T23:28:29.944 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.925+0000 7f33d57fa640 1 -- 10.20.193.45:0/2138713041 --> v1:10.20.193.45:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f33e00a5f70 con 0x7f33e0121620 2026-02-22T23:28:29.944 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.925+0000 7f33d57fa640 1 -- 10.20.193.45:0/2138713041 <== mon.0 v1:10.20.193.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4095425473 0 0) 0x7f33b0003620 con 0x7f33e00a1a60 2026-02-22T23:28:29.944 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.925+0000 7f33d57fa640 1 -- 10.20.193.45:0/2138713041 --> v1:10.20.193.45:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f33e0142a80 con 0x7f33e00a1a60 2026-02-22T23:28:29.944 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.925+0000 7f33d57fa640 1 -- 10.20.193.45:0/2138713041 <== mon.0 v1:10.20.193.45:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f33c80033d0 con 0x7f33e00a1a60 2026-02-22T23:28:29.945 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.925+0000 7f33d57fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-22T23:28:29.945 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.925+0000 7f33d57fa640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T23:28:29.945 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.925+0000 7f33d57fa640 10 monclient(hunting): dump: 2026-02-22T23:28:29.945 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:28:29.945 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:28:29.945 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:29.945 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:29.945 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:28:29.945 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:28:29.945 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:28:29.945 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:28:29.945 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:28:29.945 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:28:29.946 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:28:29.946 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:28:29.946 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:28:29.946 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:28:29.946 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:28:29.946 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:29.946 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.925+0000 7f33d57fa640 10 monclient(hunting): _finish_auth 0 2026-02-22T23:28:29.946 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.925+0000 7f33d57fa640 1 -- 10.20.193.45:0/2138713041 <== mon.2 v1:10.20.193.45:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4074071715 0 0) 0x7f33e00a5f70 con 0x7f33e0121620 2026-02-22T23:28:29.946 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.925+0000 7f33d57fa640 1 -- 10.20.193.45:0/2138713041 --> v1:10.20.193.45:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f33b0003620 con 0x7f33e0121620 2026-02-22T23:28:29.946 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.925+0000 7f33d57fa640 1 -- 10.20.193.45:0/2138713041 <== mon.4 v1:10.20.193.45:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2344963565 0 0) 0x7f33e01245d0 con 0x7f33e00a0980 2026-02-22T23:28:29.946 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.925+0000 7f33d57fa640 1 -- 10.20.193.45:0/2138713041 --> v1:10.20.193.45:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f33e00a5f70 con 0x7f33e00a0980 2026-02-22T23:28:29.947 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.925+0000 7f33d57fa640 1 -- 10.20.193.45:0/2138713041 <== mon.2 v1:10.20.193.45:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f33dc003380 con 0x7f33e0121620 2026-02-22T23:28:29.947 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.925+0000 7f33d57fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-22T23:28:29.947 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.925+0000 7f33d57fa640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-22T23:28:29.947 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.925+0000 7f33d57fa640 10 monclient(hunting): dump: 2026-02-22T23:28:29.947 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:28:29.947 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:28:29.947 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:29.947 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:29.947 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:28:29.947 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:28:29.947 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:28:29.947 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:28:29.948 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:28:29.948 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:28:29.948 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:28:29.948 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:28:29.948 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:28:29.948 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:28:29.948 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:28:29.948 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:29.948 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.925+0000 7f33d57fa640 1 -- 10.20.193.45:0/2138713041 <== mon.4 v1:10.20.193.45:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f33d00031d0 con 0x7f33e00a0980 2026-02-22T23:28:29.948 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.925+0000 7f33d57fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-22T23:28:29.948 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.925+0000 7f33d57fa640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-22T23:28:29.948 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.925+0000 7f33d57fa640 10 monclient(hunting): dump: 2026-02-22T23:28:29.948 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:28:29.949 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:28:29.949 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:29.949 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:29.949 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:28:29.949 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:28:29.949 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:28:29.949 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:28:29.949 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:28:29.949 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:28:29.949 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:28:29.949 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:28:29.949 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:28:29.949 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:28:29.950 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:28:29.950 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:29.950 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.925+0000 7f33d57fa640 1 -- 10.20.193.45:0/2138713041 <== mon.0 v1:10.20.193.45:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2459552999 0 0) 0x7f33e0142a80 con 0x7f33e00a1a60 2026-02-22T23:28:29.950 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.925+0000 7f33d57fa640 1 -- 10.20.193.45:0/2138713041 >> v1:10.20.193.45:6791/0 conn(0x7f33e00a0980 legacy=0x7f33e013ca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:29.950 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.925+0000 7f33d57fa640 1 -- 10.20.193.45:0/2138713041 >> v1:10.20.193.45:6790/0 conn(0x7f33e0121620 legacy=0x7f33e01d5bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:29.950 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.925+0000 7f33d57fa640 10 monclient: _finish_hunting 0 2026-02-22T23:28:29.950 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.925+0000 7f33d57fa640 1 monclient: found mon.a 2026-02-22T23:28:29.950 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.925+0000 7f33d57fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T23:28:29.950 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.925+0000 7f33d57fa640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-22T23:28:29.950 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.925+0000 7f33d57fa640 1 -- 10.20.193.45:0/2138713041 --> v1:10.20.193.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33e0124010 con 0x7f33e00a1a60 2026-02-22T23:28:29.950 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.925+0000 7f33d57fa640 10 monclient: _finish_auth 0 2026-02-22T23:28:29.950 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.925+0000 7f33d57fa640 10 monclient: _check_auth_tickets 2026-02-22T23:28:29.951 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.925+0000 7f33d57fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T23:28:29.951 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.925+0000 7f33e6ef5640 5 monclient: authenticate success, global_id 4734 2026-02-22T23:28:29.951 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.925+0000 7f33e6ef5640 10 monclient: _renew_subs 2026-02-22T23:28:29.951 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.925+0000 7f33e6ef5640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-22T23:28:29.951 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.925+0000 7f33e6ef5640 1 -- 10.20.193.45:0/2138713041 --> v1:10.20.193.45:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f33e01242f0 con 0x7f33e00a1a60 2026-02-22T23:28:29.951 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.925+0000 7f33e6ef5640 10 monclient: _renew_subs 2026-02-22T23:28:29.951 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.925+0000 7f33e6ef5640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-22T23:28:29.951 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.925+0000 7f33e6ef5640 1 -- 10.20.193.45:0/2138713041 --> v1:10.20.193.45:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f33e013d190 con 0x7f33e00a1a60 2026-02-22T23:28:29.951 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.925+0000 7f33d57fa640 1 -- 10.20.193.45:0/2138713041 <== mon.0 v1:10.20.193.45:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f33c8003820 con 0x7f33e00a1a60 2026-02-22T23:28:29.951 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.925+0000 7f33d57fa640 10 monclient: handle_config config(0 keys) 2026-02-22T23:28:29.951 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.925+0000 7f33d57fa640 1 -- 10.20.193.45:0/2138713041 <== mon.0 v1:10.20.193.45:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2107644800 0 0) 0x7f33c8003d90 con 0x7f33e00a1a60 2026-02-22T23:28:29.951 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.925+0000 7f33d57fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T23:28:29.951 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.925+0000 7f33d57fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T23:28:29.952 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.925+0000 7f33d6ffd640 4 set_mon_vals no callback set 2026-02-22T23:28:29.952 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.925+0000 7f33d57fa640 10 monclient: dump: 2026-02-22T23:28:29.952 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-22T23:28:29.952 INFO:teuthology.orchestra.run.trial045.stderr:fsid 4b60f18f-6660-4731-b731-dc85c4078413 2026-02-22T23:28:29.952 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:29.952 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-22T23:24:52.393472+0000 2026-02-22T23:28:29.952 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-22T23:28:29.952 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-22T23:28:29.952 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-22T23:28:29.952 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.73:6789/0 mon.f 2026-02-22T23:28:29.952 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.45:6790/0 mon.b 2026-02-22T23:28:29.952 INFO:teuthology.orchestra.run.trial045.stderr:3: v1:10.20.193.73:6790/0 mon.g 2026-02-22T23:28:29.952 INFO:teuthology.orchestra.run.trial045.stderr:4: v1:10.20.193.45:6791/0 mon.c 2026-02-22T23:28:29.953 INFO:teuthology.orchestra.run.trial045.stderr:5: v1:10.20.193.73:6791/0 mon.h 2026-02-22T23:28:29.953 INFO:teuthology.orchestra.run.trial045.stderr:6: v1:10.20.193.45:6792/0 mon.d 2026-02-22T23:28:29.953 INFO:teuthology.orchestra.run.trial045.stderr:7: v1:10.20.193.73:6792/0 mon.i 2026-02-22T23:28:29.953 INFO:teuthology.orchestra.run.trial045.stderr:8: v1:10.20.193.45:6793/0 mon.e 2026-02-22T23:28:29.953 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:29.953 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.926+0000 7f33e6ef5640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T23:28:29.953 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.926+0000 7f33e6ef5640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T23:28:29.953 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.926+0000 7f33e6ef5640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-22T23:28:29.953 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.926+0000 7f33d57fa640 1 -- 10.20.193.45:0/2138713041 <== mon.0 v1:10.20.193.45:6789/0 7 ==== mgrmap(e 5) ==== 50225+0+0 (unknown 2330357642 0 0) 0x7f33c8011660 con 0x7f33e00a1a60 2026-02-22T23:28:29.953 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.926+0000 7f33e6ef5640 1 -- 10.20.193.45:0/2138713041 --> v1:10.20.193.45:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f33e0123e10 con 0x7f33e00a1a60 2026-02-22T23:28:29.953 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.926+0000 7f33d57fa640 1 -- 10.20.193.45:0/2138713041 <== mon.0 v1:10.20.193.45:6789/0 8 ==== osd_map(25..25 src has 1..25) ==== 3502+0+0 (unknown 129690100 0 0) 0x7f33c804db20 con 0x7f33e00a1a60 2026-02-22T23:28:29.953 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.926+0000 7f33e4c6a640 10 monclient: get_auth_request con 0x7f33b00402b0 auth_method 0 2026-02-22T23:28:29.954 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.928+0000 7f33d57fa640 1 -- 10.20.193.45:0/2138713041 <== mon.0 v1:10.20.193.45:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (unknown 1092875540 0 2568732696) 0x7f33c80175a0 con 0x7f33e00a1a60 2026-02-22T23:28:29.954 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.928+0000 7f33d57fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T23:28:29.954 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:29.928+0000 7f33d57fa640 10 monclient: _finish_command 1 = system:0 2026-02-22T23:28:30.014 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:30.013+0000 7f33e6ef5640 10 start_mon_command cmd=[{"prefix": "config set", "who": "global", "name": "mon_health_to_clog", "value": "false"}] 2026-02-22T23:28:30.014 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:30.013+0000 7f33e6ef5640 10 monclient: _send_command 2 [{"prefix": "config set", "who": "global", "name": "mon_health_to_clog", "value": "false"}] 2026-02-22T23:28:30.014 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:30.013+0000 7f33e6ef5640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-22T23:28:30.014 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:30.013+0000 7f33e6ef5640 1 -- 10.20.193.45:0/2138713041 --> v1:10.20.193.45:6789/0 -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7f33e0121b60 con 0x7f33e00a1a60 2026-02-22T23:28:30.016 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:30.016+0000 7f33d57fa640 1 -- 10.20.193.45:0/2138713041 <== mon.0 v1:10.20.193.45:6789/0 10 ==== config(1 keys) ==== 35+0+0 (unknown 2555425225 0 0) 0x7f33c801b250 con 0x7f33e00a1a60 2026-02-22T23:28:30.017 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:30.016+0000 7f33d57fa640 10 monclient: handle_config config(1 keys) 2026-02-22T23:28:30.017 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:30.016+0000 7f33d6ffd640 4 set_mon_vals no callback set 2026-02-22T23:28:30.017 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:30.016+0000 7f33d6ffd640 10 set_mon_vals mon_health_to_clog = false 2026-02-22T23:28:30.017 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:30.016+0000 7f33d57fa640 1 -- 10.20.193.45:0/2138713041 <== mon.0 v1:10.20.193.45:6789/0 11 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v2)=0 v2) ==== 123+0+0 (unknown 691139944 0 0) 0x7f33e0121b60 con 0x7f33e00a1a60 2026-02-22T23:28:30.017 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:30.016+0000 7f33d57fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "config set", "who": "global", "name": "mon_health_to_clog", "value": "false"}] 2026-02-22T23:28:30.017 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:30.016+0000 7f33d57fa640 10 monclient: _finish_command 2 = system:0 2026-02-22T23:28:30.018 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:30.017+0000 7f33e6ef5640 1 -- 10.20.193.45:0/2138713041 >> v1:10.20.193.73:6800/2222410180 conn(0x7f33b00402b0 legacy=0x7f33b0042770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:30.018 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:30.017+0000 7f33e6ef5640 10 monclient: shutdown 2026-02-22T23:28:30.018 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:30.017+0000 7f33e6ef5640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T23:28:30.018 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:30.017+0000 7f33e6ef5640 1 -- 10.20.193.45:0/2138713041 >> v1:10.20.193.45:6789/0 conn(0x7f33e00a1a60 legacy=0x7f33e01d2490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:28:30.018 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:30.017+0000 7f33e6ef5640 1 -- 10.20.193.45:0/2138713041 shutdown_connections 2026-02-22T23:28:30.018 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:30.017+0000 7f33e6ef5640 1 -- 10.20.193.45:0/2138713041 >> 10.20.193.45:0/2138713041 conn(0x7f33e00a7780 msgr2=0x7f33e01416a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:28:30.019 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:30.017+0000 7f33e6ef5640 1 -- 10.20.193.45:0/2138713041 shutdown_connections 2026-02-22T23:28:30.019 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-22T23:28:30.017+0000 7f33e6ef5640 1 -- 10.20.193.45:0/2138713041 wait complete. 2026-02-22T23:28:30.026 INFO:teuthology.misc:Shutting down mds daemons... 2026-02-22T23:28:30.026 INFO:teuthology.misc:Shutting down osd daemons... 2026-02-22T23:28:30.026 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2026-02-22T23:28:30.027 INFO:teuthology.orchestra.run:waiting for 300 2026-02-22T23:28:30.064 INFO:tasks.ceph.osd.0:Stopped 2026-02-22T23:28:30.065 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2026-02-22T23:28:30.065 INFO:teuthology.orchestra.run:waiting for 300 2026-02-22T23:28:30.138 INFO:tasks.ceph.osd.1:Stopped 2026-02-22T23:28:30.139 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2026-02-22T23:28:30.139 INFO:teuthology.orchestra.run:waiting for 300 2026-02-22T23:28:30.209 INFO:tasks.ceph.osd.2:Stopped 2026-02-22T23:28:30.210 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2026-02-22T23:28:30.210 INFO:teuthology.orchestra.run:waiting for 300 2026-02-22T23:28:30.241 INFO:tasks.ceph.osd.3:Stopped 2026-02-22T23:28:30.241 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2026-02-22T23:28:30.241 INFO:teuthology.orchestra.run:waiting for 300 2026-02-22T23:28:30.315 INFO:tasks.ceph.osd.4:Stopped 2026-02-22T23:28:30.315 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2026-02-22T23:28:30.315 INFO:teuthology.orchestra.run:waiting for 300 2026-02-22T23:28:30.390 INFO:tasks.ceph.osd.5:Stopped 2026-02-22T23:28:30.390 INFO:teuthology.misc:Shutting down mgr daemons... 2026-02-22T23:28:30.390 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2026-02-22T23:28:30.390 INFO:teuthology.orchestra.run:waiting for 300 2026-02-22T23:28:30.463 INFO:tasks.ceph.mgr.x:Stopped 2026-02-22T23:28:30.463 INFO:teuthology.misc:Shutting down mon daemons... 2026-02-22T23:28:30.464 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2026-02-22T23:28:30.464 INFO:teuthology.orchestra.run:waiting for 300 2026-02-22T23:28:30.473 INFO:tasks.ceph.mon.a:Stopped 2026-02-22T23:28:30.474 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2026-02-22T23:28:30.474 INFO:teuthology.orchestra.run:waiting for 300 2026-02-22T23:28:30.523 INFO:tasks.ceph.mon.b:Stopped 2026-02-22T23:28:30.524 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2026-02-22T23:28:30.524 INFO:teuthology.orchestra.run:waiting for 300 2026-02-22T23:28:30.573 INFO:tasks.ceph.mon.c:Stopped 2026-02-22T23:28:30.573 DEBUG:tasks.ceph.mon.d:waiting for process to exit 2026-02-22T23:28:30.573 INFO:teuthology.orchestra.run:waiting for 300 2026-02-22T23:28:30.622 INFO:tasks.ceph.mon.d:Stopped 2026-02-22T23:28:30.622 DEBUG:tasks.ceph.mon.e:waiting for process to exit 2026-02-22T23:28:30.623 INFO:teuthology.orchestra.run:waiting for 300 2026-02-22T23:28:30.673 INFO:tasks.ceph.mon.e:Stopped 2026-02-22T23:28:30.673 DEBUG:tasks.ceph.mon.f:waiting for process to exit 2026-02-22T23:28:30.673 INFO:teuthology.orchestra.run:waiting for 300 2026-02-22T23:28:30.683 INFO:tasks.ceph.mon.f:Stopped 2026-02-22T23:28:30.683 DEBUG:tasks.ceph.mon.g:waiting for process to exit 2026-02-22T23:28:30.683 INFO:teuthology.orchestra.run:waiting for 300 2026-02-22T23:28:30.733 INFO:tasks.ceph.mon.g:Stopped 2026-02-22T23:28:30.733 DEBUG:tasks.ceph.mon.h:waiting for process to exit 2026-02-22T23:28:30.733 INFO:teuthology.orchestra.run:waiting for 300 2026-02-22T23:28:30.784 INFO:tasks.ceph.mon.h:Stopped 2026-02-22T23:28:30.784 DEBUG:tasks.ceph.mon.i:waiting for process to exit 2026-02-22T23:28:30.784 INFO:teuthology.orchestra.run:waiting for 300 2026-02-22T23:28:30.834 INFO:tasks.ceph.mon.i:Stopped 2026-02-22T23:28:30.834 INFO:tasks.ceph:Checking cluster log for badness... 2026-02-22T23:28:30.834 DEBUG:teuthology.orchestra.run.trial045:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v ScrubResult | egrep -v 'scrub mismatch' | egrep -v 'overall HEALTH_' | egrep -v '\(MGR_DOWN\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(SLOW_OPS\)' | egrep -v 'slow request' | egrep -v '\(OSD_SLOW_PING_TIME' | egrep -v 'overall HEALTH_' | egrep -v '\(MON_DOWN\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | head -n 1 2026-02-22T23:28:30.864 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@trial045.front.sepia.ceph.com 2026-02-22T23:28:30.864 DEBUG:teuthology.orchestra.run.trial045:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2026-02-22T23:28:30.932 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@trial045.front.sepia.ceph.com 2026-02-22T23:28:30.932 DEBUG:teuthology.orchestra.run.trial045:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2026-02-22T23:28:30.998 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@trial045.front.sepia.ceph.com 2026-02-22T23:28:30.998 DEBUG:teuthology.orchestra.run.trial045:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2026-02-22T23:28:31.069 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@trial073.front.sepia.ceph.com 2026-02-22T23:28:31.069 DEBUG:teuthology.orchestra.run.trial073:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2026-02-22T23:28:31.101 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@trial073.front.sepia.ceph.com 2026-02-22T23:28:31.101 DEBUG:teuthology.orchestra.run.trial073:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2026-02-22T23:28:31.168 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@trial073.front.sepia.ceph.com 2026-02-22T23:28:31.168 DEBUG:teuthology.orchestra.run.trial073:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2026-02-22T23:28:31.238 INFO:tasks.ceph:Archiving mon data... 2026-02-22T23:28:31.239 DEBUG:teuthology.misc:Transferring archived files from trial045:/var/lib/ceph/mon/ceph-a to /home/teuthworker/mnt/teuthology/yuriw-2026-02-22_19:35:40-rados-wip-yuri6-testing-2026-02-22-1629-squid-distro-default-trial/64386/data/mon.a.tgz 2026-02-22T23:28:31.239 DEBUG:teuthology.orchestra.run.trial045:> mktemp 2026-02-22T23:28:31.258 INFO:teuthology.orchestra.run.trial045.stdout:/tmp/tmp.OrJ2F1dqw5 2026-02-22T23:28:31.258 DEBUG:teuthology.orchestra.run.trial045:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.OrJ2F1dqw5 2026-02-22T23:28:31.339 DEBUG:teuthology.orchestra.run.trial045:> sudo chmod 0666 /tmp/tmp.OrJ2F1dqw5 2026-02-22T23:28:31.459 DEBUG:teuthology.orchestra.remote:trial045:/tmp/tmp.OrJ2F1dqw5 is 117KB 2026-02-22T23:28:31.509 DEBUG:teuthology.orchestra.run.trial045:> rm -fr /tmp/tmp.OrJ2F1dqw5 2026-02-22T23:28:31.524 DEBUG:teuthology.misc:Transferring archived files from trial045:/var/lib/ceph/mon/ceph-b to /home/teuthworker/mnt/teuthology/yuriw-2026-02-22_19:35:40-rados-wip-yuri6-testing-2026-02-22-1629-squid-distro-default-trial/64386/data/mon.b.tgz 2026-02-22T23:28:31.525 DEBUG:teuthology.orchestra.run.trial045:> mktemp 2026-02-22T23:28:31.581 INFO:teuthology.orchestra.run.trial045.stdout:/tmp/tmp.2ZJ3sQNLFY 2026-02-22T23:28:31.581 DEBUG:teuthology.orchestra.run.trial045:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.2ZJ3sQNLFY 2026-02-22T23:28:31.657 DEBUG:teuthology.orchestra.run.trial045:> sudo chmod 0666 /tmp/tmp.2ZJ3sQNLFY 2026-02-22T23:28:31.778 DEBUG:teuthology.orchestra.remote:trial045:/tmp/tmp.2ZJ3sQNLFY is 117KB 2026-02-22T23:28:31.827 DEBUG:teuthology.orchestra.run.trial045:> rm -fr /tmp/tmp.2ZJ3sQNLFY 2026-02-22T23:28:31.843 DEBUG:teuthology.misc:Transferring archived files from trial045:/var/lib/ceph/mon/ceph-c to /home/teuthworker/mnt/teuthology/yuriw-2026-02-22_19:35:40-rados-wip-yuri6-testing-2026-02-22-1629-squid-distro-default-trial/64386/data/mon.c.tgz 2026-02-22T23:28:31.843 DEBUG:teuthology.orchestra.run.trial045:> mktemp 2026-02-22T23:28:31.899 INFO:teuthology.orchestra.run.trial045.stdout:/tmp/tmp.zwODxcGe2S 2026-02-22T23:28:31.900 DEBUG:teuthology.orchestra.run.trial045:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.zwODxcGe2S 2026-02-22T23:28:31.975 DEBUG:teuthology.orchestra.run.trial045:> sudo chmod 0666 /tmp/tmp.zwODxcGe2S 2026-02-22T23:28:32.095 DEBUG:teuthology.orchestra.remote:trial045:/tmp/tmp.zwODxcGe2S is 116KB 2026-02-22T23:28:32.144 DEBUG:teuthology.orchestra.run.trial045:> rm -fr /tmp/tmp.zwODxcGe2S 2026-02-22T23:28:32.160 DEBUG:teuthology.misc:Transferring archived files from trial045:/var/lib/ceph/mon/ceph-d to /home/teuthworker/mnt/teuthology/yuriw-2026-02-22_19:35:40-rados-wip-yuri6-testing-2026-02-22-1629-squid-distro-default-trial/64386/data/mon.d.tgz 2026-02-22T23:28:32.160 DEBUG:teuthology.orchestra.run.trial045:> mktemp 2026-02-22T23:28:32.216 INFO:teuthology.orchestra.run.trial045.stdout:/tmp/tmp.scMfYJakcm 2026-02-22T23:28:32.217 DEBUG:teuthology.orchestra.run.trial045:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-d -- . > /tmp/tmp.scMfYJakcm 2026-02-22T23:28:32.293 DEBUG:teuthology.orchestra.run.trial045:> sudo chmod 0666 /tmp/tmp.scMfYJakcm 2026-02-22T23:28:32.414 DEBUG:teuthology.orchestra.remote:trial045:/tmp/tmp.scMfYJakcm is 116KB 2026-02-22T23:28:32.463 DEBUG:teuthology.orchestra.run.trial045:> rm -fr /tmp/tmp.scMfYJakcm 2026-02-22T23:28:32.479 DEBUG:teuthology.misc:Transferring archived files from trial045:/var/lib/ceph/mon/ceph-e to /home/teuthworker/mnt/teuthology/yuriw-2026-02-22_19:35:40-rados-wip-yuri6-testing-2026-02-22-1629-squid-distro-default-trial/64386/data/mon.e.tgz 2026-02-22T23:28:32.479 DEBUG:teuthology.orchestra.run.trial045:> mktemp 2026-02-22T23:28:32.537 INFO:teuthology.orchestra.run.trial045.stdout:/tmp/tmp.0bP1wY803z 2026-02-22T23:28:32.537 DEBUG:teuthology.orchestra.run.trial045:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-e -- . > /tmp/tmp.0bP1wY803z 2026-02-22T23:28:32.614 DEBUG:teuthology.orchestra.run.trial045:> sudo chmod 0666 /tmp/tmp.0bP1wY803z 2026-02-22T23:28:32.737 DEBUG:teuthology.orchestra.remote:trial045:/tmp/tmp.0bP1wY803z is 117KB 2026-02-22T23:28:32.786 DEBUG:teuthology.orchestra.run.trial045:> rm -fr /tmp/tmp.0bP1wY803z 2026-02-22T23:28:32.802 DEBUG:teuthology.misc:Transferring archived files from trial073:/var/lib/ceph/mon/ceph-f to /home/teuthworker/mnt/teuthology/yuriw-2026-02-22_19:35:40-rados-wip-yuri6-testing-2026-02-22-1629-squid-distro-default-trial/64386/data/mon.f.tgz 2026-02-22T23:28:32.802 DEBUG:teuthology.orchestra.run.trial073:> mktemp 2026-02-22T23:28:32.819 INFO:teuthology.orchestra.run.trial073.stdout:/tmp/tmp.PNj183pNzb 2026-02-22T23:28:32.820 DEBUG:teuthology.orchestra.run.trial073:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-f -- . > /tmp/tmp.PNj183pNzb 2026-02-22T23:28:32.900 DEBUG:teuthology.orchestra.run.trial073:> sudo chmod 0666 /tmp/tmp.PNj183pNzb 2026-02-22T23:28:33.022 DEBUG:teuthology.orchestra.remote:trial073:/tmp/tmp.PNj183pNzb is 116KB 2026-02-22T23:28:33.072 DEBUG:teuthology.orchestra.run.trial073:> rm -fr /tmp/tmp.PNj183pNzb 2026-02-22T23:28:33.087 DEBUG:teuthology.misc:Transferring archived files from trial073:/var/lib/ceph/mon/ceph-g to /home/teuthworker/mnt/teuthology/yuriw-2026-02-22_19:35:40-rados-wip-yuri6-testing-2026-02-22-1629-squid-distro-default-trial/64386/data/mon.g.tgz 2026-02-22T23:28:33.087 DEBUG:teuthology.orchestra.run.trial073:> mktemp 2026-02-22T23:28:33.143 INFO:teuthology.orchestra.run.trial073.stdout:/tmp/tmp.DCf8CATW9P 2026-02-22T23:28:33.143 DEBUG:teuthology.orchestra.run.trial073:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-g -- . > /tmp/tmp.DCf8CATW9P 2026-02-22T23:28:33.221 DEBUG:teuthology.orchestra.run.trial073:> sudo chmod 0666 /tmp/tmp.DCf8CATW9P 2026-02-22T23:28:33.343 DEBUG:teuthology.orchestra.remote:trial073:/tmp/tmp.DCf8CATW9P is 117KB 2026-02-22T23:28:33.393 DEBUG:teuthology.orchestra.run.trial073:> rm -fr /tmp/tmp.DCf8CATW9P 2026-02-22T23:28:33.408 DEBUG:teuthology.misc:Transferring archived files from trial073:/var/lib/ceph/mon/ceph-h to /home/teuthworker/mnt/teuthology/yuriw-2026-02-22_19:35:40-rados-wip-yuri6-testing-2026-02-22-1629-squid-distro-default-trial/64386/data/mon.h.tgz 2026-02-22T23:28:33.408 DEBUG:teuthology.orchestra.run.trial073:> mktemp 2026-02-22T23:28:33.464 INFO:teuthology.orchestra.run.trial073.stdout:/tmp/tmp.uTvfTCbVjG 2026-02-22T23:28:33.464 DEBUG:teuthology.orchestra.run.trial073:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-h -- . > /tmp/tmp.uTvfTCbVjG 2026-02-22T23:28:33.540 DEBUG:teuthology.orchestra.run.trial073:> sudo chmod 0666 /tmp/tmp.uTvfTCbVjG 2026-02-22T23:28:33.663 DEBUG:teuthology.orchestra.remote:trial073:/tmp/tmp.uTvfTCbVjG is 116KB 2026-02-22T23:28:33.712 DEBUG:teuthology.orchestra.run.trial073:> rm -fr /tmp/tmp.uTvfTCbVjG 2026-02-22T23:28:33.728 DEBUG:teuthology.misc:Transferring archived files from trial073:/var/lib/ceph/mon/ceph-i to /home/teuthworker/mnt/teuthology/yuriw-2026-02-22_19:35:40-rados-wip-yuri6-testing-2026-02-22-1629-squid-distro-default-trial/64386/data/mon.i.tgz 2026-02-22T23:28:33.729 DEBUG:teuthology.orchestra.run.trial073:> mktemp 2026-02-22T23:28:33.784 INFO:teuthology.orchestra.run.trial073.stdout:/tmp/tmp.6wxupGNIW6 2026-02-22T23:28:33.784 DEBUG:teuthology.orchestra.run.trial073:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-i -- . > /tmp/tmp.6wxupGNIW6 2026-02-22T23:28:33.861 DEBUG:teuthology.orchestra.run.trial073:> sudo chmod 0666 /tmp/tmp.6wxupGNIW6 2026-02-22T23:28:33.984 DEBUG:teuthology.orchestra.remote:trial073:/tmp/tmp.6wxupGNIW6 is 117KB 2026-02-22T23:28:34.033 DEBUG:teuthology.orchestra.run.trial073:> rm -fr /tmp/tmp.6wxupGNIW6 2026-02-22T23:28:34.049 INFO:tasks.ceph:Cleaning ceph cluster... 2026-02-22T23:28:34.049 DEBUG:teuthology.orchestra.run.trial045:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2026-02-22T23:28:34.052 DEBUG:teuthology.orchestra.run.trial073:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2026-02-22T23:28:34.132 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2026-02-22T23:28:34.169 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2026-02-22T23:28:34.169 INFO:tasks.ceph:Archiving crash dumps... 2026-02-22T23:28:34.171 DEBUG:teuthology.misc:Transferring archived files from trial045:/var/lib/ceph/crash to /home/teuthworker/mnt/teuthology/yuriw-2026-02-22_19:35:40-rados-wip-yuri6-testing-2026-02-22-1629-squid-distro-default-trial/64386/remote/trial045/crash 2026-02-22T23:28:34.171 DEBUG:teuthology.orchestra.run.trial045:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2026-02-22T23:28:34.197 DEBUG:teuthology.misc:Transferring archived files from trial073:/var/lib/ceph/crash to /home/teuthworker/mnt/teuthology/yuriw-2026-02-22_19:35:40-rados-wip-yuri6-testing-2026-02-22-1629-squid-distro-default-trial/64386/remote/trial073/crash 2026-02-22T23:28:34.198 DEBUG:teuthology.orchestra.run.trial073:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2026-02-22T23:28:34.233 INFO:tasks.ceph:Compressing logs... 2026-02-22T23:28:34.234 DEBUG:teuthology.orchestra.run.trial045:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-02-22T23:28:34.242 DEBUG:teuthology.orchestra.run.trial073:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-02-22T23:28:34.265 INFO:teuthology.orchestra.run.trial045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2026-02-22T23:28:34.297 INFO:teuthology.orchestra.run.trial045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48813.log 2026-02-22T23:28:34.297 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47536.log 2026-02-22T23:28:34.297 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.48813.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46101.log 2026-02-22T23:28:34.297 INFO:teuthology.orchestra.run.trial045.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.48813.log.gz 2026-02-22T23:28:34.297 INFO:teuthology.orchestra.run.trial045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2026-02-22T23:28:34.297 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.47536.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47685.log 2026-02-22T23:28:34.297 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.46101.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.47536.log.gz 2026-02-22T23:28:34.298 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 87.7% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.46101.log.gz /var/log/ceph/ceph-client.admin.49009.log 2026-02-22T23:28:34.298 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:34.298 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.47685.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47636.log 2026-02-22T23:28:34.298 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.49009.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.47685.log.gz 2026-02-22T23:28:34.298 INFO:teuthology.orchestra.run.trial045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48275.log 2026-02-22T23:28:34.298 INFO:teuthology.orchestra.run.trial045.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.49009.log.gz 2026-02-22T23:28:34.298 INFO:teuthology.orchestra.run.trial045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2026-02-22T23:28:34.298 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.47636.log: /var/log/ceph/ceph-client.admin.48275.log: 88.4%gzip -- replaced with /var/log/ceph/ceph-client.admin.47636.log.gz 2026-02-22T23:28:34.298 INFO:teuthology.orchestra.run.trial045.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.49303.log 2026-02-22T23:28:34.298 INFO:teuthology.orchestra.run.trial045.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.48275.log.gz 2026-02-22T23:28:34.298 INFO:teuthology.orchestra.run.trial045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45870.log 2026-02-22T23:28:34.298 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-osd.0.log: /var/log/ceph/ceph-client.admin.49303.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47930.log 2026-02-22T23:28:34.298 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.45870.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48911.log 2026-02-22T23:28:34.299 INFO:teuthology.orchestra.run.trial045.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.49303.log.gz 2026-02-22T23:28:34.299 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.47930.log: gzip 88.1% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.45870.log.gz -- /var/log/ceph/ceph-client.admin.46636.log 2026-02-22T23:28:34.299 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:34.299 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.48911.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46098.log 2026-02-22T23:28:34.299 INFO:teuthology.orchestra.run.trial045.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.47930.log.gz 2026-02-22T23:28:34.299 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.46636.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.48911.log.gz 2026-02-22T23:28:34.299 INFO:teuthology.orchestra.run.trial045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48764.log 2026-02-22T23:28:34.299 INFO:teuthology.orchestra.run.trial045.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46636.log.gz 2026-02-22T23:28:34.299 INFO:teuthology.orchestra.run.trial045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45756.log 2026-02-22T23:28:34.299 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.46098.log: /var/log/ceph/ceph-client.admin.48764.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43071.log 2026-02-22T23:28:34.299 INFO:teuthology.orchestra.run.trial045.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46098.log.gz 2026-02-22T23:28:34.299 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.45756.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47389.log 2026-02-22T23:28:34.299 INFO:teuthology.orchestra.run.trial045.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.48764.log.gz 2026-02-22T23:28:34.300 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.43071.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47881.log 2026-02-22T23:28:34.300 INFO:teuthology.orchestra.run.trial045.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.45756.log.gz 2026-02-22T23:28:34.300 INFO:teuthology.orchestra.run.trial045.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.43071.log.gz 2026-02-22T23:28:34.300 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.47389.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47340.log 2026-02-22T23:28:34.300 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.47881.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47242.log 2026-02-22T23:28:34.300 INFO:teuthology.orchestra.run.trial045.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.47389.log.gz 2026-02-22T23:28:34.300 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.47340.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.47881.log.gz 2026-02-22T23:28:34.300 INFO:teuthology.orchestra.run.trial045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47487.log 2026-02-22T23:28:34.300 INFO:teuthology.orchestra.run.trial045.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.47340.log.gz 2026-02-22T23:28:34.300 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.47242.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49352.log 2026-02-22T23:28:34.300 INFO:teuthology.orchestra.run.trial045.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.47487.log: -- /var/log/ceph/ceph-client.admin.48960.log 2026-02-22T23:28:34.300 INFO:teuthology.orchestra.run.trial045.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.47242.log.gz 2026-02-22T23:28:34.300 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.49352.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48666.log 2026-02-22T23:28:34.300 INFO:teuthology.orchestra.run.trial045.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.47487.log.gz 2026-02-22T23:28:34.300 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.48960.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2026-02-22T23:28:34.300 INFO:teuthology.orchestra.run.trial045.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.49352.log.gz 2026-02-22T23:28:34.300 INFO:teuthology.orchestra.run.trial045.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.48960.log.gz 2026-02-22T23:28:34.301 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.48666.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49695.log 2026-02-22T23:28:34.301 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46903.log 2026-02-22T23:28:34.301 INFO:teuthology.orchestra.run.trial045.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.48666.log.gz 2026-02-22T23:28:34.301 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.49695.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47193.log 2026-02-22T23:28:34.301 INFO:teuthology.orchestra.run.trial045.stderr: 86.5%/var/log/ceph/ceph-client.admin.46903.log: -- replaced with /var/log/ceph/ceph-client.admin.49695.log.gz 2026-02-22T23:28:34.301 INFO:teuthology.orchestra.run.trial045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49450.log 2026-02-22T23:28:34.301 INFO:teuthology.orchestra.run.trial045.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.46903.log.gz 2026-02-22T23:28:34.301 INFO:teuthology.orchestra.run.trial045.stderr:gzip/var/log/ceph/ceph-client.admin.47193.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.46394.log 2026-02-22T23:28:34.301 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.49450.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46397.log 2026-02-22T23:28:34.301 INFO:teuthology.orchestra.run.trial045.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.47193.log.gz 2026-02-22T23:28:34.301 INFO:teuthology.orchestra.run.trial045.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.49450.log.gz 2026-02-22T23:28:34.301 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.46394.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46392.log 2026-02-22T23:28:34.301 INFO:teuthology.orchestra.run.trial045.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.46394.log.gz 2026-02-22T23:28:34.301 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.46397.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45919.log 2026-02-22T23:28:34.301 INFO:teuthology.orchestra.run.trial045.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.46392.log: -- /var/log/ceph/ceph-client.admin.46634.log 2026-02-22T23:28:34.302 INFO:teuthology.orchestra.run.trial045.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.46397.log.gz 2026-02-22T23:28:34.302 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.45919.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46637.log 2026-02-22T23:28:34.302 INFO:teuthology.orchestra.run.trial045.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46392.log.gz 2026-02-22T23:28:34.302 INFO:teuthology.orchestra.run.trial045.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.45919.log.gz 2026-02-22T23:28:34.302 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.46634.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45731.log 2026-02-22T23:28:34.302 INFO:teuthology.orchestra.run.trial045.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.46634.log.gz 2026-02-22T23:28:34.302 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.46637.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47011.log 2026-02-22T23:28:34.302 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.45731.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.46637.log.gz 2026-02-22T23:28:34.302 INFO:teuthology.orchestra.run.trial045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47144.log 2026-02-22T23:28:34.302 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.47011.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.45731.log.gz 2026-02-22T23:28:34.302 INFO:teuthology.orchestra.run.trial045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49058.log 2026-02-22T23:28:34.302 INFO:teuthology.orchestra.run.trial045.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.47011.log.gz 2026-02-22T23:28:34.302 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.47144.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48617.log 2026-02-22T23:28:34.302 INFO:teuthology.orchestra.run.trial045.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.47144.log.gz 2026-02-22T23:28:34.303 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.49058.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47783.log 2026-02-22T23:28:34.303 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.48617.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.49058.log.gz 2026-02-22T23:28:34.303 INFO:teuthology.orchestra.run.trial045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49938.log 2026-02-22T23:28:34.303 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.47783.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.48617.log.gz 2026-02-22T23:28:34.303 INFO:teuthology.orchestra.run.trial045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49793.log 2026-02-22T23:28:34.303 INFO:teuthology.orchestra.run.trial045.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47783.log.gz 2026-02-22T23:28:34.303 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.49938.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46699.log 2026-02-22T23:28:34.303 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.49793.log: 88.4%gzip -- replaced with /var/log/ceph/ceph-client.admin.49938.log.gz 2026-02-22T23:28:34.303 INFO:teuthology.orchestra.run.trial045.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.48126.log 2026-02-22T23:28:34.303 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.46699.log: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.49793.log.gz 2026-02-22T23:28:34.303 INFO:teuthology.orchestra.run.trial045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47438.log 2026-02-22T23:28:34.303 INFO:teuthology.orchestra.run.trial045.stderr: 88.3%/var/log/ceph/ceph-client.admin.48126.log: -- replaced with /var/log/ceph/ceph-client.admin.46699.log.gz 2026-02-22T23:28:34.303 INFO:teuthology.orchestra.run.trial045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49842.log 2026-02-22T23:28:34.303 INFO:teuthology.orchestra.run.trial045.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.48126.log.gz 2026-02-22T23:28:34.303 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.47438.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47015.log 2026-02-22T23:28:34.304 INFO:teuthology.orchestra.run.trial045.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.47438.log.gz 2026-02-22T23:28:34.304 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.49842.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48028.log 2026-02-22T23:28:34.304 INFO:teuthology.orchestra.run.trial045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49891.log 2026-02-22T23:28:34.304 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.47015.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.49842.log.gz 2026-02-22T23:28:34.304 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.48028.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46904.log 2026-02-22T23:28:34.304 INFO:teuthology.orchestra.run.trial045.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.47015.log.gz 2026-02-22T23:28:34.304 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.49891.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45821.log 2026-02-22T23:28:34.304 INFO:teuthology.orchestra.run.trial045.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.48028.log.gz 2026-02-22T23:28:34.304 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.46904.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.49891.log.gz 2026-02-22T23:28:34.304 INFO:teuthology.orchestra.run.trial045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49156.log 2026-02-22T23:28:34.304 INFO:teuthology.orchestra.run.trial045.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.46904.log.gz 2026-02-22T23:28:34.304 INFO:teuthology.orchestra.run.trial045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47734.log 2026-02-22T23:28:34.304 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.45821.log: /var/log/ceph/ceph-client.admin.49156.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46696.log 2026-02-22T23:28:34.304 INFO:teuthology.orchestra.run.trial045.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45821.log.gz 2026-02-22T23:28:34.304 INFO:teuthology.orchestra.run.trial045.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.49156.log.gz 2026-02-22T23:28:34.304 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.47734.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48568.log 2026-02-22T23:28:34.304 INFO:teuthology.orchestra.run.trial045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48226.log 2026-02-22T23:28:34.305 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.46696.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.47734.log.gz 2026-02-22T23:28:34.305 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.48568.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46635.log 2026-02-22T23:28:34.305 INFO:teuthology.orchestra.run.trial045.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.46696.log.gz 2026-02-22T23:28:34.305 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.48226.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.48568.log.gz 2026-02-22T23:28:34.305 INFO:teuthology.orchestra.run.trial045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49499.log 2026-02-22T23:28:34.305 INFO:teuthology.orchestra.run.trial045.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.48226.log.gz 2026-02-22T23:28:34.305 INFO:teuthology.orchestra.run.trial045.stderr:gzip/var/log/ceph/ceph-client.admin.46635.log: -5 --verbose -- /var/log/ceph/ceph.audit.log 2026-02-22T23:28:34.305 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.49499.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.e.log 2026-02-22T23:28:34.305 INFO:teuthology.orchestra.run.trial045.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.46635.log.gz 2026-02-22T23:28:34.305 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph.audit.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.49499.log.gz 2026-02-22T23:28:34.305 INFO:teuthology.orchestra.run.trial045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47587.log 2026-02-22T23:28:34.305 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-mon.e.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42796.log 2026-02-22T23:28:34.305 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.47587.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47003.log 2026-02-22T23:28:34.305 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.42796.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.47587.log.gz 2026-02-22T23:28:34.305 INFO:teuthology.orchestra.run.trial045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46102.log 2026-02-22T23:28:34.305 INFO:teuthology.orchestra.run.trial045.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.42796.log.gz 2026-02-22T23:28:34.306 INFO:teuthology.orchestra.run.trial045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2026-02-22T23:28:34.306 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.47003.log: /var/log/ceph/ceph-client.admin.46102.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2026-02-22T23:28:34.306 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49548.log 2026-02-22T23:28:34.306 INFO:teuthology.orchestra.run.trial045.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.46102.log.gz 2026-02-22T23:28:34.306 INFO:teuthology.orchestra.run.trial045.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.47003.log.gz 2026-02-22T23:28:34.306 INFO:teuthology.orchestra.run.trial045.stderr: 96.5% -- replaced with /var/log/ceph/ceph.audit.log.gz 2026-02-22T23:28:34.306 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46902.log 2026-02-22T23:28:34.306 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.49548.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49401.log 2026-02-22T23:28:34.306 INFO:teuthology.orchestra.run.trial045.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.49548.log.gz 2026-02-22T23:28:34.306 INFO:teuthology.orchestra.run.trial045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49254.log 2026-02-22T23:28:34.306 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.46902.log: /var/log/ceph/ceph-client.admin.49401.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45661.log 2026-02-22T23:28:34.306 INFO:teuthology.orchestra.run.trial045.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.46902.log.gz 2026-02-22T23:28:34.306 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.49254.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.49401.log.gz 2026-02-22T23:28:34.306 INFO:teuthology.orchestra.run.trial045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46099.log 2026-02-22T23:28:34.306 INFO:teuthology.orchestra.run.trial045.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.49254.log.gz 2026-02-22T23:28:34.306 INFO:teuthology.orchestra.run.trial045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.37527.log 2026-02-22T23:28:34.306 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.45661.log: /var/log/ceph/ceph-client.admin.46099.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47291.log 2026-02-22T23:28:34.307 INFO:teuthology.orchestra.run.trial045.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.45661.log.gz 2026-02-22T23:28:34.307 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph.tmp-client.admin.37527.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.46099.log.gz 2026-02-22T23:28:34.307 INFO:teuthology.orchestra.run.trial045.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.37527.log.gz 2026-02-22T23:28:34.307 INFO:teuthology.orchestra.run.trial045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49205.log 2026-02-22T23:28:34.307 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.47291.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49597.log 2026-02-22T23:28:34.307 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.49205.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48862.log 2026-02-22T23:28:34.307 INFO:teuthology.orchestra.run.trial045.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.47291.log.gz 2026-02-22T23:28:34.307 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.49597.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.49205.log.gz 2026-02-22T23:28:34.307 INFO:teuthology.orchestra.run.trial045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47979.log 2026-02-22T23:28:34.307 INFO:teuthology.orchestra.run.trial045.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.49597.log.gz 2026-02-22T23:28:34.307 INFO:teuthology.orchestra.run.trial045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45549.log 2026-02-22T23:28:34.307 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.48862.log: /var/log/ceph/ceph-client.admin.47979.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49744.log 2026-02-22T23:28:34.307 INFO:teuthology.orchestra.run.trial045.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.48862.log.gz 2026-02-22T23:28:34.307 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.45549.log: gzip 88.3% -5 -- replaced with /var/log/ceph/ceph-client.admin.47979.log.gz --verbose 2026-02-22T23:28:34.307 INFO:teuthology.orchestra.run.trial045.stderr: -- /var/log/ceph/ceph-client.admin.48519.log 2026-02-22T23:28:34.307 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.49744.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45549.log.gz 2026-02-22T23:28:34.307 INFO:teuthology.orchestra.run.trial045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48715.log 2026-02-22T23:28:34.308 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.48519.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.49744.log.gz 2026-02-22T23:28:34.308 INFO:teuthology.orchestra.run.trial045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48077.log 2026-02-22T23:28:34.308 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.48715.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.d.log 2026-02-22T23:28:34.308 INFO:teuthology.orchestra.run.trial045.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.48519.log.gz 2026-02-22T23:28:34.308 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.48077.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.48715.log.gz 2026-02-22T23:28:34.308 INFO:teuthology.orchestra.run.trial045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48175.log 2026-02-22T23:28:34.308 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-mon.d.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46396.log 2026-02-22T23:28:34.308 INFO:teuthology.orchestra.run.trial045.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.48077.log.gz 2026-02-22T23:28:34.308 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.48175.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47832.log 2026-02-22T23:28:34.308 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.46396.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.48175.log.gz 2026-02-22T23:28:34.308 INFO:teuthology.orchestra.run.trial045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46100.log 2026-02-22T23:28:34.308 INFO:teuthology.orchestra.run.trial045.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.46396.log.gz 2026-02-22T23:28:34.308 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.47832.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48470.log 2026-02-22T23:28:34.308 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.46100.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2026-02-22T23:28:34.308 INFO:teuthology.orchestra.run.trial045.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.47832.log.gz 2026-02-22T23:28:34.308 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.48470.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.46100.log.gz 2026-02-22T23:28:34.308 INFO:teuthology.orchestra.run.trial045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49107.log 2026-02-22T23:28:34.308 INFO:teuthology.orchestra.run.trial045.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.48470.log.gz 2026-02-22T23:28:34.309 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46393.log 2026-02-22T23:28:34.309 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.49107.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46395.log 2026-02-22T23:28:34.309 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.46393.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.49107.log.gzgzip 2026-02-22T23:28:34.309 INFO:teuthology.orchestra.run.trial045.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.43004.log 2026-02-22T23:28:34.309 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.46395.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.46393.log.gz 2026-02-22T23:28:34.309 INFO:teuthology.orchestra.run.trial045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46103.log 2026-02-22T23:28:34.309 INFO:teuthology.orchestra.run.trial045.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.46395.log.gz 2026-02-22T23:28:34.309 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.43004.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49646.log 2026-02-22T23:28:34.309 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.46103.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.43004.log.gz 2026-02-22T23:28:34.309 INFO:teuthology.orchestra.run.trial045.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.46103.log.gz 2026-02-22T23:28:34.309 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.49646.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.49646.log.gz 2026-02-22T23:28:34.309 INFO:teuthology.orchestra.run.trial045.stderr: 95.5% -- replaced with /var/log/ceph/ceph.log.gz 2026-02-22T23:28:34.310 INFO:teuthology.orchestra.run.trial045.stderr: 90.3% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2026-02-22T23:28:34.313 INFO:teuthology.orchestra.run.trial073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.f.log 2026-02-22T23:28:34.313 INFO:teuthology.orchestra.run.trial073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2026-02-22T23:28:34.313 INFO:teuthology.orchestra.run.trial073.stderr:/var/log/ceph/ceph-mon.f.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.h.log 2026-02-22T23:28:34.313 INFO:teuthology.orchestra.run.trial073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2026-02-22T23:28:34.314 INFO:teuthology.orchestra.run.trial073.stderr:/var/log/ceph/ceph-osd.3.log: /var/log/ceph/ceph-mon.h.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46059.log 2026-02-22T23:28:34.314 INFO:teuthology.orchestra.run.trial073.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43127.log 2026-02-22T23:28:34.314 INFO:teuthology.orchestra.run.trial073.stderr:/var/log/ceph/ceph-client.admin.46059.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43221.log 2026-02-22T23:28:34.314 INFO:teuthology.orchestra.run.trial073.stderr:/var/log/ceph/ceph-client.admin.43127.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2026-02-22T23:28:34.314 INFO:teuthology.orchestra.run.trial073.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.46059.log.gz 2026-02-22T23:28:34.314 INFO:teuthology.orchestra.run.trial073.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43127.log.gz 2026-02-22T23:28:34.314 INFO:teuthology.orchestra.run.trial073.stderr:/var/log/ceph/ceph-client.admin.43221.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46025.log 2026-02-22T23:28:34.314 INFO:teuthology.orchestra.run.trial073.stderr: 88.5%/var/log/ceph/ceph-osd.4.log: -- replaced with /var/log/ceph/ceph-client.admin.43221.log.gz 2026-02-22T23:28:34.314 INFO:teuthology.orchestra.run.trial073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.i.log 2026-02-22T23:28:34.314 INFO:teuthology.orchestra.run.trial073.stderr:/var/log/ceph/ceph-client.admin.46025.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2026-02-22T23:28:34.314 INFO:teuthology.orchestra.run.trial073.stderr:/var/log/ceph/ceph-mon.i.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43080.log 2026-02-22T23:28:34.314 INFO:teuthology.orchestra.run.trial073.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.46025.log.gz 2026-02-22T23:28:34.314 INFO:teuthology.orchestra.run.trial073.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46058.log 2026-02-22T23:28:34.314 INFO:teuthology.orchestra.run.trial073.stderr:/var/log/ceph/ceph-client.admin.43080.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43033.log 2026-02-22T23:28:34.314 INFO:teuthology.orchestra.run.trial073.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43080.log.gz 2026-02-22T23:28:34.314 INFO:teuthology.orchestra.run.trial073.stderr:/var/log/ceph/ceph-client.admin.46058.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43272.log 2026-02-22T23:28:34.314 INFO:teuthology.orchestra.run.trial073.stderr:/var/log/ceph/ceph-client.admin.43033.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.g.log 2026-02-22T23:28:34.314 INFO:teuthology.orchestra.run.trial073.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.43033.log.gz 2026-02-22T23:28:34.314 INFO:teuthology.orchestra.run.trial073.stderr:/var/log/ceph/ceph-client.admin.43272.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46060.log 2026-02-22T23:28:34.314 INFO:teuthology.orchestra.run.trial073.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.43272.log.gz 2026-02-22T23:28:34.315 INFO:teuthology.orchestra.run.trial073.stderr: 96.1% -- replaced with /var/log/ceph/ceph.audit.log.gz 2026-02-22T23:28:34.315 INFO:teuthology.orchestra.run.trial073.stderr:/var/log/ceph/ceph-mon.g.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2026-02-22T23:28:34.315 INFO:teuthology.orchestra.run.trial073.stderr:/var/log/ceph/ceph-client.admin.46060.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46024.log 2026-02-22T23:28:34.315 INFO:teuthology.orchestra.run.trial073.stderr:/var/log/ceph/ceph-mgr.x.log: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.46058.log.gz 2026-02-22T23:28:34.315 INFO:teuthology.orchestra.run.trial073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2026-02-22T23:28:34.315 INFO:teuthology.orchestra.run.trial073.stderr:/var/log/ceph/ceph-client.admin.46024.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43174.log 2026-02-22T23:28:34.315 INFO:teuthology.orchestra.run.trial073.stderr:/var/log/ceph/ceph.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.46060.log.gz 2026-02-22T23:28:34.315 INFO:teuthology.orchestra.run.trial073.stderr:/var/log/ceph/ceph-client.admin.43174.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.43174.log.gz 2026-02-22T23:28:34.315 INFO:teuthology.orchestra.run.trial073.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.46024.log.gz 2026-02-22T23:28:34.315 INFO:teuthology.orchestra.run.trial073.stderr: 95.1% -- replaced with /var/log/ceph/ceph.log.gz 2026-02-22T23:28:34.322 INFO:teuthology.orchestra.run.trial045.stderr: 90.4% -- replaced with /var/log/ceph/ceph-mon.d.log.gz 2026-02-22T23:28:34.327 INFO:teuthology.orchestra.run.trial045.stderr: 92.3% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2026-02-22T23:28:34.327 INFO:teuthology.orchestra.run.trial073.stderr: 91.4% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2026-02-22T23:28:34.332 INFO:teuthology.orchestra.run.trial045.stderr: 92.3% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2026-02-22T23:28:34.333 INFO:teuthology.orchestra.run.trial073.stderr: 90.1% -- replaced with /var/log/ceph/ceph-mon.h.log.gz 2026-02-22T23:28:34.334 INFO:teuthology.orchestra.run.trial073.stderr: 90.2% -- replaced with /var/log/ceph/ceph-mon.f.log.gz 2026-02-22T23:28:34.335 INFO:teuthology.orchestra.run.trial045.stderr: 90.7% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2026-02-22T23:28:34.352 INFO:teuthology.orchestra.run.trial045.stderr: 90.8% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2026-02-22T23:28:34.363 INFO:teuthology.orchestra.run.trial073.stderr: 90.4% -- replaced with /var/log/ceph/ceph-mon.g.log.gz 2026-02-22T23:28:34.364 INFO:teuthology.orchestra.run.trial073.stderr: 92.4% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2026-02-22T23:28:34.364 INFO:teuthology.orchestra.run.trial073.stderr: 92.4% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2026-02-22T23:28:34.369 INFO:teuthology.orchestra.run.trial073.stderr: 90.4% -- replaced with /var/log/ceph/ceph-mon.i.log.gz 2026-02-22T23:28:34.374 INFO:teuthology.orchestra.run.trial073.stderr: 92.4% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2026-02-22T23:28:34.375 INFO:teuthology.orchestra.run.trial073.stderr: 2026-02-22T23:28:34.375 INFO:teuthology.orchestra.run.trial073.stderr:real 0m0.083s 2026-02-22T23:28:34.375 INFO:teuthology.orchestra.run.trial073.stderr:user 0m0.401s 2026-02-22T23:28:34.375 INFO:teuthology.orchestra.run.trial073.stderr:sys 0m0.041s 2026-02-22T23:28:34.376 INFO:teuthology.orchestra.run.trial045.stderr: 92.2% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2026-02-22T23:28:34.384 INFO:teuthology.orchestra.run.trial045.stderr: 90.4% -- replaced with /var/log/ceph/ceph-mon.e.log.gz 2026-02-22T23:28:34.385 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-22T23:28:34.385 INFO:teuthology.orchestra.run.trial045.stderr:real 0m0.129s 2026-02-22T23:28:34.385 INFO:teuthology.orchestra.run.trial045.stderr:user 0m0.534s 2026-02-22T23:28:34.386 INFO:teuthology.orchestra.run.trial045.stderr:sys 0m0.098s 2026-02-22T23:28:34.387 INFO:tasks.ceph:Archiving logs... 2026-02-22T23:28:34.387 DEBUG:teuthology.misc:Transferring archived files from trial045:/var/log/ceph to /home/teuthworker/mnt/teuthology/yuriw-2026-02-22_19:35:40-rados-wip-yuri6-testing-2026-02-22-1629-squid-distro-default-trial/64386/remote/trial045/log 2026-02-22T23:28:34.388 DEBUG:teuthology.orchestra.run.trial045:> sudo tar c -f - -C /var/log/ceph -- . 2026-02-22T23:28:34.606 DEBUG:teuthology.misc:Transferring archived files from trial073:/var/log/ceph to /home/teuthworker/mnt/teuthology/yuriw-2026-02-22_19:35:40-rados-wip-yuri6-testing-2026-02-22-1629-squid-distro-default-trial/64386/remote/trial073/log 2026-02-22T23:28:34.607 DEBUG:teuthology.orchestra.run.trial073:> sudo tar c -f - -C /var/log/ceph -- . 2026-02-22T23:28:34.705 DEBUG:teuthology.run_tasks:Unwinding manager install 2026-02-22T23:28:34.721 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2026-02-22T23:28:34.721 DEBUG:teuthology.orchestra.run.trial045:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-22T23:28:34.723 DEBUG:teuthology.orchestra.run.trial073:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-22T23:28:34.879 DEBUG:teuthology.run_tasks:Unwinding manager clock 2026-02-22T23:28:34.891 INFO:teuthology.task.clock:Checking final clock skew... 2026-02-22T23:28:34.891 DEBUG:teuthology.orchestra.run.trial045:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-22T23:28:34.892 DEBUG:teuthology.orchestra.run.trial073:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-22T23:28:34.907 INFO:teuthology.orchestra.run.trial045.stderr:bash: line 1: ntpq: command not found 2026-02-22T23:28:34.909 INFO:teuthology.orchestra.run.trial073.stderr:bash: line 1: ntpq: command not found 2026-02-22T23:28:34.930 INFO:teuthology.orchestra.run.trial073.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-22T23:28:34.930 INFO:teuthology.orchestra.run.trial073.stdout:=============================================================================== 2026-02-22T23:28:34.930 INFO:teuthology.orchestra.run.trial073.stdout:^+ 50.218.103.254 2 6 374 167 +2253us[+1267us] +/- 43ms 2026-02-22T23:28:34.930 INFO:teuthology.orchestra.run.trial073.stdout:^- 172-234-44-141.ip.linode> 2 6 377 37 +13ms[ +13ms] +/- 97ms 2026-02-22T23:28:34.930 INFO:teuthology.orchestra.run.trial073.stdout:^+ 23.186.168.131 2 6 177 36 +341us[ +341us] +/- 56ms 2026-02-22T23:28:34.930 INFO:teuthology.orchestra.run.trial073.stdout:^* as393746.mci.trtnw.net 2 6 377 37 -912us[ -945us] +/- 24ms 2026-02-22T23:28:34.931 INFO:teuthology.orchestra.run.trial045.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-22T23:28:34.931 INFO:teuthology.orchestra.run.trial045.stdout:=============================================================================== 2026-02-22T23:28:34.931 INFO:teuthology.orchestra.run.trial045.stdout:^+ 50.218.103.254 2 6 377 37 +2126us[+2126us] +/- 45ms 2026-02-22T23:28:34.931 INFO:teuthology.orchestra.run.trial045.stdout:^- 172-234-44-141.ip.linode> 2 6 377 38 +12ms[ +12ms] +/- 97ms 2026-02-22T23:28:34.931 INFO:teuthology.orchestra.run.trial045.stdout:^+ 23.186.168.131 2 6 167 35 +237us[ +237us] +/- 56ms 2026-02-22T23:28:34.931 INFO:teuthology.orchestra.run.trial045.stdout:^* as393746.mci.trtnw.net 2 6 377 38 -1059us[-1223us] +/- 24ms 2026-02-22T23:28:34.931 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2026-02-22T23:28:34.943 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2026-02-22T23:28:34.943 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2026-02-22T23:28:34.956 DEBUG:teuthology.orchestra.run.trial045:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2026-02-22T23:28:35.027 DEBUG:teuthology.orchestra.run.trial073:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2026-02-22T23:28:35.083 DEBUG:teuthology.orchestra.run.trial045:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2026-02-22T23:28:35.110 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-22T23:28:35.111 DEBUG:teuthology.orchestra.run.trial073:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2026-02-22T23:28:35.136 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-22T23:28:35.137 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2026-02-22T23:28:35.165 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2026-02-22T23:28:35.184 INFO:teuthology.task.internal:Duration was 471.031812 seconds 2026-02-22T23:28:35.185 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2026-02-22T23:28:35.200 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2026-02-22T23:28:35.200 DEBUG:teuthology.orchestra.run.trial045:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-22T23:28:35.202 DEBUG:teuthology.orchestra.run.trial073:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-22T23:28:35.238 INFO:teuthology.orchestra.run.trial045.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-22T23:28:35.240 INFO:teuthology.orchestra.run.trial073.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-22T23:28:35.465 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2026-02-22T23:28:35.465 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial045.front.sepia.ceph.com 2026-02-22T23:28:35.466 DEBUG:teuthology.orchestra.run.trial045:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-22T23:28:35.523 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial073.front.sepia.ceph.com 2026-02-22T23:28:35.523 DEBUG:teuthology.orchestra.run.trial073:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-22T23:28:35.542 INFO:teuthology.task.internal.syslog:Gathering journactl... 2026-02-22T23:28:35.542 DEBUG:teuthology.orchestra.run.trial045:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-22T23:28:35.565 DEBUG:teuthology.orchestra.run.trial073:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-22T23:28:35.641 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2026-02-22T23:28:35.641 DEBUG:teuthology.orchestra.run.trial045:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-22T23:28:35.642 DEBUG:teuthology.orchestra.run.trial073:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-22T23:28:35.663 INFO:teuthology.orchestra.run.trial045.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-22T23:28:35.664 INFO:teuthology.orchestra.run.trial045.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-22T23:28:35.664 INFO:teuthology.orchestra.run.trial045.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-22T23:28:35.664 INFO:teuthology.orchestra.run.trial045.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-22T23:28:35.664 INFO:teuthology.orchestra.run.trial045.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-22T23:28:35.664 INFO:teuthology.orchestra.run.trial073.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-22T23:28:35.665 INFO:teuthology.orchestra.run.trial073.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-22T23:28:35.665 INFO:teuthology.orchestra.run.trial073.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-22T23:28:35.665 INFO:teuthology.orchestra.run.trial073.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-22T23:28:35.665 INFO:teuthology.orchestra.run.trial073.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-22T23:28:35.675 INFO:teuthology.orchestra.run.trial045.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: 82.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-22T23:28:35.675 INFO:teuthology.orchestra.run.trial073.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: 81.7% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-22T23:28:35.678 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2026-02-22T23:28:35.695 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2026-02-22T23:28:35.695 DEBUG:teuthology.orchestra.run.trial045:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-22T23:28:35.741 DEBUG:teuthology.orchestra.run.trial073:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-22T23:28:35.767 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2026-02-22T23:28:35.784 DEBUG:teuthology.orchestra.run.trial045:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-22T23:28:35.786 DEBUG:teuthology.orchestra.run.trial073:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-22T23:28:35.808 INFO:teuthology.orchestra.run.trial045.stdout:kernel.core_pattern = core 2026-02-22T23:28:35.831 INFO:teuthology.orchestra.run.trial073.stdout:kernel.core_pattern = core 2026-02-22T23:28:35.845 DEBUG:teuthology.orchestra.run.trial045:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-22T23:28:35.876 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-22T23:28:35.877 DEBUG:teuthology.orchestra.run.trial073:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-22T23:28:35.901 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-22T23:28:35.901 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2026-02-22T23:28:35.918 INFO:teuthology.task.internal:Transferring archived files... 2026-02-22T23:28:35.919 DEBUG:teuthology.misc:Transferring archived files from trial045:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/yuriw-2026-02-22_19:35:40-rados-wip-yuri6-testing-2026-02-22-1629-squid-distro-default-trial/64386/remote/trial045 2026-02-22T23:28:35.920 DEBUG:teuthology.orchestra.run.trial045:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-22T23:28:35.955 DEBUG:teuthology.misc:Transferring archived files from trial073:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/yuriw-2026-02-22_19:35:40-rados-wip-yuri6-testing-2026-02-22-1629-squid-distro-default-trial/64386/remote/trial073 2026-02-22T23:28:35.956 DEBUG:teuthology.orchestra.run.trial073:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-22T23:28:35.990 INFO:teuthology.task.internal:Removing archive directory... 2026-02-22T23:28:35.990 DEBUG:teuthology.orchestra.run.trial045:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-22T23:28:35.993 DEBUG:teuthology.orchestra.run.trial073:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-22T23:28:36.038 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2026-02-22T23:28:36.057 INFO:teuthology.task.internal:Not uploading archives. 2026-02-22T23:28:36.057 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2026-02-22T23:28:36.074 INFO:teuthology.task.internal:Tidying up after the test... 2026-02-22T23:28:36.074 DEBUG:teuthology.orchestra.run.trial045:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-22T23:28:36.077 DEBUG:teuthology.orchestra.run.trial073:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-22T23:28:36.091 INFO:teuthology.orchestra.run.trial045.stdout: 917572 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 22 23:28 /home/ubuntu/cephtest 2026-02-22T23:28:36.093 INFO:teuthology.orchestra.run.trial073.stdout: 917572 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 22 23:28 /home/ubuntu/cephtest 2026-02-22T23:28:36.094 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2026-02-22T23:28:36.112 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2026-02-22T23:28:36.151 INFO:teuthology.run:Summary data: description: rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_latest} thrashers/sync workloads/rados_5925} duration: 471.0318124294281 flavor: default owner: scheduled_yuriw@soko04.front.sepia.ceph.com success: true 2026-02-22T23:28:36.151 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-22T23:28:36.263 INFO:teuthology.run:pass